-- Logs begin at Fri 2022-10-28 16:48:16 UTC, end at Fri 2022-10-28 19:31:13 UTC. -- Oct 28 17:17:29.046743 n-d-860864-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 17:17:29.055837 n-d-860864-13 devstack@n-api.service[104547]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 17:17:29 2022] *** Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: nodename: n-d-860864-13 Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: machine: x86_64 Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: clock source: unix Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: pcre jit disabled Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: detected number of CPU cores: 4 Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: current working directory: / Oct 28 17:17:29.057901 n-d-860864-13 devstack@n-api.service[104547]: detected binary path: /usr/bin/uwsgi-core Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: your processes number limit is 47680 Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: your memory page size is 4096 bytes Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: detected max file descriptor number: 2048 Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: lock engine: pthread robust mutexes Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: thunder lock: enabled Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 17:17:29.058482 n-d-860864-13 devstack@n-api.service[104547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 17:17:29.099068 n-d-860864-13 devstack@n-api.service[104547]: Python main interpreter initialized at 0x55de3c3549c0 Oct 28 17:17:29.099068 n-d-860864-13 devstack@n-api.service[104547]: python threads support enabled Oct 28 17:17:29.099068 n-d-860864-13 devstack@n-api.service[104547]: your server socket listen backlog is limited to 100 connections Oct 28 17:17:29.099068 n-d-860864-13 devstack@n-api.service[104547]: your mercy for graceful operations on workers is 90 seconds Oct 28 17:17:29.099428 n-d-860864-13 devstack@n-api.service[104547]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 17:17:29.099515 n-d-860864-13 devstack@n-api.service[104547]: *** Operational MODE: preforking *** Oct 28 17:17:29.099739 n-d-860864-13 devstack@n-api.service[104547]: *** uWSGI is running in multiple interpreter mode *** Oct 28 17:17:29.099739 n-d-860864-13 devstack@n-api.service[104547]: spawned uWSGI master process (pid: 104547) Oct 28 17:17:29.099925 n-d-860864-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 17:17:29.101295 n-d-860864-13 devstack@n-api.service[104547]: spawned uWSGI worker 1 (pid: 104548, cores: 1) Oct 28 17:17:29.101295 n-d-860864-13 devstack@n-api.service[104547]: spawned uWSGI worker 2 (pid: 104549, cores: 1) Oct 28 17:17:29.101295 n-d-860864-13 devstack@n-api.service[104547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 17:17:29.762259 n-d-860864-13 devstack@n-api.service[104548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:17:29.772812 n-d-860864-13 devstack@n-api.service[104549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:17:30.835899 n-d-860864-13 devstack@n-api.service[104549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:17:30.835899 n-d-860864-13 devstack@n-api.service[104549]: from cryptography.utils import int_from_bytes Oct 28 17:17:30.836623 n-d-860864-13 devstack@n-api.service[104549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:17:30.836623 n-d-860864-13 devstack@n-api.service[104549]: from cryptography.utils import int_from_bytes Oct 28 17:17:30.838016 n-d-860864-13 devstack@n-api.service[104548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:17:30.838016 n-d-860864-13 devstack@n-api.service[104548]: from cryptography.utils import int_from_bytes Oct 28 17:17:30.838431 n-d-860864-13 devstack@n-api.service[104548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:17:30.838431 n-d-860864-13 devstack@n-api.service[104548]: from cryptography.utils import int_from_bytes Oct 28 17:17:33.335605 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:17:33.336263 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:17:33.336398 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:17:33.336758 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:17:33.337012 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:17:33.337393 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.337717 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.338039 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.338358 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.338684 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.338993 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.339309 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.339654 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.339982 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.340242 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.340556 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.340879 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-13 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.341202 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.341507 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.341831 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.341926 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:17:33.342300 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.342383 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:17:33.342461 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.342665 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:17:33.342775 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.343018 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:17:33.343107 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.343271 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:17:33.343535 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.343674 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.344852 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.345060 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.345250 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.345438 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.345645 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.345824 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346011 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346171 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346356 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346572 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346721 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.346936 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.347383 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.347585 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.347810 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.347989 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.347989 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.348429 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.348652 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.348811 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349037 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-13 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349217 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-13 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349420 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349607 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349607 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.349967 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350162 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350293 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350451 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350589 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350724 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350873 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.350997 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351120 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351249 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351400 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351570 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351697 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351840 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.351972 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352096 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352228 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352353 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352476 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352599 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352748 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.352899 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353031 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353169 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353292 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353416 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353550 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353674 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353796 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.353987 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354117 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354252 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354384 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354511 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354511 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354760 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-13 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354867 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.354974 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.355079 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.355192 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.355298 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.355871 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.355993 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356104 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356210 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356317 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356431 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356549 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356663 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356770 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356874 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.356980 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357099 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357213 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357319 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357430 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357545 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357660 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357821 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.357941 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358062 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358176 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358288 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358402 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358508 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358623 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358728 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358841 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.358946 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359064 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359177 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359284 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359408 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359534 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359663 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359805 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.359931 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360062 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360194 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360325 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360449 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360661 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360790 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.360931 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361066 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361191 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361330 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361456 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361588 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361713 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361850 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.361976 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362145 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362275 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362448 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362576 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362751 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.362891 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.363055 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.363192 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.363891 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.364054 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.364387 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.364699 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.364828 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.364953 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365077 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365245 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365373 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365553 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365682 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.365870 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.366009 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.366643 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.366782 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.366909 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367043 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367175 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367300 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367446 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367586 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367714 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.367888 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368017 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368152 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368292 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368431 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368570 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368695 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368818 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.368942 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369074 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369201 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369325 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369448 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369571 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369702 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369835 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.369960 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370084 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370208 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370339 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370463 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370603 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370739 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.370870 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371023 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371152 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371292 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371480 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371609 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371771 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.371901 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372088 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372225 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372399 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372529 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372703 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.372831 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373017 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373154 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373313 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373442 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373613 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373740 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.373915 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374067 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374216 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374428 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374565 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374691 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374815 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.374948 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375074 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375199 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375390 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375523 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375691 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375834 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.375992 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376129 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376291 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376427 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376588 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376726 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.376892 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377032 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377190 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377325 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377489 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377618 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377785 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.377963 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378092 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378216 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378370 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378500 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378673 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.378799 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.379603 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.379925 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380067 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380237 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380366 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380545 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380675 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.380863 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.381005 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.381201 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.381328 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.381510 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.381638 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.381816 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.381961 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.382131 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.382259 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.382429 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.382556 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.382733 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.382869 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.383046 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.383174 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.383351 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.383517 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.383674 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.383807 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.383976 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.384105 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.384276 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.384420 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.384621 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.384749 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.384886 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.385010 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.385132 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.385254 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.385438 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.385565 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.385734 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.385869 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.386046 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.386182 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.386408 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.386547 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.386672 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.386795 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.386950 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.387093 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.387250 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.387401 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.387588 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:17:33.387718 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.387920 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388166 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388303 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388429 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388574 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388723 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.388884 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389028 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389212 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389342 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389540 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389668 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389854 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.389991 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390161 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390289 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390470 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390601 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390775 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.390912 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391086 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391214 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391411 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391561 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391788 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.391929 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392055 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392188 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392312 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392436 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392639 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392768 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.392950 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393077 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393259 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393386 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393566 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393694 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.393872 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394001 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394177 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394305 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394528 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394735 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.394864 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395151 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395314 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395474 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395655 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395785 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.395998 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396126 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396342 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396496 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396696 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396825 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.396950 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397074 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397267 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397406 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397568 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397695 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397871 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.397999 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398160 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398296 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398468 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398604 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398787 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.398917 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399099 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399235 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399423 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399556 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399738 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.399865 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400050 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400179 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400360 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400489 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400667 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400794 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.400975 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401103 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401279 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401407 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401586 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401716 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.401895 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402024 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402200 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402329 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402517 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402645 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402823 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.402951 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403129 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403265 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403482 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403620 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403756 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.403881 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404060 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404201 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404365 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404502 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404668 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.404875 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405013 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405139 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405263 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405400 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405533 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405658 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405835 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.405972 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406150 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406292 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406470 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406597 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406805 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.406934 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407068 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407194 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407388 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407520 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407697 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.407825 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408003 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408133 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408308 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408434 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408594 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408723 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.408900 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409036 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409208 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409398 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409526 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409661 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409796 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.409921 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.410091 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.410219 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.410414 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.410718 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.410848 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411018 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411179 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411308 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411510 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411653 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411815 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.411945 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412130 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412259 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412441 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412588 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412751 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.412889 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413063 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413193 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413372 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413511 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413692 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.413829 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414002 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414131 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414311 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414441 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414643 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414772 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.414973 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415094 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415274 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415397 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415611 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415718 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.415920 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416006 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416229 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416315 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416534 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416675 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416824 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.416950 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417127 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417263 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417426 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417562 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417724 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.417873 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418030 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418158 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418317 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418445 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418690 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418829 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.418968 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419094 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419218 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419342 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419500 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419636 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419810 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.419939 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420120 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420257 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420420 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420560 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420719 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.420849 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421018 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421147 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421354 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421484 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421654 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421790 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.421986 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422116 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422303 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422432 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422629 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422765 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.422925 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423054 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423230 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423358 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423565 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423707 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.423870 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424005 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424174 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424302 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424481 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424613 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424787 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.424915 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.425131 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.425267 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.425392 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.425516 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.425697 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.426394 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.426544 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.426893 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427021 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427273 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427421 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427631 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427761 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.427922 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428051 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428232 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428405 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428547 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428674 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428819 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.428947 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429126 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429255 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429436 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429567 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429749 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.429885 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430058 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430196 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430367 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430495 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430669 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430798 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.430980 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431120 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431287 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431446 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431615 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431744 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.431917 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432057 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432222 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432350 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432537 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432665 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432845 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.432983 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433159 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433287 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433463 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433590 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433768 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.433906 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434066 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434194 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434376 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434506 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434682 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434811 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.434986 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435114 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435327 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435531 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435671 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435804 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.435929 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436053 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436219 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436364 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436523 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436651 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436832 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.436955 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437135 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437275 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437436 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437566 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437743 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.437872 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438048 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438185 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438353 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438516 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438641 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438766 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.438944 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439082 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439254 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439409 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439579 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439701 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.439879 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440086 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440214 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440349 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440476 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440601 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440778 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.440917 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.441082 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.441209 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.441450 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.442074 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.442265 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.442569 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.442885 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.443275 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.443474 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.443802 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.443938 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444124 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444253 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444460 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444589 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444782 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.444919 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445096 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445225 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445438 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445576 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445714 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.445841 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446038 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446168 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446347 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446475 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446652 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446780 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.446959 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447095 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447263 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447456 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447585 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447724 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.447889 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448026 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448194 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448323 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448495 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448639 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448797 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.448934 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449108 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449236 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449409 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449545 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449694 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449819 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.449998 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450126 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450300 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450439 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450607 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450733 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.450905 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451030 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451212 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451340 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451540 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451671 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451849 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.451977 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452151 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452282 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452451 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452580 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452759 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.452889 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453063 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453312 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453441 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453642 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453778 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.453955 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454094 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454271 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454400 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454607 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454750 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.454924 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455054 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455230 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455359 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455578 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455720 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.455874 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456004 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456175 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456304 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456476 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456605 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456774 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.456916 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457120 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457249 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457426 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457555 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457737 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.457943 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458222 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458352 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458571 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458718 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458844 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.458983 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459138 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459268 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459471 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459616 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459778 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.459918 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460089 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460218 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460396 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460524 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460698 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.460837 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461002 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461131 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461299 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461427 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461606 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461742 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.461907 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462041 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462204 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462331 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462504 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462634 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462804 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.462934 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463107 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463235 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463422 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463552 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463723 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.463854 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464033 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464171 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464340 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464470 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464643 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464772 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.464961 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465167 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465303 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465440 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465581 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465772 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.465901 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466037 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466170 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466296 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466429 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466555 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466712 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.466856 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467012 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467134 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467316 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467478 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467633 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467763 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.467934 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468063 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468238 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468366 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468536 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468703 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468833 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.468987 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469117 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469243 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469417 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469550 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469719 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.469849 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470015 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470142 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470312 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470441 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470613 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470749 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.470914 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471051 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471212 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471421 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471553 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471679 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471826 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.471970 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.472391 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.472520 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.472736 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.472866 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.473265 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.473549 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.473689 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.473855 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.473987 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474165 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474302 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474471 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474600 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474773 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.474901 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475092 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475235 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475419 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475551 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475722 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.475929 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476073 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476210 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476337 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476461 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476586 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476711 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.476888 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477027 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477194 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477337 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477500 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477643 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477810 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.477948 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.478096 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.478236 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.478384 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.478690 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479111 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479253 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479422 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479550 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479737 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.479866 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480021 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480149 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480325 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480466 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480631 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480762 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.480929 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481066 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481227 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481369 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481545 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481685 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481850 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.481980 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482148 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482291 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482449 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482590 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482736 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.482876 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483056 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483196 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483360 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483528 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483695 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.483823 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484005 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484134 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484317 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484458 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484623 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484753 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.484929 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485063 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485238 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485381 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485540 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485676 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.485838 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486051 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486192 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486317 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486449 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486583 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486709 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.486834 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487022 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487163 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487321 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487497 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487659 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487788 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.487968 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.488099 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.488812 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.488941 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.489281 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.489614 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.489722 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.489947 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490042 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490274 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490369 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490580 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490686 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490891 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.490985 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.491206 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.491300 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.491612 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.491765 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.491917 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492046 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492223 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492352 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492530 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492658 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492840 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.492977 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493141 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493269 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493445 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493576 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493752 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.493882 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494052 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494180 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494358 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494489 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494665 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494794 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.494965 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495178 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495314 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495493 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495620 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495745 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.495869 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496100 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496241 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496393 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496522 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496704 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.496841 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497026 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497157 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497346 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497481 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497670 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497812 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.497978 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498112 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498290 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498418 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498600 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498755 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.498925 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499060 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499209 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499346 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499543 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499683 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499844 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.499972 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500158 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500285 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500480 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500620 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500801 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.500931 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501114 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501249 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501424 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501574 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501711 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.501845 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502015 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502144 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502331 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502468 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502632 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502770 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.502931 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503060 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503230 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503361 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503570 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503701 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.503982 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.504620 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.504936 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.505249 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.505387 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.505576 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.505732 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.505884 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506051 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506194 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506460 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506593 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506764 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.506894 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507076 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507215 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507391 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507525 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507720 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.507847 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508024 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508166 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508347 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508478 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508649 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508776 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.508962 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509088 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509271 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509368 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509593 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509732 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.509894 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510032 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510201 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510328 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510507 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510636 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510804 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.510941 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511108 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511235 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511449 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511580 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511762 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.511885 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512078 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512214 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512408 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512536 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512734 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.512867 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513043 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513173 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513376 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513506 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513692 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513836 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.513981 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514118 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514280 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514422 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514585 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514723 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.514886 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515015 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515187 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515325 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515520 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515650 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515819 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.515947 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516121 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516258 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516428 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516535 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516728 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.516822 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517025 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517132 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517323 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517418 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517626 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517776 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.517925 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518056 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518241 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518369 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518544 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518673 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518858 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.518994 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.519167 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.519291 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.519497 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.520189 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.520343 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.520681 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.520828 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.520956 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521121 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521260 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521434 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521565 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521738 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.521868 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522042 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522181 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522381 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522519 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522682 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522812 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.522997 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523139 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523323 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523515 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523644 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523769 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.523963 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524106 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524278 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524415 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524587 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524718 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.524900 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525043 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525215 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525346 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525533 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525662 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.525859 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526056 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526186 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526384 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526529 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526731 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526870 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.526997 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527123 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527294 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527442 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527640 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527778 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.527931 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528060 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528232 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528362 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528532 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528677 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528831 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.528969 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529134 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529264 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529435 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529566 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529752 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.529880 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530056 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530184 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530357 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530487 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530659 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530797 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.530960 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531088 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531292 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531465 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531613 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531741 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.531939 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532076 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532247 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532376 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532564 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532704 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.532874 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533011 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533181 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533315 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533491 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533627 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533798 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.533938 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534105 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534232 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534414 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534541 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534722 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.534851 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.535027 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.535211 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.536035 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.536342 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.536548 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.536677 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.536895 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537032 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537157 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537280 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537586 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537715 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.537898 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538025 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538211 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538347 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538519 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538644 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.538829 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539032 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539160 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539337 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539497 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539689 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.539813 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540015 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540145 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540340 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540471 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540644 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540773 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.540956 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541084 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541274 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541402 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541574 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541701 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.541879 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542018 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542189 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542318 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542496 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542632 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542800 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.542938 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543108 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543237 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543444 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543591 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543753 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.543884 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544069 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544196 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544379 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544506 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544687 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.544907 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545045 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545257 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545387 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545572 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545711 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.545880 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546007 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546189 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546320 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546496 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546640 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.546800 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547012 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547142 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547267 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547454 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547583 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547717 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.547843 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548030 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548158 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548339 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548472 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548644 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548774 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.548947 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549076 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549286 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549420 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549547 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549768 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.549897 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550086 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550225 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550418 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550548 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550763 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.550961 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.551113 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.551556 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.551689 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.551869 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.551999 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552183 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552324 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552490 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552622 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552793 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.552923 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553097 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553235 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553398 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553526 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553699 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.553828 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554001 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554131 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554305 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554433 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554608 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554738 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.554906 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555035 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555223 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555352 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555555 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555696 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.555931 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556061 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556253 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556412 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556541 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556725 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.556864 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557050 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557166 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557371 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557480 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557685 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.557782 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558003 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558096 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558304 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558399 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558607 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558695 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558910 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.558996 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.559221 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.559516 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.559621 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.559847 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.559933 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560148 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560249 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560451 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560547 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560757 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.560849 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561056 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561142 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561364 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561452 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561663 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561748 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.561981 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562066 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562281 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562382 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562580 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562675 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562880 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.562978 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563187 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563274 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563514 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563602 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563813 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.563901 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564114 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564209 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564412 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564498 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564716 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.564813 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565014 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565099 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565322 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565472 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565612 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565824 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.565971 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.566107 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.566243 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.566431 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.566573 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567033 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567262 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567434 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567567 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567710 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567861 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.567995 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568151 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568281 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568419 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568582 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568729 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.568896 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569046 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569189 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569332 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569501 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569651 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569796 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.569955 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570117 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570256 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570429 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570575 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570733 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.570952 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.571281 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.571466 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.571613 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.571756 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.571937 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572075 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572264 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572402 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572585 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572729 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.572867 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573010 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573163 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573297 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573445 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573581 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573736 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.573874 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574044 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574190 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574351 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574489 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574657 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574795 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.574946 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575123 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575270 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575487 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575625 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575795 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.575933 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576100 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576239 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576405 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576542 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576713 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.576871 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577007 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577140 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577315 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577421 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577618 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577718 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.577922 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578015 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578233 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578396 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578531 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578678 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578824 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.578960 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579123 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579262 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579448 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579628 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579760 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.579897 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580033 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580168 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580337 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580478 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580641 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580789 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.580931 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581064 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581230 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581369 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581533 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581673 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.581842 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.582498 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.582673 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.582966 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.583271 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.583532 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.583673 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.583862 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584001 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584193 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584333 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584522 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584654 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584836 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.584973 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585158 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585297 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585468 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585674 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585831 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.585967 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586102 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586236 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586371 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586504 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586691 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.586822 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587004 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587142 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587313 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587497 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587689 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587827 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.587996 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588134 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588300 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588462 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588603 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588742 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.588881 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589019 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589200 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589357 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589515 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589702 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589847 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.589986 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590134 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590281 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590428 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590581 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590721 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.590859 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591007 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591146 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591300 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591466 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591631 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591778 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.591955 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592109 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592249 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592387 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592550 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592708 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592857 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.592996 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593172 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593328 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593467 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593619 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593760 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.593898 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594037 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594182 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594320 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594467 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594607 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594745 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.594890 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595039 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595177 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595437 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595593 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595734 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.595880 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596018 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596166 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596313 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596452 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596591 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596737 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.596877 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.597284 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.597464 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.598175 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.598414 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.598661 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.598959 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599118 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599295 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599466 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599647 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599745 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.599967 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.600065 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.600226 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:17:33.600314 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.600598 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.600909 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.601220 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.601553 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.601862 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.602175 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.602480 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.602806 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.603129 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.603455 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.603777 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.604090 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.604406 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.604717 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.605023 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.605346 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.605653 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.605960 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.606264 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.606570 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.606874 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.607183 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.607509 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.607820 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.608132 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.608441 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.608761 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.609079 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.609383 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.609702 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.610024 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.610360 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.610670 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.611005 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.611327 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.611665 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.611975 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.612275 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:17:33.612516 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:17:33.752164 n-d-860864-13 devstack@n-api.service[104548]: INFO dbcounter [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Registered counter for database nova_api Oct 28 17:17:33.771410 n-d-860864-13 devstack@n-api.service[104549]: INFO dbcounter [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Registered counter for database nova_api Oct 28 17:17:33.774049 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-0817facb-574e-4758-aadd-c6649d36870a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.780609 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:33.791579 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_db.sqlalchemy.engines [None req-64daffae-6777-4903-b592-56e985ba4091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.798057 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writer thread running {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:33.837654 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.context [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=104548) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:17:33.841471 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:17:33.841942 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:17:33.843566 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:17:33.844275 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:17:33.844718 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:17:33.846708 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:17:33.849106 n-d-860864-13 devstack@n-api.service[104548]: INFO dbcounter [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Registered counter for database nova_cell0 Oct 28 17:17:33.853186 n-d-860864-13 devstack@n-api.service[104548]: INFO dbcounter [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Registered counter for database nova_cell1 Oct 28 17:17:33.856230 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.context [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=104549) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:17:33.862195 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:17:33.862195 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:17:33.862598 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-0817facb-574e-4758-aadd-c6649d36870a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.862749 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:17:33.862895 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-0817facb-574e-4758-aadd-c6649d36870a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.863035 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:17:33.863359 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:17:33.865949 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_concurrency.lockutils [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:17:33.867410 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:33.867997 n-d-860864-13 devstack@n-api.service[104549]: INFO dbcounter [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Registered counter for database nova_cell0 Oct 28 17:17:33.872078 n-d-860864-13 devstack@n-api.service[104549]: INFO dbcounter [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Registered counter for database nova_cell1 Oct 28 17:17:33.879745 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_db.sqlalchemy.engines [None req-64daffae-6777-4903-b592-56e985ba4091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.881140 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_db.sqlalchemy.engines [None req-64daffae-6777-4903-b592-56e985ba4091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:33.888787 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writer thread running {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:33.889124 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writer thread running {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:34.003095 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:34.013499 n-d-860864-13 devstack@n-api.service[104548]: INFO dbcounter [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Registered counter for database nova_cell0 Oct 28 17:17:34.021221 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_db.sqlalchemy.engines [None req-0817facb-574e-4758-aadd-c6649d36870a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:34.025819 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writer thread running {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:34.036348 n-d-860864-13 devstack@n-api.service[104549]: INFO dbcounter [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Registered counter for database nova_cell0 Oct 28 17:17:34.045149 n-d-860864-13 devstack@n-api.service[104549]: DEBUG oslo_db.sqlalchemy.engines [None req-64daffae-6777-4903-b592-56e985ba4091 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:17:34.051439 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writer thread running {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:17:34.371502 n-d-860864-13 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-0817facb-574e-4758-aadd-c6649d36870a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:17:34.373083 n-d-860864-13 devstack@n-api.service[104549]: WARNING keystonemiddleware.auth_token [None req-64daffae-6777-4903-b592-56e985ba4091 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:17:34.378733 n-d-860864-13 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:17:34.381178 n-d-860864-13 devstack@n-api.service[104549]: WARNING keystonemiddleware.auth_token [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:17:34.730112 n-d-860864-13 devstack@n-api.service[104549]: WARNING keystonemiddleware.auth_token [None req-64daffae-6777-4903-b592-56e985ba4091 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:17:34.731239 n-d-860864-13 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-0817facb-574e-4758-aadd-c6649d36870a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:17:34.736111 n-d-860864-13 devstack@n-api.service[104549]: WARNING keystonemiddleware.auth_token [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:17:34.737248 n-d-860864-13 devstack@n-api.service[104548]: WARNING keystonemiddleware.auth_token [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:17:34.742086 n-d-860864-13 devstack@n-api.service[104549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de3c3549c0 pid: 104549 (default app) Oct 28 17:17:34.743600 n-d-860864-13 devstack@n-api.service[104548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de3c3549c0 pid: 104548 (default app) Oct 28 17:17:34.744152 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-64daffae-6777-4903-b592-56e985ba4091 None None] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:17:34.745326 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-64daffae-6777-4903-b592-56e985ba4091 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Oct 28 17:17:34.745739 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Oct 28 17:17:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:18:56.489664 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:18:56.490889 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0817facb-574e-4758-aadd-c6649d36870a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Oct 28 17:18:56.491476 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:18:56.507823 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_api:SELECT=3 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:18:56.508766 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_cell1:SELECT=3 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:18:56.509862 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_cell0:SELECT=3 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:18:56.510976 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_cell0:SELECT=3 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:18:57.401110 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-31e96176-2d5f-4189-9c62-2b3cb93315af admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:18:57.434585 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-31e96176-2d5f-4189-9c62-2b3cb93315af admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.937169 Oct 28 17:18:57.435319 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:18:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:00.076741 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0817facb-574e-4758-aadd-c6649d36870a None None] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:00.077742 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0817facb-574e-4758-aadd-c6649d36870a None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 28 17:19:00.078323 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:00.534040 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-4c2b3827-6363-4725-bf45-6c455ecbe507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:00.580952 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-4c2b3827-6363-4725-bf45-6c455ecbe507 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495843 Oct 28 17:19:00.581519 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:00.595812 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:00.596641 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell1:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:00.598556 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell0:SELECT=3 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:00.599636 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:00.803214 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-17a871a2-9a65-49ea-915d-53998be5786e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:00.875268 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-17a871a2-9a65-49ea-915d-53998be5786e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285365 Oct 28 17:19:00.876610 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Oct 28 17:19:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:03.540556 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-4c2b3827-6363-4725-bf45-6c455ecbe507 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:03.541738 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-4c2b3827-6363-4725-bf45-6c455ecbe507 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Oct 28 17:19:03.542316 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:04.377642 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-9a44ce85-feab-48f2-a1ce-279faa119f07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:04.425112 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-9a44ce85-feab-48f2-a1ce-279faa119f07 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.876196 Oct 28 17:19:04.427157 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:04.442037 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d7fd58e8-cde1-44a1-a78a-11c528330527 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:04.500739 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d7fd58e8-cde1-44a1-a78a-11c528330527 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063315 Oct 28 17:19:04.502143 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Oct 28 17:19:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:07.352414 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-9a44ce85-feab-48f2-a1ce-279faa119f07 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:07.353818 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-9a44ce85-feab-48f2-a1ce-279faa119f07 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Oct 28 17:19:07.364414 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:07.940977 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-96aeb13f-e856-44c7-a8cb-de4797cac49b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "vcpus": 1, "disk": 10, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:07.962480 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-96aeb13f-e856-44c7-a8cb-de4797cac49b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.601497 Oct 28 17:19:07.963265 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:07.977262 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-f865e50e-a05c-45eb-8924-ec9104607feb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:08.009259 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-f865e50e-a05c-45eb-8924-ec9104607feb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036797 Oct 28 17:19:08.010727 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Oct 28 17:19:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:19:10.696744 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-96aeb13f-e856-44c7-a8cb-de4797cac49b admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:10.697781 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-96aeb13f-e856-44c7-a8cb-de4797cac49b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 28 17:19:10.698187 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:11.155545 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7ef2a275-013a-41c7-81c9-9ba374f5351b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:11.181064 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7ef2a275-013a-41c7-81c9-9ba374f5351b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475406 Oct 28 17:19:11.181614 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:11.194826 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-4462dc65-431e-4a30-9aa0-ab955ac9817c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:11.225881 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-4462dc65-431e-4a30-9aa0-ab955ac9817c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035010 Oct 28 17:19:11.232630 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Oct 28 17:19:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:19:13.976693 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7ef2a275-013a-41c7-81c9-9ba374f5351b admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:13.977714 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7ef2a275-013a-41c7-81c9-9ba374f5351b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 28 17:19:13.978439 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:14.436121 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:14.459514 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474268 Oct 28 17:19:14.473226 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-fd58e3ab-1594-4094-bc8c-380ec7af0837 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:14.478116 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:14.508921 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-fd58e3ab-1594-4094-bc8c-380ec7af0837 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039959 Oct 28 17:19:14.510016 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Oct 28 17:19:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:17.297974 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:17.299239 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Oct 28 17:19:17.299929 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:17.758256 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-efdb2660-f458-44fd-857a-fa7d9a2bf7dc admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:17.782666 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-efdb2660-f458-44fd-857a-fa7d9a2bf7dc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476619 Oct 28 17:19:17.783200 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:19:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:19:20.805084 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:20.806055 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-e5690f2a-073f-42ea-bf6b-fef560fbd8f9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 28 17:19:20.806473 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:21.234422 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0997e7be-cc86-457c-8d15-9cc8f184b685 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "id": "1", "ram": 512, "disk": 1}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:21.254717 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0997e7be-cc86-457c-8d15-9cc8f184b685 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441234 Oct 28 17:19:21.255275 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:19:21.269443 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-7dcf0ac1-a541-4faa-84a0-f695647309e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:21.302072 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-7dcf0ac1-a541-4faa-84a0-f695647309e3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037613 Oct 28 17:19:21.302815 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Oct 28 17:19:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:23.957699 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0997e7be-cc86-457c-8d15-9cc8f184b685 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:23.958623 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0997e7be-cc86-457c-8d15-9cc8f184b685 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 28 17:19:23.959019 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:24.364066 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-c6fdacda-fe96-4544-a717-81beebb8816c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:24.383791 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-c6fdacda-fe96-4544-a717-81beebb8816c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418826 Oct 28 17:19:24.387392 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:19:24.396458 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-3d55f40b-6651-4f3c-90f4-0400ea8097bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:24.420809 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-3d55f40b-6651-4f3c-90f4-0400ea8097bb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028053 Oct 28 17:19:24.422213 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Oct 28 17:19:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:27.054019 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-c6fdacda-fe96-4544-a717-81beebb8816c admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:27.055062 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-c6fdacda-fe96-4544-a717-81beebb8816c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001813 Oct 28 17:19:27.055505 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:27.467133 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7ebfe2f8-659c-4d3d-8dd3-2fac1a416443 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:27.489930 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7ebfe2f8-659c-4d3d-8dd3-2fac1a416443 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427801 Oct 28 17:19:27.490476 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:27.503356 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-19099ea1-c3a1-44ff-a2a2-0170b86c45d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:27.508615 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:27.547146 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-19099ea1-c3a1-44ff-a2a2-0170b86c45d8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048109 Oct 28 17:19:27.548375 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Oct 28 17:19:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:30.209873 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7ebfe2f8-659c-4d3d-8dd3-2fac1a416443 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:30.211516 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7ebfe2f8-659c-4d3d-8dd3-2fac1a416443 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Oct 28 17:19:30.211920 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:30.650919 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-238ca81d-a979-473e-9edf-9b7def8abfcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:30.673020 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-238ca81d-a979-473e-9edf-9b7def8abfcb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454982 Oct 28 17:19:30.673729 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:19:30.685891 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-576ab4d7-c0e9-4099-a753-3271c02a3d22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:30.710152 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-576ab4d7-c0e9-4099-a753-3271c02a3d22 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027825 Oct 28 17:19:30.710728 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Oct 28 17:19:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:19:33.378541 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-238ca81d-a979-473e-9edf-9b7def8abfcb admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:33.379585 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-238ca81d-a979-473e-9edf-9b7def8abfcb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 28 17:19:33.379975 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:33.832425 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:33.838779 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:33.855897 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469970 Oct 28 17:19:33.856457 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Oct 28 17:19:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:19:33.868487 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-da8c1b85-0edd-4d3a-a945-9aa7db5946c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:19:33.896984 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-da8c1b85-0edd-4d3a-a945-9aa7db5946c8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032036 Oct 28 17:19:33.897575 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Oct 28 17:19:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:19:54.588427 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:54.589472 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 28 17:19:54.589876 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:19:54.601003 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:19:54.980202 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d3bf10c8-1b87-4022-8421-efdee2160b77 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:55.002268 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d3bf10c8-1b87-4022-8421-efdee2160b77 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405656 Oct 28 17:19:55.002811 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:19:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:19:56.315569 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:56.316572 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7c93b60a-9fb5-4f72-bfda-6537c9e6da00 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 28 17:19:56.316972 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:56.863972 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-810e723b-542d-4e69-8681-8c710a14a061 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:56.869215 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.wsgi [None req-810e723b-542d-4e69-8681-8c710a14a061 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-810e723b-542d-4e69-8681-8c710a14a061 admin admin] Request method failure captured: Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Accept: application/json Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Accept-Encoding: gzip, deflate Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Connection: keep-alive Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Content-Length: 0 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Host: 10.222.0.48 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Openstack-Api-Version: compute 2.92 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: Openstack-System-Scope: None Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: User-Agent: python-novaclient Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Auth-Token: gAAAAABjXA88E7vqcmmD0MrCUDjYDb63OV5_24rfW8b6EMv-x9McrICAY3Twkdr9ENreliMXNzMWQfcPra8WDHd11HmWifG5lWo0BbQsy2W6Fawf9k1aFcyIjRgoAp3Kf3DIPr4KIouOXntYr2C-9_drPKVCRC8uYC0VjdGzafoc0UVs94s47t8 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Id: None Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Name: None Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Identity-Status: Confirmed Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Is-Admin-Project: True Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Id: default Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Name: Default Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Name: admin Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Role: admin,member,reader Oct 28 17:19:56.872421 n-d-860864-13 devstack@n-api.service[104549]: X-Roles: admin,member,reader Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant: admin Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Name: admin Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-User: admin Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Id: default Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Name: Default Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: X-User-Name: admin Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: method: > Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: exception: Flavor 42 could not be found. Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: action_args: {'id': '42'} Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:19:56.874193 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:56.875128 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.876562 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-810e723b-542d-4e69-8681-8c710a14a061 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:19:56.877871 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-810e723b-542d-4e69-8681-8c710a14a061 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399761 Oct 28 17:19:56.877871 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:19:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:19:56.883812 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-ea92a8a0-0ca3-4bdb-b6f6-4207c31d1716 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:56.906819 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-ea92a8a0-0ca3-4bdb-b6f6-4207c31d1716 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026631 Oct 28 17:19:56.907361 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:19:56.921634 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-70bc50d5-c09b-461e-a5f1-bfee264f025f admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:56.943265 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-70bc50d5-c09b-461e-a5f1-bfee264f025f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026744 Oct 28 17:19:56.943866 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:19:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:19:56.954133 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-4d98c4d6-d4a0-40d6-a7ec-662311d01515 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:56.959459 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-4d98c4d6-d4a0-40d6-a7ec-662311d01515 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-4d98c4d6-d4a0-40d6-a7ec-662311d01515 admin admin] Request method failure captured: Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Accept: application/json Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Connection: keep-alive Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Content-Length: 0 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Host: 10.222.0.48 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjXA88E7vqcmmD0MrCUDjYDb63OV5_24rfW8b6EMv-x9McrICAY3Twkdr9ENreliMXNzMWQfcPra8WDHd11HmWifG5lWo0BbQsy2W6Fawf9k1aFcyIjRgoAp3Kf3DIPr4KIouOXntYr2C-9_drPKVCRC8uYC0VjdGzafoc0UVs94s47t8 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Id: None Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Name: None Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Name: admin Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Role: admin,member,reader Oct 28 17:19:56.962684 n-d-860864-13 devstack@n-api.service[104548]: X-Roles: admin,member,reader Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant: admin Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-User: admin Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: X-User-Name: admin Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: method: > Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: exception: Flavor 42 could not be found. Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: action_args: {'id': '42'} Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:19:56.964231 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:56.965165 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:56.966317 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-4d98c4d6-d4a0-40d6-a7ec-662311d01515 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:19:56.968470 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-4d98c4d6-d4a0-40d6-a7ec-662311d01515 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014613 Oct 28 17:19:56.968470 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:19:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:19:58.182823 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-70bc50d5-c09b-461e-a5f1-bfee264f025f admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:58.183867 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-70bc50d5-c09b-461e-a5f1-bfee264f025f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 28 17:19:58.184266 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:19:58.725687 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-a5792389-868b-416d-9b75-215e4924352d admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:58.730884 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-a5792389-868b-416d-9b75-215e4924352d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-a5792389-868b-416d-9b75-215e4924352d admin admin] Request method failure captured: Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Accept: application/json Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Connection: keep-alive Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Content-Length: 0 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Host: 10.222.0.48 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjXA8-iEo5kcLD5YndUik0UH5TCIagnz8YBR32tNRaDT_yhnjtV-nBiY3GUJXxYhTHAEu8cltoCLvtPP3dZg5HkE1jsH2oe8j6p07DKJfTSExWQRgCn5YmfbitsRmjlrQNeV_6OZGu4fMO1X23VhZA6Y62vaJ1sj-BIrcOc0mM4_X17Nw Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Id: None Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Name: None Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Name: admin Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Role: admin,member,reader Oct 28 17:19:58.732491 n-d-860864-13 devstack@n-api.service[104548]: X-Roles: admin,member,reader Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant: admin Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-User: admin Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: X-User-Name: admin Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: method: > Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: exception: Flavor 84 could not be found. Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: action_args: {'id': '84'} Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:19:58.734236 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:58.735216 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.736526 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-a5792389-868b-416d-9b75-215e4924352d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:19:58.738371 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-a5792389-868b-416d-9b75-215e4924352d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.412542 Oct 28 17:19:58.738371 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:19:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:19:58.748556 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-6d211527-5b29-4531-853c-f9f8f3652576 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:58.763484 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-6d211527-5b29-4531-853c-f9f8f3652576 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020042 Oct 28 17:19:58.764543 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:19:58.774535 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-80bad26d-5c1d-4f87-acbd-238f65304aea admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:58.791152 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-80bad26d-5c1d-4f87-acbd-238f65304aea admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020178 Oct 28 17:19:58.791696 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:19:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:19:58.800788 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-c34e2823-8ab3-45af-a0fd-5be6b2dae745 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:19:58.805782 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.wsgi [None req-c34e2823-8ab3-45af-a0fd-5be6b2dae745 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-c34e2823-8ab3-45af-a0fd-5be6b2dae745 admin admin] Request method failure captured: Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Accept: application/json Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Accept-Encoding: gzip, deflate Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Connection: keep-alive Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Content-Length: 0 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Host: 10.222.0.48 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Openstack-Api-Version: compute 2.92 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: Openstack-System-Scope: None Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: User-Agent: python-novaclient Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Auth-Token: gAAAAABjXA8-iEo5kcLD5YndUik0UH5TCIagnz8YBR32tNRaDT_yhnjtV-nBiY3GUJXxYhTHAEu8cltoCLvtPP3dZg5HkE1jsH2oe8j6p07DKJfTSExWQRgCn5YmfbitsRmjlrQNeV_6OZGu4fMO1X23VhZA6Y62vaJ1sj-BIrcOc0mM4_X17Nw Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Id: None Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Name: None Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Identity-Status: Confirmed Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Is-Admin-Project: True Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Id: default Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Name: Default Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Name: admin Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Role: admin,member,reader Oct 28 17:19:58.807261 n-d-860864-13 devstack@n-api.service[104549]: X-Roles: admin,member,reader Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant: admin Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Name: admin Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-User: admin Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Id: default Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Name: Default Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: X-User-Name: admin Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: method: > Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: exception: Flavor 84 could not be found. Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: action_args: {'id': '84'} Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:19:58.808786 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:58.809891 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:19:58.811248 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-c34e2823-8ab3-45af-a0fd-5be6b2dae745 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:19:58.812645 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-c34e2823-8ab3-45af-a0fd-5be6b2dae745 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011336 Oct 28 17:19:58.812645 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:19:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:20:00.008705 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-80bad26d-5c1d-4f87-acbd-238f65304aea admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:00.009713 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-80bad26d-5c1d-4f87-acbd-238f65304aea admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 28 17:20:00.010108 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:00.533847 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-ee99fd80-342a-4422-bf9a-84e0cf8f39a4 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:00.539657 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.wsgi [None req-ee99fd80-342a-4422-bf9a-84e0cf8f39a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-ee99fd80-342a-4422-bf9a-84e0cf8f39a4 admin admin] Request method failure captured: Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Accept: application/json Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Accept-Encoding: gzip, deflate Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Connection: keep-alive Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Content-Length: 0 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Host: 10.222.0.48 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Openstack-Api-Version: compute 2.92 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: Openstack-System-Scope: None Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: User-Agent: python-novaclient Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Auth-Token: gAAAAABjXA8_NrbY8WkYjzsW4Io4wnf1gLiLvA7hGv6h7S_DUNalEmMt6e-8pynSmS5RKf0ftQ4lGYpNmi2cdEOysgHK0AUymgP9kI9cz0fP4R9L1GjoWJsmeIomVJPWtgt7Bg0yBwvCJAqk6Lo4xdK8qR-bSIC-cwkYfCaPtbRmSDZyelLvMD0 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Id: None Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Domain-Name: None Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Identity-Status: Confirmed Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Is-Admin-Project: True Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Id: default Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Domain-Name: Default Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Project-Name: admin Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Role: admin,member,reader Oct 28 17:20:00.541149 n-d-860864-13 devstack@n-api.service[104549]: X-Roles: admin,member,reader Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant: admin Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-Tenant-Name: admin Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-User: admin Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Id: default Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-User-Domain-Name: Default Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: X-User-Name: admin Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: method: > Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: exception: Flavor 451 could not be found. Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: action_args: {'id': '451'} Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:20:00.542635 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:20:00.543661 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.545745 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-ee99fd80-342a-4422-bf9a-84e0cf8f39a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:20:00.547193 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-ee99fd80-342a-4422-bf9a-84e0cf8f39a4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.393621 Oct 28 17:20:00.547193 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:20:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:20:00.552800 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-369328fb-9ee0-4ddf-944e-8a0c07b991cf admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:00.568015 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-369328fb-9ee0-4ddf-944e-8a0c07b991cf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018771 Oct 28 17:20:00.568533 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:20:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:20:00.577694 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:00.592785 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017954 Oct 28 17:20:00.593419 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Oct 28 17:20:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:20:00.602789 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7539ca43-5dd7-4d3d-bc9b-f6d737e5f967 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:00.608888 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.wsgi [None req-7539ca43-5dd7-4d3d-bc9b-f6d737e5f967 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7539ca43-5dd7-4d3d-bc9b-f6d737e5f967 admin admin] Request method failure captured: Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Accept: application/json Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Accept-Encoding: gzip, deflate Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Connection: keep-alive Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Content-Length: 0 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Host: 10.222.0.48 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Openstack-Api-Version: compute 2.92 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: Openstack-System-Scope: None Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: User-Agent: python-novaclient Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Auth-Token: gAAAAABjXA8_NrbY8WkYjzsW4Io4wnf1gLiLvA7hGv6h7S_DUNalEmMt6e-8pynSmS5RKf0ftQ4lGYpNmi2cdEOysgHK0AUymgP9kI9cz0fP4R9L1GjoWJsmeIomVJPWtgt7Bg0yBwvCJAqk6Lo4xdK8qR-bSIC-cwkYfCaPtbRmSDZyelLvMD0 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Id: None Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Domain-Name: None Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Identity-Status: Confirmed Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Is-Admin-Project: True Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Id: default Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Domain-Name: Default Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Project-Name: admin Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Role: admin,member,reader Oct 28 17:20:00.610377 n-d-860864-13 devstack@n-api.service[104548]: X-Roles: admin,member,reader Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51df626cc11a4e55baed09c912cb8996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51df626cc11a4e55baed09c912cb8996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51df626cc11a4e55baed09c912cb8996"}]}] Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant: admin Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Id: 51df626cc11a4e55baed09c912cb8996 Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-Tenant-Name: admin Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-User: admin Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Id: default Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-User-Domain-Name: Default Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-User-Id: 97fdcd9faf6c45cf9f9d88555f15a5e1 Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: X-User-Name: admin Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: method: > Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: exception: Flavor 451 could not be found. Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: action_args: {'id': '451'} Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:20:00.611921 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:20:00.613004 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: ERROR nova.api.openstack.wsgi Oct 28 17:20:00.614266 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-7539ca43-5dd7-4d3d-bc9b-f6d737e5f967 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:20:00.615601 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-7539ca43-5dd7-4d3d-bc9b-f6d737e5f967 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012378 Oct 28 17:20:00.615601 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:20:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 17:20:01.817258 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:01.818297 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Oct 28 17:20:01.818685 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:02.346654 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-1724e6ca-f6ff-45ab-8fd3-629f1fd1abad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:20:02.367800 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-1724e6ca-f6ff-45ab-8fd3-629f1fd1abad admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409969 Oct 28 17:20:02.368342 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Oct 28 17:20:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:20:03.569385 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:03.570369 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Oct 28 17:20:03.570756 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:04.093114 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-8bf8b37f-058f-4494-9fd6-4a9e2c108d81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:20:04.111918 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-8bf8b37f-058f-4494-9fd6-4a9e2c108d81 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404276 Oct 28 17:20:04.112459 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Oct 28 17:20:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:20:05.331298 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:05.332314 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 28 17:20:05.332700 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:05.847650 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c99dfa85-85bb-46c4-afc1-ea6cfabe9315 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:20:05.866217 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-c99dfa85-85bb-46c4-afc1-ea6cfabe9315 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397351 Oct 28 17:20:05.866759 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Oct 28 17:20:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:20:07.079122 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:07.080174 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002659 Oct 28 17:20:07.080561 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:07.604551 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-8e55fe15-ef1d-4130-b7b1-4af7a909c79d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:20:07.623583 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-8e55fe15-ef1d-4130-b7b1-4af7a909c79d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405120 Oct 28 17:20:07.624852 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Oct 28 17:20:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:20:08.833795 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:08.834816 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 28 17:20:08.835313 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:20:09.354133 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-0ddd57be-c263-4b03-80bf-cd1737393ca2 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:20:09.376214 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-0ddd57be-c263-4b03-80bf-cd1737393ca2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403394 Oct 28 17:20:09.376753 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Oct 28 17:20:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:21:07.002214 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.003247 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-d2d16658-928e-4a97-86d8-7fe79dba6947 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 28 17:21:07.003675 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 931 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:21:07.014058 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:21:07.398057 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-3c9b77c0-922a-4ba0-a379-0b4c008938b0 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.418138 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-3c9b77c0-922a-4ba0-a379-0b4c008938b0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408540 Oct 28 17:21:07.418666 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:21:07.441051 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_api:SELECT=14 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:21:07.444801 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-54b1ee2a-a788-46ec-8678-7aeecc501ba9 admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.452235 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-54b1ee2a-a788-46ec-8678-7aeecc501ba9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012632 Oct 28 17:21:07.452762 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:21:07.464361 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-b90625c3-5d76-4516-a763-d310248efe5d admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.472708 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-b90625c3-5d76-4516-a763-d310248efe5d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011918 Oct 28 17:21:07.473225 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:21:07.484338 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.491955 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011091 Oct 28 17:21:07.492468 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:21:07.504327 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-3bc40f1b-017c-4c78-b472-855da0533283 admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:21:07.511450 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-3bc40f1b-017c-4c78-b472-855da0533283 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011259 Oct 28 17:21:07.511951 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Oct 28 17:21:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:26:13.818633 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:26:13.819697 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 28 17:26:13.820098 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:26:13.964066 n-d-860864-13 devstack@n-api.service[104548]: DEBUG dbcounter [-] [104548] Writing DB stats nova_api:SELECT=6 {{(pid=104548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:26:14.110368 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:26:14.115390 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:26:14.115876 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:26:14.116303 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:26:14.117011 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:26:14.117453 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:26:14.117870 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:26:14.156392 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-c6787bf1-fccb-4494-a166-a529e19ca72a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.193568 Oct 28 17:26:14.156946 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 35/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:26:13 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:26:15.218662 n-d-860864-13 devstack@n-api.service[104549]: DEBUG nova.api.openstack.wsgi [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] Calling method '>' {{(pid=104549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:26:15.219694 n-d-860864-13 devstack@n-api.service[104549]: INFO nova.api.openstack.requestlog [None req-0fc173c1-225a-43e6-b3da-1a5f30261b9b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Oct 28 17:26:15.220088 n-d-860864-13 devstack@n-api.service[104549]: [pid: 104549|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Oct 28 17:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:26:15.412524 n-d-860864-13 devstack@n-api.service[104548]: DEBUG nova.api.openstack.wsgi [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Calling method '>' {{(pid=104548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:26:15.415990 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:26:15.416467 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:26:15.416894 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:26:15.417604 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:26:15.418050 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:26:15.418468 n-d-860864-13 devstack@n-api.service[104548]: DEBUG oslo_concurrency.lockutils [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:26:15.441975 n-d-860864-13 devstack@n-api.service[104548]: INFO nova.api.openstack.requestlog [None req-a758c781-044b-43de-b44e-813ccce1063e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.081217 Oct 28 17:26:15.442467 n-d-860864-13 devstack@n-api.service[104548]: [pid: 104548|app: 0|req: 36/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:26:15 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:27:00.901040 n-d-860864-13 devstack@n-api.service[104547]: Fri Oct 28 17:27:00 2022 - graceful shutdown triggered... Oct 28 17:27:00.901558 n-d-860864-13 devstack@n-api.service[104548]: Gracefully killing worker 1 (pid: 104548)... Oct 28 17:27:00.901162 n-d-860864-13 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 17:27:00.902372 n-d-860864-13 devstack@n-api.service[104549]: Gracefully killing worker 2 (pid: 104549)... Oct 28 17:27:01.028287 n-d-860864-13 devstack@n-api.service[104549]: DEBUG dbcounter [-] [104549] Writing DB stats nova_api:SELECT=4 {{(pid=104549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:01.902166 n-d-860864-13 devstack@n-api.service[104547]: worker 1 buried after 1 seconds Oct 28 17:27:01.902166 n-d-860864-13 devstack@n-api.service[104547]: worker 2 buried after 1 seconds Oct 28 17:27:01.902803 n-d-860864-13 devstack@n-api.service[104547]: goodbye to uWSGI. Oct 28 17:27:01.903795 n-d-860864-13 systemd[1]: devstack@n-api.service: Succeeded. Oct 28 17:27:01.904354 n-d-860864-13 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 17:27:01.907099 n-d-860864-13 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 17:27:01.923886 n-d-860864-13 devstack@n-api.service[120556]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 17:27:01 2022] *** Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: nodename: n-d-860864-13 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: machine: x86_64 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: clock source: unix Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: pcre jit disabled Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: detected number of CPU cores: 4 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: current working directory: / Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: detected binary path: /usr/bin/uwsgi-core Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: your processes number limit is 47680 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: your memory page size is 4096 bytes Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: detected max file descriptor number: 2048 Oct 28 17:27:01.944328 n-d-860864-13 devstack@n-api.service[120556]: lock engine: pthread robust mutexes Oct 28 17:27:01.945452 n-d-860864-13 devstack@n-api.service[120556]: thunder lock: enabled Oct 28 17:27:01.945452 n-d-860864-13 devstack@n-api.service[120556]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 17:27:01.945452 n-d-860864-13 devstack@n-api.service[120556]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 17:27:01.987671 n-d-860864-13 devstack@n-api.service[120556]: Python main interpreter initialized at 0x561e618b09c0 Oct 28 17:27:01.987671 n-d-860864-13 devstack@n-api.service[120556]: python threads support enabled Oct 28 17:27:01.987671 n-d-860864-13 devstack@n-api.service[120556]: your server socket listen backlog is limited to 100 connections Oct 28 17:27:01.987671 n-d-860864-13 devstack@n-api.service[120556]: your mercy for graceful operations on workers is 90 seconds Oct 28 17:27:01.988324 n-d-860864-13 devstack@n-api.service[120556]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 17:27:01.988324 n-d-860864-13 devstack@n-api.service[120556]: *** Operational MODE: preforking *** Oct 28 17:27:01.988593 n-d-860864-13 devstack@n-api.service[120556]: *** uWSGI is running in multiple interpreter mode *** Oct 28 17:27:01.988593 n-d-860864-13 devstack@n-api.service[120556]: spawned uWSGI master process (pid: 120556) Oct 28 17:27:01.988608 n-d-860864-13 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 17:27:01.989337 n-d-860864-13 devstack@n-api.service[120556]: spawned uWSGI worker 1 (pid: 120567, cores: 1) Oct 28 17:27:01.989714 n-d-860864-13 devstack@n-api.service[120556]: spawned uWSGI worker 2 (pid: 120568, cores: 1) Oct 28 17:27:01.989860 n-d-860864-13 devstack@n-api.service[120556]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 17:27:03.113805 n-d-860864-13 devstack@n-api.service[120568]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:27:03.115525 n-d-860864-13 devstack@n-api.service[120567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 17:27:04.656641 n-d-860864-13 devstack@n-api.service[120568]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:27:04.656641 n-d-860864-13 devstack@n-api.service[120568]: from cryptography.utils import int_from_bytes Oct 28 17:27:04.658047 n-d-860864-13 devstack@n-api.service[120568]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:27:04.658047 n-d-860864-13 devstack@n-api.service[120568]: from cryptography.utils import int_from_bytes Oct 28 17:27:04.658214 n-d-860864-13 devstack@n-api.service[120567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:27:04.658214 n-d-860864-13 devstack@n-api.service[120567]: from cryptography.utils import int_from_bytes Oct 28 17:27:04.658214 n-d-860864-13 devstack@n-api.service[120567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 17:27:04.658214 n-d-860864-13 devstack@n-api.service[120567]: from cryptography.utils import int_from_bytes Oct 28 17:27:07.098484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:27:07.099112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:27:07.099201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 17:27:07.099201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 17:27:07.100127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:27:07.100127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:27:07.100288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 17:27:07.100366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:27:07.100465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 17:27:07.100568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.100669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 17:27:07.100905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.101848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.102805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.103930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-13 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-13 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.104897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.105968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.106131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.106281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.106431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.106583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.107994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.108266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.108528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.108747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.108961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.109173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.109377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.109599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.109817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.110035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.110248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.110475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.110688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.110910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.111127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.111339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.111603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.112429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.112809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.113222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.113441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.113823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.114013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-13 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.114440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-13 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.114608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.114819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.115508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.115721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.115876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.116025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.116174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.116890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.116890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.117966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.118118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.118280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.118707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.118869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.119025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.119176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.119329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.120883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.121898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.122933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.123868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.124025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.124180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.124490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.124656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.124828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.125042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.125553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.125751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.125914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.126937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.127106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.127422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.127758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.127925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.128969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.129934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.130963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.131122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.131264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.131441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.131620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.131863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.132012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.132166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.132316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.132458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.132613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.134955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.135963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.136996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.137945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.138947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.139944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.140903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.141981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.142910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.143572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.143712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.143841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.144100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.144252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.144395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.144538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.145892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.146996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.147951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.148077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.148198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.148311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.148430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 17:27:07.148549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.148669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.148669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.148902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.148902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.149911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.150894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.151994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.152938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.153890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.154976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.155425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.155597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.155757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.155912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.156874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.157957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.158109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.158265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.158449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.159519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.159691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.159850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.160904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.161855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.162988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.163999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.164154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.164308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.164462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.164619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.164766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.165085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.165539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.165707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.165855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.166948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.167842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.168926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.169982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.170910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.171855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.172921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.173849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.174981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.175281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.175748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.175903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.176982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.177894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.178972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.179909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.180999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.181902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.182948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.183894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.184963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.185109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.185408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.185861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.186953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.187904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.188944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.189877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.190983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.191784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.192148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.192322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.193865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.194923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.195071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.195226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.195591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.196776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.197862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.198907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.199995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.200877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.201951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.202996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.203999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.204900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.205056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.205211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.205358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.206516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.206692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.206856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.207942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.208905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.209984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.210847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.211798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.212997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.213978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.214964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.215928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.216922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.217991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.218868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.219929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.220859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.221099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.221768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.221925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.222979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.223920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.224139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.224232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.224715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.224822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.225959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.226985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.227924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.228947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.229877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.230808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.231974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.232286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.232447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.232594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.232771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.232894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.233840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.234982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.235106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.235448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.235764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.236073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.236386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.236659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.236793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.236942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.237993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.238208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.238324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.239359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.239569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.239700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.239817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.239939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.240936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.241874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.242975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.243968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.244909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.245967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.246952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.247913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.248873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.249808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.250961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.251924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.252918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.253944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.254241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.254562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.254669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.254880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.254982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.255943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.256170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.256273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.256490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.256604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.256809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.257934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.258887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.259816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.260962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.261993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.262087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.262304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.262406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.262620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.262712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.263789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.264960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.265916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.266857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.267827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.268425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.268670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.268762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.269003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.269391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.269485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.269738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.269821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.270869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.271983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.272957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.273908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.274832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.275800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.276971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.277996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.278947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.279949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.280943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.281896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.282833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.283030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.283124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.283337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.283495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.284322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.284635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.284753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.284948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.285871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.286830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.287987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.288916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.289915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.290928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.291959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.292901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.293985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.294079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.294310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.294577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.294673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.294907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.295971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.296902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.297872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.298804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.299030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.299124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.299504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.299876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.299971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.300952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.301923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.302867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.303840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.304986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.305937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.306879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.307112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.307207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.307464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.307708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.307808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.308792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.309942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.310965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.311196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.311309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.311489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.311594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.311813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.312791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.313984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.314209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.314302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.314536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.314632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.314948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.315086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.315438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.315767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.315871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.316813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.317760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.318941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.319906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.320818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.321943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.322967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.323912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.324849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.325982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.326929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.327967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.328190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.328285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.328527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.328718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.328821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.329853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.330041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.330137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.330347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.331000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.331154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.331859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.331974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.332925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.333863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.334798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.335962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.336994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.337950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.338867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.339811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.340976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.341998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.342936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.343914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.344935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.345870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.346178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.346780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.347166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.347521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.347633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.347840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.347937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.348887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.349090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.349193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.349664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.349772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.349969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.350976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.351965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.352813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.353937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.354979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.355178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.355310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.355841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.355991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.356935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.357818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.358946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.359912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.360962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.361723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.361851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.361966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.362864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.363826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.364966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.365905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.366843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.367834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.368010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.368141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.368320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.368470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.368573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120568) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:27:07.368796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.369145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.369477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.369804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.370138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.370455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.370767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.371074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 17:27:07.371317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 17:27:07.431809 n-d-860864-13 devstack@n-api.service[120568]: INFO dbcounter [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Registered counter for database nova_api Oct 28 17:27:07.435615 n-d-860864-13 devstack@n-api.service[120567]: INFO dbcounter [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Registered counter for database nova_api Oct 28 17:27:07.451770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_db.sqlalchemy.engines [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.456837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_db.sqlalchemy.engines [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.459502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writer thread running {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.463313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writer thread running {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.516408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.context [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120568) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:27:07.520859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.context [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120567) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 17:27:07.521349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:07.521827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:07.523491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:07.524214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:07.524659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:07.524965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:07.525442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:07.526736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:07.527043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:07.527769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:07.528210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:07.528788 n-d-860864-13 devstack@n-api.service[120568]: INFO dbcounter [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Registered counter for database nova_cell0 Oct 28 17:27:07.530253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:07.532390 n-d-860864-13 devstack@n-api.service[120567]: INFO dbcounter [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Registered counter for database nova_cell0 Oct 28 17:27:07.533147 n-d-860864-13 devstack@n-api.service[120568]: INFO dbcounter [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Registered counter for database nova_cell1 Oct 28 17:27:07.537412 n-d-860864-13 devstack@n-api.service[120567]: INFO dbcounter [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Registered counter for database nova_cell1 Oct 28 17:27:07.542173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_db.sqlalchemy.engines [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.542790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_db.sqlalchemy.engines [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.545316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_db.sqlalchemy.engines [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.546634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_db.sqlalchemy.engines [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.550311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writer thread running {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.552342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writer thread running {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.553773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writer thread running {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.555393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writer thread running {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.699856 n-d-860864-13 devstack@n-api.service[120568]: INFO dbcounter [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Registered counter for database nova_cell0 Oct 28 17:27:07.701132 n-d-860864-13 devstack@n-api.service[120567]: INFO dbcounter [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Registered counter for database nova_cell0 Oct 28 17:27:07.708561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_db.sqlalchemy.engines [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120568) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.711918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_db.sqlalchemy.engines [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 17:27:07.713534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writer thread running {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:07.717584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writer thread running {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 17:27:08.044018 n-d-860864-13 devstack@n-api.service[120568]: WARNING keystonemiddleware.auth_token [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:27:08.051965 n-d-860864-13 devstack@n-api.service[120568]: WARNING keystonemiddleware.auth_token [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:27:08.063341 n-d-860864-13 devstack@n-api.service[120567]: WARNING keystonemiddleware.auth_token [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:27:08.071894 n-d-860864-13 devstack@n-api.service[120567]: WARNING keystonemiddleware.auth_token [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:27:08.401198 n-d-860864-13 devstack@n-api.service[120568]: WARNING keystonemiddleware.auth_token [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:27:08.407273 n-d-860864-13 devstack@n-api.service[120568]: WARNING keystonemiddleware.auth_token [None req-40512fa3-d948-44b9-8a9a-9294d104398e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:27:08.412688 n-d-860864-13 devstack@n-api.service[120568]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561e618b09c0 pid: 120568 (default app) Oct 28 17:27:08.430006 n-d-860864-13 devstack@n-api.service[120567]: WARNING keystonemiddleware.auth_token [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 17:27:08.435714 n-d-860864-13 devstack@n-api.service[120567]: WARNING keystonemiddleware.auth_token [None req-abdb4df7-1f12-4324-aa3c-bbcde47db977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 17:27:08.442096 n-d-860864-13 devstack@n-api.service[120567]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e618b09c0 pid: 120567 (default app) Oct 28 17:27:48.160853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:48.162294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:48.163164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:48.164046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:49.148626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:49.150295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:49.151214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:49.152116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:49.616060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1297507849", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:50.346788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:50.352704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:50.353356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:50.353983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:50.355300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:50.355932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:50.356550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:50.406600 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03554170-560d-4799-8e51-12b440fbe74d tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.268579 Oct 28 17:27:50.407268 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:27:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:50.736445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:27:51.007104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '.version_select at 0x7f7525d88a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:51.014629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120567) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 17:27:51.015523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.016134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.016780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.046772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.047290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.047815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.060637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.061108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.061533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.066519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:27:51.066894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:27:51.067373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:27:51.067780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:27:51.068281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:27:51.070331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d6055cb-4cf6-4dad-8566-4b990d6fb830 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.661327 Oct 28 17:27:51.071321 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:27:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:51.075881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29f6c014-b57f-4343-96c7-0d91ae5fc8f5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1517473142"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:51.091035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.091549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.091983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.092961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.093409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.093826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.098558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-29f6c014-b57f-4343-96c7-0d91ae5fc8f5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid 3741929f-4027-4db2-b64c-2fc7e7b36240 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:51.128812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Getting quotas for project 1a4bfe1d7aee49858fdd893680f733fc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:27:51.135920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Getting quotas for user 62c38d65ee164ee9931a64607b92de6b and project 1a4bfe1d7aee49858fdd893680f733fc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:27:51.150313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:27:51.154734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:27:51.176136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29f6c014-b57f-4343-96c7-0d91ae5fc8f5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103486 Oct 28 17:27:51.177087 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:51.239547 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e0c0192-518c-4e5c-b98f-dff6212e4712 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.084901 Oct 28 17:27:51.240525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1/4] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:27:51.413435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:51.416043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.416536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.416974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.417707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.418176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.418596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.445967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.265728 Oct 28 17:27:51.445967 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 4/5] 10.222.0.48 () {58 vars in 1164 bytes} [Fri Oct 28 17:27:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:51.445967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:51.482076 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-efab8a8d-7b4a-469d-b143-0a0a78b8dced tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001203 Oct 28 17:27:51.482076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 5/6] 10.222.0.48 () {56 vars in 886 bytes} [Fri Oct 28 17:27:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 17:27:51.482802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Calling method '.version_select at 0x7f7525eeef70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:51.482802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120568) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 17:27:51.482802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.482802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.483331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.512725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.513219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.513699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.551214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.551916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.552352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.565835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.566247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.566681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.580460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.580965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.581397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.589495 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-339ad5db-bb18-4eca-8ac7-96ac5be2b6b7 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1575 microversion: 2.53 time: 0.347492 Oct 28 17:27:51.590490 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2/7] 10.222.0.48 () {60 vars in 1243 bytes} [Fri Oct 28 17:27:51 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1575 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:27:51.595220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11aedf47-4151-4b68-9ffb-aa7afdea2c52 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:51.627414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11aedf47-4151-4b68-9ffb-aa7afdea2c52 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:51.627906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11aedf47-4151-4b68-9ffb-aa7afdea2c52 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:51.628540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11aedf47-4151-4b68-9ffb-aa7afdea2c52 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:51.639839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8bf5d19-a8de-4851-96fb-993469fdb4c2 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-604063510", "ram": 512, "vcpus": 1, "disk": 10, "id": 318857563, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:51.698151 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8bf5d19-a8de-4851-96fb-993469fdb4c2 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.249768 Oct 28 17:27:51.699023 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 6/8] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:51 2022] POST /compute/v2.1/flavors => generated 412 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:51.706128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3988cd8-2573-497a-8c2d-cc369c807661 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:51.707959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3988cd8-2573-497a-8c2d-cc369c807661 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:52.291046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11aedf47-4151-4b68-9ffb-aa7afdea2c52 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.699296 Oct 28 17:27:52.295621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3/9] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:51 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:52.301204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:52.303043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.303549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.303980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.304700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.305143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.305699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.378421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92b78101-9f28-47af-8d46-7cc374f9063d tempest-AZAdminV2TestJSON-1777964150 tempest-AZAdminV2TestJSON-1777964150-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.085293 Oct 28 17:27:52.388602 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4/10] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:27:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:52.393858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Calling method '.version_select at 0x7f75253d83a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:52.399288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.400798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.400798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.431325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.433555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b3988cd8-2573-497a-8c2d-cc369c807661 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:52.434053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.434486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.469293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3988cd8-2573-497a-8c2d-cc369c807661 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1219 microversion: 2.1 time: 0.768599 Oct 28 17:27:52.471451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 7/11] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:51 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1219 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:52.472358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.472887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.473334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.500440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.501463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.502035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.503477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22374fa7-3729-418c-9344-eb55a06f2125 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:52.524578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.525320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.525906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.532758 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8eddfcbf-252b-494a-9a2d-81721bd5e102 tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 267 microversion: 2.53 time: 0.143356 Oct 28 17:27:52.533868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 5/12] 10.222.0.48 () {60 vars in 1222 bytes} [Fri Oct 28 17:27:52 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:27:52.539288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:52.551324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.551963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.552394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.592567 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-860864-13. Oct 28 17:27:52.600694 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22374fa7-3729-418c-9344-eb55a06f2125 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109254 Oct 28 17:27:52.605925 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 8/13] 10.222.0.48 () {60 vars in 1221 bytes} [Fri Oct 28 17:27:52 2022] POST /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:52.609253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Calling method '.version_select at 0x7f752672a4c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:52.613657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.614136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.618274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 40 Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:27:52.636661 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: {"add_host": {"host": "n-h2-860864-13"}} Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:52.637962 n-d-860864-13 devstack@n-api.service[120568]: exception: Aggregate 1 already has host n-h2-860864-13. Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-860864-13'}}} Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:27:52.638700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-860864-13-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 17:27:52.639777 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 17:27:52.640898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:27:52.643260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-860864-13-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 17, 27, 52, 571997), 'updated_at': None, 'host': 'n-h2-860864-13', 'aggregate_id': 1}] Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:52.644405 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-860864-13. Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.645285 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-860864-13. Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:52.646445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:52.647537 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-860864-13. Oct 28 17:27:52.647537 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:52.647537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-860864-13. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:52.647537 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ebf3d0e-17e6-44f7-995d-7bbe1026eacc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.103278 Oct 28 17:27:52.647783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 6/14] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 28 17:27:52.653563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.654234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.654809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.662897 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-939e0905-6af7-4bd4-a578-4eff9181be8d tempest-HypervisorAdminV253TestBase-1256971722 tempest-HypervisorAdminV253TestBase-1256971722-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/b6bb7413-fdbb-4b4f-842b-7ea079a374d1" status: 200 len: 793 microversion: 2.53 time: 0.060175 Oct 28 17:27:52.663963 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 9/15] 10.222.0.48 () {60 vars in 1298 bytes} [Fri Oct 28 17:27:52 2022] GET /compute/v2.1/os-hypervisors/b6bb7413-fdbb-4b4f-842b-7ea079a374d1 => generated 793 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:27:52.668811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c872b61b-ca2e-4831-89e0-04d299c3a953 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:52.683879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c872b61b-ca2e-4831-89e0-04d299c3a953 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:52.684699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c872b61b-ca2e-4831-89e0-04d299c3a953 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:52.685470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c872b61b-ca2e-4831-89e0-04d299c3a953 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:52.936553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d20238bb-58b4-4787-adbf-c3d0f40a3655 tempest-FlavorsExtraSpecsTestJSON-889573329 tempest-FlavorsExtraSpecsTestJSON-889573329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:52.946542 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d20238bb-58b4-4787-adbf-c3d0f40a3655 tempest-FlavorsExtraSpecsTestJSON-889573329 tempest-FlavorsExtraSpecsTestJSON-889573329-project] 10.222.0.48 "GET /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.297771 Oct 28 17:27:52.954460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 7/16] 10.222.0.48 () {58 vars in 1200 bytes} [Fri Oct 28 17:27:52 2022] GET /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:52.959628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e5fa681-3f02-4572-ad6f-c778699f93da tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:53.019701 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e5fa681-3f02-4572-ad6f-c778699f93da tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063691 Oct 28 17:27:53.023510 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 8/17] 10.222.0.48 () {60 vars in 1221 bytes} [Fri Oct 28 17:27:52 2022] POST /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.033923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46163201-429d-40dc-b3e5-5bab33e123c3 tempest-FlavorsExtraSpecsTestJSON-889573329 tempest-FlavorsExtraSpecsTestJSON-889573329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.043728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46163201-429d-40dc-b3e5-5bab33e123c3 tempest-FlavorsExtraSpecsTestJSON-889573329 tempest-FlavorsExtraSpecsTestJSON-889573329-project] 10.222.0.48 "GET /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015897 Oct 28 17:27:53.044373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 9/18] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.057650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-857e1447-8448-4f30-9016-926bb4e0188b tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:53.085245 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-857e1447-8448-4f30-9016-926bb4e0188b tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031869 Oct 28 17:27:53.086408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 10/19] 10.222.0.48 () {60 vars in 1221 bytes} [Fri Oct 28 17:27:53 2022] POST /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.097467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56d42b05-d2c0-4a4b-b470-81cadf043ae6 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.107724 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56d42b05-d2c0-4a4b-b470-81cadf043ae6 tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015184 Oct 28 17:27:53.108978 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 11/20] 10.222.0.48 () {58 vars in 1200 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.119531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18d95679-17eb-4f95-88c8-4e34023debbf tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:53.154560 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18d95679-17eb-4f95-88c8-4e34023debbf tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039404 Oct 28 17:27:53.156101 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 12/21] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:27:53 2022] PUT /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.166009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8daa1cd9-a056-4ad1-aa94-3249a871658d tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.175008 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8daa1cd9-a056-4ad1-aa94-3249a871658d tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012526 Oct 28 17:27:53.175609 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 13/22] 10.222.0.48 () {58 vars in 1200 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/flavors/318857563/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.185742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a290ab70-bfb2-4b46-ab34-6eec8baa758d tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.215478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:53.228671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a290ab70-bfb2-4b46-ab34-6eec8baa758d tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045877 Oct 28 17:27:53.232429 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 14/23] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:27:53 2022] DELETE /compute/v2.1/flavors/318857563/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 17:27:53.239868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-779942e7-3665-4e62-a2f2-f9e25cec2e1e tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.271515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-779942e7-3665-4e62-a2f2-f9e25cec2e1e tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/318857563/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.037375 Oct 28 17:27:53.272005 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 15/24] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:27:53 2022] DELETE /compute/v2.1/flavors/318857563/os-extra_specs/hw:cpu_policy => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:53.279771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-303e37dc-bcf1-405e-98a7-452326d0cb1f tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.288189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-303e37dc-bcf1-405e-98a7-452326d0cb1f tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/318857563/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011690 Oct 28 17:27:53.288848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 16/25] 10.222.0.48 () {58 vars in 1200 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/flavors/318857563/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:27:53.298993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4285d4c2-5ca1-48cf-b3b1-d0ed1fd6ab3f tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.330770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4285d4c2-5ca1-48cf-b3b1-d0ed1fd6ab3f tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/318857563" status: 202 len: 0 microversion: 2.1 time: 0.032504 Oct 28 17:27:53.331409 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:27:53 2022] DELETE /compute/v2.1/flavors/318857563 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:27:53.339353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-904c6c18-21ac-4cc1-bd56-90811a6e08da tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.372822 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-904c6c18-21ac-4cc1-bd56-90811a6e08da tempest-FlavorsExtraSpecsTestJSON-1602014356 tempest-FlavorsExtraSpecsTestJSON-1602014356-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037169 Oct 28 17:27:53.373868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 18/27] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:27:53.494926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.496219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:53.511844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:53.512777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:53.513454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:53.514361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:53.515086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:53.515769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:53.816082 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c872b61b-ca2e-4831-89e0-04d299c3a953 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.150619 Oct 28 17:27:53.817968 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 10/28] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:53.838881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:53.867467 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73821c3b-5c05-4fe2-a4b0-c59e134e89c4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1289 microversion: 2.1 time: 0.377003 Oct 28 17:27:53.870032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 19/29] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:53 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1289 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:27:53.888471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-878d43dc-e82f-49c3-8b19-1baa33bf6c43 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:53.930518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-878d43dc-e82f-49c3-8b19-1baa33bf6c43 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.059222 Oct 28 17:27:53.931514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 20/30] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:53 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:53.943650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d0c23d9-f05c-4d75-911d-228a25fdedff tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1762737503"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:53.948510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-7d0c23d9-f05c-4d75-911d-228a25fdedff tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid 4c33fc21-621e-4eab-9268-472df2236a08 for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:54.006695 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d0c23d9-f05c-4d75-911d-228a25fdedff tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069452 Oct 28 17:27:54.008300 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 21/31] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.023927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34650b25-b419-4d58-89fb-eb949b716412 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-352554846", "name": "tempest-test_aggregate-1434771520"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.077784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-34650b25-b419-4d58-89fb-eb949b716412 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 15d06cd3-72de-4330-9282-04b735c27d5d for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:54.117263 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34650b25-b419-4d58-89fb-eb949b716412 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.107611 Oct 28 17:27:54.126631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 22/32] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.308979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9be80ab-680a-4531-bd5e-f7c2100260f6 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-74575498", "id": 1481059794, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.365913 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9be80ab-680a-4531-bd5e-f7c2100260f6 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.545535 Oct 28 17:27:54.366505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 11/33] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:53 2022] POST /compute/v2.1/flavors => generated 428 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.379339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54310521-3ea9-40e2-b2f4-984989815e23 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.401272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54310521-3ea9-40e2-b2f4-984989815e23 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.026110 Oct 28 17:27:54.401868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 12/34] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:27:54 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.418387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c321dc0f-0688-460d-9a60-526a63020383 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.475769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c321dc0f-0688-460d-9a60-526a63020383 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1481059794" status: 202 len: 0 microversion: 2.1 time: 0.072693 Oct 28 17:27:54.476379 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 13/35] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:27:54 2022] DELETE /compute/v2.1/flavors/1481059794 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:54.490534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3e6bb76-c9dc-42dd-ba6a-fe1ac24d2081 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.535074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb76-c9dc-42dd-ba6a-fe1ac24d2081 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:54.536556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb76-c9dc-42dd-ba6a-fe1ac24d2081 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:54.537833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3e6bb76-c9dc-42dd-ba6a-fe1ac24d2081 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:54.559595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76e0e475-6a59-4b14-ab6e-2cf1a36398de tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.565461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76e0e475-6a59-4b14-ab6e-2cf1a36398de tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76e0e475-6a59-4b14-ab6e-2cf1a36398de tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 40 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:27:54.575034 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: {"add_host": {"host": "n-h2-860864-13"}} Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:54.576133 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-860864-13'}}} Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:54.576840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 17:27:54.577831 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.581885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76e0e475-6a59-4b14-ab6e-2cf1a36398de tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:54.583946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76e0e475-6a59-4b14-ab6e-2cf1a36398de tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.456107 Oct 28 17:27:54.585211 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 23/36] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:54.633480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b7ee7ca-094f-47c8-bf50-69900d2ef763 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.679395 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b7ee7ca-094f-47c8-bf50-69900d2ef763 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090961 Oct 28 17:27:54.680602 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 24/37] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:54.686213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd2a71ba-eaf3-476c-a96f-0559b7ea8c73 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.762150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd2a71ba-eaf3-476c-a96f-0559b7ea8c73 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.080082 Oct 28 17:27:54.769892 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 25/38] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:54 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:54.776867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2e5841a-ae63-4a71-86a4-793b6cb64583 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-424742920", "id": 1033861615, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.811454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2e5841a-ae63-4a71-86a4-793b6cb64583 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.038894 Oct 28 17:27:54.812382 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 26/39] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/flavors => generated 416 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.818710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70b03597-a33d-4e98-a593-1f8ae6c8afac tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-675950881"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.824327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-70b03597-a33d-4e98-a593-1f8ae6c8afac tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid a9fa8cc9-b449-4f2e-be2e-33cad03bba38 for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:54.837739 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3e6bb76-c9dc-42dd-ba6a-fe1ac24d2081 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.360175 Oct 28 17:27:54.846694 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 14/40] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.853486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70b03597-a33d-4e98-a593-1f8ae6c8afac tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038919 Oct 28 17:27:54.861438 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 27/41] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:54.863725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-486fba76-c6b3-4985-b335-41efbaa76efa tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.868705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1234696546"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:54.883421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:54.883787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:54.884239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:54.897653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:54.898206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:54.898663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:54.909408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1234696546 could not be found. Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 58 Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:27:54.913767 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: {"add_host": {"host": "tempest-nonexist_host-1234696546"}} Oct 28 17:27:54.914829 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: exception: Compute host tempest-nonexist_host-1234696546 could not be found. Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1234696546'}}} Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1234696546' is not mapped to any cell Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.915427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 28 17:27:54.916428 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1234696546 could not be found. Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1234696546 could not be found. Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:54.917416 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1234696546 could not be found. Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1234696546 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:54.918454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e421ff3f-1def-47cd-936c-48c747fdf883 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.053419 Oct 28 17:27:54.920990 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 28/42] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:27:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:54.930667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:54.931293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:54.940347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:54.941081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:54.941751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:54.943722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:54.944709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:54.945743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:54.957525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-486fba76-c6b3-4985-b335-41efbaa76efa tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.109382 Oct 28 17:27:54.958121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 15/43] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:54 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:54.965829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa222f57-ebe0-4317-8896-c80edb16f3d5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.030260 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa222f57-ebe0-4317-8896-c80edb16f3d5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.067226 Oct 28 17:27:55.031418 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 16/44] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:54 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:55.053797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0835559-bd30-472b-93bd-443afba6ed59 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.072939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:55.083103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0835559-bd30-472b-93bd-443afba6ed59 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1033861615" status: 202 len: 0 microversion: 2.1 time: 0.049635 Oct 28 17:27:55.084248 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 17/45] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/flavors/1033861615 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:55.084856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea53d449-ff32-4457-956e-8fdd939443f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1298 microversion: 2.1 time: 0.162218 Oct 28 17:27:55.087611 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 29/46] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:54 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:55.095992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4616f4d8-674f-4e09-a744-077922ec974a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4616f4d8-674f-4e09-a744-077922ec974a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 283 Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:27:55.102417 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.104302 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:27:55.104828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.105389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.106237 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.106997 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:27:55.106997 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:27:55.106997 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:27:55.106997 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.108871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4616f4d8-674f-4e09-a744-077922ec974a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.110780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4616f4d8-674f-4e09-a744-077922ec974a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024656 Oct 28 17:27:55.112322 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 18/47] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:27:55.123603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84f42ddd-433c-47a5-8a5b-8b52be442590 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.125679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c737177-0300-4d67-b265-83d37cb3f371 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c737177-0300-4d67-b265-83d37cb3f371 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 27 Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:27:55.130703 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: {"aggregate": {"name": ""}} Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.131810 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi '' Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.132528 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:27:55.133599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.134526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c737177-0300-4d67-b265-83d37cb3f371 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.134526 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c737177-0300-4d67-b265-83d37cb3f371 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014871 Oct 28 17:27:55.135656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 19/48] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:27:55.148206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16cbfb03-d873-4e0c-a236-d75ba2cd538f tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-958160113"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.167325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-16cbfb03-d873-4e0c-a236-d75ba2cd538f tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16cbfb03-d873-4e0c-a236-d75ba2cd538f tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 59 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:27:55.179653 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: {"aggregate": {"name": "tempest-test_aggregate-958160113"}} Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.180798 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-958160113'}}} Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:27:55.181555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:27:55.182445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 17:27:55.184449 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.184449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16cbfb03-d873-4e0c-a236-d75ba2cd538f tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.190650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16cbfb03-d873-4e0c-a236-d75ba2cd538f tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.044890 Oct 28 17:27:55.191768 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 20/49] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:55.196240 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84f42ddd-433c-47a5-8a5b-8b52be442590 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098461 Oct 28 17:27:55.198835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 30/50] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:55.221029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5005b953-a687-4151-bad2-22a64aede964 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1876624300"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.224918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-5005b953-a687-4151-bad2-22a64aede964 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid dca4347c-ea94-40f8-b942-10a29e3ca345 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:55.229360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b960bbe2-4594-43ff-8c4e-fe660098cca1 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1789840914", "id": 1772235858, "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.278042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b960bbe2-4594-43ff-8c4e-fe660098cca1 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.058117 Oct 28 17:27:55.283936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 31/51] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/flavors => generated 429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.294627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9aa01c3b-dfa9-4867-97c8-11bd40ac0bb4 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.320341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9aa01c3b-dfa9-4867-97c8-11bd40ac0bb4 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1772235858" status: 202 len: 0 microversion: 2.1 time: 0.029446 Oct 28 17:27:55.329853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5005b953-a687-4151-bad2-22a64aede964 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.126382 Oct 28 17:27:55.333657 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 21/52] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.335544 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 32/53] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/flavors/1772235858 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:27:55.355479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1876624300"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.361508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid 7333fc91-d951-414a-8fdd-69918ba77170 for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:55.365629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6313de51-47f1-4870-b50a-3a201a04ffe5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.373749 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1876624300 already exists. Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 60 Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:27:55.380269 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: {"aggregate": {"name": "tempest-test_aggregate-1876624300"}} Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:55.381727 n-d-860864-13 devstack@n-api.service[120568]: exception: Aggregate tempest-test_aggregate-1876624300 already exists. Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1876624300'}}} Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 28 17:27:55.382502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1876624300 already exists. Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:55.383924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1876624300 already exists. Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1876624300 already exists. Oct 28 17:27:55.385374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.387257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1876624300 already exists. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.388448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5ab99e9-8642-44b5-b512-84143db26acc tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.043709 Oct 28 17:27:55.395816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 33/54] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:27:55.404816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f22d5491-d091-41b4-8bd5-ca5e4bc0e2a8 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.416797 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6313de51-47f1-4870-b50a-3a201a04ffe5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076468 Oct 28 17:27:55.420719 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 22/55] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:55.446825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e1116e8-73a2-4337-8383-b3c4a3fe0102 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1405976539", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.451409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f22d5491-d091-41b4-8bd5-ca5e4bc0e2a8 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.050013 Oct 28 17:27:55.462124 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 34/56] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:55.471920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c28dde84-8bef-4449-b0d5-f13c38769ea4 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-134441884"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.478978 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e1116e8-73a2-4337-8383-b3c4a3fe0102 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.040760 Oct 28 17:27:55.480049 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 23/57] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/flavors => generated 507 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.485000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-c28dde84-8bef-4449-b0d5-f13c38769ea4 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid 43ca25fb-09a9-40dd-83bb-afa3dd91e729 for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:55.495218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5a4836b-2d3d-4aab-a130-23d8a1d5d1f4 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.532517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:55.541735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5a4836b-2d3d-4aab-a130-23d8a1d5d1f4 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/fe3b8848-0e3d-458e-aae5-a6f64513936b" status: 202 len: 0 microversion: 2.1 time: 0.052920 Oct 28 17:27:55.551351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c28dde84-8bef-4449-b0d5-f13c38769ea4 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083364 Oct 28 17:27:55.552018 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 35/58] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.553797 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 24/59] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/flavors/fe3b8848-0e3d-458e-aae5-a6f64513936b => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:27:55.568034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4b3f5a2-98a6-4361-b8d6-38cfbd06802e tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.578983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93f9b89b-3943-4a0a-8616-d8c5062fbd9e tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.588312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93f9b89b-3943-4a0a-8616-d8c5062fbd9e tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93f9b89b-3943-4a0a-8616-d8c5062fbd9e tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:27:55.589667 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 17:27:55.590722 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6'} Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:55.591313 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.592275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93f9b89b-3943-4a0a-8616-d8c5062fbd9e tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.595437 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93f9b89b-3943-4a0a-8616-d8c5062fbd9e tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.021787 Oct 28 17:27:55.619726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 25/60] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:55.628624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29eda004-6398-4c24-b0f2-e33ab0222ec6 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.651352 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4b3f5a2-98a6-4361-b8d6-38cfbd06802e tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085007 Oct 28 17:27:55.654201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 36/61] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:55.681834 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29eda004-6398-4c24-b0f2-e33ab0222ec6 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.056245 Oct 28 17:27:55.682653 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 26/62] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:55.682894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2583c9b-1faa-45d4-965f-6c0eeb932051 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1202285454", "id": "402be40f-263f-461f-8d97-30df6b2b0d73", "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.694082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f62b3d97-c6a5-4b7c-b1b9-9133fee9fe47 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.732874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2583c9b-1faa-45d4-965f-6c0eeb932051 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.053574 Oct 28 17:27:55.733453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 37/63] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/flavors => generated 507 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.739571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f62b3d97-c6a5-4b7c-b1b9-9133fee9fe47 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f62b3d97-c6a5-4b7c-b1b9-9133fee9fe47 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:27:55.747024 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: exception: Aggregate -1 could not be found. Oct 28 17:27:55.748491 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '-1'} Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:27:55.749233 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.750399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 17:27:55.752151 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.755288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f62b3d97-c6a5-4b7c-b1b9-9133fee9fe47 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.756667 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f62b3d97-c6a5-4b7c-b1b9-9133fee9fe47 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.068586 Oct 28 17:27:55.759839 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 27/64] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:27:55.766922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f5adf55-798d-40fe-a51f-0d04c8318064 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.811092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f5adf55-798d-40fe-a51f-0d04c8318064 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/402be40f-263f-461f-8d97-30df6b2b0d73" status: 202 len: 0 microversion: 2.1 time: 0.049871 Oct 28 17:27:55.813431 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 28/65] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:27:55 2022] DELETE /compute/v2.1/flavors/402be40f-263f-461f-8d97-30df6b2b0d73 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:55.825513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b496124b-6660-4f16-9ec1-c941621f9ba2 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1226995742"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:55.836923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-b496124b-6660-4f16-9ec1-c941621f9ba2 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid d0b05a0b-c7f2-458e-accf-8cfd0cb580b7 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:27:55.905460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b496124b-6660-4f16-9ec1-c941621f9ba2 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090505 Oct 28 17:27:55.908818 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 29/66] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:55.920691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e96dda0-4606-471a-a0d7-a95ed1f28f0d tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.958715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e96dda0-4606-471a-a0d7-a95ed1f28f0d tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046337 Oct 28 17:27:55.960567 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 30/67] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:55.967045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5face018-a53e-413c-a956-43ad48555462 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:55.970520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5face018-a53e-413c-a956-43ad48555462 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5face018-a53e-413c-a956-43ad48555462 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:27:55.972689 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 17:27:55.973867 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7'} Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:55.974769 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 17:27:55.975798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:55.978600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5face018-a53e-413c-a956-43ad48555462 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:55.979693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5face018-a53e-413c-a956-43ad48555462 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.017783 Oct 28 17:27:55.980773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 31/68] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:27:55 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:55.988583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bf62d19-398c-410f-b5b0-52ee4ddfcd87 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-962710970", "id": 607469286, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:56.018297 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bf62d19-398c-410f-b5b0-52ee4ddfcd87 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.034422 Oct 28 17:27:56.024467 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 32/69] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/flavors => generated 410 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:56.038012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85818568-ddf4-4452-9d22-cc36fb8c8fa8 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:56.106605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85818568-ddf4-4452-9d22-cc36fb8c8fa8 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.080158 Oct 28 17:27:56.111264 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 33/70] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:27:56.123935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e318f2e-4b8a-43cf-9bbb-814060da9b88 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:56.149036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e318f2e-4b8a-43cf-9bbb-814060da9b88 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/607469286" status: 200 len: 410 microversion: 2.1 time: 0.027262 Oct 28 17:27:56.150997 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 34/71] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:27:56 2022] GET /compute/v2.1/flavors/607469286 => generated 410 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:56.170610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:56.173941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:56.190823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:56.191330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:56.194823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:56.197984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:56.198491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:56.198946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:56.672420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1831789535", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "availability_zone": "tempest-test_az-352554846"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:56.715348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:56.715880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:56.716306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:56.717140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:56.717476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:56.724487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:56.861685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:56.877883 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f327b63-b321-4dd4-94eb-c917b2be9349 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.723837 Oct 28 17:27:56.878800 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 35/72] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:56 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:56.884527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c54f1600-9291-41c4-86b8-0a9620ee50ce tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:56.893325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c54f1600-9291-41c4-86b8-0a9620ee50ce tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c54f1600-9291-41c4-86b8-0a9620ee50ce tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:27:56.895678 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: exception: Aggregate -1 could not be found. Oct 28 17:27:56.897239 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '-1'} Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:56.898079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 17:27:56.900042 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:27:56.903618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c54f1600-9291-41c4-86b8-0a9620ee50ce tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:56.904958 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c54f1600-9291-41c4-86b8-0a9620ee50ce tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024654 Oct 28 17:27:56.905721 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 36/73] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:27:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:27:56.937367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:27:57.332631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:27:57.333154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:27:57.333702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:27:57.334176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:27:57.334645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:27:57.352859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:57.353991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:57.356923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:57.357936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:57.362269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:57.370088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:57.400382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=13,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:27:57.428656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Getting quotas for project f680e101d13d4d13aecb0ff391b50332. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:27:57.440325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Getting quotas for user 4b136d7515ea4b28b7508b403c249168 and project f680e101d13d4d13aecb0ff391b50332. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:27:57.471517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:27:57.475265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:27:57.573428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3dfde41-7206-40fa-af5a-6c456c934d3a tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.628859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8684627c-c94e-4994-a351-d6305d74891b tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894173 Oct 28 17:27:57.645246 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:27:57.651546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8916678d-f947-467e-b5ca-806a98146b67 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.653116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8916678d-f947-467e-b5ca-806a98146b67 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8916678d-f947-467e-b5ca-806a98146b67 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:27:57.654787 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 17:27:57.656011 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:27:57.656627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:57.658115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8916678d-f947-467e-b5ca-806a98146b67 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:57.676837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8916678d-f947-467e-b5ca-806a98146b67 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.030145 Oct 28 17:27:57.677506 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 39/75] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:27:57 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:27:57.697313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ea0b20e-7fcb-44f2-8e5e-688f90c68757 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.698137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2ea0b20e-7fcb-44f2-8e5e-688f90c68757 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:57.707351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3dfde41-7206-40fa-af5a-6c456c934d3a tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.793695 Oct 28 17:27:57.735548 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 37/76] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:56 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:57.746673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9335b48b-be67-499c-b0d9-b9ddd3e6e9ee tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.803064 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9335b48b-be67-499c-b0d9-b9ddd3e6e9ee tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/607469286" status: 202 len: 0 microversion: 2.1 time: 0.066009 Oct 28 17:27:57.804053 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:27:57 2022] DELETE /compute/v2.1/flavors/607469286 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:57.812396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-683df704-c66b-4c1d-9993-b2909f2b4d61 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.827157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2ea0b20e-7fcb-44f2-8e5e-688f90c68757 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:57.847554 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ea0b20e-7fcb-44f2-8e5e-688f90c68757 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1242 microversion: 2.1 time: 0.159252 Oct 28 17:27:57.867901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:57 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1242 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:57.878480 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-683df704-c66b-4c1d-9993-b2909f2b4d61 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070059 Oct 28 17:27:57.879712 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:57.901020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0480853-514a-40d5-b96a-0c22847e10b1 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1941852475", "id": 2085899163, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:57.905423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:57.906182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:57.920551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:57.924477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:57.926677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:57.927898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:57.929858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:57.931703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:57.941517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0480853-514a-40d5-b96a-0c22847e10b1 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.045851 Oct 28 17:27:57.946643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 41/80] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:57 2022] POST /compute/v2.1/flavors => generated 430 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:57.962655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f2c6591-fb21-4a52-8905-09cbb11c660b tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "2085899163"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:57.998875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9f2c6591-fb21-4a52-8905-09cbb11c660b tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] HTTP exception thrown: Flavor 2085899163 could not be found. Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f2c6591-fb21-4a52-8905-09cbb11c660b tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Request method failure captured: Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 107 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEXNT4-GDSXbIj_qN0vzklijsW8Ztc3qwZcL1SNsSVi0HUAJkytX48G1yRJjscQyZDcbROfRuYJxTDd4qW85oNWxiJe_9SWn5VKsNMi8rdojE4uHvzcPBFkePFYIp1VbBWlovUP2OOlWnvMBfVPKvcmrKX-8SxHpvi03eb7YC5Rs60 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 76fe536046d1403b9cd49d4f52ce3077 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsAdminTestJSON-1178598635 Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:27:58.007748 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76fe536046d1403b9cd49d4f52ce3077"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76fe536046d1403b9cd49d4f52ce3077"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76fe536046d1403b9cd49d4f52ce3077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76fe536046d1403b9cd49d4f52ce3077"}]}] Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsAdminTestJSON-1178598635 Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 76fe536046d1403b9cd49d4f52ce3077 Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1178598635 Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsAdminTestJSON-1178598635-project Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 75172648cb7145c781af16652f6db54a Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsAdminTestJSON-1178598635-project Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "test", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "2085899163"}} Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:27:58.008810 n-d-860864-13 devstack@n-api.service[120568]: exception: Flavor 2085899163 could not be found. Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '2085899163'}}} Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2085899163 could not be found. Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:58.009540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2085899163 could not be found. Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:27:58.010632 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2085899163 could not be found. Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f2c6591-fb21-4a52-8905-09cbb11c660b tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Returning 400 to user: Flavor 2085899163 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:27:58.011689 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f2c6591-fb21-4a52-8905-09cbb11c660b tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.057689 Oct 28 17:27:58.012640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 42/81] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:57 2022] POST /compute/v2.1/servers => generated 81 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:27:58.037753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c5fc5f8-70d9-4a6c-9841-4f6dde8a8218 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.066655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c5fc5f8-70d9-4a6c-9841-4f6dde8a8218 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2085899163" status: 202 len: 0 microversion: 2.1 time: 0.047634 Oct 28 17:27:58.100555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 43/82] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:27:58 2022] DELETE /compute/v2.1/flavors/2085899163 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:58.120172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc99c50f-e1ef-4510-ac5f-ea5a14e36973 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.166316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc99c50f-e1ef-4510-ac5f-ea5a14e36973 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065379 Oct 28 17:27:58.169157 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 44/83] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:58.199809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56a13797-9441-4204-a07a-e61093878930 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-814109487", "id": 922421815, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:58.226672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56a13797-9441-4204-a07a-e61093878930 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035169 Oct 28 17:27:58.228100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 45/84] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:27:58.244467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e42666f8-86f2-40db-bd1b-4ba2bfcc1ded tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1802803123", "id": 1773189835, "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:58.286069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:58.292912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e42666f8-86f2-40db-bd1b-4ba2bfcc1ded tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053456 Oct 28 17:27:58.295522 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 46/85] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:27:58.310867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-33dcf192-5793-4239-8bdf-39d19684e496 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.312971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3ba3621-9286-4f72-a195-099439961ffc tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.412683 Oct 28 17:27:58.314683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 40/86] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:57 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:27:58.375884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-33dcf192-5793-4239-8bdf-39d19684e496 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.070068 Oct 28 17:27:58.378403 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 47/87] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:58.403448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4090955b-835e-4c21-8ca9-eb62536c0d87 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.457254 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4090955b-835e-4c21-8ca9-eb62536c0d87 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.064643 Oct 28 17:27:58.458479 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 41/88] 10.222.0.48 () {58 vars in 1177 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:58.476566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38c17804-ae59-45ab-8d06-4913d7d5d8a5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.501824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38c17804-ae59-45ab-8d06-4913d7d5d8a5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.033256 Oct 28 17:27:58.512472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 48/89] 10.222.0.48 () {58 vars in 1171 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:58.523958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8466920c-15fc-4a87-a7e0-b103243f926b tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.550001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8466920c-15fc-4a87-a7e0-b103243f926b tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.031333 Oct 28 17:27:58.553114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 42/90] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:58.567900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7ee1b4e-413f-46be-b79a-ff2b331a33ae tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.616456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7ee1b4e-413f-46be-b79a-ff2b331a33ae tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.052599 Oct 28 17:27:58.618480 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 49/91] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:58.644874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5cc2fcdb-eb5b-4041-a6ee-b0f29ba344fb tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.763260 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5cc2fcdb-eb5b-4041-a6ee-b0f29ba344fb tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.123783 Oct 28 17:27:58.783714 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 43/92] 10.222.0.48 () {58 vars in 1175 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:27:58.803778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-453bbeca-59f3-47b7-adc8-078f8e39f534 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.877570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96437f96-449e-4770-a124-6dffcbf5e147 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.879519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96437f96-449e-4770-a124-6dffcbf5e147 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:58.886375 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-453bbeca-59f3-47b7-adc8-078f8e39f534 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.085909 Oct 28 17:27:58.889717 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 50/93] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:58.909971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af6df4b4-f624-47db-bb97-02175f7d5373 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:58.992110 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af6df4b4-f624-47db-bb97-02175f7d5373 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.086513 Oct 28 17:27:59.023004 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.039025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-664c1db1-19fe-4a2a-83b4-f22d3019b7c7 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.093658 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-664c1db1-19fe-4a2a-83b4-f22d3019b7c7 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1773189835" status: 202 len: 0 microversion: 2.1 time: 0.068356 Oct 28 17:27:59.101970 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 52/95] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:27:59 2022] DELETE /compute/v2.1/flavors/1773189835 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:59.110692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bdbe329-e09e-4ebc-8943-d8f13d400cb3 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.120802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96437f96-449e-4770-a124-6dffcbf5e147 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:59.129534 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96437f96-449e-4770-a124-6dffcbf5e147 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1242 microversion: 2.1 time: 0.258384 Oct 28 17:27:59.150661 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 44/96] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:58 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1242 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.230875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bdbe329-e09e-4ebc-8943-d8f13d400cb3 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.127441 Oct 28 17:27:59.232130 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 53/97] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.252967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8818986-75c9-4bdf-b05f-18750182fa3b tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.314459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8818986-75c9-4bdf-b05f-18750182fa3b tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/922421815" status: 202 len: 0 microversion: 2.1 time: 0.065784 Oct 28 17:27:59.315885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 45/98] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:27:59 2022] DELETE /compute/v2.1/flavors/922421815 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:59.327114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9eb65b4e-d37c-4a97-86ae-0ce4a6aa434f tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.346144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.351127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:27:59.377873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:59.381890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:59.382470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:59.386493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:27:59.387066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:27:59.388672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:27:59.395754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9eb65b4e-d37c-4a97-86ae-0ce4a6aa434f tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074202 Oct 28 17:27:59.408750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 54/99] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.435633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1092b72-0b8a-4ac6-969a-a7d3a0d3ed08 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-250227981", "id": 992673789, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:59.486057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1092b72-0b8a-4ac6-969a-a7d3a0d3ed08 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.054097 Oct 28 17:27:59.495723 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 55/100] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:27:59.507281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3b7ffaf-bd5f-4493-8c05-6dca68678278 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.593842 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3b7ffaf-bd5f-4493-8c05-6dca68678278 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091599 Oct 28 17:27:59.599593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 56/101] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.616892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3263fca-932b-46b0-a099-a664ce7c620e tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.694249 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3263fca-932b-46b0-a099-a664ce7c620e tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081000 Oct 28 17:27:59.697507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 57/102] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:27:59.720120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5fa77ffe-b915-4441-8c21-a9eaefb41430 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.763152 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5fa77ffe-b915-4441-8c21-a9eaefb41430 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/992673789" status: 202 len: 0 microversion: 2.1 time: 0.049204 Oct 28 17:27:59.764043 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 58/103] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:27:59 2022] DELETE /compute/v2.1/flavors/992673789 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:27:59.772281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f470aef0-65d6-438b-9426-f54cffcbccf2 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.810278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f470aef0-65d6-438b-9426-f54cffcbccf2 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041625 Oct 28 17:27:59.816266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 59/104] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.843674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fdbca06-c2b8-44bf-a0db-48e5c44fd1e9 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-759595755", "id": 698608079, "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:27:59.888275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:27:59.899767 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8f45848-da36-446e-af54-08314486c3d2 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.566033 Oct 28 17:27:59.900002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fdbca06-c2b8-44bf-a0db-48e5c44fd1e9 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.063376 Oct 28 17:27:59.904743 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 60/105] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:27:59 2022] POST /compute/v2.1/flavors => generated 410 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:27:59.905470 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 46/106] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:27:59.943502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ee10484-d705-4c21-ab51-f4e827b59539 tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:27:59.998099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ee10484-d705-4c21-ab51-f4e827b59539 tempest-FlavorsAdminTestJSON-1178598635 tempest-FlavorsAdminTestJSON-1178598635-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.080304 Oct 28 17:28:00.000067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 61/107] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:27:59 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:00.023241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0d01f85-dd65-4269-b8b6-50c42075267e tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:00.060702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0d01f85-dd65-4269-b8b6-50c42075267e tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/698608079" status: 202 len: 0 microversion: 2.1 time: 0.041139 Oct 28 17:28:00.061851 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 47/108] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:28:00 2022] DELETE /compute/v2.1/flavors/698608079 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:00.070889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9110863-41c8-41c4-ac1e-dc90a382a3c5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:00.118640 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9110863-41c8-41c4-ac1e-dc90a382a3c5 tempest-FlavorsAdminTestJSON-1722360471 tempest-FlavorsAdminTestJSON-1722360471-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051805 Oct 28 17:28:00.119682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 62/109] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:00.165051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:00.165882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:00.175773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:00.180249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:00.181120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:00.183020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:00.184957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:00.187466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:00.340904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:00.350476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ebc11d6-cbc0-4820-9e86-043111f63886 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.193948 Oct 28 17:28:00.373145 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 48/110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:00 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:00.931674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:00.932281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:00.944546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:00.944909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:00.945352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:00.946059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:00.946673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:00.948385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.177702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:01.186850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8000a0ad-778a-420f-9413-d0bb0717c8f1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.258902 Oct 28 17:28:01.204530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 49/111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:00 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:01.378990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:01.380540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:01.399252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:01.399615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41025789-7952-4f81-a195-8f899c802154", "tag": "e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:01.400546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:01.401143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.402272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:01.403812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:01.404415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.424924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:01.425420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:01.427296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.442781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:01.452127 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Creating event network-changed:e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7 for instance 41025789-7952-4f81-a195-8f899c802154 on n-h2-860864-13 Oct 28 17:28:01.453346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:28:01.454481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9d6630e-64a7-4ef8-b12e-29a8cd3e1fef req-5d9ed4af-6258-4220-ba39-4bc5bf5b434c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:28:01.455821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:01.456631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:01.457224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.458479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:01.459094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:01.459781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:01.472137 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.rpcapi [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 17:28:01.473306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] Releasing lock "compute-rpcapi-router" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:28:01.501438 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5742ebef-e855-47a2-b68e-1bdbb4166fdc None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.593691 Oct 28 17:28:01.504596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 63/112] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:01.545876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:01.556476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00cc10f5-d16c-46ca-a2d1-def59a8e9f0c tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.182349 Oct 28 17:28:01.557297 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 50/113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:01 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:02.215451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:02.216175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:02.224627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.225120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.225555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.226264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.226718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.227138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.440513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:02.452439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d606e2b-b1db-43fc-a249-8755370942c9 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.241848 Oct 28 17:28:02.461281 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 51/114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:02 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:02.583626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:02.584240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:02.602149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.602646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.603190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.607241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.607786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.608219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.720287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:02.729658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a400998-270e-4637-8c3a-b7d43c0623c5 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.149757 Oct 28 17:28:02.730551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 52/115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:02 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:02.804947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Calling method '.version_select at 0x7f7524efe940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:02.806784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.807263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.807726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.826729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.827428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.828028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.842957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.852322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.852835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.860428 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-253d3fcd-e40d-4e41-8b2e-877918a6e780 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.676452 Oct 28 17:28:02.863781 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 64/116] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:02.872077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Calling method '.version_select at 0x7f75251090d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:02.874705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.875277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.876050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.924673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:DELETE=18,nova_api:SELECT=80,nova_api:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:02.934419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:02.941701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:02.942537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:02.951748 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ef9e447-0f51-4b30-9f14-6d3f1e84de64 tempest-HypervisorAdminV228Test-1546190112 tempest-HypervisorAdminV228Test-1546190112-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.083879 Oct 28 17:28:02.961180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 53/117] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:28:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:03.482875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:03.483565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:03.496540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:03.498891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:03.503452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:03.504386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:03.505085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:03.505528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:03.788555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:03.801957 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3133f98-f158-4db0-84e9-32a8cbe209be tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.322606 Oct 28 17:28:03.817047 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 54/118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:03 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:03.830381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:03.830920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:03.839704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:03.840437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:03.841193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:03.841888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8ae1d61-d77d-48a6-ac48-fa4232925b23 tempest-AZAdminNegativeTestJSON-1011085874 tempest-AZAdminNegativeTestJSON-1011085874-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:03.842741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:03.843473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:03.843676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8ae1d61-d77d-48a6-ac48-fa4232925b23 tempest-AZAdminNegativeTestJSON-1011085874 tempest-AZAdminNegativeTestJSON-1011085874-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd8c238c141174f8e8be9f0b907c55616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ddd9f70ae6d4d40b38e78dffb672db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:03.844929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8ae1d61-d77d-48a6-ac48-fa4232925b23 tempest-AZAdminNegativeTestJSON-1011085874 tempest-AZAdminNegativeTestJSON-1011085874-project] Request method failure captured: Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEgP2oLKyOLmGHpDBA8HYMxq4d1gKPzZfKEv-3aYvh-ADDSvZuj-0CMOix5mTmVd7_Kh0eK47IRTNKgTozKGF58EjXMc4y1dZy39OQTDCZYaufmsIjVYB4XvppdznKYypvr8KFV2r7wRNIZDLTb49WwOepvXe2WSA0kGkjiPcAbmRs Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 3ddd9f70ae6d4d40b38e78dffb672db0 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1011085874 Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:03.846586 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ddd9f70ae6d4d40b38e78dffb672db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3ddd9f70ae6d4d40b38e78dffb672db0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3ddd9f70ae6d4d40b38e78dffb672db0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3ddd9f70ae6d4d40b38e78dffb672db0"}]}] Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AZAdminNegativeTestJSON-1011085874 Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 3ddd9f70ae6d4d40b38e78dffb672db0 Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1011085874 Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AZAdminNegativeTestJSON-1011085874-project Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d8c238c141174f8e8be9f0b907c55616 Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AZAdminNegativeTestJSON-1011085874-project Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 17:28:03.848277 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:03.849645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:03.850869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8ae1d61-d77d-48a6-ac48-fa4232925b23 tempest-AZAdminNegativeTestJSON-1011085874 tempest-AZAdminNegativeTestJSON-1011085874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:03.852082 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8ae1d61-d77d-48a6-ac48-fa4232925b23 tempest-AZAdminNegativeTestJSON-1011085874 tempest-AZAdminNegativeTestJSON-1011085874-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.592408 Oct 28 17:28:03.852082 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 65/119] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:28:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 594 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:03.946010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:03.954971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8218068e-1263-4481-87d5-ce1edea5cd91 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.136573 Oct 28 17:28:03.955593 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 55/120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:03 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:04.793790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-108dc2f4-05f1-45a5-a693-d44c071dbba7 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Calling method '.version_select at 0x7f7524ea4430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:04.796440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-108dc2f4-05f1-45a5-a693-d44c071dbba7 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2f702f8094be4662a1f1d9b159f1c090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9d37001f2246f6a08acaa54503d6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-108dc2f4-05f1-45a5-a693-d44c071dbba7 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Request method failure captured: Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEh0_n9mFmWLIgKAKY11duIzqJ1oKzHLtE_ggaJcylY32_SSSdOqvfimvaf-6k7An3wMTs45cKvRYdSVVFSaDOgVGzHRY1dyNFa0mQ8VtvO9Rmwn0Gxf3oPfvkLHO3geO5QJ6WXvHu9z1d2csIE-dmMpSIXJqdf4VsfE0yjtYEu3ak Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:04.798610 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b9d37001f2246f6a08acaa54503d6ea"}]}] Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 2f702f8094be4662a1f1d9b159f1c090 Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:28:04.800033 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:04.800939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 17:28:04.802282 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.803663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-108dc2f4-05f1-45a5-a693-d44c071dbba7 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:04.803663 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-108dc2f4-05f1-45a5-a693-d44c071dbba7 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.537620 Oct 28 17:28:04.806707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 66/121] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:28:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:04.811695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53b96ceb-a502-4b3a-a624-94866a53deee tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Calling method '.version_select at 0x7f75251e8280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:04.815209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53b96ceb-a502-4b3a-a624-94866a53deee tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2f702f8094be4662a1f1d9b159f1c090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9d37001f2246f6a08acaa54503d6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53b96ceb-a502-4b3a-a624-94866a53deee tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Request method failure captured: Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEh0_n9mFmWLIgKAKY11duIzqJ1oKzHLtE_ggaJcylY32_SSSdOqvfimvaf-6k7An3wMTs45cKvRYdSVVFSaDOgVGzHRY1dyNFa0mQ8VtvO9Rmwn0Gxf3oPfvkLHO3geO5QJ6WXvHu9z1d2csIE-dmMpSIXJqdf4VsfE0yjtYEu3ak Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:04.817320 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b9d37001f2246f6a08acaa54503d6ea"}]}] Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 2f702f8094be4662a1f1d9b159f1c090 Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: action_args: {} Oct 28 17:28:04.818642 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:04.819508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 17:28:04.820723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.822456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53b96ceb-a502-4b3a-a624-94866a53deee tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:04.822456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53b96ceb-a502-4b3a-a624-94866a53deee tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013768 Oct 28 17:28:04.827128 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 56/122] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:04 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:04.836492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:04.841115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e62377ec-71d7-43fa-99c2-a6b8d694cd8a tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Calling method '.version_select at 0x7f75251094c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:04.843128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e62377ec-71d7-43fa-99c2-a6b8d694cd8a tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2f702f8094be4662a1f1d9b159f1c090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9d37001f2246f6a08acaa54503d6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:04.846272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e62377ec-71d7-43fa-99c2-a6b8d694cd8a tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Request method failure captured: Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEh0_n9mFmWLIgKAKY11duIzqJ1oKzHLtE_ggaJcylY32_SSSdOqvfimvaf-6k7An3wMTs45cKvRYdSVVFSaDOgVGzHRY1dyNFa0mQ8VtvO9Rmwn0Gxf3oPfvkLHO3geO5QJ6WXvHu9z1d2csIE-dmMpSIXJqdf4VsfE0yjtYEu3ak Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:04.848448 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b9d37001f2246f6a08acaa54503d6ea"}]}] Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 2f702f8094be4662a1f1d9b159f1c090 Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: action_args: {} Oct 28 17:28:04.850150 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:04.851047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 17:28:04.852399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:04.855161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e62377ec-71d7-43fa-99c2-a6b8d694cd8a tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:04.856026 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e62377ec-71d7-43fa-99c2-a6b8d694cd8a tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026223 Oct 28 17:28:04.856575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 57/123] 10.222.0.48 () {58 vars in 1179 bytes} [Fri Oct 28 17:28:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:04.867212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:04.868008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:04.868701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:04.869514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:04.870118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:04.870613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.073434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:05.088411 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b0b7f9a-7237-41e5-bce7-856eb863a928 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.257604 Oct 28 17:28:05.090825 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 67/124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:04 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:05.098446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.099432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:05.107510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.108138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.108622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.109442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.110145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.110664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.222668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:05.251324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Calling method '.version_select at 0x7f7525109430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.258684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.262030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.263210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.275278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73f7cc4a-c205-4921-91fe-c5e4ada3e1b2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.182687 Oct 28 17:28:05.279845 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 68/125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:05.308941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.309435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.310207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.323833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.324861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.325578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.333152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93b36956-14df-484f-baf3-cc10ea7884c8 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.469362 Oct 28 17:28:05.334196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 58/126] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:05.345880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cffaf964-0991-486e-a6a3-e393c4bcd893 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Calling method '.version_select at 0x7f7525109670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.347808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cffaf964-0991-486e-a6a3-e393c4bcd893 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2f702f8094be4662a1f1d9b159f1c090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9d37001f2246f6a08acaa54503d6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cffaf964-0991-486e-a6a3-e393c4bcd893 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Request method failure captured: Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEh0_n9mFmWLIgKAKY11duIzqJ1oKzHLtE_ggaJcylY32_SSSdOqvfimvaf-6k7An3wMTs45cKvRYdSVVFSaDOgVGzHRY1dyNFa0mQ8VtvO9Rmwn0Gxf3oPfvkLHO3geO5QJ6WXvHu9z1d2csIE-dmMpSIXJqdf4VsfE0yjtYEu3ak Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:05.349794 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b9d37001f2246f6a08acaa54503d6ea"}]}] Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 2f702f8094be4662a1f1d9b159f1c090 Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1'} Oct 28 17:28:05.351098 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:05.351955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 17:28:05.353138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.356311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cffaf964-0991-486e-a6a3-e393c4bcd893 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:05.357344 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cffaf964-0991-486e-a6a3-e393c4bcd893 tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015947 Oct 28 17:28:05.358426 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 59/127] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:05.371930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82477274-15c3-499c-965a-f4877b419c59 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Calling method '.version_select at 0x7f75251c6ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.373903 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-82477274-15c3-499c-965a-f4877b419c59 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] HTTP exception thrown: Hypervisor with ID '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' could not be found. Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82477274-15c3-499c-965a-f4877b419c59 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Request method failure captured: Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/2e8bcf54-e5ed-4c66-896f-6a7a7457e173/uptime HTTP/1.1 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEke_uBoigGzWpMVX1F2KukoCjGG-2OBrcmdLGxYYWal8B049uvwpyuFhE0kao446jTnXyoLk7JPFXU-x0dJnxIT41_IJyInZs7_AuFgwSMLyCuWi7CwUjNubbMNh1CvMfUT4F3iGk6W73uQfsTPLcYFeEks8_D7YCkwynGStJUU80 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0370f89bc74b46988b6fb58d9826c499 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:05.388868 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0370f89bc74b46988b6fb58d9826c499"}]}] Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0370f89bc74b46988b6fb58d9826c499 Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ac4a907b0b7b42f99b58ce4f5de5f426 Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: exception: Hypervisor with ID '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' could not be found. Oct 28 17:28:05.390351 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2e8bcf54-e5ed-4c66-896f-6a7a7457e173'} Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 17:28:05.391744 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' could not be found. Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.396807 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' could not be found. Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82477274-15c3-499c-965a-f4877b419c59 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Returning 404 to user: Hypervisor with ID '2e8bcf54-e5ed-4c66-896f-6a7a7457e173' could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82477274-15c3-499c-965a-f4877b419c59 tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2e8bcf54-e5ed-4c66-896f-6a7a7457e173/uptime" status: 404 len: 123 microversion: 2.1 time: 0.026955 Oct 28 17:28:05.398555 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 60/128] 10.222.0.48 () {58 vars in 1278 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/os-hypervisors/2e8bcf54-e5ed-4c66-896f-6a7a7457e173/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:05.401590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Calling method '.version_select at 0x7f7525109820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.403549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.404317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.405206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.422903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.423892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.424446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.442114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:05.442596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:05.443318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:05.451951 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3dcd44a3-e939-48c1-b6b2-819bab247b5a tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054067 Oct 28 17:28:05.459139 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 61/129] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:05.467597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c002431c-1b58-4b5f-9f4b-3b5034c8f0fb tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Calling method '.version_select at 0x7f7525109940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.471108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c002431c-1b58-4b5f-9f4b-3b5034c8f0fb tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2f702f8094be4662a1f1d9b159f1c090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b9d37001f2246f6a08acaa54503d6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c002431c-1b58-4b5f-9f4b-3b5034c8f0fb tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Request method failure captured: Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEh0_n9mFmWLIgKAKY11duIzqJ1oKzHLtE_ggaJcylY32_SSSdOqvfimvaf-6k7An3wMTs45cKvRYdSVVFSaDOgVGzHRY1dyNFa0mQ8VtvO9Rmwn0Gxf3oPfvkLHO3geO5QJ6WXvHu9z1d2csIE-dmMpSIXJqdf4VsfE0yjtYEu3ak Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:05.471769 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6b9d37001f2246f6a08acaa54503d6ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6b9d37001f2246f6a08acaa54503d6ea"}]}] Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6b9d37001f2246f6a08acaa54503d6ea Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-608765652 Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 2f702f8094be4662a1f1d9b159f1c090 Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-608765652-project Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1'} Oct 28 17:28:05.472880 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:05.473534 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 17:28:05.474931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.475922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c002431c-1b58-4b5f-9f4b-3b5034c8f0fb tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:05.475922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c002431c-1b58-4b5f-9f4b-3b5034c8f0fb tempest-HypervisorAdminNegativeTestJSON-608765652 tempest-HypervisorAdminNegativeTestJSON-608765652-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.012481 Oct 28 17:28:05.475922 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 62/130] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:05.485765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-622d33c4-7ddc-4270-84a9-5c05f76dcc4f tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Calling method '.version_select at 0x7f75251e8b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.487685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-622d33c4-7ddc-4270-84a9-5c05f76dcc4f tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] HTTP exception thrown: Hypervisor with ID '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' could not be found. Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-622d33c4-7ddc-4270-84a9-5c05f76dcc4f tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Request method failure captured: Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c HTTP/1.1 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEke_uBoigGzWpMVX1F2KukoCjGG-2OBrcmdLGxYYWal8B049uvwpyuFhE0kao446jTnXyoLk7JPFXU-x0dJnxIT41_IJyInZs7_AuFgwSMLyCuWi7CwUjNubbMNh1CvMfUT4F3iGk6W73uQfsTPLcYFeEks8_D7YCkwynGStJUU80 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0370f89bc74b46988b6fb58d9826c499 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:05.490165 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0370f89bc74b46988b6fb58d9826c499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0370f89bc74b46988b6fb58d9826c499"}]}] Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0370f89bc74b46988b6fb58d9826c499 Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696 Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ac4a907b0b7b42f99b58ce4f5de5f426 Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: exception: Hypervisor with ID '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' could not be found. Oct 28 17:28:05.491252 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c'} Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 17:28:05.491956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:05.493092 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' could not be found. Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' could not be found. Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-622d33c4-7ddc-4270-84a9-5c05f76dcc4f tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] Returning 404 to user: Hypervisor with ID '2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c' could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:05.494076 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-622d33c4-7ddc-4270-84a9-5c05f76dcc4f tempest-HypervisorAdminNegativeTestJSON-1333867696 tempest-HypervisorAdminNegativeTestJSON-1333867696-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c" status: 404 len: 123 microversion: 2.1 time: 0.010823 Oct 28 17:28:05.496936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 63/131] 10.222.0.48 () {58 vars in 1257 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/os-hypervisors/2bc555c7-bfeb-4d2d-8459-f0e6311b3d2c => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:05.576627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af9f3d92-1dc4-470b-9384-3f8c03c071cf tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1721817010", "ram": 512, "vcpus": 1, "disk": 10, "id": 1853474898, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:05.594365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:05.599561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af9f3d92-1dc4-470b-9384-3f8c03c071cf tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.314490 Oct 28 17:28:05.600700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 69/132] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:05 2022] POST /compute/v2.1/flavors => generated 416 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:05.969745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82bf3b20-d19e-425e-94ee-46a5b1ecbb4a tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:05.987720 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-82bf3b20-d19e-425e-94ee-46a5b1ecbb4a tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] HTTP exception thrown: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82bf3b20-d19e-425e-94ee-46a5b1ecbb4a tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Request method failure captured: Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEiRVHzzmvYoEJMc7Tpost5iEEsEjmCLXGIM6dqzVCnxf_ngYwbQsdQ6LNJux--5ALsvbPBbkTQXIF2vhtSf_hRo6_yuIlPft6KW4KwnE2gbAqzrFVXq1wkOocOFFoZ-gF6zFtCFo62YD9nb-7Rs4ak07_UQ_VZZewS92Y-y1JsJKM Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:05.989657 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26ada4f1b7e642cc8fb3c539e13f8dba"}]}] Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 92943594788741cc8da64c46ef1a0a80 Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:05.990996 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1853474898', 'id': 'hw:cpu_thread_policy'} Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:05.991760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:05.993136 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:05.994355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82bf3b20-d19e-425e-94ee-46a5b1ecbb4a tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Returning 404 to user: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:05.995742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82bf3b20-d19e-425e-94ee-46a5b1ecbb4a tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] 10.222.0.48 "GET /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.385611 Oct 28 17:28:05.996424 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 64/133] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:28:05 2022] GET /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:06.007746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ac79438-8121-47e8-b1ba-032e5886b14b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.011781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ac79438-8121-47e8-b1ba-032e5886b14b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '92943594788741cc8da64c46ef1a0a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ada4f1b7e642cc8fb3c539e13f8dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ac79438-8121-47e8-b1ba-032e5886b14b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Request method failure captured: Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/flavors/1853474898/os-extra_specs HTTP/1.1 Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 66 Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEiRVHzzmvYoEJMc7Tpost5iEEsEjmCLXGIM6dqzVCnxf_ngYwbQsdQ6LNJux--5ALsvbPBbkTQXIF2vhtSf_hRo6_yuIlPft6KW4KwnE2gbAqzrFVXq1wkOocOFFoZ-gF6zFtCFo62YD9nb-7Rs4ak07_UQ_VZZewS92Y-y1JsJKM Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:06.013903 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26ada4f1b7e642cc8fb3c539e13f8dba"}]}] Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 92943594788741cc8da64c46ef1a0a80 Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 28 17:28:06.015295 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'flavor_id': '1853474898', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:06.016716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 17:28:06.017961 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.019887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ac79438-8121-47e8-b1ba-032e5886b14b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.020949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ac79438-8121-47e8-b1ba-032e5886b14b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] 10.222.0.48 "POST /compute/v2.1/flavors/1853474898/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.018162 Oct 28 17:28:06.021536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 70/134] 10.222.0.48 () {60 vars in 1224 bytes} [Fri Oct 28 17:28:06 2022] POST /compute/v2.1/flavors/1853474898/os-extra_specs => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:06.033775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c448f52e-3936-482c-9505-da675e23b6a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.063706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c448f52e-3936-482c-9505-da675e23b6a9 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1853474898/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034725 Oct 28 17:28:06.064384 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 65/135] 10.222.0.48 () {60 vars in 1224 bytes} [Fri Oct 28 17:28:06 2022] POST /compute/v2.1/flavors/1853474898/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:06.077377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3022807b-5e01-417b-8661-6d640056a04b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.077377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3022807b-5e01-417b-8661-6d640056a04b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '92943594788741cc8da64c46ef1a0a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ada4f1b7e642cc8fb3c539e13f8dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3022807b-5e01-417b-8661-6d640056a04b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Request method failure captured: Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEiRVHzzmvYoEJMc7Tpost5iEEsEjmCLXGIM6dqzVCnxf_ngYwbQsdQ6LNJux--5ALsvbPBbkTQXIF2vhtSf_hRo6_yuIlPft6KW4KwnE2gbAqzrFVXq1wkOocOFFoZ-gF6zFtCFo62YD9nb-7Rs4ak07_UQ_VZZewS92Y-y1JsJKM Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:06.079724 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26ada4f1b7e642cc8fb3c539e13f8dba"}]}] Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 92943594788741cc8da64c46ef1a0a80 Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:06.081082 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'flavor_id': '1853474898', 'id': 'hw:numa_nodes'} Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:06.081704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.083564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3022807b-5e01-417b-8661-6d640056a04b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.084543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3022807b-5e01-417b-8661-6d640056a04b tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] 10.222.0.48 "DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010741 Oct 28 17:28:06.084543 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:28:06 2022] DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:06.090948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e29a866-eb6e-4118-ab3a-8203ce86f034 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.118768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e29a866-eb6e-4118-ab3a-8203ce86f034 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1853474898/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031595 Oct 28 17:28:06.122539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.123335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:06.124378 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 66/137] 10.222.0.48 () {60 vars in 1224 bytes} [Fri Oct 28 17:28:06 2022] POST /compute/v2.1/flavors/1853474898/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:06.129732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dfd92d1-bbac-48ca-8aa4-38e2eb0e7f9c tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.133051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0dfd92d1-bbac-48ca-8aa4-38e2eb0e7f9c tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '92943594788741cc8da64c46ef1a0a80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ada4f1b7e642cc8fb3c539e13f8dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dfd92d1-bbac-48ca-8aa4-38e2eb0e7f9c tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Request method failure captured: Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 22 Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEiRVHzzmvYoEJMc7Tpost5iEEsEjmCLXGIM6dqzVCnxf_ngYwbQsdQ6LNJux--5ALsvbPBbkTQXIF2vhtSf_hRo6_yuIlPft6KW4KwnE2gbAqzrFVXq1wkOocOFFoZ-gF6zFtCFo62YD9nb-7Rs4ak07_UQ_VZZewS92Y-y1JsJKM Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:06.134929 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26ada4f1b7e642cc8fb3c539e13f8dba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26ada4f1b7e642cc8fb3c539e13f8dba"}]}] Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 26ada4f1b7e642cc8fb3c539e13f8dba Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 92943594788741cc8da64c46ef1a0a80 Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: {"hw:numa_nodes": "1"} Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:06.136409 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1853474898', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:06.137173 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 17:28:06.138584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.139791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dfd92d1-bbac-48ca-8aa4-38e2eb0e7f9c tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.139791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0dfd92d1-bbac-48ca-8aa4-38e2eb0e7f9c tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531 tempest-FlavorsExtraSpecsNegativeTestJSON-1225116531-project] 10.222.0.48 "PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010937 Oct 28 17:28:06.141547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 67/138] 10.222.0.48 () {60 vars in 1265 bytes} [Fri Oct 28 17:28:06 2022] PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:06.144057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:06.146141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35d01acf-602d-4aca-880d-882e5300074a tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.148022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:06.148495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:06.152500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:06.153398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:06.154218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-35d01acf-602d-4aca-880d-882e5300074a tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] HTTP exception thrown: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:06.154975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35d01acf-602d-4aca-880d-882e5300074a tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Request method failure captured: Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEkOPBquZN0492CATfIpc6NlXxAuyJ2uAbvTNBNY937Q4ia5vgvUSOCqThQrAopcPhj9geWw33T1t5qjzM4OwWkVONpRSJ3ChcAB8rakprnMZrCkoxYGUsBSV7xkKQp8XfR9DahvrX3tBLHrnyDYlemKAeZfufQSRIkIyTYCtXtyNY Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:06.155832 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f495a6efa6ea4790a4ab5169f3257752"}]}] Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3f29e83e02e3475995dbf05fe6595584 Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:06.157805 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1853474898', 'id': 'hw:cpu_thread_policy'} Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.159111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35d01acf-602d-4aca-880d-882e5300074a tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Returning 404 to user: Flavor 1853474898 has no extra specs with key hw:cpu_thread_policy. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35d01acf-602d-4aca-880d-882e5300074a tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015255 Oct 28 17:28:06.160767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:28:06 2022] DELETE /compute/v2.1/flavors/1853474898/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:06.169091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a488802-3cad-47bb-b262-ceb14b6b0cbd tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.172582 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6a488802-3cad-47bb-b262-ceb14b6b0cbd tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a488802-3cad-47bb-b262-ceb14b6b0cbd tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Request method failure captured: Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 27 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEkOPBquZN0492CATfIpc6NlXxAuyJ2uAbvTNBNY937Q4ia5vgvUSOCqThQrAopcPhj9geWw33T1t5qjzM4OwWkVONpRSJ3ChcAB8rakprnMZrCkoxYGUsBSV7xkKQp8XfR9DahvrX3tBLHrnyDYlemKAeZfufQSRIkIyTYCtXtyNY Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:06.175420 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f495a6efa6ea4790a4ab5169f3257752"}]}] Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3f29e83e02e3475995dbf05fe6595584 Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: {"hw:cpu_policy": "shared"} Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:06.176737 n-d-860864-13 devstack@n-api.service[120567]: exception: Request body and URI mismatch Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1853474898', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.177634 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a488802-3cad-47bb-b262-ceb14b6b0cbd tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.178782 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a488802-3cad-47bb-b262-ceb14b6b0cbd tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.011153 Oct 28 17:28:06.180699 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 69/140] 10.222.0.48 () {60 vars in 1265 bytes} [Fri Oct 28 17:28:06 2022] PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:28:06.186153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2f0e9dc-7047-447f-b428-6b96805c3537 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2f0e9dc-7047-447f-b428-6b96805c3537 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Request method failure captured: Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 49 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEkOPBquZN0492CATfIpc6NlXxAuyJ2uAbvTNBNY937Q4ia5vgvUSOCqThQrAopcPhj9geWw33T1t5qjzM4OwWkVONpRSJ3ChcAB8rakprnMZrCkoxYGUsBSV7xkKQp8XfR9DahvrX3tBLHrnyDYlemKAeZfufQSRIkIyTYCtXtyNY Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:06.191789 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f495a6efa6ea4790a4ab5169f3257752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f495a6efa6ea4790a4ab5169f3257752"}]}] Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f495a6efa6ea4790a4ab5169f3257752 Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3f29e83e02e3475995dbf05fe6595584 Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 28 17:28:06.193026 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1853474898', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance: Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 28 17:28:06.193833 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.195178 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 17:28:06.196343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:06.197485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2f0e9dc-7047-447f-b428-6b96805c3537 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:06.198464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2f0e9dc-7047-447f-b428-6b96805c3537 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016649 Oct 28 17:28:06.204486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 70/141] 10.222.0.48 () {60 vars in 1265 bytes} [Fri Oct 28 17:28:06 2022] PUT /compute/v2.1/flavors/1853474898/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:28:06.210262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f80c487-4d12-43a1-8d7a-e91808aae71f tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.235454 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f80c487-4d12-43a1-8d7a-e91808aae71f tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1853474898" status: 202 len: 0 microversion: 2.1 time: 0.028943 Oct 28 17:28:06.236487 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 71/142] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:28:06 2022] DELETE /compute/v2.1/flavors/1853474898 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:06.244906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-faf7d7bb-476e-4bad-9273-3783c49cd60c tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.268749 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-faf7d7bb-476e-4bad-9273-3783c49cd60c tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607 tempest-FlavorsExtraSpecsNegativeTestJSON-1481452607-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027403 Oct 28 17:28:06.269903 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 72/143] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:06.303217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:06.304266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:06.312396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:06.313016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:06.313578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:06.314288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:06.314732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:06.315322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:06.319764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:06.440661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:06.454827 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ef214f73-4448-430a-b6fc-c78194823f21 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1290 microversion: 2.1 time: 0.155309 Oct 28 17:28:06.471122 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 73/144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:06 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1290 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:06.472164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:06.479597 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d6a39e0-3690-4cd8-a764-158bba34f23a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.366853 Oct 28 17:28:06.482380 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 72/145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:06 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:07.479433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:07.480204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:07.488880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:07.490009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:07.490599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:07.491738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:07.492277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:07.492779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:07.505221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:07.505836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:07.518432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:07.518941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:07.519406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:07.520134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:07.520591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:07.521737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:07.705075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:07.721663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6f5f192-b4d0-40a6-b006-d9e4e23e30be tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1296 microversion: 2.1 time: 0.245630 Oct 28 17:28:07.735410 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 74/146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:07 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1296 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:07.847396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:07.887815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:07.900819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9727b1a7-d859-459c-b15b-668ea6905d34 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.400904 Oct 28 17:28:07.905060 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:07 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:08.497639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-386624cb-2b27-40a6-b411-fc075d7c6728 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-644056737", "id": 2146437224, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:08.523129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-386624cb-2b27-40a6-b411-fc075d7c6728 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.325129 Oct 28 17:28:08.523931 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 75/148] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:28:08 2022] POST /compute/v2.1/flavors => generated 470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:08.537407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffe57c79-b13a-41d4-bbe8-4a2b4058a239 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:08.742444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffe57c79-b13a-41d4-bbe8-4a2b4058a239 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/2146437224/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.209003 Oct 28 17:28:08.744532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 74/149] 10.222.0.48 () {62 vars in 1265 bytes} [Fri Oct 28 17:28:08 2022] POST /compute/v2.1/flavors/2146437224/os-extra_specs => generated 62 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:08.755015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:08.756697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:08.760767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-914f8087-e4d3-48e0-8947-3bcad9ba0383 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:08.773424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:08.777040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:08.777699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:08.780897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:08.782328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:08.785810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:08.800960 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-914f8087-e4d3-48e0-8947-3bcad9ba0383 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2146437224" status: 202 len: 0 microversion: 2.86 time: 0.047990 Oct 28 17:28:08.803540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 75/150] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Oct 28 17:28:08 2022] DELETE /compute/v2.1/flavors/2146437224 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:08.816332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac24e948-5952-43fa-91d2-1cdd139f6f98 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:08.886143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac24e948-5952-43fa-91d2-1cdd139f6f98 tempest-FlavorMetadataValidation-1921269928 tempest-FlavorMetadataValidation-1921269928-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.074214 Oct 28 17:28:08.888542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 76/151] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:08.931557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:08.932237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:08.943170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:08.944739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:08.945187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:08.947768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:08.948267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:08.949156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:09.056014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:09.066853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09bc458b-8e92-47d8-87f7-f40351a473f9 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.319192 Oct 28 17:28:09.080545 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 76/152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:08 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:09.238706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:09.247802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-653ec462-4e1a-41c1-a61f-720cbed177c8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.323277 Oct 28 17:28:09.248724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 77/153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:08 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:10.106713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:10.107336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:10.109255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:10.121585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:10.122073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:10.124981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:10.127547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:10.128572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:10.131704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:10.277239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:10.278713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:10.287765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:10.289158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:10.289603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:10.291474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:10.291956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:10.292391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:10.558419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:10.571532 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9974ab8-daae-45f9-ac1a-ab439b22fa21 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.301991 Oct 28 17:28:10.572862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:10 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:10.581757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:10.590444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3255a894-b56b-4d93-aca1-041130ff8122 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.488853 Oct 28 17:28:10.605946 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 77/155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:10 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:10.809402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-50382115", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:10.905214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:11.470454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:11.594561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:11.595313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:11.605484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.606233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.607155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.608709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.610101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.611090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.628919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:11.629333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:11.629831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:11.630418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:11.630742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:11.643731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.644713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.645777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.646869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.647513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.648502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.685681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:11.691929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for user d6161a967d6549ea8275b2d9dd98aa02 and project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:11.706785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:28:11.710647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:28:11.783824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5702cbe9-c06d-42d9-b634-d5038755884e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209451 Oct 28 17:28:11.784621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 79/156] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:28:11.790476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:11.791353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:11.799445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.800377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.800952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.801809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:11.802409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:11.802836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:11.840978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:12.038332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:12.054338 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-047b3192-59e4-45f5-83ae-fa4ec8e8b7a4 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.462715 Oct 28 17:28:12.057771 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 78/157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:11 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:12.159418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:12.167593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a9e3732-ed46-4186-aeb6-986fe44f159f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.381528 Oct 28 17:28:12.174634 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:11 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:12.179756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-586517106", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:12.264794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:12.487100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e7890f-a186-4215-85ec-4dbfd7ba0510", "tag": "d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:12.512392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:12.520983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:12.521987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:12.564631 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Creating event network-changed:d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21 for instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 on n-h2-860864-13 Oct 28 17:28:12.572672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:28:12.574977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-15e9b197-89d4-47a8-b212-f12a7bb0be7f req-6237b237-6ef1-4861-9575-84b14a55b0eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:28:12.576478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:12.579689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:12.580736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:12.581818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:12.584321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:12.585186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:12.605493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.compute.rpcapi [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 17:28:12.610177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] Releasing lock "compute-rpcapi-router" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:28:12.640526 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7ea062a-f25b-4d15-8611-036793958c81 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.580113 Oct 28 17:28:12.643897 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 79/159] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:12.681091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:12.681571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:12.688674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:12.689525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:12.690643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:12.706340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:12.707602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:12.708573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:12.710734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:12.711874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:12.712670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:12.735741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:12.739838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for user d6161a967d6549ea8275b2d9dd98aa02 and project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:12.755342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:28:12.757711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:28:12.807296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6b168c0-2245-4a39-8ef5-f88354e470d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631304 Oct 28 17:28:12.808050 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 81/160] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:28:12.822124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf74410a-1807-43e8-9dca-ea695167f187 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:12.823032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf74410a-1807-43e8-9dca-ea695167f187 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:12.908767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf74410a-1807-43e8-9dca-ea695167f187 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:12.918008 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf74410a-1807-43e8-9dca-ea695167f187 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1213 microversion: 2.1 time: 0.101077 Oct 28 17:28:12.919400 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:12 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:13.080029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:13.081028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:13.087940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:13.088510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:13.089147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:13.090085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:13.090658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:13.091349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:13.202301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9574b0ac-78fc-4424-8f78-ea4e288633f6 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1791594806", "id": 1097771064, "os-flavor-access:is_public": "False"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:13.234989 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9574b0ac-78fc-4424-8f78-ea4e288633f6 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.544855 Oct 28 17:28:13.252351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 80/162] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:13.276453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:13.277379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:13.295780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:13.295923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:13.296637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:13.299926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:13.301002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:13.301613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:13.302173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:13.317298 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7e0cf82-55a1-481f-b2a7-bc762f031910 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.241569 Oct 28 17:28:13.329470 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 83/163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:13 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:13.336374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5cc059a2-6142-483a-9efa-b7f789bb3fdf tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:13.649826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:13.663191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-281a529c-6a47-4b06-81ba-108f68d02724 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.406099 Oct 28 17:28:13.665404 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:13 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:13.917078 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5cc059a2-6142-483a-9efa-b7f789bb3fdf tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1097771064/action" status: 200 len: 97 microversion: 2.1 time: 0.585972 Oct 28 17:28:13.924516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 84/165] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:13 2022] POST /compute/v2.1/flavors/1097771064/action => generated 97 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:13.929880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35ea7f0d-10e0-40ba-a3cd-ee728de7430e tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:14.065832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Calling method '.version_select at 0x7f752519c0d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:14.068112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.068976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.069689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.088014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.088792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.089582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.103229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.104138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.105168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.114430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-158534dd-d279-44a9-961c-359f7b64d183 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.447210 Oct 28 17:28:14.119514 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:14.130177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:14.135216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:14.147438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.148069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.148742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.149913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.150470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.151183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.257805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:14.269383 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcb751f3-8eb4-4bad-a623-72f2d609997a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.147517 Oct 28 17:28:14.283394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 83/167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:14 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:14.378550 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-35ea7f0d-10e0-40ba-a3cd-ee728de7430e tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35ea7f0d-10e0-40ba-a3cd-ee728de7430e tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Request method failure captured: Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/flavors/1097771064/action HTTP/1.1 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 67 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEreC_ggqjFq5CwLqrfYEmi9j9vneNvCQX6bEuU4zV4ISIE6IV57C71ovhM8ATRtm_9r7GmlogGnejAzbb5q7q8iV1ZbIEllyXtScQPpa9c1nDQIjf2oMFad8g-DgRdqvHk1dDENVeKNTSgM2cGB5Fr0OF-ifD2eAe3IyQF_gMn4yE Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:14.397228 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_664a47c201434a0d88867432b519bcb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/664a47c201434a0d88867432b519bcb7"}]}] Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 597d14a0645a43f9aa0ac690dff0300f Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} Oct 28 17:28:14.398724 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: exception: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1097771064', 'body': {'addTenantAccess': {'tenant': 'e14aef692baf4deabe8fe7e5b10d3cd4'}}} Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:28:14.400344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-e14aef692baf4deabe8fe7e5b10d3cd4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 17:28:14.402054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 17:28:14.403927 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:28:14.405290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-e14aef692baf4deabe8fe7e5b10d3cd4' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 17, 28, 14, 356832), 'updated_at': None, 'flavor_id': 29, 'project_id': 'e14aef692baf4deabe8fe7e5b10d3cd4'}] Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:14.406527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:14.410836 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:14.412872 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:14.415283 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. Oct 28 17:28:14.415283 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.434288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35ea7f0d-10e0-40ba-a3cd-ee728de7430e tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project e14aef692baf4deabe8fe7e5b10d3cd4 combination. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:14.435172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-35ea7f0d-10e0-40ba-a3cd-ee728de7430e tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1097771064/action" status: 409 len: 152 microversion: 2.1 time: 0.509475 Oct 28 17:28:14.435805 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 85/168] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:13 2022] POST /compute/v2.1/flavors/1097771064/action => generated 152 bytes in 511 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:14.475905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03c69930-dc4a-4c80-afbf-96ccd19322ec tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1058530896", "id": 701321689, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:14.530982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03c69930-dc4a-4c80-afbf-96ccd19322ec tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.251431 Oct 28 17:28:14.532573 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 84/169] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:28:14 2022] POST /compute/v2.1/flavors => generated 465 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:14.539501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:14.540661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:14.563150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.563938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.564610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.565485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:14.565945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:14.566372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:14.934317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8dc38af-fecf-4119-9101-9f778d7b80a3 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Calling method '.version_select at 0x7f7524efec10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:14.936705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8dc38af-fecf-4119-9101-9f778d7b80a3 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '7f571e59d86a4a3fb079c8a9dfc1bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee02a3daee94085be7efefa4a3d3dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8dc38af-fecf-4119-9101-9f778d7b80a3 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Request method failure captured: Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hypervisors/n-h2-860864-13/search HTTP/1.1 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBErgZER-nKxgrjxtcn6oydCaAlEevboMZmdn3Hqhtl_8BohNh3g2nszsnti3kk4zau1BtgY5L87K0j783J7fr5-uByb3FtA1OXTJRxE9VUNkNqw_oLYTP0YrtpKz4WOpZMIw0EeAOpo1Znug0MGUoB2ydQBjBOpMAbIgWmqG2P_3oI Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: cee02a3daee94085be7efefa4a3d3dc2 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:14.938810 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cee02a3daee94085be7efefa4a3d3dc2"}]}] Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: cee02a3daee94085be7efefa4a3d3dc2 Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7f571e59d86a4a3fb079c8a9dfc1bf56 Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 17:28:14.940089 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'n-h2-860864-13'} Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:14.940775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 17:28:14.941799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:14.942744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8dc38af-fecf-4119-9101-9f778d7b80a3 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:14.942744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8dc38af-fecf-4119-9101-9f778d7b80a3 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-860864-13/search" status: 403 len: 117 microversion: 2.1 time: 0.503467 Oct 28 17:28:14.949478 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 86/170] 10.222.0.48 () {58 vars in 1212 bytes} [Fri Oct 28 17:28:14 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-13/search => generated 117 bytes in 513 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:14.959131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31d5fb53-e00c-4ba5-9cf2-05e0b91d54aa tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:14.991077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:14.998996 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e83181f6-30cf-4727-aa07-0b969867441f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.464432 Oct 28 17:28:15.010935 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 85/171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:14 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:15.323329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39d66b3f-73fa-4202-aacd-18ecba643184 tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.337061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39d66b3f-73fa-4202-aacd-18ecba643184 tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] 10.222.0.48 "GET /compute/v2.1/flavors/701321689" status: 200 len: 465 microversion: 2.61 time: 0.330758 Oct 28 17:28:15.347126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 86/172] 10.222.0.48 () {60 vars in 1196 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/flavors/701321689 => generated 465 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:15.353731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.356818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:15.371067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.372741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.373925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.376402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.376966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.385249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.443010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31d5fb53-e00c-4ba5-9cf2-05e0b91d54aa tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1097771064/action" status: 200 len: 21 microversion: 2.1 time: 0.491747 Oct 28 17:28:15.449221 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 87/173] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:14 2022] POST /compute/v2.1/flavors/1097771064/action => generated 21 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:15.456217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Calling method '.version_select at 0x7f7524f86790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.458441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.458925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.459568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.482726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Request method failure captured: Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEt3xEZ_52UyYRa33Rzz4mSD5MHRs9dvMjR0_8Xvgv1KWsXK_XKU_bWCsJLSXedwAQh1zxtYJxfxyZJcBE84IgeO_p53MNCWehSShMXYTdKEjpre0uyDl6MQ34f2yx0CrDvB2zRDIVU8tgTrZXmyAY_fzHyBitGSrfI0HD60TkN9UQ Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 932c48ecb2ce46b59641b856cdf80e72 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:15.485562 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/932c48ecb2ce46b59641b856cdf80e72"}]}] Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 932c48ecb2ce46b59641b856cdf80e72 Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 068aa96de11b4446b7301a143fccd0bd Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 17:28:15.486861 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:15.487586 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:15.488656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:15.488656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:15.488656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:15.488656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 17:28:15.488656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.489823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:15.491181 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfc7355a-e82c-4fef-abde-ea4f55f2054a tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.040336 Oct 28 17:28:15.496122 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 88/174] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:15.596357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:15.606013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1095e1c1-9dfd-4990-9edd-595a69793e2f tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.257540 Oct 28 17:28:15.606997 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 87/175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:15.618384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.623461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:15.632807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.633525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.634162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.635073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.635799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.636843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.675154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41025789-7952-4f81-a195-8f899c802154", "name": "network-vif-plugged", "status": "completed", "tag": "e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:15.685595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.686860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.687786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.708619 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] Creating event network-vif-plugged:e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7 for instance 41025789-7952-4f81-a195-8f899c802154 on n-h2-860864-13 Oct 28 17:28:15.715960 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-87cf3562-4592-4bd6-a694-30506d1bef04 req-667c3097-f030-4eb8-8fea-4314484d3491 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218227 Oct 28 17:28:15.717658 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 89/176] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:15.727514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-810eaa42-bcdd-4d8e-975f-5729ce0a0ffd tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] Action: 'update', calling method: .version_select at 0x7f7526292b80>, body: {"flavor": {"description": "new"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:15.744585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:15.751610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=2,nova_api:INSERT=10,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:15.761185 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0940df43-758d-4fc4-9442-25dee0e1f43b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.150732 Oct 28 17:28:15.779449 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 88/177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:15.793385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-810eaa42-bcdd-4d8e-975f-5729ce0a0ffd tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/701321689" status: 200 len: 466 microversion: 2.61 time: 0.073634 Oct 28 17:28:15.794031 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 90/178] 10.222.0.48 () {62 vars in 1216 bytes} [Fri Oct 28 17:28:15 2022] PUT /compute/v2.1/flavors/701321689 => generated 466 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:15.795808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddcb1c64-7f18-4ff5-88ef-3dbd9667e684 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.799645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Calling method '.version_select at 0x7f7524e0d4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.801659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.802310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.802993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.816673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=4,nova_api:INSERT=5,nova_api:RELEASE=4,nova_api:DELETE=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:15.825996 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddcb1c64-7f18-4ff5-88ef-3dbd9667e684 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1097771064" status: 202 len: 0 microversion: 2.1 time: 0.044039 Oct 28 17:28:15.826586 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 89/179] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:28:15 2022] DELETE /compute/v2.1/flavors/1097771064 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:15.839173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3aa2c66-695f-4c7a-9260-ed514e8567e7 tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.849505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.850367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.851068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.879272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3aa2c66-695f-4c7a-9260-ed514e8567e7 tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.051577 Oct 28 17:28:15.880686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 90/180] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:15.880810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:15.881365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:15.881872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:15.888290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ceee569-e456-4803-89d4-b61e6a97874c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.894630 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e08e44fd-0ae7-46a5-88e4-b36308a7bf4c tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.097805 Oct 28 17:28:15.895348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 91/181] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:15.915246 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ceee569-e456-4803-89d4-b61e6a97874c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.032862 Oct 28 17:28:15.916058 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:15.921426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e65ce5f-6834-4360-ad76-ded2146f5f8c tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.945729 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e65ce5f-6834-4360-ad76-ded2146f5f8c tempest-FlavorsV261TestJSON-572917848 tempest-FlavorsV261TestJSON-572917848-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.028176 Oct 28 17:28:15.946594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 92/183] 10.222.0.48 () {60 vars in 1166 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:15.963326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5212a8c1-266f-4eb5-8cba-d786c021e964 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Calling method '.version_select at 0x7f752519cf70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:15.965847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5212a8c1-266f-4eb5-8cba-d786c021e964 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '7f571e59d86a4a3fb079c8a9dfc1bf56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee02a3daee94085be7efefa4a3d3dc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5212a8c1-266f-4eb5-8cba-d786c021e964 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Request method failure captured: Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBErgZER-nKxgrjxtcn6oydCaAlEevboMZmdn3Hqhtl_8BohNh3g2nszsnti3kk4zau1BtgY5L87K0j783J7fr5-uByb3FtA1OXTJRxE9VUNkNqw_oLYTP0YrtpKz4WOpZMIw0EeAOpo1Znug0MGUoB2ydQBjBOpMAbIgWmqG2P_3oI Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: cee02a3daee94085be7efefa4a3d3dc2 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:15.968533 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cee02a3daee94085be7efefa4a3d3dc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cee02a3daee94085be7efefa4a3d3dc2"}]}] Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: cee02a3daee94085be7efefa4a3d3dc2 Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198 Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7f571e59d86a4a3fb079c8a9dfc1bf56 Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 17:28:15.970138 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1'} Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:15.970941 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 17:28:15.972390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:15.973317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5212a8c1-266f-4eb5-8cba-d786c021e964 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:15.973317 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5212a8c1-266f-4eb5-8cba-d786c021e964 tempest-HypervisorAdminNegativeUnderV252Test-1219311198 tempest-HypervisorAdminNegativeUnderV252Test-1219311198-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.023329 Oct 28 17:28:15.973317 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:15.978281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3641674-3d44-49dd-a238-9bbf7c5e212b tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1779925606", "id": 1847372977, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:16.001285 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3641674-3d44-49dd-a238-9bbf7c5e212b tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028474 Oct 28 17:28:16.002842 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 94/185] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:15 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:16.007567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d658176-1634-498e-9f4c-dd17a8a05a73 tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.036954 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d658176-1634-498e-9f4c-dd17a8a05a73 tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/701321689" status: 202 len: 0 microversion: 2.61 time: 0.032508 Oct 28 17:28:16.037993 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 95/186] 10.222.0.48 () {60 vars in 1199 bytes} [Fri Oct 28 17:28:16 2022] DELETE /compute/v2.1/flavors/701321689 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:16.046596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Calling method '.version_select at 0x7f75250dcf70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.048839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.049365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.049800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.060014 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] HTTP exception thrown: No hypervisor matching 'f50029f2-952e-4c44-883e-f859a6a7d83e' could be found. Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Request method failure captured: Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hypervisors/f50029f2-952e-4c44-883e-f859a6a7d83e/servers HTTP/1.1 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEt3xEZ_52UyYRa33Rzz4mSD5MHRs9dvMjR0_8Xvgv1KWsXK_XKU_bWCsJLSXedwAQh1zxtYJxfxyZJcBE84IgeO_p53MNCWehSShMXYTdKEjpre0uyDl6MQ34f2yx0CrDvB2zRDIVU8tgTrZXmyAY_fzHyBitGSrfI0HD60TkN9UQ Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 932c48ecb2ce46b59641b856cdf80e72 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:16.061643 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_932c48ecb2ce46b59641b856cdf80e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/932c48ecb2ce46b59641b856cdf80e72"}]}] Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 932c48ecb2ce46b59641b856cdf80e72 Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432 Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 068aa96de11b4446b7301a143fccd0bd Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: exception: No hypervisor matching 'f50029f2-952e-4c44-883e-f859a6a7d83e' could be found. Oct 28 17:28:16.062966 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f50029f2-952e-4c44-883e-f859a6a7d83e'} Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f50029f2-952e-4c44-883e-f859a6a7d83e' could be found. Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.063717 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f50029f2-952e-4c44-883e-f859a6a7d83e' could be found. Oct 28 17:28:16.064694 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.066957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] Returning 404 to user: No hypervisor matching 'f50029f2-952e-4c44-883e-f859a6a7d83e' could be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:16.068084 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e50d526-7a1f-46eb-a55f-9222aa0ea339 tempest-HypervisorAdminNegativeUnderV252Test-1529882432 tempest-HypervisorAdminNegativeUnderV252Test-1529882432-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/f50029f2-952e-4c44-883e-f859a6a7d83e/servers" status: 404 len: 123 microversion: 2.1 time: 0.025979 Oct 28 17:28:16.068652 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 96/187] 10.222.0.48 () {58 vars in 1281 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/os-hypervisors/f50029f2-952e-4c44-883e-f859a6a7d83e/servers => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:16.073691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f99b47b-a963-42b3-a2be-867eafde468c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.083307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0f99b47b-a963-42b3-a2be-867eafde468c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f99b47b-a963-42b3-a2be-867eafde468c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Request method failure captured: Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/flavors/1847372977/os-flavor-access HTTP/1.1 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEreC_ggqjFq5CwLqrfYEmi9j9vneNvCQX6bEuU4zV4ISIE6IV57C71ovhM8ATRtm_9r7GmlogGnejAzbb5q7q8iV1ZbIEllyXtScQPpa9c1nDQIjf2oMFad8g-DgRdqvHk1dDENVeKNTSgM2cGB5Fr0OF-ifD2eAe3IyQF_gMn4yE Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:16.084852 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_664a47c201434a0d88867432b519bcb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/664a47c201434a0d88867432b519bcb7"}]}] Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 597d14a0645a43f9aa0ac690dff0300f Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: exception: Access list not available for public flavors. Oct 28 17:28:16.086117 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'flavor_id': '1847372977'} Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 28 17:28:16.090968 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.092539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f99b47b-a963-42b3-a2be-867eafde468c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:16.092539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f99b47b-a963-42b3-a2be-867eafde468c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1847372977/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.016454 Oct 28 17:28:16.092539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1209 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/flavors/1847372977/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:16.093728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.094965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:16.096662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524e0d280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.101412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.102241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.102893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.104073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.104750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.105389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.106608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.107098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.107564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.108265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.108721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.109148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.146320 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-790f006b-b81a-4e4e-a26a-bd0e46236ed9 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.249846 Oct 28 17:28:16.147282 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 92/189] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:28:15 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:16.159044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee1b1eba-cfdf-4ce8-ba55-10e46a636ce1 tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.186914 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee1b1eba-cfdf-4ce8-ba55-10e46a636ce1 tempest-FlavorsV261TestJSON-1207180412 tempest-FlavorsV261TestJSON-1207180412-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6259 microversion: 2.61 time: 0.038266 Oct 28 17:28:16.187763 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 93/190] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/flavors/detail => generated 6259 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:16.216638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46c75cb9-f432-4cd6-9c4b-67f7eb7d6d5f tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.274639 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46c75cb9-f432-4cd6-9c4b-67f7eb7d6d5f tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1847372977" status: 202 len: 0 microversion: 2.1 time: 0.073618 Oct 28 17:28:16.281859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:28:16 2022] DELETE /compute/v2.1/flavors/1847372977 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:16.288685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524db9f70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.293910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.294653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.295075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.296192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.297456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.298603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.301474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:16.310704 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29aaa865-144e-44bb-af5e-dd32b4b79747 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.222576 Oct 28 17:28:16.311447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 98/192] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:16.333788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a46c678-e4bd-49cb-a569-564b2a6937c6 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.338010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7fff5631-093f-43bf-bdee-afed5176f83c tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.054677 Oct 28 17:28:16.339525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 95/193] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:16.356661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f75253dd040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.367584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.369700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.370857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.373510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.374359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.374794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.378539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a46c678-e4bd-49cb-a569-564b2a6937c6 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050298 Oct 28 17:28:16.379135 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 99/194] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:16.407024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fde3a83f-a8e8-4b5a-950f-2b8258643cb4 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-408589524", "id": 1078267930, "os-flavor-access:is_public": "False"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:16.413898 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6ddb40a-1b2d-4f8b-b55f-f640e1231615 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.065989 Oct 28 17:28:16.414656 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 96/195] 10.222.0.48 () {58 vars in 1145 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:16.441515 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fde3a83f-a8e8-4b5a-950f-2b8258643cb4 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.041648 Oct 28 17:28:16.442652 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 100/196] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:16 2022] POST /compute/v2.1/flavors => generated 438 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:16.632592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.633393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:16.641764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.642469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.643061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.643974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.644578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.645965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.810082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8813052f-19a5-42f7-869e-b712c4726401 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:16.814427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8813052f-19a5-42f7-869e-b712c4726401 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'cf4e26a4e8564c4a8cf48be46e38e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14aef692baf4deabe8fe7e5b10d3cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8813052f-19a5-42f7-869e-b712c4726401 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Request method failure captured: Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/flavors/1078267930/action HTTP/1.1 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 67 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEp5OsKTdc3fUr6F8GCAw35-Bmh0pf8nZnzU5rKNvSKt_AXeWmQrwNuFLHyWAqgDqlduTyNgi6mvMdaP8r-SqA14cqtWVcpzfWtpoh3z2AfkPJlq4JGKY2xsFKSCXb_-apV80Jzz7uYwm-LNBWfPmE1OXqH_zoRXG7sICoo5wRxoh4 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e14aef692baf4deabe8fe7e5b10d3cd4 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:16.816290 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e14aef692baf4deabe8fe7e5b10d3cd4"}]}] Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e14aef692baf4deabe8fe7e5b10d3cd4 Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1481201242-project Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: cf4e26a4e8564c4a8cf48be46e38e758 Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242-project Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} Oct 28 17:28:16.817781 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1078267930', 'body': {'addTenantAccess': {'tenant': 'e14aef692baf4deabe8fe7e5b10d3cd4'}}} Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:16.818578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 17:28:16.819934 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:16.821173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8813052f-19a5-42f7-869e-b712c4726401 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:16.821173 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8813052f-19a5-42f7-869e-b712c4726401 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] 10.222.0.48 "POST /compute/v2.1/flavors/1078267930/action" status: 403 len: 130 microversion: 2.1 time: 0.366618 Oct 28 17:28:16.821173 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 97/197] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:16 2022] POST /compute/v2.1/flavors/1078267930/action => generated 130 bytes in 368 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:16.823004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.823736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:16.831791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.832272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.832902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.833642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:16.834120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:16.834596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:16.954053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:16.962384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3bd86920-86ce-4e1c-82bb-a8c56396166f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.142751 Oct 28 17:28:16.975434 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 98/198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:16.975434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-275b20c7-7a47-478b-b400-928ec05d88db tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:16.987022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-275b20c7-7a47-478b-b400-928ec05d88db tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1078267930" status: 202 len: 0 microversion: 2.1 time: 0.022469 Oct 28 17:28:16.987755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:28:16 2022] DELETE /compute/v2.1/flavors/1078267930 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:16.995448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f98d149-65a8-47dc-8e0e-6aaf2d7dada2 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:17.012751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:17.018348 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f98d149-65a8-47dc-8e0e-6aaf2d7dada2 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026292 Oct 28 17:28:17.019344 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:17.033204 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60658a8d-f998-44f5-b70c-a80694be3110 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.402683 Oct 28 17:28:17.040190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26b5ccf4-8ce1-429d-ad88-15187db471b8 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-478397396", "id": 1001630320, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.044496 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:16 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:17.060936 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26b5ccf4-8ce1-429d-ad88-15187db471b8 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025243 Oct 28 17:28:17.061807 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 101/202] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:17.074489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f253ea7-ab37-4d4b-b629-39ec23bdfdf9 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.295658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f253ea7-ab37-4d4b-b629-39ec23bdfdf9 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1001630320/action" status: 200 len: 97 microversion: 2.1 time: 0.223284 Oct 28 17:28:17.308905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3690ea07-1996-452d-a9e5-26a4f5c31506 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.314324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3690ea07-1996-452d-a9e5-26a4f5c31506 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'cf4e26a4e8564c4a8cf48be46e38e758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14aef692baf4deabe8fe7e5b10d3cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:17.316256 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 102/203] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors/1001630320/action => generated 97 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3690ea07-1996-452d-a9e5-26a4f5c31506 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Request method failure captured: Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/flavors/1001630320/action HTTP/1.1 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 70 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEp5OsKTdc3fUr6F8GCAw35-Bmh0pf8nZnzU5rKNvSKt_AXeWmQrwNuFLHyWAqgDqlduTyNgi6mvMdaP8r-SqA14cqtWVcpzfWtpoh3z2AfkPJlq4JGKY2xsFKSCXb_-apV80Jzz7uYwm-LNBWfPmE1OXqH_zoRXG7sICoo5wRxoh4 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e14aef692baf4deabe8fe7e5b10d3cd4 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:17.316794 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e14aef692baf4deabe8fe7e5b10d3cd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e14aef692baf4deabe8fe7e5b10d3cd4"}]}] Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e14aef692baf4deabe8fe7e5b10d3cd4 Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242 Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FlavorsAccessNegativeTestJSON-1481201242-project Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: cf4e26a4e8564c4a8cf48be46e38e758 Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1481201242-project Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: {"removeTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} Oct 28 17:28:17.317917 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1001630320', 'body': {'removeTenantAccess': {'tenant': 'e14aef692baf4deabe8fe7e5b10d3cd4'}}} Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can( Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:17.318527 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 17:28:17.319585 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:17.321072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3690ea07-1996-452d-a9e5-26a4f5c31506 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:17.321072 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3690ea07-1996-452d-a9e5-26a4f5c31506 tempest-FlavorsAccessNegativeTestJSON-1481201242 tempest-FlavorsAccessNegativeTestJSON-1481201242-project] 10.222.0.48 "POST /compute/v2.1/flavors/1001630320/action" status: 403 len: 133 microversion: 2.1 time: 0.013556 Oct 28 17:28:17.327190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ec7ee64-4292-42f4-93ca-7e0564fc27ed tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e14aef692baf4deabe8fe7e5b10d3cd4"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.333223 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 102/204] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors/1001630320/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:17.338488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:17.339159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:17.472211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ec7ee64-4292-42f4-93ca-7e0564fc27ed tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1001630320/action" status: 200 len: 21 microversion: 2.1 time: 0.148942 Oct 28 17:28:17.478105 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 103/205] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors/1001630320/action => generated 21 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:28:17.483049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad8c3954-93e1-4d6f-9526-e7afde465d5b tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:17.506614 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad8c3954-93e1-4d6f-9526-e7afde465d5b tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1001630320" status: 202 len: 0 microversion: 2.1 time: 0.027356 Oct 28 17:28:17.507857 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 104/206] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:28:17 2022] DELETE /compute/v2.1/flavors/1001630320 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:17.518553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb9276fc-dacc-46dd-96ff-d5cc4e4d07de tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:17.556228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb9276fc-dacc-46dd-96ff-d5cc4e4d07de tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043232 Oct 28 17:28:17.557180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 105/207] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:17.565623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:17.566175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:17.566683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:17.567491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:17.567945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:17.568368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:17.578033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3c4ed32-aadd-400e-bff0-c5d6f9ee9247 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2083918072", "id": 736843998, "os-flavor-access:is_public": "False"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.600792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3c4ed32-aadd-400e-bff0-c5d6f9ee9247 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.026618 Oct 28 17:28:17.601777 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 106/208] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors => generated 436 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:17.617001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-829a18d5-cb04-43ef-a7b9-9c8debc1fc71 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "abcab985bdf24dd3891442939b5e22f8"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:17.732230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:17.741524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee261bda-6ec7-4cda-a315-90677a961b27 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1340 microversion: 2.1 time: 0.407032 Oct 28 17:28:17.743235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 103/209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:17 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1340 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:17.991671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:17.992832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:18.002016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.002599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.003506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.004394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.004977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.006256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.111598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:18.122395 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0933b49d-70f7-4744-b669-2ed2f4690454 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.137946 Oct 28 17:28:18.123472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 104/210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:17 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:18.131300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:18.136682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:18.144969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.144969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.145245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.145968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.146466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.147009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.209144 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-829a18d5-cb04-43ef-a7b9-9c8debc1fc71 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] HTTP exception thrown: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-829a18d5-cb04-43ef-a7b9-9c8debc1fc71 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Request method failure captured: Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/flavors/736843998/action HTTP/1.1 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 70 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEreC_ggqjFq5CwLqrfYEmi9j9vneNvCQX6bEuU4zV4ISIE6IV57C71ovhM8ATRtm_9r7GmlogGnejAzbb5q7q8iV1ZbIEllyXtScQPpa9c1nDQIjf2oMFad8g-DgRdqvHk1dDENVeKNTSgM2cGB5Fr0OF-ifD2eAe3IyQF_gMn4yE Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:18.211565 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/664a47c201434a0d88867432b519bcb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_664a47c201434a0d88867432b519bcb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/664a47c201434a0d88867432b519bcb7"}]}] Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 664a47c201434a0d88867432b519bcb7 Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405 Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 597d14a0645a43f9aa0ac690dff0300f Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: {"removeTenantAccess": {"tenant": "abcab985bdf24dd3891442939b5e22f8"}} Oct 28 17:28:18.212743 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '736843998', 'body': {'removeTenantAccess': {'tenant': 'abcab985bdf24dd3891442939b5e22f8'}}} Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 28 17:28:18.213374 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:18.214455 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. Oct 28 17:28:18.215505 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:18.218747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-829a18d5-cb04-43ef-a7b9-9c8debc1fc71 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Returning 404 to user: Flavor access not found for 34 / abcab985bdf24dd3891442939b5e22f8 combination. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:18.220299 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-829a18d5-cb04-43ef-a7b9-9c8debc1fc71 tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/736843998/action" status: 404 len: 124 microversion: 2.1 time: 0.609170 Oct 28 17:28:18.227421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 107/211] 10.222.0.48 () {60 vars in 1197 bytes} [Fri Oct 28 17:28:17 2022] POST /compute/v2.1/flavors/736843998/action => generated 124 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:18.236918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e97b0cf9-6445-437c-92e9-c3aa31b2790c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:18.264956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e97b0cf9-6445-437c-92e9-c3aa31b2790c tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/736843998" status: 202 len: 0 microversion: 2.1 time: 0.033010 Oct 28 17:28:18.266380 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:28:18 2022] DELETE /compute/v2.1/flavors/736843998 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:18.275407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bde7ef17-8c49-4a99-8d98-60dd355bb21d tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:18.300979 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bde7ef17-8c49-4a99-8d98-60dd355bb21d tempest-FlavorsAccessNegativeTestJSON-1952118405 tempest-FlavorsAccessNegativeTestJSON-1952118405-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029941 Oct 28 17:28:18.301905 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 109/213] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:18.394612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:18.408080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e567c61-8019-46d5-a557-677e9c294b2d tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.281938 Oct 28 17:28:18.408689 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 105/214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:18 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:18.651419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e7890f-a186-4215-85ec-4dbfd7ba0510", "name": "network-vif-plugged", "status": "completed", "tag": "d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:18.669592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.670365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.670805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.686052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] Creating event network-vif-plugged:d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21 for instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 on n-h2-860864-13 Oct 28 17:28:18.692399 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-23706500-b1aa-43d6-bf3b-04fe2408510e req-5ad0e40c-4a86-4523-88cd-496996b531ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045272 Oct 28 17:28:18.694189 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 110/215] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:18.767099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:18.768179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:18.775204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.776694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.777556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.778459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:18.779114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:18.779940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:18.950371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:18.958510 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0afcd10-3c35-4ec6-a22c-995c4162ee99 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1489 microversion: 2.1 time: 0.196455 Oct 28 17:28:18.959064 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 106/216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:18 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1489 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:19.147669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:19.148577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:19.155730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.155912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.156809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.157875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.159269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.159882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.226802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2057541769", "block_migration": true, "disk_over_commit": false}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:19.229785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:19.238985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:19.241022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.241506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.241932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.242630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.243073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.243520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.248357 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fa64ac42-21d9-48a8-ba80-045ba670a275 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.103804 Oct 28 17:28:19.249267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 107/217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:19 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:19.432780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:19.433455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:19.439979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.440692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.441328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.442036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.442649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.443068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.601275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:19.609483 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efe98ae1-f083-4910-8a26-4fdbfdf66af2 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1338 microversion: 2.1 time: 0.180436 Oct 28 17:28:19.610046 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 108/218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:19 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:19.810152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lazy-loading 'flavor' on Instance uuid 41025789-7952-4f81-a195-8f899c802154 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:28:19.863066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] [instance: 41025789-7952-4f81-a195-8f899c802154] Going to try to live migrate instance to tempest-host-2057541769 {{(pid=120567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:28:19.873671 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] HTTP exception thrown: Compute host tempest-host-2057541769 could not be found. Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Request method failure captured: Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154/action HTTP/1.1 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 107 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBETCZ_vs37tOGNkot2Z2U5i3bNQYlI6jKNqBRuyxb9u75Dp9DkfE322p4NDSCuTOS-riLavZR6SBNrpdUnxEaML6lNTi0foBSyyYQ3etFiRZdi7VXc4QQ6gVdLhAvzlAW2mJemt6j2poJy-TWAIed4aC65LCZoaogi5ApqTXlFg2K8 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 74d8c2c8fdfa4d978307c6239476980e Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:19.875465 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d8c2c8fdfa4d978307c6239476980e"}]}] Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 74d8c2c8fdfa4d978307c6239476980e Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationNegativeTest-778644995-project-admin Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 65e4fb355cc34fa7811ca51c58479142 Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationNegativeTest-778644995-project-admin Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: {"os-migrateLive": {"host": "tempest-host-2057541769", "block_migration": true, "disk_over_commit": false}} Oct 28 17:28:19.876662 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: exception: Compute host tempest-host-2057541769 could not be found. Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '41025789-7952-4f81-a195-8f899c802154', 'body': {'os-migrateLive': {'host': 'tempest-host-2057541769', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:19.877336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2057541769 could not be found. Oct 28 17:28:19.878369 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2057541769 could not be found. Oct 28 17:28:19.879389 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2057541769 could not be found. Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Returning 400 to user: Compute host tempest-host-2057541769 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ea60ad4-5a1f-4c17-b3f0-b7cf7d46ef64 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154/action" status: 400 len: 100 microversion: 2.1 time: 0.898889 Oct 28 17:28:19.880445 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 111/219] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Oct 28 17:28:18 2022] POST /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154/action => generated 100 bytes in 900 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:28:19.886197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:19.886975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:19.894761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.895247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.895903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:19.896858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:19.897443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:19.897898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.146998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:20.154895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6634db6a-00c2-455a-86fd-34d0cedfc79e tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1489 microversion: 2.1 time: 0.272614 Oct 28 17:28:20.168687 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 109/220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:19 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1489 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:20.280478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:20.281836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:20.291346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.292025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.292638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.293506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.294114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.294928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.360778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1399334455", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:20.399045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:20.415191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f02098ee-9b51-4c83-b872-654758cd4062 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1265 microversion: 2.1 time: 0.142979 Oct 28 17:28:20.419447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 112/221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:20 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:20.465657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:20.632512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:20.633577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:20.640221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.641707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.642148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.643308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.646008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.646639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.652787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:20.835974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:20.836395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:20.837481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:20.837901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:20.838297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:20.852857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.853105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.853443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.854170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:20.854622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:20.855042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:20.874445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Getting quotas for project 1a4bfe1d7aee49858fdd893680f733fc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:20.879796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Getting quotas for user 62c38d65ee164ee9931a64607b92de6b and project 1a4bfe1d7aee49858fdd893680f733fc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:20.892334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:28:20.895471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:28:20.930623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:20.943028 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a05722ce-86b5-4bce-8c58-43390abed07e tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1487 microversion: 2.1 time: 0.314027 Oct 28 17:28:20.944203 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 113/222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:20 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1487 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:20.970665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d3b22af-1897-4eec-aed6-2cfc7313c144 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614995 Oct 28 17:28:20.980418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 110/223] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:28:20.984085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:20.987867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:20.988568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d3410c0-d436-4b26-9d50-11b9e6937523 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:20.989365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d3410c0-d436-4b26-9d50-11b9e6937523 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:21.013623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.016486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.017196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:21.047067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.050629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.052122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:21.096969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d3410c0-d436-4b26-9d50-11b9e6937523 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:21.110059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d3410c0-d436-4b26-9d50-11b9e6937523 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1219 microversion: 2.1 time: 0.127267 Oct 28 17:28:21.125707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 111/224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:20 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:21.443066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:21.444036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:21.461967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.462503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.462927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:21.463681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.471997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.472615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:21.648864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:21.664369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0c99d5d-cb1f-4ca6-9253-b7224cbc50b8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1273 microversion: 2.1 time: 0.222656 Oct 28 17:28:21.665086 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 112/225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:21 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:21.915568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ce127527-aa55-4667-826d-5244259c1da6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1640 microversion: 2.1 time: 0.950215 Oct 28 17:28:21.921055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:20 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1640 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:21.945476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:21.946307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:21.958788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.962751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.963992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:21.966173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:21.968116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:21.969302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.020561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:28:22.121598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Action: 'update', calling method: .version_select at 0x7f7525027790>, body: {"quota_set": {"ram": "5120"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:22.222908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.225060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.228731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.229864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.232940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.235871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.290915 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e0029108-b065-4a71-a9e6-bee03454d996 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 204 len: 0 microversion: 2.1 time: 0.351398 Oct 28 17:28:22.292122 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:28:21 2022] DELETE /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:22.312670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:22.314249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:22.334668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.336232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.336801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.338778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.340077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.340853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.349939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:22.372502 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91828ff9-b49b-4551-8b9a-58a46225d356 tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5" status: 200 len: 148 microversion: 2.57 time: 0.578119 Oct 28 17:28:22.402824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 113/228] 10.222.0.48 () {62 vars in 1303 bytes} [Fri Oct 28 17:28:21 2022] PUT /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5 => generated 148 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:28:22.408715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:22.409343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:22.429718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.430247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.430706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.431675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.432316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.433029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.472532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:22.496297 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89e7e73c-2553-46d2-b00f-5b0ef1627c5f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1292 microversion: 2.1 time: 0.202902 Oct 28 17:28:22.497802 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 116/229] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:22 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1292 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:22.518793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Calling method '.version_select at 0x7f7524fb65e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:22.604824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:22.638731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.639454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.641105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.642105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.642968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.643776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.682288 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb0c490c-dfb5-4f52-a926-e0a8821a755a tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5/detail" status: 200 len: 463 microversion: 2.57 time: 0.181745 Oct 28 17:28:22.683283 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 117/230] 10.222.0.48 () {60 vars in 1304 bytes} [Fri Oct 28 17:28:22 2022] GET /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5/detail => generated 463 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:22.698906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:22.699547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:22.713020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:22.722387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73364cb1-2034-49e8-85eb-58f942687638 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1493 microversion: 2.1 time: 0.318322 Oct 28 17:28:22.727188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.727697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.728164 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 114/231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:22 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1493 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:22.728812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.729697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:22.730357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:22.730999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:22.843234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:22.857126 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3531ec0d-5645-434f-b45d-9eaf17cc563b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1271 microversion: 2.1 time: 0.162620 Oct 28 17:28:22.859740 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 118/232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:22 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:22.933635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Action: 'update', calling method: .version_select at 0x7f75250a4f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:23.181745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.182473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.183094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.184183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.185387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.186018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.233725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.236354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.236985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.240144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.240803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.241381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.502959 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a2ea971-799a-4c98-8291-980f86a4096f tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5?user_id=a89473620c9044c69cbb15a5c5ece95d" status: 200 len: 148 microversion: 2.57 time: 0.573135 Oct 28 17:28:23.504331 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 115/233] 10.222.0.48 () {62 vars in 1384 bytes} [Fri Oct 28 17:28:22 2022] PUT /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5?user_id=a89473620c9044c69cbb15a5c5ece95d => generated 148 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:23.515141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6ed6338-1a2e-4c73-bcad-7df41a69a58d tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] Calling method '.version_select at 0x7f7525109820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:23.522407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:23.523020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:23.545340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.545981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.546436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.547457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.547998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.548425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.728240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:23.730420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:23.743696 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-08e16fb4-ed6e-4b57-a739-a21ad3ef2f94 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1292 microversion: 2.1 time: 0.224910 Oct 28 17:28:23.744204 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 116/234] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:23 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1292 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:23.776640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:23.777262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:23.784166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.784464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.784902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.785637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.786081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.792307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.852621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:23.918159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6ed6338-1a2e-4c73-bcad-7df41a69a58d tempest-QuotasAdminTestV257-189459090 tempest-QuotasAdminTestV257-189459090-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5?user_id=a89473620c9044c69cbb15a5c5ece95d" status: 200 len: 190 microversion: 2.57 time: 0.406843 Oct 28 17:28:23.919250 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 119/235] 10.222.0.48 () {60 vars in 1364 bytes} [Fri Oct 28 17:28:23 2022] GET /compute/v2.1/os-quota-sets/7c3f1021265b4e9882e402c65f7ca3a5?user_id=a89473620c9044c69cbb15a5c5ece95d => generated 190 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:23.929708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:23.930912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:23.949544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.950265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.950903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:23.951784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:23.952383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:23.953114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:24.035795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:24.052251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a461338c-7dec-4de5-bd06-ff7fbdd8dec3 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1493 microversion: 2.1 time: 0.295551 Oct 28 17:28:24.054668 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 117/236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:23 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1493 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:24.561825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:24.576062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7045579a-1501-4ff5-bfab-52b82b4fc220 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.655564 Oct 28 17:28:24.587611 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:23 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:24.772777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:24.774278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:24.781505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:24.782443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:24.783357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:24.784702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:24.785656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:24.786091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:24.959405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:24.972935 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7856e80c-b5a7-4b3f-b1ac-3a8d8ed24f71 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1298 microversion: 2.1 time: 0.204070 Oct 28 17:28:24.975009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:24 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:25.078666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:25.079728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:25.091339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:25.094080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:25.096307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:25.098228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:25.099765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:25.100664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:25.614295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:25.615140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:25.627798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:25.628466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:25.630466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:25.648118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:25.650796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:25.653523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:25.674733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:25.692025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4d3af99-9e86-4fea-848b-37968d23b951 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1493 microversion: 2.1 time: 0.619348 Oct 28 17:28:25.693656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 121/239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:25 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1493 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:25.729160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:25.747046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:25.747847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:25.748458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:25.801227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] Creating event network-changed:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:28:25.817204 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1ff66ae3-b272-4978-84b8-3c4c52541884 req-d7afdd9f-eceb-433a-9c0c-d2575fa4ab00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121144 Oct 28 17:28:25.817983 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 122/240] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:26.048233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb69d9a7-13f5-42b7-907e-fd523a7175f4 tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-583515968", "id": 1833203755, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:26.076072 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb69d9a7-13f5-42b7-907e-fd523a7175f4 tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.256551 Oct 28 17:28:26.077443 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 123/241] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:28:25 2022] POST /compute/v2.1/flavors => generated 448 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:26.096816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b00bca-255c-4ee3-bed7-d2cb16cc56a0", "tag": "45cdaf83-90fb-4f87-bc39-c1cda16ec105"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:26.127260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.135073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.135821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.157657 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] Creating event network-changed:45cdaf83-90fb-4f87-bc39-c1cda16ec105 for instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 on n-h1-860864-13 Oct 28 17:28:26.163087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-27858625-cfe6-4439-8f1e-30412faf609f req-1289fedb-c18a-46bf-aba2-617720f7b444 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078267 Oct 28 17:28:26.164478 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 124/242] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:26.170023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.171243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:26.180836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.181545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.182578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.184146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.184856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.185423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.372875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:26.388280 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f357c56-9fc2-48a4-b210-955489d20bda tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.779540 Oct 28 17:28:26.388851 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 119/243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:25 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:26.678947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3f67995-3690-432e-b827-2ae6a3016b49 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.688824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a3f67995-3690-432e-b827-2ae6a3016b49 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] 10.222.0.48 "GET /compute/v2.1/flavors/1833203755" status: 200 len: 448 microversion: 2.55 time: 0.298890 Oct 28 17:28:26.690032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 120/244] 10.222.0.48 () {60 vars in 1199 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/flavors/1833203755 => generated 448 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:26.704089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d891ff0c-13a1-41ad-b53f-f99e26cb969f tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:26.707710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:26.721306 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47197c47-3e93-435c-a1b8-9737ec66571b tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1340 microversion: 2.1 time: 0.555234 Oct 28 17:28:26.724646 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 125/245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1340 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:26.741505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.744538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:26.754956 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d891ff0c-13a1-41ad-b53f-f99e26cb969f tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1833203755" status: 200 len: 449 microversion: 2.55 time: 0.055380 Oct 28 17:28:26.756526 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 121/246] 10.222.0.48 () {62 vars in 1219 bytes} [Fri Oct 28 17:28:26 2022] PUT /compute/v2.1/flavors/1833203755 => generated 449 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:28:26.773567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.774562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.775215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.776180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.776840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.777438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.787831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30ec5df2-44aa-4d44-90a0-3874902b6e48 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.818036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:26.818889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:26.819563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:26.820253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lazy-loading 'fault' on Instance uuid c8e7890f-a186-4215-85ec-4dbfd7ba0510 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:28:26.855049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30ec5df2-44aa-4d44-90a0-3874902b6e48 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.088237 Oct 28 17:28:26.864681 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 122/247] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:26.880897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3884f34e-8d6d-4ba3-afb8-a802548c3431 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.930516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3884f34e-8d6d-4ba3-afb8-a802548c3431 tempest-FlavorsV255TestJSON-1283164604 tempest-FlavorsV255TestJSON-1283164604-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.053410 Oct 28 17:28:26.944136 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 123/248] 10.222.0.48 () {60 vars in 1166 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:26.949227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ab89b12-74c4-4d14-b910-3dcb48a630e3 tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:26.986040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ab89b12-74c4-4d14-b910-3dcb48a630e3 tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1833203755" status: 202 len: 0 microversion: 2.55 time: 0.040345 Oct 28 17:28:26.987172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 124/249] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Oct 28 17:28:26 2022] DELETE /compute/v2.1/flavors/1833203755 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:26.999225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb52e8ff-e4f2-45a8-9eb8-685e5474e84d tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:27.053890 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb52e8ff-e4f2-45a8-9eb8-685e5474e84d tempest-FlavorsV255TestJSON-1650164650 tempest-FlavorsV255TestJSON-1650164650-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.060774 Oct 28 17:28:27.070555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 125/250] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:27.218113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b136d7515ea4b28b7508b403c249168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f680e101d13d4d13aecb0ff391b50332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:27.226715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de8ec6a1-db28-445a-9435-ae0d6d1d2dda tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 200 len: 1328 microversion: 2.1 time: 0.498855 Oct 28 17:28:27.227299 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 126/251] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:26 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 1328 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:27.413206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:27.414118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:27.425046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:27.425540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:27.426095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:27.426808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:27.427258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:27.427707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:27.750128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:27.751511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:27.763753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:27.766035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:27.767817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:27.769491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:27.770181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:27.772074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.129116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:28.146961 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e027fdd-fad4-4368-96c4-b166a3d6b314 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.738341 Oct 28 17:28:28.150346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 126/252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:27 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:28.161029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e7890f-a186-4215-85ec-4dbfd7ba0510", "name": "network-vif-deleted", "tag": "d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:28.182258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:28.195350 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-797eb234-09b2-4433-8592-9c6d24b2921f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1340 microversion: 2.1 time: 0.451103 Oct 28 17:28:28.197853 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 127/253] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:27 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1340 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:28.210428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.210875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.211432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.239791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] Creating event network-vif-deleted:d3071f2a-f0ef-49d2-ab6f-fcc0a65abc21 for instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 on n-h2-860864-13 Oct 28 17:28:28.249232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a344673a-af18-4d22-8979-e16230325790 req-66540260-ac8a-4492-8c6e-9d0af8a1d97b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097090 Oct 28 17:28:28.250593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 127/254] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:28.253514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:28.254710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:28.270194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.271045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.271745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.272614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.273224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.273702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.309810 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] HTTP exception thrown: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Request method failure captured: Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 HTTP/1.1 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBETihM5_panGPOgpIL5-XacaEFJ-4Xva4HmPDZe5xia0cgRwm06XtdsAnaP_J-gu8EUv00TSVfsmjKGQ8uFYqHRPwKRI3-HZmUBwWd0kWYzs4xDHEw-K3oJPLpZ__L2h42hz4DoMbiYbkX962SkGmoNo75zt8IDi5qO1_Tp25ilLxc Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:28.317119 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f680e101d13d4d13aecb0ff391b50332"}]}] Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 4b136d7515ea4b28b7508b403c249168 Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:28.318466 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c8e7890f-a186-4215-85ec-4dbfd7ba0510'} Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:28.319147 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:28.320299 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:28.327107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Returning 404 to user: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:28.328459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5ad8a8f-8844-498c-886b-500c09a73d19 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 404 len: 111 microversion: 2.1 time: 0.081919 Oct 28 17:28:28.329625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:28 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:28.339706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ae9451b-4928-497b-b192-734c3d1d4699 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:28.365090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ae9451b-4928-497b-b192-734c3d1d4699 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.365574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ae9451b-4928-497b-b192-734c3d1d4699 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.366063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ae9451b-4928-497b-b192-734c3d1d4699 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.465966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1", "tag": "1ed108c7-486a-48fa-81ab-7ac5beed1ec1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:28.478523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.479293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.480249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.507516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] Creating event network-changed:1ed108c7-486a-48fa-81ab-7ac5beed1ec1 for instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 on n-h2-860864-13 Oct 28 17:28:28.513698 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-577f0a2d-9c1a-4e1f-aef8-1f958ae5a67f req-273b9fc8-cb6a-4925-9e40-7068a916f81e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059699 Oct 28 17:28:28.514884 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 129/256] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:28.623441 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ae9451b-4928-497b-b192-734c3d1d4699 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 0.286859 Oct 28 17:28:28.632493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 128/257] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:28:28 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:28.639836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab122492-2702-4079-bd4c-db0bb1cb2e80 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:28.693661 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab122492-2702-4079-bd4c-db0bb1cb2e80 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.059696 Oct 28 17:28:28.694065 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 130/258] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:28 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 17:28:28.713784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f752545b0d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:28.723597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.724554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.728048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.731006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.731692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.732459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.790712 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-becf87ee-f460-40b6-bc73-447b38032d2a tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.083708 Oct 28 17:28:28.801816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 129/259] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:28:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:28.807487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524db2ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:28.812596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.814036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.816536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.818208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.818937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.819696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.870451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77f61ba7-6ad2-4f4d-a0f6-f8ee9edfbec6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.068976 Oct 28 17:28:28.871441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 131/260] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:28 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:28.882982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524e0d1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:28.886666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.887330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.888827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.892887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:28.893776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:28.894574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:28.929863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-94bac951-9a76-439e-8aeb-f639a8710fd7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1041770114"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:28.939093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-94bac951-9a76-439e-8aeb-f639a8710fd7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 4f1904f2-9fbb-40d1-9633-a64e8a6d7e9e for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:29.005684 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-94bac951-9a76-439e-8aeb-f639a8710fd7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086275 Oct 28 17:28:29.006644 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7cc834a-7166-418e-8eaa-2f6fa2f1c1fa tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.127274 Oct 28 17:28:29.015081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 132/261] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.016387 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:28:28 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.021834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524e5f550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:29.035144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d955d153-f490-4da4-9ed4-199380484c69 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:29.038992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.042241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.042736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.065137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.066474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d955d153-f490-4da4-9ed4-199380484c69 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.066732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.066965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d955d153-f490-4da4-9ed4-199380484c69 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.067858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d955d153-f490-4da4-9ed4-199380484c69 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.069129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.162226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5221b026-3c6a-40a5-97de-8c675ab6f553 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h2-860864-13" status: 200 len: 471 microversion: 2.1 time: 0.145455 Oct 28 17:28:29.162749 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:28:29 2022] GET /compute/v2.1/os-hosts/n-h2-860864-13 => generated 471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.174679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Calling method '.version_select at 0x7f7524e9d940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:29.188367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.189123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.189712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.213211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.213810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.214274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.267105 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b8614e7-dcf1-4a2a-abb1-f4f344e2dde6 tempest-HostsAdminTestJSON-830309517 tempest-HostsAdminTestJSON-830309517-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h1-860864-13" status: 200 len: 471 microversion: 2.1 time: 0.096456 Oct 28 17:28:29.280311 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 134/264] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:28:29 2022] GET /compute/v2.1/os-hosts/n-h1-860864-13 => generated 471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.287648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d955d153-f490-4da4-9ed4-199380484c69 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.269167 Oct 28 17:28:29.294800 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 131/265] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:28:29 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.294968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:29.294968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:29.295136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:29.300623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:29.305497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.306226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.306909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.308301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.309000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.309613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.314658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.315141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.318499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.319290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.319792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.320237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.597098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:29.609800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:29.617126 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-401f3b85-dfae-4e03-9c32-c73104297c53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.333994 Oct 28 17:28:29.621463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 135/266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:29 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:29.630591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ba4a3ef-06cf-466a-a410-7f03b858b304 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:29.664779 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ba4a3ef-06cf-466a-a410-7f03b858b304 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 243 microversion: 2.1 time: 0.041836 Oct 28 17:28:29.668881 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 136/267] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:28:29 2022] GET /compute/v2.1/os-aggregates/8 => generated 243 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.682564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f113d6b-397b-4bff-b999-716c63ea1d18 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:29.713404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f113d6b-397b-4bff-b999-716c63ea1d18 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:29.714230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f113d6b-397b-4bff-b999-716c63ea1d18 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:29.715286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f113d6b-397b-4bff-b999-716c63ea1d18 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:29.726377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:29.745567 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e192ed0-ff38-4efd-8e8d-2f01260653ee tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.454751 Oct 28 17:28:29.754760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 132/268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:29 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:29.962914 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f113d6b-397b-4bff-b999-716c63ea1d18 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.286722 Oct 28 17:28:29.964302 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 137/269] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:28:29 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:29.980849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-141ee226-d0a5-470d-9975-d9e3002d327c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:30.028021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-141ee226-d0a5-470d-9975-d9e3002d327c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.053851 Oct 28 17:28:30.029271 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 133/270] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:30.043407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c90adf47-2b8d-48da-b88f-8ed95168c16f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1222901914"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:30.047129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-c90adf47-2b8d-48da-b88f-8ed95168c16f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid b9f17ffa-82e6-4b03-91f9-23e45258ba31 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:30.088377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c90adf47-2b8d-48da-b88f-8ed95168c16f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049520 Oct 28 17:28:30.090144 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 138/271] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:30.104838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89bc7f7f-39ba-49af-bd92-c71db04d5b27 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:30.118301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bc7f7f-39ba-49af-bd92-c71db04d5b27 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.118853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bc7f7f-39ba-49af-bd92-c71db04d5b27 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.119289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bc7f7f-39ba-49af-bd92-c71db04d5b27 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.295005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89bc7f7f-39ba-49af-bd92-c71db04d5b27 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.196619 Oct 28 17:28:30.296704 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 134/272] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:30.309109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8073f6bd-07d9-495c-babc-d59bea8d348f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:30.325607 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8073f6bd-07d9-495c-babc-d59bea8d348f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.021305 Oct 28 17:28:30.326887 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 139/273] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:28:30 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:30.341562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cfe2271-7a86-4013-a416-1ac1d4f411b8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:30.356935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:30.369285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cfe2271-7a86-4013-a416-1ac1d4f411b8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.370147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cfe2271-7a86-4013-a416-1ac1d4f411b8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.370794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cfe2271-7a86-4013-a416-1ac1d4f411b8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.560594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3cfe2271-7a86-4013-a416-1ac1d4f411b8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.221664 Oct 28 17:28:30.571830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 135/274] 10.222.0.48 () {60 vars in 1191 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:30.574906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4fab9d13-e561-4f3c-a0c2-f6c36e387bc6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:30.623250 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4fab9d13-e561-4f3c-a0c2-f6c36e387bc6 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.052290 Oct 28 17:28:30.623942 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 140/275] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:30 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 17:28:30.637620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42f5a679-05b3-4619-9f42-763a48af91e8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1161527458"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:30.643015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-42f5a679-05b3-4619-9f42-763a48af91e8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid f0a24ce6-8a00-4d4f-9dcf-1e0293595d6e for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:30.648838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:30.650056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:30.660659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.662480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.663116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.664743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.666692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.667519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.676884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42f5a679-05b3-4619-9f42-763a48af91e8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043084 Oct 28 17:28:30.677770 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 136/276] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:30.692745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73f95d2f-2383-4fa8-8134-20ee9307dfd8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:30.709397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f95d2f-2383-4fa8-8134-20ee9307dfd8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.710030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f95d2f-2383-4fa8-8134-20ee9307dfd8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.711158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f95d2f-2383-4fa8-8134-20ee9307dfd8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.920602 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73f95d2f-2383-4fa8-8134-20ee9307dfd8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.235089 Oct 28 17:28:30.923419 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 137/277] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:30.941256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:30.941937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:30.947419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:30.950149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.950823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.952129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.953445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:30.954071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:30.954914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:30.957776 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13817ddc-b342-47f1-8cdf-7c53d839f94a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.312412 Oct 28 17:28:30.959221 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 141/278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:30 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:30.982513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-263f1cdb-40e6-43f3-b95b-4db2f2aef68e tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.007069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-263f1cdb-40e6-43f3-b95b-4db2f2aef68e tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:31.007683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-263f1cdb-40e6-43f3-b95b-4db2f2aef68e tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:31.008152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-263f1cdb-40e6-43f3-b95b-4db2f2aef68e tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:31.190380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:31.200175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ff977e2-bc74-42da-8ec1-038cc57b92f7 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.275181 Oct 28 17:28:31.200760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 138/279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:30 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:31.213573 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-263f1cdb-40e6-43f3-b95b-4db2f2aef68e tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.253176 Oct 28 17:28:31.214515 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 142/280] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:30 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:31.226159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70f08f79-65f0-4408-887f-80b79ff661a8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.248506 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70f08f79-65f0-4408-887f-80b79ff661a8 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.026280 Oct 28 17:28:31.249950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 139/281] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:31 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:31.259600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9b3191fa-a9bb-497e-bccd-bcc5a1febcf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1464522709"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.263216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-9b3191fa-a9bb-497e-bccd-bcc5a1febcf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 045b25d3-1d12-4ca6-8174-a2b5f915f270 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:31.292007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9b3191fa-a9bb-497e-bccd-bcc5a1febcf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036134 Oct 28 17:28:31.293118 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 143/282] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:31.304957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-827414dd-5fe1-427f-987b-b144d02bf586 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.336021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8104373-3553-4535-90d7-ade45d68944f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1746293934"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.342339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-827414dd-5fe1-427f-987b-b144d02bf586 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.041701 Oct 28 17:28:31.345756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 140/283] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:31 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:31.346437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-b8104373-3553-4535-90d7-ade45d68944f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid 7c6faa25-62f6-4bb9-a970-8fff4c01688c for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:31.354822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2331343d-404e-4b86-b2a6-cc73d9f66212 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.372543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2331343d-404e-4b86-b2a6-cc73d9f66212 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2331343d-404e-4b86-b2a6-cc73d9f66212 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Request method failure captured: Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEWx8izgjd5059W_haTuAQZMa5_JsZQzpZq_2zTpJ4IA4Oos5tcqfr-ebKD4htHCHgTCc7AI0aR1oGRoBvUqQOtTM7SIlMtWxbpAYb8opx-opL2SlPKqa1h8n5fsDgXszPggzNYsfRg550E728L-XlpR9JmKbnSlg1BWbZwMQOeh_k Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:31.374679 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b51c7751d6774616ba91441c36d36063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b51c7751d6774616ba91441c36d36063"}]}] Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 967b1a6397104658beb7e3cf0972b4ac Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: exception: Aggregate 11 could not be found. Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '11'} Oct 28 17:28:31.376142 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.376948 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 28 17:28:31.378254 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.380233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2331343d-404e-4b86-b2a6-cc73d9f66212 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:31.381300 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2331343d-404e-4b86-b2a6-cc73d9f66212 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.033153 Oct 28 17:28:31.382241 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 141/284] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:31 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:31.391741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bd76d48-059c-4f60-b05c-88ead8904a0f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.401753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8104373-3553-4535-90d7-ade45d68944f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073734 Oct 28 17:28:31.402662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 144/285] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:31.415057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bccd522e-97e3-4c3f-b4b3-1e2f231c214f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.426575 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6bd76d48-059c-4f60-b05c-88ead8904a0f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bd76d48-059c-4f60-b05c-88ead8904a0f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Request method failure captured: Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEWx8izgjd5059W_haTuAQZMa5_JsZQzpZq_2zTpJ4IA4Oos5tcqfr-ebKD4htHCHgTCc7AI0aR1oGRoBvUqQOtTM7SIlMtWxbpAYb8opx-opL2SlPKqa1h8n5fsDgXszPggzNYsfRg550E728L-XlpR9JmKbnSlg1BWbZwMQOeh_k Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:31.428949 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b51c7751d6774616ba91441c36d36063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b51c7751d6774616ba91441c36d36063"}]}] Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 967b1a6397104658beb7e3cf0972b4ac Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: exception: Aggregate 11 could not be found. Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '11'} Oct 28 17:28:31.430449 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:31.431317 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.432623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.434032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.434032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:31.434032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:31.434032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 28 17:28:31.434032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.434367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccd522e-97e3-4c3f-b4b3-1e2f231c214f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:31.434367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccd522e-97e3-4c3f-b4b3-1e2f231c214f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:31.434613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccd522e-97e3-4c3f-b4b3-1e2f231c214f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:31.435697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bd76d48-059c-4f60-b05c-88ead8904a0f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:31.437005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6bd76d48-059c-4f60-b05c-88ead8904a0f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.049943 Oct 28 17:28:31.438232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:31 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:28:31.448010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-889daf4c-5116-4cc0-81d5-c8ce1c9c172a tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2138496746", "name": "tempest-test_aggregate-538064451"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.484502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-889daf4c-5116-4cc0-81d5-c8ce1c9c172a tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 3c5c1de4-9e54-4775-bdb2-a9db82b5484e for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:31.536691 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-889daf4c-5116-4cc0-81d5-c8ce1c9c172a tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.086990 Oct 28 17:28:31.537466 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 143/287] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:31.550978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-634050b9-f8f8-45b2-a1de-cdc871853bff tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.612019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-634050b9-f8f8-45b2-a1de-cdc871853bff tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.067100 Oct 28 17:28:31.613551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 17:28:31.628741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6846eb53-dab2-4cde-9bc0-54ed923c1568 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.646045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6846eb53-dab2-4cde-9bc0-54ed923c1568 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6846eb53-dab2-4cde-9bc0-54ed923c1568 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Request method failure captured: Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEWx8izgjd5059W_haTuAQZMa5_JsZQzpZq_2zTpJ4IA4Oos5tcqfr-ebKD4htHCHgTCc7AI0aR1oGRoBvUqQOtTM7SIlMtWxbpAYb8opx-opL2SlPKqa1h8n5fsDgXszPggzNYsfRg550E728L-XlpR9JmKbnSlg1BWbZwMQOeh_k Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:31.655792 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b51c7751d6774616ba91441c36d36063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b51c7751d6774616ba91441c36d36063"}]}] Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 967b1a6397104658beb7e3cf0972b4ac Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: exception: Aggregate 13 could not be found. Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '13'} Oct 28 17:28:31.657782 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.658485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 17:28:31.659522 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.663442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6846eb53-dab2-4cde-9bc0-54ed923c1568 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:31.663442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6846eb53-dab2-4cde-9bc0-54ed923c1568 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.041526 Oct 28 17:28:31.669445 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 145/289] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:31 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:31.672356 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bccd522e-97e3-4c3f-b4b3-1e2f231c214f tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 244 microversion: 2.1 time: 0.260971 Oct 28 17:28:31.675625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 145/290] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates/12/action => generated 244 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:31.690546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c2a78f9-1186-4790-a56b-37d14cfd9d6c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.700425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-812a48bd-45e3-48f2-8ba3-e25b10f3aa06 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.702189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:31.708605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-812a48bd-45e3-48f2-8ba3-e25b10f3aa06 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0c917303b73b4cad941fdb45169e20c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5815440b4178bdf4941386d086d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-812a48bd-45e3-48f2-8ba3-e25b10f3aa06 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Request method failure captured: Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 43 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEStMwGV1rvBPL-TmN1Jkwf2MNhB5MwdIPRZ40TAhdIM1ttDQg5veRRbWcDBwdYKCOotl2tVETBb6UKq89e--w_ABTV9cDe6__7Yk2HithsCgAWmZOtJ4F0uJ4yqjJrxr5MCNbUJ7ymsOlgOf09ppAlfucTSx0yPnDGqbPBsSEiYwo Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:31.714803 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/739e5815440b4178bdf4941386d086d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_739e5815440b4178bdf4941386d086d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/739e5815440b4178bdf4941386d086d7"}]}] Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 739e5815440b4178bdf4941386d086d7 Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146 Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0c917303b73b4cad941fdb45169e20c8 Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1607698146-project Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: {"remove_host": {"host": "n-h2-860864-13"}} Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:31.716218 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-860864-13'}}} Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:31.716995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 17:28:31.718140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.721327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-812a48bd-45e3-48f2-8ba3-e25b10f3aa06 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:31.721327 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-812a48bd-45e3-48f2-8ba3-e25b10f3aa06 tempest-AggregatesAdminNegativeTestJSON-1607698146 tempest-AggregatesAdminNegativeTestJSON-1607698146-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.031100 Oct 28 17:28:31.727390 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 146/291] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:31.735195 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0c2a78f9-1186-4790-a56b-37d14cfd9d6c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c2a78f9-1186-4790-a56b-37d14cfd9d6c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Request method failure captured: Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEWx8izgjd5059W_haTuAQZMa5_JsZQzpZq_2zTpJ4IA4Oos5tcqfr-ebKD4htHCHgTCc7AI0aR1oGRoBvUqQOtTM7SIlMtWxbpAYb8opx-opL2SlPKqa1h8n5fsDgXszPggzNYsfRg550E728L-XlpR9JmKbnSlg1BWbZwMQOeh_k Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:31.739240 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b51c7751d6774616ba91441c36d36063"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b51c7751d6774616ba91441c36d36063"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b51c7751d6774616ba91441c36d36063"}]}] Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: b51c7751d6774616ba91441c36d36063 Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-413563595 Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 967b1a6397104658beb7e3cf0972b4ac Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminTestJSON-413563595-project-admin Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: exception: Aggregate 13 could not be found. Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '13'} Oct 28 17:28:31.740509 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:31.741214 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:31.742196 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:31.743293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c2a78f9-1186-4790-a56b-37d14cfd9d6c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:31.744377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c2a78f9-1186-4790-a56b-37d14cfd9d6c tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.067645 Oct 28 17:28:31.744936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:31.750131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61914a71-230c-4e2e-9372-478c84bacd48 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.768964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65148a04-7d77-4cc3-8af1-4c725c8771db tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-68324"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.782942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-65148a04-7d77-4cc3-8af1-4c725c8771db tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 2e00868f-d5f9-4c3b-b0d5-741532f0e117 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:31.794394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61914a71-230c-4e2e-9372-478c84bacd48 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:31.796072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61914a71-230c-4e2e-9372-478c84bacd48 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:31.797422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61914a71-230c-4e2e-9372-478c84bacd48 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:31.831474 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65148a04-7d77-4cc3-8af1-4c725c8771db tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 194 microversion: 2.1 time: 0.077353 Oct 28 17:28:31.833251 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 147/293] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:31.851153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-249714b0-568d-42e6-9c52-1c1abecfa6c7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:31.871560 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-249714b0-568d-42e6-9c52-1c1abecfa6c7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 223 microversion: 2.1 time: 0.031091 Oct 28 17:28:31.872953 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 148/294] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:31 2022] GET /compute/v2.1/os-aggregates/14 => generated 223 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:31.901734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eafe953a-ef25-4f13-9dab-686540fcf427 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:31.965879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eafe953a-ef25-4f13-9dab-686540fcf427 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 261 microversion: 2.1 time: 0.076440 Oct 28 17:28:31.973289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 149/295] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates/14/action => generated 261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:32.002840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e93a4cf6-a2e8-4989-8f4f-32e91e67d45f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:32.030224 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e93a4cf6-a2e8-4989-8f4f-32e91e67d45f tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 237 microversion: 2.1 time: 0.048906 Oct 28 17:28:32.032302 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 150/296] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:31 2022] GET /compute/v2.1/os-aggregates/14 => generated 237 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:32.049531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:32.050967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:32.060346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:32.061368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:32.062700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:32.064829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:32.066145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:32.068642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:32.103175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61914a71-230c-4e2e-9372-478c84bacd48 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.373967 Oct 28 17:28:32.110515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 147/297] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:31 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:32.123720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-847b556c-d5a1-499d-9efd-434238127706 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:32.173922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-847b556c-d5a1-499d-9efd-434238127706 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.065348 Oct 28 17:28:32.179479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:32 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:32.193323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4ba02b1-4e45-4f5a-83f9-39b07c1b1bf2 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:32.252199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4ba02b1-4e45-4f5a-83f9-39b07c1b1bf2 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.075492 Oct 28 17:28:32.252798 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:32 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:32.273754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42e84f6a-7ecb-4d5c-b633-f7419e57af49 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1548572341", "availability_zone": "tempest-test_az-167767229"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:32.285786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.aggregate [None req-42e84f6a-7ecb-4d5c-b633-f7419e57af49 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid 791b2b30-e04f-47a8-8916-bd3078ab977f for aggregate {{(pid=120568) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:32.370420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42e84f6a-7ecb-4d5c-b633-f7419e57af49 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112999 Oct 28 17:28:32.378456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 150/300] 10.222.0.48 () {60 vars in 1165 bytes} [Fri Oct 28 17:28:32 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:32.388487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:32.389224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:32.404866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:32.405357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:32.406544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:32.407263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:32.408890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:32.409325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:32.602376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:32.615737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d20bfec6-803e-4094-ba14-d7103d4789af tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.578011 Oct 28 17:28:32.636120 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 151/301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:32 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:32.643094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6ff2787-43a1-491d-b824-29f6c12825c5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1406652628"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:32.647925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-f6ff2787-43a1-491d-b824-29f6c12825c5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Generated uuid d516f49e-2d06-4af8-8336-1d24434dd58c for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:32.690867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6ff2787-43a1-491d-b824-29f6c12825c5 tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052139 Oct 28 17:28:32.692580 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 152/302] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:32.705346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f256cc3-1795-473d-a561-23bc234bdaf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1548572341_new", "availability_zone": "tempest-test_az-167767229_new"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:32.972630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:32.986917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52e0f60c-4a86-4c99-8167-45100b1d528d tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.607420 Oct 28 17:28:32.987445 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:32 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:33.002380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:33.020172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f256cc3-1795-473d-a561-23bc234bdaf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.020904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f256cc3-1795-473d-a561-23bc234bdaf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.021226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f256cc3-1795-473d-a561-23bc234bdaf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.021943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.022497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.025778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.042684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.045728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.048878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.069662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.compute.aggregates [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 17:28:33.070436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Request method failure captured: Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 42 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEVrgWP4_jUGQ16F0IjxodrJRxJE8XtaowYKp4iuN6adB0OsJh4mmcVPuTZDPCktXH_woiDiwPwHmknHf8YOj8oYNqWeb_cfvZS7QtLUxHg-uPE9q31IwTT6A-JtqjUMfxoI0MK87_jcCRYwDtwtLfb6EbE8mxjCW3A8d6O0va6qFA Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:28:33.073257 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2680e060f9524f7093891fb1949d372d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2680e060f9524f7093891fb1949d372d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2680e060f9524f7093891fb1949d372d"}]}] Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2680e060f9524f7093891fb1949d372d Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568 Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9533bebca55147f99c2f3d7ec141b6fd Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: {"remove_host": {"host": "nonexist_host"}} Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:33.074498 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 17:28:33.075293 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 28 17:28:33.076399 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.077493 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 28 17:28:33.079272 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.086544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:33.087753 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-09b34ba7-432f-44fb-954e-d9755290da1a tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.097302 Oct 28 17:28:33.088620 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 152/304] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 17:28:32 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:33.100416 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f256cc3-1795-473d-a561-23bc234bdaf7 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 335 microversion: 2.1 time: 0.405237 Oct 28 17:28:33.107691 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 153/305] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 17:28:32 2022] PUT /compute/v2.1/os-aggregates/15 => generated 335 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:33.111199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48fbfd8e-9cd0-4d90-ae06-f6209d7c96de tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.154394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48fbfd8e-9cd0-4d90-ae06-f6209d7c96de tempest-AggregatesAdminNegativeTestJSON-1339794568 tempest-AggregatesAdminNegativeTestJSON-1339794568-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.048899 Oct 28 17:28:33.159834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 154/306] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:33 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:33.173299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9721005a-863a-43de-8e74-4c5860c0fcba tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.188813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9721005a-863a-43de-8e74-4c5860c0fcba tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.023602 Oct 28 17:28:33.189717 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 155/307] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:28:33 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:33.201700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed359e8e-be0b-46f9-8ebe-eec4255cc9a2 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.245196 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed359e8e-be0b-46f9-8ebe-eec4255cc9a2 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.047443 Oct 28 17:28:33.253533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 156/308] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:33 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 17:28:33.259725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9181cc54-b2f2-49ba-b4e4-cdbf1c078309 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1555222190"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:33.266592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-9181cc54-b2f2-49ba-b4e4-cdbf1c078309 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Generated uuid e240e54f-db77-4a92-9e95-6ff006a273c4 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:33.304778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9181cc54-b2f2-49ba-b4e4-cdbf1c078309 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049930 Oct 28 17:28:33.312122 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 157/309] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 17:28:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:33.318406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-678f6d28-68e8-4d9a-b775-5214dccd46a9 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.329378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-678f6d28-68e8-4d9a-b775-5214dccd46a9 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.014468 Oct 28 17:28:33.337797 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 158/310] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:28:33 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:33.342876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0635dc8-a84f-461d-a84a-b9c81613e844 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.375800 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0635dc8-a84f-461d-a84a-b9c81613e844 tempest-AggregatesAdminTestJSON-413563595 tempest-AggregatesAdminTestJSON-413563595-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035717 Oct 28 17:28:33.377295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 159/311] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:28:33 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 17:28:33.396926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.397436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:33.410038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.413511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.413963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.415710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.416176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.417816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.442499 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] HTTP exception thrown: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Request method failure captured: Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 HTTP/1.1 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBETihM5_panGPOgpIL5-XacaEFJ-4Xva4HmPDZe5xia0cgRwm06XtdsAnaP_J-gu8EUv00TSVfsmjKGQ8uFYqHRPwKRI3-HZmUBwWd0kWYzs4xDHEw-K3oJPLpZ__L2h42hz4DoMbiYbkX962SkGmoNo75zt8IDi5qO1_Tp25ilLxc Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:33.444869 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f680e101d13d4d13aecb0ff391b50332"}]}] Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 4b136d7515ea4b28b7508b403c249168 Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.446013 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c8e7890f-a186-4215-85ec-4dbfd7ba0510'} Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:33.446646 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.447728 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.448796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Returning 404 to user: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:33.448796 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-568e0f66-2183-465e-98ae-f53d35121401 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 404 len: 111 microversion: 2.1 time: 0.063158 Oct 28 17:28:33.448796 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 160/312] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:28:33 2022] DELETE /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:33.467134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.467808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] [instance: c8e7890f-a186-4215-85ec-4dbfd7ba0510] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:33.489066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=42 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:33.492120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.502303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0182ef17-6444-46c5-b36c-37b17f512a4c tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Calling method '.version_select at 0x7f7524cf7550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.507806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.509113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.514045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.514545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.519432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.560342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] HTTP exception thrown: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Request method failure captured: Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 HTTP/1.1 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBETihM5_panGPOgpIL5-XacaEFJ-4Xva4HmPDZe5xia0cgRwm06XtdsAnaP_J-gu8EUv00TSVfsmjKGQ8uFYqHRPwKRI3-HZmUBwWd0kWYzs4xDHEw-K3oJPLpZ__L2h42hz4DoMbiYbkX962SkGmoNo75zt8IDi5qO1_Tp25ilLxc Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:33.566529 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f680e101d13d4d13aecb0ff391b50332"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f680e101d13d4d13aecb0ff391b50332"}]}] Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f680e101d13d4d13aecb0ff391b50332 Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2122530657 Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 4b136d7515ea4b28b7508b403c249168 Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AggregatesAdminTestJSON-2122530657-project Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.567971 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c8e7890f-a186-4215-85ec-4dbfd7ba0510'} Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:33.568621 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. Oct 28 17:28:33.569757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:33.570741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] Returning 404 to user: Instance c8e7890f-a186-4215-85ec-4dbfd7ba0510 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:33.570741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0dcd1d80-8865-463b-9d41-453b112b02e1 tempest-AggregatesAdminTestJSON-2122530657 tempest-AggregatesAdminTestJSON-2122530657-project] 10.222.0.48 "GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510" status: 404 len: 111 microversion: 2.1 time: 0.113836 Oct 28 17:28:33.576571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 161/313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:33 2022] GET /compute/v2.1/servers/c8e7890f-a186-4215-85ec-4dbfd7ba0510 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:33.647454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:33.651847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:33.661836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.662422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.663038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.663920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:33.665961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:33.667008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:33.903048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:34.161891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:34.172434 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb06c95f-03ef-4705-8643-54b765e1ba62 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.533778 Oct 28 17:28:34.176437 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 162/314] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:33 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:34.182625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:34.183457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:34.200416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:34.200899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:34.201323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:34.202034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:34.203005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:34.203454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:34.380889 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0182ef17-6444-46c5-b36c-37b17f512a4c tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 371 microversion: 2.1 time: 1.286016 Oct 28 17:28:34.384537 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 153/315] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:28:33 2022] GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 371 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:34.399485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524fa7940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:34.517944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:34.525683 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b415806c-cef0-41d1-ae62-42ffc08cab11 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.349175 Oct 28 17:28:34.527650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 163/316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:34 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:34.902741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:34.903775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:34.904213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:34.904939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:34.908066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:34.910360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:35.023996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=12,nova_api:INSERT=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:35.029084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48dcadc3-8e2d-461a-a62a-2843cd934901 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 328 microversion: 2.1 time: 0.634620 Oct 28 17:28:35.031110 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 154/317] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:34 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 328 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:35.197587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:35.198045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:35.212627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:35.213157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:35.216256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:35.216998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:35.222369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:35.224148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:35.750013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b477488-9236-415f-ab10-4589925afbaf tempest-InstanceUsageAuditLogTestJSON-382013994 tempest-InstanceUsageAuditLogTestJSON-382013994-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:35.824974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b477488-9236-415f-ab10-4589925afbaf tempest-InstanceUsageAuditLogTestJSON-382013994 tempest-InstanceUsageAuditLogTestJSON-382013994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 17:28:35" status: 200 len: 318 microversion: 2.1 time: 0.512719 Oct 28 17:28:35.826532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 155/318] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:28:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2017%3A28%3A35 => generated 318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:36.157797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:36.167045 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1ab403d-5fea-4b68-aa3a-0ad24fb947b3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.973333 Oct 28 17:28:36.168053 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 164/319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:35 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:36.186096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:36.186656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:36.227684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:36.228236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:36.228814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:36.229689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:36.230156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:36.230589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:36.524741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-480148335", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:36.623417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:36.751335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:36.761210 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f666d903-1a13-4188-8009-84cb3fbb2943 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.592002 Oct 28 17:28:36.765819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 165/320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:36 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:36.774890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3c3da02-ace2-4ae8-a3f9-5eab2bdb482e tempest-InstanceUsageAuditLogTestJSON-382013994 tempest-InstanceUsageAuditLogTestJSON-382013994-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:36.826686 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3c3da02-ace2-4ae8-a3f9-5eab2bdb482e tempest-InstanceUsageAuditLogTestJSON-382013994 tempest-InstanceUsageAuditLogTestJSON-382013994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.058962 Oct 28 17:28:36.839514 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 166/321] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:28:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:37.195292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:37.196400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:37.212469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.213791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.215110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.216893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.219340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.223420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.512318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:37.513014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:37.513709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:37.514322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:37.515680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:37.534222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.536248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.541836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.543926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.545209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.547401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.599584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:37.611085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for user 191c6585ac8f40a6863e2b8efabfb10e and project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:37.635319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.utils [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] cores quota exceeded for 0c27fb132d9c4e3c934736572524bc2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120568) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 17:28:37.642104 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Request method failure captured: Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 144 Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBE-Ybx0jkJubcgH3jPg1CHO8C254StPcwhT6taEmlScVrbwv8h-FsJpznR5TtxtE5fEvRNqTmCSyIl9plB_fAOg9joNkUzifr8UMLYWgQWjehpo6xQbN-_r-ad7Kqj-Rzc5lDBb3TzfIB9yotpjDvCfb1QtaHVhYNz6qe-jrYnSkHI Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:37.652345 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c27fb132d9c4e3c934736572524bc2d"}]}] Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 191c6585ac8f40a6863e2b8efabfb10e Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-480148335", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} Oct 28 17:28:37.653613 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-480148335', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452'}}} Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 17:28:37.654288 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:37.655270 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.657325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-322192f4-50a6-406c-ae39-0419da54dfae tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.828774 Oct 28 17:28:37.662111 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 156/322] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:35 2022] POST /compute/v2.1/servers => generated 111 bytes in 1834 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:37.669451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:37.680766 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf31fe48-1cb9-4a11-b808-c52a0d2a4f30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.490489 Oct 28 17:28:37.683980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524d3c5e0>, body: {"quota_set": {"cores": 20}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:37.688147 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 167/323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:37 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:37.775278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-plugged", "status": "completed", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:37.790154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.790922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.792092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.809686 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] Creating event network-vif-plugged:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:28:37.817073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-54febbb6-1e8b-4cb3-8af9-b6a2b5755dad req-60946e53-c06e-441f-aa93-add914585b86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047475 Oct 28 17:28:37.818024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 168/324] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:37.825814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:37.827090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:37.835990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.836683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.837374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:37.839740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:37.840547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:37.841822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:38.516653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:38.517533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:38.518370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:38.521082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:38.526273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:38.526952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:38.559254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:38.572585 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f7ebfee-05ee-4c43-aa78-aab2e35d79b6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.753084 Oct 28 17:28:38.573205 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 169/325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:37 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:38.708362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:38.710420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:38.714463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89c31921-2d69-4abb-9497-729041d1df28 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 329 microversion: 2.1 time: 1.046342 Oct 28 17:28:38.715140 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 157/326] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:37 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 329 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:38.729292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c4eb977-b798-4953-a977-08407f7ac353 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Calling method '.version_select at 0x7f7524d619d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:38.731126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:38.733048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:38.734774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:38.736197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:38.738358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:38.740173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:38.837181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:39.185668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:39.193782 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e9e9fe2-5450-406a-ac34-fad3ccb33f04 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.491190 Oct 28 17:28:39.200493 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 170/327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:38 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:28:40.009522 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c4eb977-b798-4953-a977-08407f7ac353 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 371 microversion: 2.1 time: 1.284274 Oct 28 17:28:40.020830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 158/328] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:28:38 2022] GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 371 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:40.033001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:40.034150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:40.050247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.050598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524e1ae50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:40.052580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.053036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.053522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.053839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.054057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.056918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.057528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.059048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.086232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.086723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.087153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.120293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.121425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.121932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.139151 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4a4cf8da-2b98-4b9e-9e52-1c154f41d51e tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.755913 Oct 28 17:28:40.148228 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 171/329] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:40.150997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1", "name": "network-vif-plugged", "status": "completed", "tag": "1ed108c7-486a-48fa-81ab-7ac5beed1ec1"}, {"server_uuid": "61b00bca-255c-4ee3-bed7-d2cb16cc56a0", "name": "network-vif-plugged", "status": "completed", "tag": "45cdaf83-90fb-4f87-bc39-c1cda16ec105"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:40.174960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.175407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.175827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.209280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Creating event network-vif-plugged:1ed108c7-486a-48fa-81ab-7ac5beed1ec1 for instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 on n-h2-860864-13 Oct 28 17:28:40.210170 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] Creating event network-vif-plugged:45cdaf83-90fb-4f87-bc39-c1cda16ec105 for instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 on n-h1-860864-13 Oct 28 17:28:40.233304 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-882947a6-5b17-479f-a631-bd5dc878433c req-4829d5f1-39ac-41e5-8b71-4bad37581680 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089833 Oct 28 17:28:40.234767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 172/330] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:40.255782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524d7bf70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:40.500710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:40.509985 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0e0b25ad-da03-4b75-9358-d2a20fde1ad8 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.485584 Oct 28 17:28:40.519912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 159/331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:40 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:40.525776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524d59700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:40.531976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.532643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.534379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.575036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.576636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.577105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.614665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.616785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.618212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.631834 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5e74a7f-6f3c-4ed1-a10a-0df4e0458f69 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.109956 Oct 28 17:28:40.633671 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 160/332] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:28:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:40.650403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:40.651304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:40.663643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.664822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.667592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:40.668808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:40.671679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:40.674052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.007715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.008213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.008648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.009379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.013927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.014585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.108716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:41.134458 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2ef1149-88ac-4260-a5cc-4c3a7e659676 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 328 microversion: 2.1 time: 0.898054 Oct 28 17:28:41.136037 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 173/333] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:40 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 328 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:41.149462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524d36f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:41.161271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.162625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.163182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.192481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.199049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.199805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.222390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.224120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.226070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.242345 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f672e209-3d89-4992-bba0-aad95c25b0e2 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.105014 Oct 28 17:28:41.247409 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 174/334] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:41.261466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524e9d3a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:41.263882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.265163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.265921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.284472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.286277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.286884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.296990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35ffbb5f-f5b1-4e9b-b186-1b2956794a84 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.040224 Oct 28 17:28:41.309352 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 175/335] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:41.322687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-280bd818-e5e6-413f-a8ad-9210ece582bc tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524db2e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:41.326141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-280bd818-e5e6-413f-a8ad-9210ece582bc tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.326783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-280bd818-e5e6-413f-a8ad-9210ece582bc tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.327737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-280bd818-e5e6-413f-a8ad-9210ece582bc tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.360380 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-280bd818-e5e6-413f-a8ad-9210ece582bc tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.049312 Oct 28 17:28:41.361658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 176/336] 10.222.0.48 () {58 vars in 1179 bytes} [Fri Oct 28 17:28:41 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:41.377300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-194678839", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:41.481007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:41.519467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:41.536593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a36058eb-4853-4757-9302-9ed7e9de03b6 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1313 microversion: 2.1 time: 0.897263 Oct 28 17:28:41.537540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 161/337] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:40 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:41.545843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524cf7d30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:41.548231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.548612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.549009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.555785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:41.574026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.574623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.575054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.588251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.588907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.589718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.599195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd10d1b4-39ea-4292-9825-2ba73b005f23 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.060171 Oct 28 17:28:41.599997 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 162/338] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:28:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:41.604986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:41.606035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:41.613652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.614349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.614929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:41.615837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:41.616459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:41.617027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.161392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:42.181953 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d9047e3-1d92-4a84-9f16-f3feb086f0a1 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1319 microversion: 2.1 time: 0.579867 Oct 28 17:28:42.183843 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 163/339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:41 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:42.195866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524d59310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:42.198114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.198723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.199433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.244040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.244546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.245957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.254496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c2e92cfb-52b8-4c4d-8ae9-692c13251740 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.068295 Oct 28 17:28:42.266353 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 164/340] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:42.408841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:42.409870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:42.410373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:42.410787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:42.411329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:42.439566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.440070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.440516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.441249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.445898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.448401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.490406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:42.505948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for user 191c6585ac8f40a6863e2b8efabfb10e and project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:42.530052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.utils [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] instances quota exceeded for 0c27fb132d9c4e3c934736572524bc2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 17:28:42.532267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Request method failure captured: Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 144 Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBE-Ybx0jkJubcgH3jPg1CHO8C254StPcwhT6taEmlScVrbwv8h-FsJpznR5TtxtE5fEvRNqTmCSyIl9plB_fAOg9joNkUzifr8UMLYWgQWjehpo6xQbN-_r-ad7Kqj-Rzc5lDBb3TzfIB9yotpjDvCfb1QtaHVhYNz6qe-jrYnSkHI Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:42.538027 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c27fb132d9c4e3c934736572524bc2d"}]}] Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 191c6585ac8f40a6863e2b8efabfb10e Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-194678839", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} Oct 28 17:28:42.539521 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-194678839', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452'}}} Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 17:28:42.540189 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:42.541149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.542308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:42.543458 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b40be84a-d1ed-4c96-ab64-d24ce07b622e tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.178205 Oct 28 17:28:42.547178 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 177/341] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 1185 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:42.557063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f752524fca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:42.559983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.560746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.563500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.569120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:42.585567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.586717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.587502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.600611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d99e45e2-edee-4b6f-94c8-a69fd8a915db tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.049370 Oct 28 17:28:42.601722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 178/342] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:28:42 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:42.607526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524d7ba60>, body: {"quota_set": {"instances": 10}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:42.761645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Calling method '.version_select at 0x7f7524d59940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:42.766654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.770171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.770881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.808664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.810038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.812936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.827408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.828420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.829064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.836772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f331116c-5651-4360-a16a-f794e14a3d67 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.569261 Oct 28 17:28:42.837702 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 165/343] 10.222.0.48 () {60 vars in 1208 bytes} [Fri Oct 28 17:28:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:42.844614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:42.845479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:42.852612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.853517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.855278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:42.856812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:42.857470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:42.858184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.163729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.165033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.169872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.172567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.173119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.173776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.311280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32963d4c-2d7f-46cd-bb68-e89f09c52852 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 329 microversion: 2.1 time: 0.708238 Oct 28 17:28:43.318827 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 179/344] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:42 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 329 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:43.330964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Calling method '.version_select at 0x7f7524c73f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:43.336205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.338716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.339345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.381612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.384077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.385879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.418923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.421771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.423541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.473460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00782f83-a9c2-474d-b349-562f9e115953 tempest-HypervisorAdminTestJSON-1224874956 tempest-HypervisorAdminTestJSON-1224874956-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.153215 Oct 28 17:28:43.479415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 180/345] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:28:43 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:43.490715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:43.502882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43655c16-e43f-4ced-bfd5-20278d0e5b23 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-757094759"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:43.503078 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c96c46fd-6260-40e1-8753-e6cb4980b727 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1462 microversion: 2.1 time: 0.663809 Oct 28 17:28:43.504667 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 166/346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:42 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1462 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:43.512822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-43655c16-e43f-4ced-bfd5-20278d0e5b23 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Generated uuid c95b75b8-d081-458b-b03d-bdec72b2e2d6 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 17:28:43.514443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:43.515126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:43.533713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.534237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.534685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.535428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:43.535896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:43.536321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:43.598223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43655c16-e43f-4ced-bfd5-20278d0e5b23 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.116994 Oct 28 17:28:43.602937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 181/347] 10.222.0.48 () {62 vars in 1205 bytes} [Fri Oct 28 17:28:43 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:43.615611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69e8a9b2-d2da-4daa-a938-7b5a536675ba tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Calling method '.version_select at 0x7f7524c698b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:44.157494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69e8a9b2-d2da-4daa-a938-7b5a536675ba tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 371 microversion: 2.1 time: 0.550871 Oct 28 17:28:44.169504 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 182/348] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:28:43 2022] GET /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 371 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:44.190383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:44.208810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a4335f8-7f97-4067-ac4e-ae6048854f58 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1469 microversion: 2.1 time: 0.701984 Oct 28 17:28:44.209430 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 167/349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:43 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:44.219564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:44.220405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:44.238376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.239296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.239999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.241135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.243069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.245493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.607342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25142aa2-5591-4f18-a174-f91c4f1a9178 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:44.612309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-25142aa2-5591-4f18-a174-f91c4f1a9178 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25142aa2-5591-4f18-a174-f91c4f1a9178 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin] Request method failure captured: Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFLceSx-tBXKVl6Oh-V0LD-guqFe8djimCn1SJNe4Y8PCGil2kh7iMuw-yndbkYJ65kexcSX_W82yNtwhqWAGd3XY1WDmr2V7jvG4Ws8CxTKivb9JL-dGLcqxRP1ZF40rx9FUg7k-LvA39ECsoFSyXXEDXQzhulpAOEz9ROLmALYLM Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bad6e5cd8afe4fcfb21b20058cdb64c9 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:44.627652 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bad6e5cd8afe4fcfb21b20058cdb64c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bad6e5cd8afe4fcfb21b20058cdb64c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bad6e5cd8afe4fcfb21b20058cdb64c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bad6e5cd8afe4fcfb21b20058cdb64c9"}]}] Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bad6e5cd8afe4fcfb21b20058cdb64c9 Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a8ad7b8223a54d49aa4e254cd524ef67 Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:44.629503 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid timestamp for date invalid_time Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'invalid_time'} Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:44.630276 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 28 17:28:44.631670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:44.634286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25142aa2-5591-4f18-a174-f91c4f1a9178 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:44.637262 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25142aa2-5591-4f18-a174-f91c4f1a9178 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563 tempest-InstanceUsageAuditLogNegativeTestJSON-684918563-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.466525 Oct 28 17:28:44.647684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 183/350] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Oct 28 17:28:44 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:28:44.652960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88279f5c-be01-4b96-9e7f-0bbc41582eae tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087808047"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:44.701397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:44.715552 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-672f113a-290f-4fb2-98a5-bd7686bd72e1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1461 microversion: 2.1 time: 0.504186 Oct 28 17:28:44.718831 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 168/351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:44 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1461 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:44.727002 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88279f5c-be01-4b96-9e7f-0bbc41582eae tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.074425 Oct 28 17:28:44.728200 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 184/352] 10.222.0.48 () {62 vars in 1213 bytes} [Fri Oct 28 17:28:44 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:44.732183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524d59a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:44.736565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:44.740296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:44.755810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.757102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.757821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.760367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.763668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.764492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.914160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.915970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.917293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.918399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:44.921479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:44.922327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:44.931757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lazy-loading 'flavor' on Instance uuid 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:28:44.967276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=32 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:45.076012 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8038a2bf-bc99-43b4-878f-dfb435ab73c5 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 325 microversion: 2.1 time: 0.354166 Oct 28 17:28:45.080128 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-955dc673-3c3d-471c-a2f1-edfa874a858e tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1/action" status: 202 len: 0 microversion: 2.1 time: 0.350450 Oct 28 17:28:45.081267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 185/353] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:28:44 2022] POST /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:28:45.090029 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 169/354] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:44 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:45.245634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1272391179", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "0cbf4b98-e322-48fb-b131-dac3c084f709"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:45.373401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] validate_networks() for [('0cbf4b98-e322-48fb-b131-dac3c084f709', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:45.454194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81931d97-4b9d-4733-9c27-491ec1b3db48 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:45.456162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81931d97-4b9d-4733-9c27-491ec1b3db48 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f2178f6fb10f45cfaf89171fcf1713da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec65775b6654f75a2515aecb36f929a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81931d97-4b9d-4733-9c27-491ec1b3db48 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Request method failure captured: Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFKxhTgpJ7MnMjDj29IOkfa4htcs_KqwQixLxWbXJTw97oqyNo9sem6tVZL6ei0b2DbBEpXWwSaVVHnGqOBMuQUfzWw7CajBzE4x_0tZgSwbYY9Mqis-gP60mP7kY0lywcx6yVj7I6Fo88dv2nqSGx5zbrXCSgQBkdjV-ZNYdc91e4 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4ec65775b6654f75a2515aecb36f929a Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:45.457932 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4ec65775b6654f75a2515aecb36f929a"}]}] Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4ec65775b6654f75a2515aecb36f929a Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f2178f6fb10f45cfaf89171fcf1713da Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project Oct 28 17:28:45.459183 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:45.460188 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 17:28:45.461268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:45.462188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81931d97-4b9d-4733-9c27-491ec1b3db48 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:45.462188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81931d97-4b9d-4733-9c27-491ec1b3db48 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.368394 Oct 28 17:28:45.470806 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 170/355] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:28:45 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 380 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:45.478689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7bd7abba-b7b9-426f-9345-72217e811f57 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:45.495067 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7bd7abba-b7b9-426f-9345-72217e811f57 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.023084 Oct 28 17:28:45.501235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 171/356] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:28:45 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:45.506200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-496236220", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "91b8092a-21c3-44e2-8fec-86e6d125db39"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:45.613358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:46.849350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:46.850703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:46.851585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:46.852954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:46.854290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:46.872162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:46.872943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:46.874098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:46.875106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:46.875811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:46.876573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:46.933402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:46.940040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Getting quotas for user d6161a967d6549ea8275b2d9dd98aa02 and project 51bdbcf44e1646268fc1b36fabb61260. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:46.962488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:28:46.964854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:28:47.041225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-560abc86-e55a-40a6-82e7-9d314c57f95a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538005 Oct 28 17:28:47.055613 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 172/357] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:28:47.062700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:47.063936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:47.072028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:47.084999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:47.085860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:47.087632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:47.089537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:47.090769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:47.173749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:47.615994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:47.616672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:47.617141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:47.617774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:47.618390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:47.634212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:47.645112 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10c7336d-072c-4208-9f5e-9241846b8431 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1460 microversion: 2.1 time: 0.587713 Oct 28 17:28:47.647356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:47.648101 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 173/358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:47 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1460 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:47.648754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:47.659982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:47.661262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:47.661839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:47.666104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:47.675276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1955099297", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:47.741116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:47.745469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for user 5121cf58427a48738ec1c70fbf5e922d and project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:47.774507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:28:47.775343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:28:47.781287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:28:47.930186 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ce0cb8a-7bd1-4d5c-94cf-146eeea9f0c8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.847397 Oct 28 17:28:47.934867 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 186/359] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:28:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2853 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:28:47.976859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0acec646-d364-4ee9-9ff8-0a336808e5fd tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:47.979939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0acec646-d364-4ee9-9ff8-0a336808e5fd tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f2178f6fb10f45cfaf89171fcf1713da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec65775b6654f75a2515aecb36f929a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0acec646-d364-4ee9-9ff8-0a336808e5fd tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Request method failure captured: Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2017:28:45 HTTP/1.1 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFKxhTgpJ7MnMjDj29IOkfa4htcs_KqwQixLxWbXJTw97oqyNo9sem6tVZL6ei0b2DbBEpXWwSaVVHnGqOBMuQUfzWw7CajBzE4x_0tZgSwbYY9Mqis-gP60mP7kY0lywcx6yVj7I6Fo88dv2nqSGx5zbrXCSgQBkdjV-ZNYdc91e4 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4ec65775b6654f75a2515aecb36f929a Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:47.981806 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4ec65775b6654f75a2515aecb36f929a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4ec65775b6654f75a2515aecb36f929a"}]}] Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4ec65775b6654f75a2515aecb36f929a Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f2178f6fb10f45cfaf89171fcf1713da Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project Oct 28 17:28:47.983321 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2022-10-28 17:28:45'} Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:47.983924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 17:28:47.985142 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:47.986783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0acec646-d364-4ee9-9ff8-0a336808e5fd tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:47.990037 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0acec646-d364-4ee9-9ff8-0a336808e5fd tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301 tempest-InstanceUsageAuditLogNegativeTestJSON-1778017301-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 17:28:45" status: 403 len: 128 microversion: 2.1 time: 0.049217 Oct 28 17:28:47.992132 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 187/360] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:28:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2017%3A28%3A45 => generated 128 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:48.032576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a69269bf-d965-40eb-be75-fb9a21a23d51 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:48.084783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a69269bf-d965-40eb-be75-fb9a21a23d51 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.085294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a69269bf-d965-40eb-be75-fb9a21a23d51 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.085732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a69269bf-d965-40eb-be75-fb9a21a23d51 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.335412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:28:48.337457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:28:48.338031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:28:48.338505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:28:48.338915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:28:48.365263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.365750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.366184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.367228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.367708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.368126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.437313 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a69269bf-d965-40eb-be75-fb9a21a23d51 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 316 microversion: 2.41 time: 0.442694 Oct 28 17:28:48.439482 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 188/361] 10.222.0.48 () {62 vars in 1235 bytes} [Fri Oct 28 17:28:47 2022] POST /compute/v2.1/os-aggregates/18/action => generated 316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:48.455197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:48.456828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:48.468815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.470524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.474332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.475865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.476497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.477085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.536055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:48.564812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Getting quotas for user 191c6585ac8f40a6863e2b8efabfb10e and project 0c27fb132d9c4e3c934736572524bc2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:48.621678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.utils [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] ram quota exceeded for 0c27fb132d9c4e3c934736572524bc2d, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120568) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 17:28:48.632564 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Request method failure captured: Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 145 Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBE-Ybx0jkJubcgH3jPg1CHO8C254StPcwhT6taEmlScVrbwv8h-FsJpznR5TtxtE5fEvRNqTmCSyIl9plB_fAOg9joNkUzifr8UMLYWgQWjehpo6xQbN-_r-ad7Kqj-Rzc5lDBb3TzfIB9yotpjDvCfb1QtaHVhYNz6qe-jrYnSkHI Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:28:48.642572 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c27fb132d9c4e3c934736572524bc2d"}]}] Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 191c6585ac8f40a6863e2b8efabfb10e Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1955099297", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} Oct 28 17:28:48.644119 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1955099297', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452'}}} Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 17:28:48.644940 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:48.646170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.647664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:28:48.649066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:48.650543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e537d443-4b80-4848-ae5b-76de84ac6715 tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.999645 Oct 28 17:28:48.651169 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 174/362] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:28:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 1002 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:48.684537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:48.690259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:48.729660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.734869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:48.744004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.748877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.754166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:48.754809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:48.757843 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7ba0a3f-34c7-4ab7-b443-6edc7eba365f tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1265 microversion: 2.1 time: 0.316976 Oct 28 17:28:48.758729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:48.760535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 189/363] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:48 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:48.779617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:48.781086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:48.974647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:49.012196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:49.020338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:49.026678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01873bce-0f19-4d96-97f2-c87d8e2e7ddb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1262 microversion: 2.25 time: 0.258398 Oct 28 17:28:49.029114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 190/364] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:48 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1262 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:49.061395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1135a545-02f8-4cff-b82f-ab88fdf2332f tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:49.141682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1135a545-02f8-4cff-b82f-ab88fdf2332f tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:49.144337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1135a545-02f8-4cff-b82f-ab88fdf2332f tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:49.145253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1135a545-02f8-4cff-b82f-ab88fdf2332f tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:49.421264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1135a545-02f8-4cff-b82f-ab88fdf2332f tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.390805 Oct 28 17:28:49.434562 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 191/365] 10.222.0.48 () {62 vars in 1235 bytes} [Fri Oct 28 17:28:49 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:28:49.449522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Action: 'update', calling method: .version_select at 0x7f7524bec550>, body: {"quota_set": {"ram": 51200}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:50.244177 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf36acc5-111f-4b5d-95a2-aaaac8f56ab4 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1613 microversion: 2.1 time: 1.582809 Oct 28 17:28:50.264757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 175/366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:48 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1613 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:50.272306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e001afa-d939-420d-995b-06ad86fd3f93 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:50.320446 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e001afa-d939-420d-995b-06ad86fd3f93 tempest-AggregatesAdminTestV241-32037164 tempest-AggregatesAdminTestV241-32037164-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.053910 Oct 28 17:28:50.329514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 176/367] 10.222.0.48 () {60 vars in 1196 bytes} [Fri Oct 28 17:28:50 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:50.359337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:50.361706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:50.382883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.388986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.393538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.397818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.400071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.400517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.508599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.509083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.509500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.514378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.514901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.515416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.587722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:50.691597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:50.728681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-149b47a8-5085-415b-a4d2-78639ba0c200 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1271 microversion: 2.1 time: 0.397186 Oct 28 17:28:50.734242 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 177/368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:50 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:50.759344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:50.761875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:50.781651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.782777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.784531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.785470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.788181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.790220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.794603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38ffa3f8-f1d6-4d81-953f-fa2f7a348572 tempest-QuotasAdminNegativeTest-1480637572 tempest-QuotasAdminNegativeTest-1480637572-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 200 len: 329 microversion: 2.1 time: 1.358201 Oct 28 17:28:50.806588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 192/369] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:49 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 329 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:50.829238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:50.856610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.857370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.858513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.860478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:50.862474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:50.868282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:50.968455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0228c0a-0c2d-407b-85c7-6275702d2111 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.160009 Oct 28 17:28:50.969855 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 193/370] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:28:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:50.982664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:50.982907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-603e00dd-9a91-4734-83ba-9bde7978408a tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Action: 'update', calling method: .version_select at 0x7f7524c62790>, body: {"quota_set": {"ram": 0}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:50.987982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-603e00dd-9a91-4734-83ba-9bde7978408a tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '191c6585ac8f40a6863e2b8efabfb10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c27fb132d9c4e3c934736572524bc2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-603e00dd-9a91-4734-83ba-9bde7978408a tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Request method failure captured: Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d HTTP/1.1 Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 25 Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBE-Ybx0jkJubcgH3jPg1CHO8C254StPcwhT6taEmlScVrbwv8h-FsJpznR5TtxtE5fEvRNqTmCSyIl9plB_fAOg9joNkUzifr8UMLYWgQWjehpo6xQbN-_r-ad7Kqj-Rzc5lDBb3TzfIB9yotpjDvCfb1QtaHVhYNz6qe-jrYnSkHI Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:50.993403 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c27fb132d9c4e3c934736572524bc2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c27fb132d9c4e3c934736572524bc2d"}]}] Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0c27fb132d9c4e3c934736572524bc2d Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-153049466 Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 191c6585ac8f40a6863e2b8efabfb10e Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-QuotasAdminNegativeTest-153049466-project Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: {"quota_set": {"ram": 0}} Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 17:28:50.994629 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0c27fb132d9c4e3c934736572524bc2d', 'body': {'quota_set': {'ram': 0}}} Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:50.995385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:50.996591 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 17:28:50.997802 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:50.998134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:50.999594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-603e00dd-9a91-4734-83ba-9bde7978408a tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:51.001629 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-603e00dd-9a91-4734-83ba-9bde7978408a tempest-QuotasAdminNegativeTest-153049466 tempest-QuotasAdminNegativeTest-153049466-project] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d" status: 403 len: 116 microversion: 2.1 time: 0.030457 Oct 28 17:28:51.003266 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 194/371] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:28:50 2022] PUT /compute/v2.1/os-quota-sets/0c27fb132d9c4e3c934736572524bc2d => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:28:51.005000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:51.006228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8bc9bac-aaab-4045-bfbd-d88cc86b0142 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1332 microversion: 2.25 time: 0.269111 Oct 28 17:28:51.006789 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 178/372] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:50 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1332 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:51.008602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:51.011512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:51.020753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.021710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.022307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.023207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.023832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.025030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.066184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Lazy-loading 'flavor' on Instance uuid 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:28:51.080858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 while it is in vm_state suspended Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Request method failure captured: Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1/action HTTP/1.1 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 98 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBETCZ_vs37tOGNkot2Z2U5i3bNQYlI6jKNqBRuyxb9u75Dp9DkfE322p4NDSCuTOS-riLavZR6SBNrpdUnxEaML6lNTi0foBSyyYQ3etFiRZdi7VXc4QQ6gVdLhAvzlAW2mJemt6j2poJy-TWAIed4aC65LCZoaogi5ApqTXlFg2K8 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 74d8c2c8fdfa4d978307c6239476980e Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:28:51.083221 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d8c2c8fdfa4d978307c6239476980e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d8c2c8fdfa4d978307c6239476980e"}]}] Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 74d8c2c8fdfa4d978307c6239476980e Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-778644995 Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationNegativeTest-778644995-project-admin Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 65e4fb355cc34fa7811ca51c58479142 Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationNegativeTest-778644995-project-admin Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": true, "disk_over_commit": false}} Oct 28 17:28:51.084750 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'os-migrateLive' instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 while it is in vm_state suspended Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1', 'body': {'os-migrateLive': {'host': 'n-h1-860864-13', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 17:28:51.085493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:51.086467 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 while it is in vm_state suspended Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 while it is in vm_state suspended Oct 28 17:28:51.087568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:51.090572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 while it is in vm_state suspended {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:51.091712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-401206b2-6579-44b0-aada-af9d14d9b836 tempest-LiveMigrationNegativeTest-778644995 tempest-LiveMigrationNegativeTest-778644995-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1/action" status: 409 len: 155 microversion: 2.1 time: 0.087242 Oct 28 17:28:51.093487 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 195/373] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:28:51 2022] POST /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1/action => generated 155 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:28:51.107541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:51.109423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:51.121718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.122374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.123110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.124516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.125737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.127038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.173730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:28:51.504012 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-196bec07-5946-42cd-b742-7fd0d9395e86 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 204 len: 0 microversion: 2.1 time: 0.402416 Oct 28 17:28:51.515327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:51.517246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:51.520824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 179/374] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:28:51 2022] DELETE /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:51.529525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.530760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.533580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.535439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.537109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.539698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.762937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:51.763687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:51.773900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.774711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.776155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:51.777098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:51.782604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:51.784306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:52.091725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:52.100603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4c26b2e-02d9-446d-973e-fa6f66015b24 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1466 microversion: 2.1 time: 0.589458 Oct 28 17:28:52.103765 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 196/375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:51 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1466 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:52.114638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:52.115502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:52.126970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:52.133265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:52.134152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:52.134844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:52.135825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:52.136521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:52.137108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:52.149513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-24840407-90a2-460a-9347-64b6f89a3d83 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1271 microversion: 2.1 time: 0.394913 Oct 28 17:28:52.150834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 180/376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:51 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1271 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:52.313699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:52.323841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:52.325756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:52.327883 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e21023f9-e213-4deb-b5ea-12d745ec7f64 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1320 microversion: 2.25 time: 0.222155 Oct 28 17:28:52.328571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 197/377] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:52 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:53.133351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:53.133954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:53.143996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:53.144475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:53.146502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:53.147738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:53.148218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:53.148646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:53.176475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:53.177758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:53.193182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:53.193673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:53.194099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:53.204683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:53.206773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:53.208050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:54.076724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:54.096313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4c778b9-31c9-4066-9cf9-90d3a24b31a6 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1466 microversion: 2.1 time: 0.968500 Oct 28 17:28:54.099761 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 181/378] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:53 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1466 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:54.110339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:54.110955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:54.131657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:54.132145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:54.132580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:54.133288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:54.135575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:54.136151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:54.164628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:54.172686 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-855360b5-674d-45d4-91fd-96d2cd9caaa1 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 1.000682 Oct 28 17:28:54.173270 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 198/379] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:53 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:54.200126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:54.471172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1", "name": "network-vif-deleted", "tag": "1ed108c7-486a-48fa-81ab-7ac5beed1ec1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:54.494651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:54.497938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:54.502605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:54.530229 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] Creating event network-vif-deleted:1ed108c7-486a-48fa-81ab-7ac5beed1ec1 for instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 on n-h2-860864-13 Oct 28 17:28:54.562383 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-bdb8ba47-f2dd-4a59-9cfa-b7a144e8951e req-9e1d1681-108b-4fec-b9fb-f8d51e3ab03b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096323 Oct 28 17:28:54.563942 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 199/380] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:28:54.783075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:54.798454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:54.800299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:54.805894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59311fd9-7fc5-491e-82e4-8b76bac6cdcc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.703874 Oct 28 17:28:54.807697 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 182/381] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:54 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:55.129459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:55.131023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:55.149897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.151629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.152314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.156614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.159352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.160149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.200584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:55.204498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:55.215328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.218880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.220999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.222129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.227137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.228689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.343482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.346255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.348888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.350274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lazy-loading 'fault' on Instance uuid 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:28:55.575910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:55.591999 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c782c46a-237b-4d84-ade0-1147c4139323 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 200 len: 1309 microversion: 2.1 time: 0.465739 Oct 28 17:28:55.609625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 200/382] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:55 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 1309 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:55.833398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:55.834008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:55.840012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.840713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.841307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.842232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:55.843016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:55.843668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:55.943714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:55.956758 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d093409-c9f6-4f21-a728-e8271a72a706 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.762107 Oct 28 17:28:55.957885 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 183/383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:55 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:56.333066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:56.351683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:56.358714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:56.360500 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34a97ace-1db3-454a-bc26-96e4900f6938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.530710 Oct 28 17:28:56.362904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 201/384] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:55 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:28:56.623484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:56.625309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:56.642913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.643499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.643951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.644701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.645344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.645782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.681056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] HTTP exception thrown: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Request method failure captured: Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 HTTP/1.1 Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBER8iCiRbBD2KLMvIXJyIrOeea5RjxJLt8q3aic50VBd7osze5UZ6XOKXA2LZRrQS3gO3OZjZINoVa6ioZ46mS1YD-bcSugkfPa5gc-ECqVuvpQA01XnRHlkcQEvvcHCizqXyeSjOdoacdeuyBKvdNM8A87SmHJw-ZfT94am4xEDEg Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1a4bfe1d7aee49858fdd893680f733fc Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:28:56.685030 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a4bfe1d7aee49858fdd893680f733fc"}]}] Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1a4bfe1d7aee49858fdd893680f733fc Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationNegativeTest-1675932696-project Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 62c38d65ee164ee9931a64607b92de6b Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationNegativeTest-1675932696-project Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. Oct 28 17:28:56.687253 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1'} Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:28:56.688130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. Oct 28 17:28:56.689387 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:28:56.690431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Returning 404 to user: Instance 7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:28:56.690431 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a0b2293-161f-4fad-b757-c3f6dc7b7dda tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1" status: 404 len: 111 microversion: 2.1 time: 0.071621 Oct 28 17:28:56.693236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 202/385] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:56 2022] GET /compute/v2.1/servers/7f5e4727-0cc7-41b6-ba9e-f2cf4c9294e1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:28:56.708458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:56.710841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:56.724923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.726721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.728753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.729655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.736443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.737192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.796611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:28:56.841261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:56.922016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ebd5615a-1051-487f-aafd-3d884bef598f tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "DELETE /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 204 len: 0 microversion: 2.1 time: 0.222251 Oct 28 17:28:56.927732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 203/386] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:28:56 2022] DELETE /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:28:56.938343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:56.939963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:56.948696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.949316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.950333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.951990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:56.952850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:56.953468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:56.979044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e76f20c6-fb88-47c1-a1d2-0f8055fb881b tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] Action: 'create', calling method: .version_select at 0x7f7524bdd1f0>, body: {"security_group": {"name": "tempest-securitygroup-949655334", "description": "tempest-description-1303790014"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:57.734222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:57.749309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1eb14eb4-d98d-48a1-9002-08dbf7bd0a39 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1474 microversion: 2.1 time: 0.819676 Oct 28 17:28:57.753148 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 204/387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:56 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1474 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:57.786730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:57.787407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:57.798728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:57.799914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:57.800574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:57.802036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:57.802504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:57.803089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:58.481703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=5 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:58.589340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=50 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:28:58.897314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:28:58.908793 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db87b27f-ef5d-465f-a7d3-2a9e8a2672cf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 1.144787 Oct 28 17:28:58.911232 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 205/388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:57 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:28:58.923331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae40224-e17e-4f5e-b095-7b9332702681", "tag": "5c9e771a-e7f6-42ca-afe9-ae193a4bbecf"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:58.960569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e76f20c6-fb88-47c1-a1d2-0f8055fb881b tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.426760 Oct 28 17:28:58.985260 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 184/389] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:28:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:59.002123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:59.004507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:59.005142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:59.022676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] Creating event network-changed:5c9e771a-e7f6-42ca-afe9-ae193a4bbecf for instance 4ae40224-e17e-4f5e-b095-7b9332702681 on n-h1-860864-13 Oct 28 17:28:59.029197 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a81a580e-eab4-46a7-9de0-b2069321fcfd req-4e97ff25-176f-449f-b7bd-a88cc4501cae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115334 Oct 28 17:28:59.030959 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 206/390] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:28:59.036750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:59.037696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:59.047069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:59.061019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:59.061656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:59.062623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:59.063226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:59.063850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:59.447672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2e66e4d-5c09-4aa5-a777-4637fc804824 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.462863 Oct 28 17:28:59.449011 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 185/391] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:28:58 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 17:28:59.618852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2840bce0-b04c-4294-9960-3d20ba09cdfc tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Action: 'create', calling method: .version_select at 0x7f7524bdd820>, body: {"keypair": {"name": "tempest-keypair-1008578617", "type": "ssh", "user_id": "dbc2951aaf014fee9f93475c1bbda367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5+G0A8JpZWDJiN/DXQ0Tyf0ZsEjJBVN3iIj6sBG5pI8V8BOpJjsl/HLMAX6MMhBDY6pBY9dqHH0esd0p2C2qCdgZh1evgbmPE5ulgtlX442hNBTnnOQbb2lRweQPGJGw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:28:59.684218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2840bce0-b04c-4294-9960-3d20ba09cdfc tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:28:59.694538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2840bce0-b04c-4294-9960-3d20ba09cdfc tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for user 8614dbbadc2f423889892a8803d2abad and project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:28:59.754755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2840bce0-b04c-4294-9960-3d20ba09cdfc tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.304455 Oct 28 17:28:59.756043 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 186/392] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:28:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 306 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:28:59.762439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:28:59.763046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:28:59.791282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:59.794342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:59.794832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:28:59.798650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:28:59.799255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:28:59.801739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:00.067352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:00.081456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:00.083688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:00.085364 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b109d377-a2ff-49ac-a8e4-2166947f9669 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 1.053076 Oct 28 17:29:00.086642 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 207/393] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:28:59 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:00.095662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c389fbd2-e633-43bf-8a40-5360de15987e tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] Action: 'create', calling method: .version_select at 0x7f7524b92e50>, body: {"security_group": {"name": "tempest-securitygroup-872175838", "description": "tempest-description-2028283830"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:00.500640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:00.514018 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2dc208c5-6453-424a-a078-57f9714739aa tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1474 microversion: 2.1 time: 0.754983 Oct 28 17:29:00.514988 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 187/394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:28:59 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1474 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:00.531777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d7ea6e2-11a0-4bdd-9d64-c5b0e42a7e9e tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Calling method '.version_select at 0x7f7524bdd1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:00.588396 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3d7ea6e2-11a0-4bdd-9d64-c5b0e42a7e9e tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] HTTP exception thrown: Image not found. Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d7ea6e2-11a0-4bdd-9d64-c5b0e42a7e9e tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Request method failure captured: Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFZ-yzcE25WIqM8oHmUXub1bO7joqkXX7EP9bNqpEoBEbYZ3huRCclb4UBERhGnWLt0qsyfH1jb7apf0djPCJ7FRr9t2TJq_coj1Vrov_VHMfSiHLSPMx1rbI9hUuBly3yE7t8cVMSneOzXD-0aCqgBzJ15bx_DfqLsPdrsiC3tI8o Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:00.606422 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1138f59b9c0f43b881d5f978b63d222f"}]}] Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ab90d0d518f742bfae2cb60c9448fbf0 Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '-1'} Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:00.608374 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.609184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:00.610356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d7ea6e2-11a0-4bdd-9d64-c5b0e42a7e9e tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:00.613505 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d7ea6e2-11a0-4bdd-9d64-c5b0e42a7e9e tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.091590 Oct 28 17:29:00.614912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 188/395] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Oct 28 17:29:00 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:00.621477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44e5c92e-eefd-429e-ae46-08bc78456f0c tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Action: 'create', calling method: .version_select at 0x7f7524b6faf0>, body: {"keypair": {"name": "tempest-keypair-1911946790", "type": "ssh", "user_id": "dbc2951aaf014fee9f93475c1bbda367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdW+I4p9ATjuRfmF8Bt0KU+GC4W7ZJO3PazQS23MadqZLHv3pd96gtZQxrJt4J7BeE2ZhoqCx3BE/a4IcSwtDXZSDPVdV2jUe7/f7XrbRsfR6dokvxJKjacpLjBpf09kQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:00.661488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-44e5c92e-eefd-429e-ae46-08bc78456f0c tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:00.671847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-44e5c92e-eefd-429e-ae46-08bc78456f0c tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for user 8614dbbadc2f423889892a8803d2abad and project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:00.724700 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-44e5c92e-eefd-429e-ae46-08bc78456f0c tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.108541 Oct 28 17:29:00.725820 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 189/396] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:29:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:29:00.737699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:00.738340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:00.753925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:00.755606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:00.756101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:00.758262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:00.760730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:00.761966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:00.767538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=44 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:00.909709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:01.003481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:01.018021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31674638-3543-4ab6-8a65-46b275eba6a0 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.288869 Oct 28 17:29:01.018917 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 190/397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:00 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:01.037457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40e20aab-59e7-4d1b-ad35-cdcd33acd4f9 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Calling method '.version_select at 0x7f7524b798b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:01.088596 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-40e20aab-59e7-4d1b-ad35-cdcd33acd4f9 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] HTTP exception thrown: Image not found. Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40e20aab-59e7-4d1b-ad35-cdcd33acd4f9 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Request method failure captured: Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j HTTP/1.1 Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFZ-yzcE25WIqM8oHmUXub1bO7joqkXX7EP9bNqpEoBEbYZ3huRCclb4UBERhGnWLt0qsyfH1jb7apf0djPCJ7FRr9t2TJq_coj1Vrov_VHMfSiHLSPMx1rbI9hUuBly3yE7t8cVMSneOzXD-0aCqgBzJ15bx_DfqLsPdrsiC3tI8o Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:01.090435 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1138f59b9c0f43b881d5f978b63d222f"}]}] Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ab90d0d518f742bfae2cb60c9448fbf0 Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j'} Oct 28 17:29:01.091657 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j to delete Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.092669 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j could not be found. Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:01.093721 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40e20aab-59e7-4d1b-ad35-cdcd33acd4f9 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:01.094781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40e20aab-59e7-4d1b-ad35-cdcd33acd4f9 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j" status: 404 len: 62 microversion: 2.1 time: 0.070896 Oct 28 17:29:01.095593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 191/398] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:01 2022] DELETE /compute/v2.1/images/9f9168aa-7ee3-4e4c-8cf6-8739055b3c6j => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:01.102726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d630adb-1a2c-49e4-b49f-48bd702aed8e tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Calling method '.version_select at 0x7f7524b4e1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:01.133231 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d630adb-1a2c-49e4-b49f-48bd702aed8e tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1008578617?user_id=dbc2951aaf014fee9f93475c1bbda367" status: 200 len: 512 microversion: 2.10 time: 0.039299 Oct 28 17:29:01.134362 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 192/399] 10.222.0.48 () {60 vars in 1340 bytes} [Fri Oct 28 17:29:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1008578617?user_id=dbc2951aaf014fee9f93475c1bbda367 => generated 512 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:29:01.145373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8abcba-e8d9-4d0d-920b-29e60391d599", "tag": "90bb83c2-c8ff-43a5-ad60-21f4062a8587"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:01.161533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:01.162529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:01.163254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:01.183714 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] Creating event network-changed:90bb83c2-c8ff-43a5-ad60-21f4062a8587 for instance ff8abcba-e8d9-4d0d-920b-29e60391d599 on n-h2-860864-13 Oct 28 17:29:01.192602 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b316c2d6-1799-4877-a231-18f4d0675ec4 req-5719b00c-b617-4ecb-9d1d-c284c3209167 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056278 Oct 28 17:29:01.193640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 193/400] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:01.200475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0d6dac0-950a-4c8a-8788-fa1ccc575c84 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Calling method '.version_select at 0x7f7524b79c10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:01.222456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f0d6dac0-950a-4c8a-8788-fa1ccc575c84 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] HTTP exception thrown: Image not found. Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0d6dac0-950a-4c8a-8788-fa1ccc575c84 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Request method failure captured: Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/1fa13b2e-2969-4ffe-a576-511eca1ecdd71 HTTP/1.1 Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFZ-yzcE25WIqM8oHmUXub1bO7joqkXX7EP9bNqpEoBEbYZ3huRCclb4UBERhGnWLt0qsyfH1jb7apf0djPCJ7FRr9t2TJq_coj1Vrov_VHMfSiHLSPMx1rbI9hUuBly3yE7t8cVMSneOzXD-0aCqgBzJ15bx_DfqLsPdrsiC3tI8o Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:01.226732 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1138f59b9c0f43b881d5f978b63d222f"}]}] Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ab90d0d518f742bfae2cb60c9448fbf0 Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1fa13b2e-2969-4ffe-a576-511eca1ecdd71'} Oct 28 17:29:01.228133 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1fa13b2e-2969-4ffe-a576-511eca1ecdd71 to delete Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.228843 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1fa13b2e-2969-4ffe-a576-511eca1ecdd71 could not be found. Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:01.229876 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:29:01.231150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.233277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0d6dac0-950a-4c8a-8788-fa1ccc575c84 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:01.239287 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0d6dac0-950a-4c8a-8788-fa1ccc575c84 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/1fa13b2e-2969-4ffe-a576-511eca1ecdd71" status: 404 len: 62 microversion: 2.1 time: 0.042777 Oct 28 17:29:01.242469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 194/401] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:29:01 2022] DELETE /compute/v2.1/images/1fa13b2e-2969-4ffe-a576-511eca1ecdd71 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:01.255829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:01.257406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:01.274710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:01.275837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:01.276340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:01.277695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:01.278067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:01.278599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:01.326938 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c389fbd2-e633-43bf-8a40-5360de15987e tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.238411 Oct 28 17:29:01.336435 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 208/402] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:00 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:01.342381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41025789-7952-4f81-a195-8f899c802154", "name": "network-vif-deleted", "tag": "e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:01.365061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:01.367581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:01.374083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:01.388648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] Creating event network-vif-deleted:e858a16e-bcc5-4ee0-8cd3-e69b4ca33ab7 for instance 41025789-7952-4f81-a195-8f899c802154 on n-h2-860864-13 Oct 28 17:29:01.397038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c257ca9c-103c-4547-a136-b52ea6977547 req-4cc4282a-9f04-41ae-9821-ae62524a5b12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057733 Oct 28 17:29:01.398966 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 209/403] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:01.406768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c99fa57e-83bf-4438-a134-9f37cc312cbb tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Action: 'create', calling method: .version_select at 0x7f7524b9b700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1790505043", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaMYTqLfHjwdqDfFjpaD2+YOXWeY2nUtQC+P/5T48XA2d1Seu3gM4c0EYijYu5SUboEGmRIH5hoM56nousElbEyFyRR1qS3WhSBwJm/0DFB+DMQJZi1qbJXdOCo7NCk0A=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:01.437226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c99fa57e-83bf-4438-a134-9f37cc312cbb tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:01.444608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c99fa57e-83bf-4438-a134-9f37cc312cbb tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Getting quotas for user 8614dbbadc2f423889892a8803d2abad and project 23ee3edf9ae947cdbbe0a3696ef74a84. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:01.494086 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c99fa57e-83bf-4438-a134-9f37cc312cbb tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.092158 Oct 28 17:29:01.495503 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 210/404] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:29:01 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:29:01.519292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a426f1d6-58aa-4801-9b37-34396434950a tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Calling method '.version_select at 0x7f7524b9b940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:01.556203 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a426f1d6-58aa-4801-9b37-34396434950a tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] HTTP exception thrown: Image not found. Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a426f1d6-58aa-4801-9b37-34396434950a tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Request method failure captured: Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/tempest-invalid-878089937 HTTP/1.1 Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFZ-yzcE25WIqM8oHmUXub1bO7joqkXX7EP9bNqpEoBEbYZ3huRCclb4UBERhGnWLt0qsyfH1jb7apf0djPCJ7FRr9t2TJq_coj1Vrov_VHMfSiHLSPMx1rbI9hUuBly3yE7t8cVMSneOzXD-0aCqgBzJ15bx_DfqLsPdrsiC3tI8o Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:01.563218 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1138f59b9c0f43b881d5f978b63d222f"}]}] Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ab90d0d518f742bfae2cb60c9448fbf0 Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'tempest-invalid-878089937'} Oct 28 17:29:01.564589 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-878089937 to delete Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.565334 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-878089937 could not be found. Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:01.566341 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a426f1d6-58aa-4801-9b37-34396434950a tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:01.567459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a426f1d6-58aa-4801-9b37-34396434950a tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/tempest-invalid-878089937" status: 404 len: 62 microversion: 2.1 time: 0.064138 Oct 28 17:29:01.568283 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 211/405] 10.222.0.48 () {58 vars in 1203 bytes} [Fri Oct 28 17:29:01 2022] DELETE /compute/v2.1/images/tempest-invalid-878089937 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:01.823260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5efa6cc6-6e21-4d58-b337-b8e6dc84df20 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] Action: 'create', calling method: .version_select at 0x7f7524b57550>, body: {"security_group": {"name": "tempest-securitygroup-767815186", "description": "tempest-description-2065884163"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:02.716282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:02.730127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:02.732757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:02.734570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a887d8a5-a74c-462c-89fd-9db9e0c81645 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 1.490141 Oct 28 17:29:02.735727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 195/406] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:01 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:02.740508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-16dbc37a-71dc-4d2c-ba91-5dd4dbc90c9f tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Calling method '.version_select at 0x7f7525027790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:02.746407 n-d-860864-13 devstack@n-api.service[120568]: WARNING oslo_db.sqlalchemy.utils [None req-16dbc37a-71dc-4d2c-ba91-5dd4dbc90c9f tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:29:02.768459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-16dbc37a-71dc-4d2c-ba91-5dd4dbc90c9f tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs?user_id=dbc2951aaf014fee9f93475c1bbda367" status: 200 len: 726 microversion: 2.10 time: 0.031400 Oct 28 17:29:02.769492 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 196/407] 10.222.0.48 () {60 vars in 1259 bytes} [Fri Oct 28 17:29:02 2022] GET /compute/v2.1/os-keypairs?user_id=dbc2951aaf014fee9f93475c1bbda367 => generated 726 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:29:02.774927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:02.775841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:02.784375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:02.785370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:02.786035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:02.786973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:02.787678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:02.788323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:02.861158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:02.864411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:02.865046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:02.866803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lazy-loading 'fault' on Instance uuid 41025789-7952-4f81-a195-8f899c802154 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:03.000910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c38d65ee164ee9931a64607b92de6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4bfe1d7aee49858fdd893680f733fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:03.011015 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5fdf48fd-91e3-4098-9e8e-34d23a368700 tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 200 len: 1309 microversion: 2.1 time: 0.240158 Oct 28 17:29:03.011519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 197/408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:02 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:03.051810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5f6c832-8f83-45d3-88c6-53c8be955cc6 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Calling method '.version_select at 0x7f7524b79790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:03.084050 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f5f6c832-8f83-45d3-88c6-53c8be955cc6 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] HTTP exception thrown: Image not found. Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5f6c832-8f83-45d3-88c6-53c8be955cc6 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Request method failure captured: Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/300bec5b-66c9-4f0e-bd3f-bc3872a4c641 HTTP/1.1 Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFZ-yzcE25WIqM8oHmUXub1bO7joqkXX7EP9bNqpEoBEbYZ3huRCclb4UBERhGnWLt0qsyfH1jb7apf0djPCJ7FRr9t2TJq_coj1Vrov_VHMfSiHLSPMx1rbI9hUuBly3yE7t8cVMSneOzXD-0aCqgBzJ15bx_DfqLsPdrsiC3tI8o Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:03.086062 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1138f59b9c0f43b881d5f978b63d222f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1138f59b9c0f43b881d5f978b63d222f"}]}] Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1138f59b9c0f43b881d5f978b63d222f Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399 Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ab90d0d518f742bfae2cb60c9448fbf0 Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1082706399-project Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '300bec5b-66c9-4f0e-bd3f-bc3872a4c641'} Oct 28 17:29:03.087633 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 300bec5b-66c9-4f0e-bd3f-bc3872a4c641 to delete Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:03.088499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 300bec5b-66c9-4f0e-bd3f-bc3872a4c641 could not be found. Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:03.089623 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:29:03.090758 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:03.094755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5f6c832-8f83-45d3-88c6-53c8be955cc6 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:03.095825 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5f6c832-8f83-45d3-88c6-53c8be955cc6 tempest-ImagesDeleteNegativeTestJSON-1082706399 tempest-ImagesDeleteNegativeTestJSON-1082706399-project] 10.222.0.48 "DELETE /compute/v2.1/images/300bec5b-66c9-4f0e-bd3f-bc3872a4c641" status: 404 len: 62 microversion: 2.1 time: 0.062602 Oct 28 17:29:03.096388 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 198/409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:03 2022] DELETE /compute/v2.1/images/300bec5b-66c9-4f0e-bd3f-bc3872a4c641 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:03.106409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:03.110367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:03.119014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:03.119896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:03.120848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:03.121781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:03.122440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:03.124557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:03.361518 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5efa6cc6-6e21-4d58-b337-b8e6dc84df20 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.793999 Oct 28 17:29:03.362924 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 212/410] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:03.376638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-775f7b9b-4b6f-4577-b0ad-07883817840e tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Calling method '.version_select at 0x7f7524b9b040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:03.434030 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-775f7b9b-4b6f-4577-b0ad-07883817840e tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1790505043" status: 204 len: 0 microversion: 2.10 time: 0.069191 Oct 28 17:29:03.435350 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 213/411] 10.222.0.48 () {60 vars in 1325 bytes} [Fri Oct 28 17:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1790505043 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:29:03.892542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a54e22bf-8e99-4896-8747-69bc105eb3bc tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:03.907215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a54e22bf-8e99-4896-8747-69bc105eb3bc tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.470072 Oct 28 17:29:03.907758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 214/412] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:29:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:03.922851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-961e694f-020c-4b76-b3a1-8d07f494f0b2 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] Action: 'create', calling method: .version_select at 0x7f7524ab9d30>, body: {"security_group": {"name": "tempest-securitygroup-1853903625", "description": "tempest-description-647622191"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:03.923635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:03.931497 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7593fa18-e951-422d-922f-d72854238d30 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.833579 Oct 28 17:29:03.932070 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 199/413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:03 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:03.968941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7744941-c21d-43ab-9348-bf08599c2129 tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Calling method '.version_select at 0x7f7524b4e670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:04.019992 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7744941-c21d-43ab-9348-bf08599c2129 tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911946790?user_id=dbc2951aaf014fee9f93475c1bbda367" status: 204 len: 0 microversion: 2.10 time: 0.055667 Oct 28 17:29:04.021212 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 200/414] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911946790?user_id=dbc2951aaf014fee9f93475c1bbda367 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:29:04.031392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:04.033723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:04.041121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:04.042088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:04.042701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:04.043611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:04.044270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:04.044849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:04.606850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-961e694f-020c-4b76-b3a1-8d07f494f0b2 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.697953 Oct 28 17:29:04.608252 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 215/415] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:03 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:04.849873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9827651a-2a39-4692-be1d-c95b54ad3969 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-109073551", "id": 1449392243, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:04.869800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:04.887399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:04.889836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:04.895578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dea19dd3-f20d-42ec-92e7-0c8329d69975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.871663 Oct 28 17:29:04.896177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 201/416] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:04 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:04.898078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9827651a-2a39-4692-be1d-c95b54ad3969 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.277189 Oct 28 17:29:04.900612 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 216/417] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:04 2022] POST /compute/v2.1/flavors => generated 424 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:04.915045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:04.920668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] [instance: 41025789-7952-4f81-a195-8f899c802154] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:04.921994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7e179ed0-5d6f-4fad-9c7f-55520f25d561 tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] Calling method '.version_select at 0x7f7524b6f280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:04.941492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:04.944414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:04.950863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:04.954613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:04.963955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:04.966518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:04.969398 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7e179ed0-5d6f-4fad-9c7f-55520f25d561 tempest-KeyPairsV210TestJSON-1157469385 tempest-KeyPairsV210TestJSON-1157469385-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008578617?user_id=dbc2951aaf014fee9f93475c1bbda367" status: 204 len: 0 microversion: 2.10 time: 0.068659 Oct 28 17:29:04.970321 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 202/418] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1008578617?user_id=dbc2951aaf014fee9f93475c1bbda367 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:29:04.995389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8692be34-f7ca-4ac7-aa36-a37ae7bb75ab tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] Calling method '.version_select at 0x7f7524b6f3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:05.007162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] HTTP exception thrown: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Request method failure captured: Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 HTTP/1.1 Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBER8iCiRbBD2KLMvIXJyIrOeea5RjxJLt8q3aic50VBd7osze5UZ6XOKXA2LZRrQS3gO3OZjZINoVa6ioZ46mS1YD-bcSugkfPa5gc-ECqVuvpQA01XnRHlkcQEvvcHCizqXyeSjOdoacdeuyBKvdNM8A87SmHJw-ZfT94am4xEDEg Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1a4bfe1d7aee49858fdd893680f733fc Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:05.012034 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a4bfe1d7aee49858fdd893680f733fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a4bfe1d7aee49858fdd893680f733fc"}]}] Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1a4bfe1d7aee49858fdd893680f733fc Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1675932696 Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationNegativeTest-1675932696-project Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 62c38d65ee164ee9931a64607b92de6b Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationNegativeTest-1675932696-project Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. Oct 28 17:29:05.013812 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '41025789-7952-4f81-a195-8f899c802154'} Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:05.014836 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. Oct 28 17:29:05.016099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:05.017281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] Returning 404 to user: Instance 41025789-7952-4f81-a195-8f899c802154 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:05.017281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cce03e75-0a73-4ee4-943c-bc38fa82859a tempest-LiveMigrationNegativeTest-1675932696 tempest-LiveMigrationNegativeTest-1675932696-project] 10.222.0.48 "GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154" status: 404 len: 111 microversion: 2.1 time: 0.109430 Oct 28 17:29:05.017596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 217/419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:04 2022] GET /compute/v2.1/servers/41025789-7952-4f81-a195-8f899c802154 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:29:05.030693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99a97386-e3f6-4c93-922b-70c5519e6780 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:05.047354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99a97386-e3f6-4c93-922b-70c5519e6780 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028506 Oct 28 17:29:05.047894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 218/420] 10.222.0.48 () {58 vars in 1182 bytes} [Fri Oct 28 17:29:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:05.062814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:05.063464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:05.096481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:05.098276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:05.099683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:05.100664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:05.108405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:05.109227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:05.799996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:05.812811 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-746e4330-5db8-40e9-82e3-e24375ff8838 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.763840 Oct 28 17:29:05.815411 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 219/421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:05 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:05.820195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-261c8717-186f-4c72-86c9-28b3d640baf1 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1073206808", "id": 1112582634, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:05.866094 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-261c8717-186f-4c72-86c9-28b3d640baf1 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.049303 Oct 28 17:29:05.867214 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 220/422] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:05 2022] POST /compute/v2.1/flavors => generated 425 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:05.880462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f26daff-0313-4029-954d-1e24f1d38f83 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:05.895070 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f26daff-0313-4029-954d-1e24f1d38f83 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019041 Oct 28 17:29:05.905919 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 221/423] 10.222.0.48 () {58 vars in 1182 bytes} [Fri Oct 28 17:29:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:05.931506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4be1ba99-4e51-45c6-b37c-1dc86e95aac6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Action: 'create', calling method: .version_select at 0x7f7524becaf0>, body: {"keypair": {"name": "tempest-keypair-1065819665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbmeSHSo0/fNvsGgXew+MnyvO2REb8oQBG1/0yQbvl+K5MaT/b6pdB/DIN/DVTMTduGg5Za3HYYiNMvU+Wbq7+XUuC/yXgeXt7ea72JmN0FkEvVmDa2wgs8V+f7ObPI5g=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:05.974256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4be1ba99-4e51-45c6-b37c-1dc86e95aac6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for project 1e0865660ba7474c9ad6405d63c64078. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:05.991247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4be1ba99-4e51-45c6-b37c-1dc86e95aac6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for user 8e76f32ce7d84fde8a2fb8f7597e61a8 and project 1e0865660ba7474c9ad6405d63c64078. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:06.013180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:06.035838 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4be1ba99-4e51-45c6-b37c-1dc86e95aac6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122364 Oct 28 17:29:06.036415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 222/424] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:06.041206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:06.052504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:06.068018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:06.076291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:06.077607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:06.078509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:06.079114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:06.079758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:06.711750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:06.723972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:06.728490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:06.732147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7a228b2-f39c-4ee5-a6f3-edf611d3d502 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.694683 Oct 28 17:29:06.734288 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 223/425] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:06 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:07.061602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4604da8b-d352-4b0a-9a26-083084223615 tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] Calling method '.version_select at 0x7f7524bec940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:07.139726 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4604da8b-d352-4b0a-9a26-083084223615 tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] 10.222.0.48 "GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6" status: 200 len: 784 microversion: 2.1 time: 0.366395 Oct 28 17:29:07.150097 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 224/426] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:29:06 2022] GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6 => generated 784 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:07.155168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:07.158101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:07.177001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:07.178087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:07.178705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:07.179643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:07.180401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:07.181004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:08.104716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:08.120450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e1c4b4b-899a-4b9b-b1c0-806124ac0e53 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.968704 Oct 28 17:29:08.131415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 225/427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:07 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:08.131415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7a519b7-2ce2-4388-8580-9186096ae40e tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] Calling method '.version_select at 0x7f7524ab9c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:08.250515 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7a519b7-2ce2-4388-8580-9186096ae40e tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] 10.222.0.48 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.127860 Oct 28 17:29:08.261351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 226/428] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Oct 28 17:29:08 2022] GET /compute/v2.1/images => generated 445 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:08.270733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:08.272107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:08.281005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:08.283306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:08.289911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:08.292363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:08.294160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:08.294718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:08.815976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:08.828941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:08.832768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:08.837478 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dcf3817-2edd-4b1e-87ab-72f376b93a3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.573500 Oct 28 17:29:08.839756 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 227/429] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:08 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:08.854319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0273cf16-8ad7-41c1-be19-b4550430f28f tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] Calling method '.version_select at 0x7f7524c69af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:08.959873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0273cf16-8ad7-41c1-be19-b4550430f28f tempest-ListImagesTestJSON-1097096217 tempest-ListImagesTestJSON-1097096217-project] 10.222.0.48 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.115086 Oct 28 17:29:08.960942 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 228/430] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:29:08 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:09.150105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:09.150912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:09.165595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:09.166372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:09.167329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:09.169252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:09.172820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:09.175000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:09.807958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:09.821198 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8bb30ad9-ee37-4585-9018-512c74139fa8 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.677923 Oct 28 17:29:09.823919 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 229/431] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:09 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:09.855504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae40224-e17e-4f5e-b095-7b9332702681", "name": "network-vif-plugged", "status": "completed", "tag": "5c9e771a-e7f6-42ca-afe9-ae193a4bbecf"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:09.875836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:09.878103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:09.878741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:09.899460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] Creating event network-vif-plugged:5c9e771a-e7f6-42ca-afe9-ae193a4bbecf for instance 4ae40224-e17e-4f5e-b095-7b9332702681 on n-h1-860864-13 Oct 28 17:29:09.908509 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-32ab93f5-4de8-4f6c-8cb6-30f1dabe7d5d req-fe8b7e82-a3fc-470b-a73c-20c6d6cb6abc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082223 Oct 28 17:29:09.914863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 230/432] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:09.937454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:09.938287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:09.956770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:09.957337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:09.957780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:09.967465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:09.969321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:09.969781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:10.004837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8692be34-f7ca-4ac7-aa36-a37ae7bb75ab tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9747 microversion: 2.1 time: 5.032717 Oct 28 17:29:10.006830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 203/433] 10.222.0.48 () {58 vars in 1191 bytes} [Fri Oct 28 17:29:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9747 bytes in 5036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:10.043574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13d04c10-55d0-4ff9-bb03-4653a0d854ec tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] Calling method '.version_select at 0x7f7524b4e160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:10.614973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:10.619517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13d04c10-55d0-4ff9-bb03-4653a0d854ec tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.591463 Oct 28 17:29:10.625778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 204/434] 10.222.0.48 () {58 vars in 1191 bytes} [Fri Oct 28 17:29:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:10.631577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:10.634538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:10.638205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab53f937-d7ac-4f92-812f-6736847c98f0 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] Calling method '.version_select at 0x7f7524b6fee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:10.640526 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-afdfcd95-c9a5-47a5-8574-1ef78158c3d0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.711523 Oct 28 17:29:10.642694 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 231/435] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:09 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:10.691704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:10.834764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-89469846", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "1112582634", "adminPass": "***", "networks": [{"uuid": "3a881b1a-5b9e-4d56-8641-1d8966e16aeb"}], "security_groups": [{"name": "tempest-securitygroup--498579820"}], "key_name": "tempest-keypair-1065819665", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:11.134726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] validate_networks() for [('3a881b1a-5b9e-4d56-8641-1d8966e16aeb', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:11.683892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab53f937-d7ac-4f92-812f-6736847c98f0 tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7d7c679e-321c-4c6c-a491-2c958d679fd0" status: 202 len: 0 microversion: 2.1 time: 1.053315 Oct 28 17:29:11.685158 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 205/436] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:10 2022] DELETE /compute/v2.1/os-security-groups/7d7c679e-321c-4c6c-a491-2c958d679fd0 => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:29:11.690658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:11.691705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:11.707178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:11.711184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:11.711919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:11.712871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:11.713543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:11.714196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.067700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:12.082081 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b3a801d-59f7-4c00-a804-6a91024bbe61 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1313 microversion: 2.1 time: 0.394199 Oct 28 17:29:12.101641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 206/437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:11 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:12.111222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:12.116411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:12.130518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:12.131518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:12.133166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.134142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:12.136718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:12.137352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.400904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:12.401889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:12.402361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:12.402763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:12.403164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:12.416828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:12.421045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:12.423726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.425923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:12.427115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:12.429799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.485621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for project 1e0865660ba7474c9ad6405d63c64078. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:12.496794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for user 8e76f32ce7d84fde8a2fb8f7597e61a8 and project 1e0865660ba7474c9ad6405d63c64078. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:12.523462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:12.527929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:12.598327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:12.617328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:12.625523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:12.626979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2139002b-7cc0-4c8e-a86d-3a6105c41422 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.523925 Oct 28 17:29:12.644852 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 207/438] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:12 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:12.657350 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-91cbc9ab-8e0c-4948-9adb-6caa221fad91 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.826535 Oct 28 17:29:12.659829 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 232/439] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:29:12.666018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8abcba-e8d9-4d0d-920b-29e60391d599", "name": "network-vif-plugged", "status": "completed", "tag": "90bb83c2-c8ff-43a5-ad60-21f4062a8587"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:12.673607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-956d4631-67a1-47ca-b83b-7f6d5062283d tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] Calling method '.version_select at 0x7f7524b79280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:12.680103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:12.680998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:12.681571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:12.702589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] Creating event network-vif-plugged:90bb83c2-c8ff-43a5-ad60-21f4062a8587 for instance ff8abcba-e8d9-4d0d-920b-29e60391d599 on n-h2-860864-13 Oct 28 17:29:12.710642 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8dbb0669-c1ab-4e4a-ba6d-a31021c1812a req-0bc7b47f-5433-4512-abf4-8f8d05fbc62b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049336 Oct 28 17:29:12.711904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 233/440] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:13.173756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-210b9459-da98-4065-90b0-570ff1ecae12 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f7524bc5f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:13.539344 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-210b9459-da98-4065-90b0-570ff1ecae12 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e" status: 200 len: 371 microversion: 2.1 time: 0.825973 Oct 28 17:29:13.540902 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 234/441] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:29:12 2022] GET /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e => generated 371 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:13.552075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af5c73c1-ca31-437a-9b4c-57b928321d88 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:13.552808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af5c73c1-ca31-437a-9b4c-57b928321d88 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:13.602001 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-956d4631-67a1-47ca-b83b-7f6d5062283d tempest-SecurityGroupsTestAdminJSON-1528206725 tempest-SecurityGroupsTestAdminJSON-1528206725-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ab6467db-3a94-4674-bb5e-edc06c5794e5" status: 202 len: 0 microversion: 2.1 time: 0.954023 Oct 28 17:29:13.603460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 208/442] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:12 2022] DELETE /compute/v2.1/os-security-groups/ab6467db-3a94-4674-bb5e-edc06c5794e5 => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:13.670302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af5c73c1-ca31-437a-9b4c-57b928321d88 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:13.689268 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af5c73c1-ca31-437a-9b4c-57b928321d88 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1263 microversion: 2.1 time: 0.147041 Oct 28 17:29:13.695214 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 235/443] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:13 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:13.711092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:13.711738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:13.728079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:13.729292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:13.729926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:13.730945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:13.731706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:13.732463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:13.965253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:13.979772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3fc5832b-b24e-4174-8567-711b9ce89982 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1462 microversion: 2.1 time: 0.279787 Oct 28 17:29:13.991510 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 236/444] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:13 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:14.004026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Action: 'update', calling method: .version_select at 0x7f7524abb940>, body: {"quota_set": {"ram": "5120"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:14.014456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe38ceb1-25ad-498c-90b2-0fb1fba31555 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524b6f8b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6OuEIbTuPZ6DEPT9WbsgMs2ehYGRn90B8lrEVvaF53CP4iXbNI7or0e+zqkiT0McGvwHcTbK3xICxXFmQJHwrEogTpWW1Y/dHXqMfHy3gGEO1IaZSkvYSuQdQ3JXwKWg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe38ceb1-25ad-498c-90b2-0fb1fba31555 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 257 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:14.028509 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:14.030583 n-d-860864-13 devstack@n-api.service[120568]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6OuEIbTuPZ6DEPT9WbsgMs2ehYGRn90B8lrEVvaF53CP4iXbNI7or0e+zqkiT0McGvwHcTbK3xICxXFmQJHwrEogTpWW1Y/dHXqMfHy3gGEO1IaZSkvYSuQdQ3JXwKWg=="}} Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6OuEIbTuPZ6DEPT9WbsgMs2ehYGRn90B8lrEVvaF53CP4iXbNI7or0e+zqkiT0McGvwHcTbK3xICxXFmQJHwrEogTpWW1Y/dHXqMfHy3gGEO1IaZSkvYSuQdQ3JXwKWg=='}}} Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.031468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:14.032488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:29:14.033694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:29:14.035189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 17:29:14.035189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.035189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe38ceb1-25ad-498c-90b2-0fb1fba31555 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:14.035189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe38ceb1-25ad-498c-90b2-0fb1fba31555 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.420701 Oct 28 17:29:14.035189 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 209/445] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:13 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:14.038354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d99f11f-d9fc-4ea6-9d08-479a501e3f3a tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] Calling method '.version_select at 0x7f7524b4e160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:14.266582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.267345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.268004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.269159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.269946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.270548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.355464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4cf85464-67de-4f0a-8814-095cbfa2f0d7 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e" status: 200 len: 328 microversion: 2.1 time: 0.362577 Oct 28 17:29:14.356720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 237/446] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:29:13 2022] PUT /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:14.362266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:14.363397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:14.375028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.375604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.376046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.376749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.377368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.377942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.661217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d99f11f-d9fc-4ea6-9d08-479a501e3f3a tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7bc29323-80bb-4923-8c10-3ea0dcd4c2a1" status: 202 len: 0 microversion: 2.1 time: 0.627571 Oct 28 17:29:14.662459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 210/447] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:14 2022] DELETE /compute/v2.1/os-security-groups/7bc29323-80bb-4923-8c10-3ea0dcd4c2a1 => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:14.766830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:14.780822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:14.782270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:14.783455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85f5d8e5-0657-4248-b3c3-19005f193334 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1362 microversion: 2.25 time: 0.425360 Oct 28 17:29:14.784010 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 238/448] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:14 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:14.803748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524abb310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-442767067", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:14.824393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:14.828908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for user 6799172f60424e35bbb18971e0b3b779 and project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:14.855943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:14.859841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:14.865468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'deleted': False, 'project_id': '1d44d72e4806453c908107df4a9b7664'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 2166 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-442767067", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:14.869119 n-d-860864-13 devstack@n-api.service[120567]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-442767067', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:14.871072 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c5e810d-1124-4ce9-ab93-9b148632c97b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.085717 Oct 28 17:29:14.876551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 239/449] 10.222.0.48 () {60 vars in 1160 bytes} [Fri Oct 28 17:29:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:29:14.881504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:14.884120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d4e81d1-110b-404c-99b1-a7de4ed3b9e5 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:14.892547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.894403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.896774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.897731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:14.899555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:14.900738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:14.919625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d4e81d1-110b-404c-99b1-a7de4ed3b9e5 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e" status: 202 len: 0 microversion: 2.1 time: 0.047153 Oct 28 17:29:14.923456 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 240/450] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:29:14 2022] DELETE /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:14.927496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44f5bc2f-5263-4a1f-944d-d0ce62cd5c02 tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] Calling method '.version_select at 0x7f7524b92040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:15.119971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef39d05e-2746-4f97-b34b-bf06341f89aa tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.455864 Oct 28 17:29:15.121607 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 211/451] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:29:14 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:15.165032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:15.165994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:15.177093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:15.177999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:15.178808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:15.179778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:15.180581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:15.181276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:15.346443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:15.364059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d093f31d-42e6-4471-b7a5-a58a43fb8134 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1323 microversion: 2.1 time: 0.208302 Oct 28 17:29:15.364999 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 212/452] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:15 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:15.369623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd812fea-76c2-49e5-9873-0cbc0122a87b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524b79f70>, body: {"keypair": {"name": "tempest-keypair-1207850164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJAgbCTogdoWmB4Ws02/zSE5LCSBoaijt8M3Ka2dLQZkAkpBddjsWkEgfwUxrKZFxbAwMVP6hYr+zWsfXFDaG1BD8KLPTQciA5cXplIvw/DRofcBNSYSbA6adESZo8Ptg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:15.400595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-dd812fea-76c2-49e5-9873-0cbc0122a87b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:15.410696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-dd812fea-76c2-49e5-9873-0cbc0122a87b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for user 6799172f60424e35bbb18971e0b3b779 and project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:15.444080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd812fea-76c2-49e5-9873-0cbc0122a87b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077883 Oct 28 17:29:15.451933 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 213/453] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:15.460250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00de98a5-fb1b-40b4-a28c-8db116407574 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f7524b4e700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:15.542591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00de98a5-fb1b-40b4-a28c-8db116407574 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e" status: 200 len: 371 microversion: 2.1 time: 0.088291 Oct 28 17:29:15.543284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 214/454] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:29:15 2022] GET /compute/v2.1/os-quota-sets/5570e9cead4a4e1bb458a1b248bbb23e => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:15.556174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:15.574566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'deleted': False} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:15.582525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:15.583196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:15.583934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:15.585040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:15.585708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:15.586303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:15.681159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44f5bc2f-5263-4a1f-944d-d0ce62cd5c02 tempest-SecurityGroupsTestAdminJSON-316624212 tempest-SecurityGroupsTestAdminJSON-316624212-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/69f5c9ac-4c66-418f-9130-48449434e138" status: 202 len: 0 microversion: 2.1 time: 0.757889 Oct 28 17:29:15.681159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 241/455] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:14 2022] DELETE /compute/v2.1/os-security-groups/69f5c9ac-4c66-418f-9130-48449434e138 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:15.689641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524b9be50>, body: {"keypair": {"name": "tempest-keypair-1207850164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiGqRJkfnm9J8PWZ54fwaUKtpQIwsl+DIJPi6Ab/mhBsJNqY6mXDjQqZdddSQ0GguyiRwjwSZLP6HDxc3K/UbSM8/jH5t1Vm7O2FTLEUZ1GYxDOIJB2mNprdzI62Q+sWw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:15.737351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:15.745582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for user 6799172f60424e35bbb18971e0b3b779 and project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:15.776569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:29:15.792722 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] HTTP exception thrown: Key pair 'tempest-keypair-1207850164' already exists. Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 273 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: {"keypair": {"name": "tempest-keypair-1207850164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiGqRJkfnm9J8PWZ54fwaUKtpQIwsl+DIJPi6Ab/mhBsJNqY6mXDjQqZdddSQ0GguyiRwjwSZLP6HDxc3K/UbSM8/jH5t1Vm7O2FTLEUZ1GYxDOIJB2mNprdzI62Q+sWw=="}} Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: exception: Key pair 'tempest-keypair-1207850164' already exists. Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1207850164', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiGqRJkfnm9J8PWZ54fwaUKtpQIwsl+DIJPi6Ab/mhBsJNqY6mXDjQqZdddSQ0GguyiRwjwSZLP6HDxc3K/UbSM8/jH5t1Vm7O2FTLEUZ1GYxDOIJB2mNprdzI62Q+sWw=='}}} Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '6799172f60424e35bbb18971e0b3b779-tempest-keypair-1207850164' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 17:29:15.819740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result.read() Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 17:29:15.823841 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '6799172f60424e35bbb18971e0b3b779-tempest-keypair-1207850164' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 17, 29, 15, 783874), 'updated_at': None, 'name': 'tempest-keypair-1207850164', 'user_id': '6799172f60424e35bbb18971e0b3b779', 'fingerprint': 'de:8e:19:e9:ed:d7:6b:2b:5e:71:62:7e:03:fc:be:7c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiGqRJkfnm9J8PWZ54fwaUKtpQIwsl+DIJPi6Ab/mhBsJNqY6mXDjQqZdddSQ0GguyiRwjwSZLP6HDxc3K/UbSM8/jH5t1Vm7O2FTLEUZ1GYxDOIJB2mNprdzI62Q+sWw==', 'type': 'ssh'}] Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair.create() Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._create() Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1207850164' already exists. Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 28 17:29:15.828576 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1207850164' already exists. Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1207850164' already exists. Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 409 to user: Key pair 'tempest-keypair-1207850164' already exists. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:15.835457 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30eef2cf-2477-4ca4-a878-0a8f155d307b tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.152493 Oct 28 17:29:15.837179 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 242/456] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:15 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:29:15.844611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe60ba7c-48fc-496d-8ba6-51aa9577f249 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f75248cbee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:15.960448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:15.961184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:15.961784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:16.112179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe60ba7c-48fc-496d-8ba6-51aa9577f249 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.273073 Oct 28 17:29:16.112764 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 243/457] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:29:15 2022] GET /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:16.128925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:16.129768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:16.137252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:16.137907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:16.139077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:16.140073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:16.140676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:16.141254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:16.696554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:16.713877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:16.722105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:16.728759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-11a664ef-7df3-443b-b4f8-1b99c0b0ec06 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1559 microversion: 2.25 time: 0.599524 Oct 28 17:29:16.731213 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 244/458] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:16 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1559 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:16.741437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41c3dc4b-4154-4df0-aa41-aca33f6b33d7 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Calling method '.version_select at 0x7f75248e2280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:16.788459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41c3dc4b-4154-4df0-aa41-aca33f6b33d7 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207850164" status: 202 len: 0 microversion: 2.1 time: 0.053178 Oct 28 17:29:16.789739 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 245/459] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207850164 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:16.799324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:16.801097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:16.810398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:16.811616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:16.812874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:16.813902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:16.814627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:16.815301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:16.960664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:16.972367 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e83e49d7-926d-4d9b-a1bb-8ab6ce118b38 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1321 microversion: 2.1 time: 0.180646 Oct 28 17:29:16.974944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 246/460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:16 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:16.985748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Action: 'update', calling method: .version_select at 0x7f75248e2820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:17.038932 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bc05fd57-ed75-4f8a-bc80-ad1637f0d604 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 7955 microversion: 2.1 time: 1.487283 Oct 28 17:29:17.043777 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 215/461] 10.222.0.48 () {58 vars in 1171 bytes} [Fri Oct 28 17:29:15 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 7955 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:17.206299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.208225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.208883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.210033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.210789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.211557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.232972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:17.285366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6ae737b-4c12-49f6-965a-b7b8fbf63b99 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a" status: 200 len: 328 microversion: 2.1 time: 0.308835 Oct 28 17:29:17.287385 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 247/462] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:29:16 2022] PUT /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a => generated 328 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:17.294103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9ca307f-9738-400d-bfa6-149d7716ce01 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f75248cba60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEszBg7w01YDHUMiNrQWGarHRcEOXhNlRrJdTo0dXngGboP/6NpumsPYkqggMmrwQBXOkZieSJ5ZE+psYALD6ZZt2aU1c6IAsAyQ2HRmU6WmAAl4+n+ydcT6yvFVxff6Nw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9ca307f-9738-400d-bfa6-149d7716ce01 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 247 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEszBg7w01YDHUMiNrQWGarHRcEOXhNlRrJdTo0dXngGboP/6NpumsPYkqggMmrwQBXOkZieSJ5ZE+psYALD6ZZt2aU1c6IAsAyQ2HRmU6WmAAl4+n+ydcT6yvFVxff6Nw=="}} Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEszBg7w01YDHUMiNrQWGarHRcEOXhNlRrJdTo0dXngGboP/6NpumsPYkqggMmrwQBXOkZieSJ5ZE+psYALD6ZZt2aU1c6IAsAyQ2HRmU6WmAAl4+n+ydcT6yvFVxff6Nw=='}}} Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi '' Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:29:17.299921 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:29:17.303537 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.304362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9ca307f-9738-400d-bfa6-149d7716ce01 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:17.305789 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d9ca307f-9738-400d-bfa6-149d7716ce01 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016447 Oct 28 17:29:17.306063 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 248/463] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:17 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:17.318342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:17.323982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'deleted': False, 'project_id': '1d44d72e4806453c908107df4a9b7664'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:17.332046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.332523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.332943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.334144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.334760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.335328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.441473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:17.470734 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9962ce0e-9ef0-4dd7-a239-b03ad08d3933 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?tenant_id=51bdbcf44e1646268fc1b36fabb61260" status: 200 len: 15 microversion: 2.1 time: 0.163205 Oct 28 17:29:17.471536 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 249/464] 10.222.0.48 () {58 vars in 1231 bytes} [Fri Oct 28 17:29:17 2022] GET /compute/v2.1/servers/detail?tenant_id=51bdbcf44e1646268fc1b36fabb61260 => generated 15 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:17.477164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f7524e5faf0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:17.478778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:17.479407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:17.503951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.504995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.505720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.506803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.507431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.508024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.577866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.578821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.579269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.580174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.583667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.584340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.616934 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f070e9c-c7cf-423c-adce-26b5c9b70fa8 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a/detail" status: 200 len: 916 microversion: 2.1 time: 0.143773 Oct 28 17:29:17.617852 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 250/465] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:29:17 2022] GET /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a/detail => generated 916 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:17.623592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524a91670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2078788551", "public_key": " "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:17.646877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:17.651452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for user 6799172f60424e35bbb18971e0b3b779 and project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:17.681365 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 95 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2078788551", "public_key": " "}} Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2078788551', 'public_key': ' '}}} Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:17.683834 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:17.687882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eda768da-3a5d-4616-8caf-aad534a057e0 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.066317 Oct 28 17:29:17.694832 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 251/466] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Oct 28 17:29:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:29:17.699971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:17.710174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'tenant_id': '51bdbcf44e1646268fc1b36fabb61260', 'deleted': False} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:17.724685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.725638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.728388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.729428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:17.730110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:17.730917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:17.773131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:29:17.959590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid ff8abcba-e8d9-4d0d-920b-29e60391d599 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:18.069448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.073643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.078205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.096852 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-950d7072-dc4d-4cde-bb08-b832f1db5361 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 2054 microversion: 2.25 time: 1.046655 Oct 28 17:29:18.098954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 216/467] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:17 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 2054 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:18.111214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-195bb63f-b142-463d-b584-1f528811c1d5 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524b79f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb+cLCIT+zMjc2llIKlZgTfPkRCdLYonZjod9viU4MwkEXZiLViQM5MFu6r5A0KAfjNjEQ8ujG72/q12EzYcaxg85h1SUNaWngmPMpHHgqiO5EJYh6eSMd+6bO9Jlt7Zw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-195bb63f-b142-463d-b584-1f528811c1d5 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 507 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb+cLCIT+zMjc2llIKlZgTfPkRCdLYonZjod9viU4MwkEXZiLViQM5MFu6r5A0KAfjNjEQ8ujG72/q12EzYcaxg85h1SUNaWngmPMpHHgqiO5EJYh6eSMd+6bO9Jlt7Zw=="}} Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb+cLCIT+zMjc2llIKlZgTfPkRCdLYonZjod9viU4MwkEXZiLViQM5MFu6r5A0KAfjNjEQ8ujG72/q12EzYcaxg85h1SUNaWngmPMpHHgqiO5EJYh6eSMd+6bO9Jlt7Zw=='}}} Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 17:29:18.123577 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 17:29:18.126344 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:18.131937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-195bb63f-b142-463d-b584-1f528811c1d5 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:18.133045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-195bb63f-b142-463d-b584-1f528811c1d5 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.032867 Oct 28 17:29:18.138889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 217/468] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:18 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:18.146881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Action: 'update', calling method: .version_select at 0x7f7524b6f940>, body: {"quota_set": {"ram": "2048"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:18.641348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.642199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.642643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.643623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.644407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.645015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.691000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.691992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.692594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.693923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.694553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.695141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.723016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-676bb7a1-570b-4a67-a70b-bc89ee24bce2 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51bdbcf44e1646268fc1b36fabb61260" status: 200 len: 4827 microversion: 2.1 time: 1.027099 Oct 28 17:29:18.723887 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 252/469] 10.222.0.48 () {58 vars in 1257 bytes} [Fri Oct 28 17:29:17 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=51bdbcf44e1646268fc1b36fabb61260 => generated 4827 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:18.729064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:18.729891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:18.743983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.746848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.748040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.750753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.752370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.753435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.777511 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-560e2962-7052-4e0d-bb72-08c8fc586070 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a?user_id=b61fea0974ea4d9ab5aa19c6f412bf4b" status: 200 len: 328 microversion: 2.1 time: 0.636887 Oct 28 17:29:18.779965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 218/470] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:29:18 2022] PUT /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a?user_id=b61fea0974ea4d9ab5aa19c6f412bf4b => generated 328 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:18.791876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:18.793820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:18.802721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.804474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.805118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:18.806084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:18.806830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:18.807510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.103514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:19.112285 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22f8d168-02aa-4b64-9397-bfc8f5649be1 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 0.386899 Oct 28 17:29:19.113237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 253/471] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:18 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:19.128929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Action: 'create', calling method: .version_select at 0x7f7524d7b550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1816878575", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:19.164081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:19.180739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Getting quotas for user 6799172f60424e35bbb18971e0b3b779 and project 2e6232821ded417fbd2f32b3f27fceb2. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:19.195898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid ff8abcba-e8d9-4d0d-920b-29e60391d599 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:19.200638 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:19.202747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 118 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1816878575", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1816878575', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 17:29:19.202961 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 17:29:19.207674 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.210992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:19.212104 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55d70f80-e2b0-4609-adb2-bf4fbf71a767 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.097821 Oct 28 17:29:19.219149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 254/472] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:29:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:29:19.228723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:19.229243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8b15091-9e31-4379-a13a-f462dca8de22 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 2054 microversion: 2.25 time: 0.447961 Oct 28 17:29:19.243392 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 219/473] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:18 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 2054 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:19.244584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4afa674c-aa28-4721-a11b-34ea26c70d84 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f7524b6fee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:19.258325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'tenant_id': '1d44d72e4806453c908107df4a9b7664', 'deleted': False} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:19.277114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.277610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.278047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.279332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.279826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.280253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.339510 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2531cb8-6f35-4c92-b954-f2b24647aed1 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1d44d72e4806453c908107df4a9b7664" status: 200 len: 15 microversion: 2.1 time: 0.115875 Oct 28 17:29:19.342184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 255/474] 10.222.0.48 () {58 vars in 1257 bytes} [Fri Oct 28 17:29:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1d44d72e4806453c908107df4a9b7664 => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:19.348898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90e7e41f-561b-416c-8e9b-eaa3b91ab5d4 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Calling method '.version_select at 0x7f7524d7ba60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:19.400503 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-90e7e41f-561b-416c-8e9b-eaa3b91ab5d4 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90e7e41f-561b-416c-8e9b-eaa3b91ab5d4 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Request method failure captured: Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-56991330 HTTP/1.1 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFoJf5T-GiV1YhKLm9EabfyvFzPhecRAzgy-Lt6cM92vMLLx-yVaVEV7mY5UZiSKq6dyRG-R_oiCeGhlzJmxMcwpyIOueNs52caT20zaAiD9fncV0PVUjzMXqcJfxw_dd0DU2XqCbTAFyi76iAY5ITy2MYO_xA-8p-P-mIHnxGhPHI Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2e6232821ded417fbd2f32b3f27fceb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2e6232821ded417fbd2f32b3f27fceb2"}]}] Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2e6232821ded417fbd2f32b3f27fceb2 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-341988745 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-KeyPairsNegativeTestJSON-341988745-project Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: exception: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'tempest-keypair-non-existent-56991330'} Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.408568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 Oct 28 17:29:19.412569 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:19.420100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90e7e41f-561b-416c-8e9b-eaa3b91ab5d4 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] Returning 404 to user: Keypair tempest-keypair-non-existent-56991330 not found for user 6799172f60424e35bbb18971e0b3b779 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:19.422330 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90e7e41f-561b-416c-8e9b-eaa3b91ab5d4 tempest-KeyPairsNegativeTestJSON-341988745 tempest-KeyPairsNegativeTestJSON-341988745-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-56991330" status: 404 len: 143 microversion: 2.1 time: 0.078727 Oct 28 17:29:19.425132 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 256/475] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 17:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-56991330 => generated 143 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:29:19.442059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:19.448194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.448682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.449131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.450133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.450575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.451770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.521591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65ff3256-2486-46bb-be14-505060e0bae2 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.094235 Oct 28 17:29:19.522448 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 257/476] 10.222.0.48 () {60 vars in 1217 bytes} [Fri Oct 28 17:29:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:29:19.531795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfc4ec09-4a9f-415e-bfef-7913d8d20c2a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:19.540637 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfc4ec09-4a9f-415e-bfef-7913d8d20c2a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015956 Oct 28 17:29:19.541534 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 258/477] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Oct 28 17:29:19 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:19.548629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": "auto"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:19.571263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:19.579927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.581125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.581801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.582746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.589462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.590288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.668601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'flavor' on Instance uuid ff8abcba-e8d9-4d0d-920b-29e60391d599 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:19.689781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:29:19.805325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4afa674c-aa28-4721-a11b-34ea26c70d84 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a?user_id=b61fea0974ea4d9ab5aa19c6f412bf4b" status: 200 len: 370 microversion: 2.1 time: 0.573938 Oct 28 17:29:19.813818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 220/478] 10.222.0.48 () {58 vars in 1323 bytes} [Fri Oct 28 17:29:19 2022] GET /compute/v2.1/os-quota-sets/15e4c0cb2346408fa06b56f3f8f98b6a?user_id=b61fea0974ea4d9ab5aa19c6f412bf4b => generated 370 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:19.818078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:19.820489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:19.833687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.834279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.834597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:19.835292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:19.840596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:19.841352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.134649 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d40ef61e-2420-498d-89dc-097f9a4b4f9c tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 0 microversion: 2.1 time: 0.320096 Oct 28 17:29:20.135488 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 221/479] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:19 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:20.141743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1d9434-775e-4090-b961-5d01f144af52", "tag": "2e195bff-4a7c-40fb-aef8-b61a63fb43a2"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:20.151856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:20.152648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:20.153124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.172598 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] Creating event network-changed:2e195bff-4a7c-40fb-aef8-b61a63fb43a2 for instance 2d1d9434-775e-4090-b961-5d01f144af52 on n-h2-860864-13 Oct 28 17:29:20.184239 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5bcf1196-9127-4b6c-bbca-39685951a377 req-c60c41d0-828d-446d-8043-02b2acf26267 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047453 Oct 28 17:29:20.190925 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 222/480] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:20.201534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:20.205266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:20.220377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:20.220878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:20.224750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.226550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:20.227048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:20.227515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.582575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:20.590923 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6a98861-f881-4f72-8601-001f9bd92e81 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 0.398291 Oct 28 17:29:20.593322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 223/481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:20 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:20.610858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:20.627466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:20.628327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '51bdbcf44e1646268fc1b36fabb61260'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:20.645080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:20.645962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:20.646369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.653260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:20.658199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:20.660657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:20.804314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:29:20.887780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b892f7ab-54df-4c7a-9040-ea4c1d326a73 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers?status=error" status: 200 len: 337 microversion: 2.1 time: 0.291738 Oct 28 17:29:20.895844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 224/482] 10.222.0.48 () {58 vars in 1150 bytes} [Fri Oct 28 17:29:20 2022] GET /compute/v2.1/servers?status=error => generated 337 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:20.906676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f989f19a-1904-4afa-b600-b553e93e1f3f tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Calling method '.version_select at 0x7f7524b4e1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:21.359323 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f989f19a-1904-4afa-b600-b553e93e1f3f tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.458630 Oct 28 17:29:21.359943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 225/483] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:29:20 2022] GET /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6/defaults => generated 371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:21.374114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:21.376409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:21.382475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:21.382968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:21.383668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:21.384466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:21.385239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:21.385324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:21.471659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b880907-cf20-420e-8b01-cc2f469fda46 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 0 microversion: 2.1 time: 0.103108 Oct 28 17:29:21.475346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 226/484] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:21 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:21.827218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1414255548", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "3a6a8a69-8887-4595-92d7-f0a0dfb49ff9"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:21.897586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] validate_networks() for [('3a6a8a69-8887-4595-92d7-f0a0dfb49ff9', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:22.803558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:22.804206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:22.804443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:22.805129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:22.805704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:22.818992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:22.819506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:22.819947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:22.820672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:22.826301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:22.826571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:22.873708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:22.882188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for user b5dbc2c295144accbd4d508afb066b03 and project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:22.927997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:22.931205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:23.012727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea8a27ce-bc30-461f-b102-682b9e817fd6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539382 Oct 28 17:29:23.014199 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 227/485] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:29:23.019315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Action: 'update', calling method: .version_select at 0x7f75249148b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:23.210462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.210947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.211400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:23.212123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.212574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.213015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:23.384085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:23.635865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82cddd30-0387-49e0-b26f-6d51322eaf78 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6" status: 200 len: 329 microversion: 2.1 time: 0.620213 Oct 28 17:29:23.636510 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 228/486] 10.222.0.48 () {60 vars in 1263 bytes} [Fri Oct 28 17:29:23 2022] PUT /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6 => generated 329 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:23.650420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:23.652300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:23.665950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.666466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.666954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:23.667685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.668144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.668570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:23.897001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39eecde1-07c1-4cbc-a40f-1bddcd2075aa tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599/action" status: 202 len: 0 microversion: 2.25 time: 4.353947 Oct 28 17:29:23.901836 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 259/487] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:29:19 2022] POST /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599/action => generated 0 bytes in 4359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:29:23.913743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:23.914275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:23.923704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.924527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.925414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:23.926484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:23.927975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:23.928935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.027610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c910d10-603f-48b3-9751-79c7e09d15c7 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1614 microversion: 2.1 time: 0.389939 Oct 28 17:29:24.029210 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 229/488] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:23 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1614 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:24.222377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1448143051", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:24.260656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:24.285751 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ce7eab2-af2b-4313-8353-420273bb1653 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 0.376338 Oct 28 17:29:24.292180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 260/489] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:23 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:24.305120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:24.305747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:24.326722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.327917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.328589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.329597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.329819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:24.330591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.331177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.490899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:24.515865 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca1090d3-d63d-41aa-a432-695952c43002 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1263 microversion: 2.1 time: 0.208880 Oct 28 17:29:24.518131 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 261/490] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:24 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:24.539509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Action: 'update', calling method: .version_select at 0x7f7524774790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:24.676108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.676919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.677697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.678582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.679197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.679781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.807608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:24.808166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:24.808737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:24.809231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:24.810584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:24.846508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.853034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.853852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.854972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:24.855793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:24.860254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:24.915480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Getting quotas for project f5fba61ca50f4905bace527a2d67123a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:24.939626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Getting quotas for user ecb6d66fdaf64a17aae2bd316b727788 and project f5fba61ca50f4905bace527a2d67123a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:24.989801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:24.999971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:25.081437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=7 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:25.155832 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cd8d308-5f46-4701-b9e1-9784e313c95e tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105638 Oct 28 17:29:25.169846 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 230/491] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:29:25.180880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:25.183827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:25.194922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:25.195663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:25.196258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:25.197942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:25.198613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:25.199197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:25.386140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-051f6ad7-a3af-4b7e-b4d8-735f6a174743 tempest-QuotasAdminTestJSON-228229499 tempest-QuotasAdminTestJSON-228229499-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6" status: 200 len: 329 microversion: 2.1 time: 0.866497 Oct 28 17:29:25.387106 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 262/492] 10.222.0.48 () {60 vars in 1263 bytes} [Fri Oct 28 17:29:24 2022] PUT /compute/v2.1/os-quota-sets/4d163a3d7b2a4a8e8e35496f957fb2e6 => generated 329 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:25.407242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:25.407881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:25.433104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:25.434012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:25.434726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:25.436071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:25.436708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:25.437333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:25.799615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:25.810772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:25.812496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:25.815727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d492dd6e-6662-4196-bc15-eab2c6faf558 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.644189 Oct 28 17:29:25.819156 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 231/493] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:25 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:25.827921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dcc77ba1-7e26-4481-9fc8-2a7c1a4d12b4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:25.839437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dcc77ba1-7e26-4481-9fc8-2a7c1a4d12b4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:25.954351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dcc77ba1-7e26-4481-9fc8-2a7c1a4d12b4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:25.962605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dcc77ba1-7e26-4481-9fc8-2a7c1a4d12b4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1214 microversion: 2.1 time: 0.139187 Oct 28 17:29:25.967715 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 232/494] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:25 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:25.980031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:25.986106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:26.005709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.006434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.007057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.008716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.019344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.019829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.250129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0095cc2-d2cb-4215-82a2-6878c6359c62 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1614 microversion: 2.1 time: 0.861106 Oct 28 17:29:26.250692 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 263/495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:25 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1614 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:26.663047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3aca673-420f-435e-8cc6-11fa0a8b67e2 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] Calling method '.version_select at 0x7f75248e2dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:26.679210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:26.695176 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0aff3772-952f-4d25-9607-4d1bb763cbda tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 0.726174 Oct 28 17:29:26.701537 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 233/496] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:25 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:26.710341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:26.711550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:26.720610 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3aca673-420f-435e-8cc6-11fa0a8b67e2 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.464853 Oct 28 17:29:26.729089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.729920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.730598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.733116 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 264/497] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:29:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:26.735547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.736318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.737205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.744003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:26.782577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'host': 'n-h1-860864-13', 'deleted': False} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:26.799757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.800565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.801153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.802406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:26.803045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:26.803816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:26.934410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:26.942781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:29:26.950989 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-adde3686-4886-46f6-b21b-b23a73d639da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1269 microversion: 2.1 time: 0.247319 Oct 28 17:29:26.952322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 234/498] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:26 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:26.971178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2aa39e3-0928-45b6-a004-d6ea8a29443d tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] Action: 'update', calling method: .version_select at 0x7f75247d0a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:27.029726 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abbcc6b7-24af-4d1e-ab58-aa65d0e0fea8 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=n-h1-860864-13&all_tenants=1" status: 200 len: 1310 microversion: 2.1 time: 0.295961 Oct 28 17:29:27.039107 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 265/499] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Oct 28 17:29:26 2022] GET /compute/v2.1/servers?host=n-h1-860864-13&all_tenants=1 => generated 1310 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:27.044347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:27.045157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:27.075528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.078498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.079144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.080168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.081291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.081898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.270374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:27.412041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=23,nova_api:UPDATE=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:27.577038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:27.585447 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2aa39e3-0928-45b6-a004-d6ea8a29443d tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.630787 Oct 28 17:29:27.588190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:27.592625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:27.592850 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 235/500] 10.222.0.48 () {60 vars in 1206 bytes} [Fri Oct 28 17:29:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:27.597108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-344a3b17-067b-4faf-8e6d-91ad2954495e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.556695 Oct 28 17:29:27.597833 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 266/501] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:27 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:27.612759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:27.613383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:27.634598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.634802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.635509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.635918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.636373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.636630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:27.636789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.652053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:29:27.677115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.677692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.678169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.683423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.684100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.686286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.738836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ac9650c-7f75-43be-b24b-2ddd5ecbed7f tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.119387 Oct 28 17:29:27.744618 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 267/502] 10.222.0.48 () {58 vars in 1196 bytes} [Fri Oct 28 17:29:27 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:29:27.750258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1d9434-775e-4090-b961-5d01f144af52", "name": "network-vif-plugged", "status": "completed", "tag": "2e195bff-4a7c-40fb-aef8-b61a63fb43a2"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:27.776999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.777485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.777913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.812670 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] Creating event network-vif-plugged:2e195bff-4a7c-40fb-aef8-b61a63fb43a2 for instance 2d1d9434-775e-4090-b961-5d01f144af52 on n-h2-860864-13 Oct 28 17:29:27.822940 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b6559a47-cb6a-4980-9758-e4ad4b3ba504 req-b00ddf7e-81d8-405b-b240-776bf29c0a88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075951 Oct 28 17:29:27.823591 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 268/503] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:27.833929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7de4614-ffb7-425b-b881-9f7a541e6d59 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] Calling method '.version_select at 0x7f752469cd30>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:27.841991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:27.857079 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8cc7537-e06c-4a28-aa15-04cd9a2eb099 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1272 microversion: 2.1 time: 0.263164 Oct 28 17:29:27.871403 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 236/504] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:27 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:27.879223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7de4614-ffb7-425b-b881-9f7a541e6d59 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.053829 Oct 28 17:29:27.881963 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 269/505] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 17:29:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:27.886404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:27.890074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:27.900372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:27.905456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:27.909729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.910843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.913160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.915088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.918020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.918572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.922574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.923070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.924235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:27.924958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:27.925420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:27.928177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.061077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc8f4fdc-802c-44ec-a238-334f78c4a499 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 0 microversion: 2.1 time: 0.174645 Oct 28 17:29:28.065067 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 270/506] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:27 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:28.073698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8abcba-e8d9-4d0d-920b-29e60391d599", "name": "network-vif-unplugged", "status": "completed", "tag": "90bb83c2-c8ff-43a5-ad60-21f4062a8587"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:28.089658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.090164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.090724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.104923 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] Creating event network-vif-unplugged:90bb83c2-c8ff-43a5-ad60-21f4062a8587 for instance ff8abcba-e8d9-4d0d-920b-29e60391d599 on n-h2-860864-13 Oct 28 17:29:28.113233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-84c7d983-adb6-4bec-9931-40c27d40db9e req-da5085c6-4be4-4e12-b29e-98a276b1d9ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049869 Oct 28 17:29:28.114280 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 271/507] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:28.121291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-732cd609-9659-402c-8449-3054727a9555 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] Action: 'update', calling method: .version_select at 0x7f752469c670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:28.299195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:28.308225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa191704-7a97-4455-8010-86d91ef43478 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 0.447512 Oct 28 17:29:28.313003 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 237/508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:27 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:28.325091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:28.327623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:28.343800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.345666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.349690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.353219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.354658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.357186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.392282 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-732cd609-9659-402c-8449-3054727a9555 tempest-QuotaClassesAdminTestJSON-1264837230 tempest-QuotaClassesAdminTestJSON-1264837230-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.275106 Oct 28 17:29:28.405157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 272/509] 10.222.0.48 () {60 vars in 1206 bytes} [Fri Oct 28 17:29:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:28.437475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:28.457814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:28.482516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.483092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.483623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.485019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.485951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.486556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.634598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:28.657744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:28.658264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:28.658874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:28.659470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:28.660133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:28.756779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:28.765765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.766441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.766990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.767849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.768414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.769091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.817278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b393189b-02e4-4a0a-a080-02e4b6b2b8cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 1065 microversion: 2.1 time: 0.410619 Oct 28 17:29:28.821904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 273/510] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:28 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 1065 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 17:29:28.828655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:28.829400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:28.836526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.837004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.837702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:28.838791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:28.839255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:28.839712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.215751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:29.226800 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b82d6191-38d6-4a26-8fee-3653194656a3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.910664 Oct 28 17:29:29.248737 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 238/511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:28 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:29.255862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:29.256963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:29.264345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.265216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.265870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.267004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.267724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.268394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.600373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:29.619333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:29.621132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:29.659061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6052aae-c1db-4bd2-b62a-1c712e32377b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.835864 Oct 28 17:29:29.664912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 274/512] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:28 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:29.668366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:29.679680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:29.687927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:29.692016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:29.703633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-972317c3-c6d6-4d2e-a456-aee1e67564ff tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.449477 Oct 28 17:29:29.704908 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 239/513] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:29 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:29.720867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:29.721736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:29.730328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.740075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.740713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.741627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.744024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.744828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.768904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.770926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.773255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:29.774327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:29.774970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:29.776296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:30.507429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:30.523325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b871a233-098b-420c-a31a-7a93eeff9aad tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1272 microversion: 2.1 time: 0.855989 Oct 28 17:29:30.523955 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 275/514] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:29 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1272 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:30.534755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:30.535379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:30.561031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:30.564174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:30.565802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:30.567999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:30.568508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:30.569101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.176986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:31.193117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ca83e66-638d-4eff-99ba-b563aa9c8e71 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1388 microversion: 2.1 time: 1.484521 Oct 28 17:29:31.201188 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 240/515] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:29 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1388 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:31.212562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8abcba-e8d9-4d0d-920b-29e60391d599", "tag": "90bb83c2-c8ff-43a5-ad60-21f4062a8587"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:31.229030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.230183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.232269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.260133 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] Creating event network-changed:90bb83c2-c8ff-43a5-ad60-21f4062a8587 for instance ff8abcba-e8d9-4d0d-920b-29e60391d599 on n-h2-860864-13 Oct 28 17:29:31.269965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b96351b8-24ce-4327-b2ff-d30e6d43905f req-aad5af60-0119-4263-be2d-d1ec3afcb143 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067441 Oct 28 17:29:31.270582 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 241/516] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:31.285471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8490c85-575e-43e1-80d5-d6d29f94c5fb", "tag": "330285af-8dac-4717-8a98-1b709b53f61e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:31.302596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.303561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.304404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.319278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] Creating event network-changed:330285af-8dac-4717-8a98-1b709b53f61e for instance a8490c85-575e-43e1-80d5-d6d29f94c5fb on n-h1-860864-13 Oct 28 17:29:31.326853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b96b5db1-8efa-4069-8f69-971617faeb89 req-80da98a8-a688-4722-ad7e-405f8728d25a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048008 Oct 28 17:29:31.327887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 242/517] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:31.335078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:31.336280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:31.348002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.349493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.350162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.351076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.351775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.352730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.486074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:31.495238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dba4decc-3920-49bf-9d62-051971fdb2da tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.970200 Oct 28 17:29:31.500160 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 276/518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:30 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:31.521179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:31.522133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:31.529375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.530255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.530913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.531876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.532551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.533173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.823130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:31.844637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:31.847817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:31.849632 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-24f6fd3b-e35a-4b34-a78e-fe4aaec540ce tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.519989 Oct 28 17:29:31.851139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 243/519] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:31 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:31.865001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:31.866253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:31.885662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.886407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.887027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.888609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:31.889744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:31.890378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:31.985547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:32.005774 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51805923-309a-4445-bc20-0f972555585a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.492786 Oct 28 17:29:32.006370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 277/520] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:31 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:32.222571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:32.223445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:32.233987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.234469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.234905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:32.235638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.236104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.236517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:32.552497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:32.560958 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b648c8d1-f9e6-4005-aa06-0d0e35f070f4 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.708559 Oct 28 17:29:32.576594 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 244/521] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:31 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:32.583948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:32.586724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:32.599856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.608413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.609034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:32.610043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.610728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.611435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:32.616711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:32.628823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-894ad727-b8e8-4ddc-ad55-970ffdada085 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1587 microversion: 2.1 time: 0.411649 Oct 28 17:29:32.629776 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 278/522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:32 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1587 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:29:32.664843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:32.665510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:32.679533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.680276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.680919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:32.681677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:32.682086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:32.682583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.018298 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45d81cf6-2358-42f4-9885-2f7786945d0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.366203 Oct 28 17:29:33.019008 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 279/523] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:29:32 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52/os-interface => generated 285 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:33.034421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:33.035282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:33.045649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.046399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.047158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.048101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.048737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.049415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.204689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:33.219271 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-186e268f-8856-40de-a408-94f3ecd1e633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.640500 Oct 28 17:29:33.229202 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 245/524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:32 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:33.229202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:33.229202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:33.238612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.238612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.238612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.238961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.239493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.239985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.860315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:33.873102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:33.879615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:33.883061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69cc15e0-729a-4aff-97a5-0e835236c684 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.853348 Oct 28 17:29:33.884747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 280/525] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:33 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:33.922248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:33.923647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:33.932625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.933761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.934421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.935386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:33.936040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:33.936659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:33.970910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:33.979887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a026f350-c2c2-4bb5-8478-26ed802a233c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.758218 Oct 28 17:29:33.984347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 246/526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:33 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:34.246329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:34.247032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:34.261684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.262419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.263072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.264011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.264650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.265250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.293812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:34.303498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b401c630-05f2-4642-a26f-35b6e765d015 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.417299 Oct 28 17:29:34.304054 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 281/527] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:33 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:34.395209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff093b2f-eb15-4457-b502-f685dd093792", "tag": "7e6e831d-487d-491a-9eb1-dcd0ee5936ac"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:34.418106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.418601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.419091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.432117 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] Creating event network-changed:7e6e831d-487d-491a-9eb1-dcd0ee5936ac for instance ff093b2f-eb15-4457-b502-f685dd093792 on n-h2-860864-13 Oct 28 17:29:34.438129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ac6f9beb-bcb1-47c5-a96d-42cac8d1c608 req-34c1c905-ffa4-4a59-8874-600a01b4675c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048373 Oct 28 17:29:34.440261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 282/528] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:34.777584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:34.798120 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23b488b1-0fce-4b07-bcb8-45069810a55b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.553484 Oct 28 17:29:34.820386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 247/529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:34 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:29:34.895386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:34.904874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1d9434-775e-4090-b961-5d01f144af52", "tag": "2e195bff-4a7c-40fb-aef8-b61a63fb43a2"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:34.910167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:34.929961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=17 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:34.936551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=74,nova_api:UPDATE=19 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:34.947147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.950774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.951469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.954009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.954739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.955306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:34.957334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:34.958701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.960996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:34.989926 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] Creating event network-changed:2e195bff-4a7c-40fb-aef8-b61a63fb43a2 for instance 2d1d9434-775e-4090-b961-5d01f144af52 on n-h2-860864-13 Oct 28 17:29:35.004882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d097d479-7230-491e-b708-f39d02933562 req-d9f5d2cd-1c7b-40ca-8b0b-ddd1c42356f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104768 Oct 28 17:29:35.005909 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 248/530] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:35.029207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:35.029469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:35.050552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.054236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.055054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:35.059158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.060820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.062243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:35.633527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:35.647508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed054f36-74ef-43f7-a172-c812a0915379 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 200 len: 1587 microversion: 2.1 time: 0.758044 Oct 28 17:29:35.648737 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 283/531] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:34 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 1587 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:35.650782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:35.656598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:35.657907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:35.659986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:35.666663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:35.668406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d762672-ac45-4153-be26-6824529eb467 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.661343 Oct 28 17:29:35.672342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.672535 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 249/532] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:35 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:35.674126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.674826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:35.675742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.676525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.677690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:35.681242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:35.682140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:35.691438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.704071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.704680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:35.705533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:35.706078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:35.706745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.065611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:36.074651 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c89fe046-39e7-4e3e-a900-7db25ffbb21c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.424645 Oct 28 17:29:36.092655 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 284/533] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:35 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:36.114830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:36.131706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58ce6588-9aac-4166-ae9b-02572f0b1b8b tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.457868 Oct 28 17:29:36.132314 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 250/534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:35 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:36.144301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:36.145038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:36.151629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.152139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.152563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.153390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.154066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.154495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.370860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:36.381443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7818cbc9-d591-48e6-b500-eef9605dfb01 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.246906 Oct 28 17:29:36.390216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 251/535] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:36 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:36.439821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1592432342", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:36.513979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0dcdafd-8038-4ccf-9a31-8322a5235c48 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75247d00d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1070620949", "description": "tempest-description-2048284022"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:36.516369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:36.892863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:36.893737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:36.894450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:36.895194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:36.895837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:36.903182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=95 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:36.913288 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0dcdafd-8038-4ccf-9a31-8322a5235c48 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.521515 Oct 28 17:29:36.913852 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 252/536] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:36 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.923288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.929526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:36.930419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:36.945090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.945597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.946027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.946732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:36.947185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:36.947362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Getting quotas for project 77fa7eb671e6455bb68c17a15d4e3578. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:36.950217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:36.954222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Getting quotas for user 1d202e8bf5e846bdb2a528008a322856 and project 77fa7eb671e6455bb68c17a15d4e3578. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:36.970421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:36.973593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:37.068753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c335196b-326c-4a2d-8b16-7089f36b2799 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972914 Oct 28 17:29:37.071141 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 285/537] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:29:37.086825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ad111d6-7863-4463-87b7-9224bd954e41 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75248e2940>, body: {"security_group_rule": {"parent_group_id": "db1a47c4-80d1-4e30-89ad-47fa1e2ae539", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:37.288143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.301439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.303078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.305558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5b5da49-20c3-40ae-8e12-66e86c826d48 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.379385 Oct 28 17:29:37.339467 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 253/538] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:36 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:37.345817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c71b0fd6-2eb3-402b-acc7-7549b222cf8d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:37.349876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c71b0fd6-2eb3-402b-acc7-7549b222cf8d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:37.435332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c71b0fd6-2eb3-402b-acc7-7549b222cf8d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.444810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c71b0fd6-2eb3-402b-acc7-7549b222cf8d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1223 microversion: 2.1 time: 0.103783 Oct 28 17:29:37.447836 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 254/539] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:37 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:37.484483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:37.485298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:37.496272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.497125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.498495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.500225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.501699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.502628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.531275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ad111d6-7863-4463-87b7-9224bd954e41 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.457513 Oct 28 17:29:37.532101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 286/540] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:37.538359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:37.539275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:37.562490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.563004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.563467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.568765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.569472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.570074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.810152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.822309 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f31a4854-6da0-4148-a75a-ee32be47e0c9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.353665 Oct 28 17:29:37.844018 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 255/541] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:37 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:37.849678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:37.861328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:37.871751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.872738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.873613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.874538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:37.877433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:37.883764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:37.884504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:37.897626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b23d2254-7411-456f-8167-698f9e449884 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.363282 Oct 28 17:29:37.898678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 287/542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:37 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:37.904612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68f49c71-09bd-4f64-8895-b60385196895 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f7524654a60>, body: {"security_group_rule": {"parent_group_id": "db1a47c4-80d1-4e30-89ad-47fa1e2ae539", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:38.021245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-68f49c71-09bd-4f64-8895-b60385196895 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68f49c71-09bd-4f64-8895-b60385196895 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 138 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: {"security_group_rule": {"parent_group_id": "db1a47c4-80d1-4e30-89ad-47fa1e2ae539", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: exception: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'db1a47c4-80d1-4e30-89ad-47fa1e2ae539', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:38.023474 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68f49c71-09bd-4f64-8895-b60385196895 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: This rule already exists in group db1a47c4-80d1-4e30-89ad-47fa1e2ae539 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68f49c71-09bd-4f64-8895-b60385196895 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.124804 Oct 28 17:29:38.029310 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 288/543] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:37 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:38.037896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5dedee5-53d8-4f14-b189-da90906d00e9 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f7524602dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:38.253964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:38.266683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b1461526-dbc3-4d11-bc25-bfabe36b41d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.421105 Oct 28 17:29:38.279644 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 256/544] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:37 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:38.344080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:38.344745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:38.358393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:38.359033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:38.359648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:38.360448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:38.362758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:38.364149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:38.875151 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5dedee5-53d8-4f14-b189-da90906d00e9 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/e93941df-2027-4f9a-a8ea-08d0a4e24f89" status: 202 len: 0 microversion: 2.1 time: 0.842171 Oct 28 17:29:38.881974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 289/545] 10.222.0.48 () {58 vars in 1287 bytes} [Fri Oct 28 17:29:38 2022] DELETE /compute/v2.1/os-security-group-rules/e93941df-2027-4f9a-a8ea-08d0a4e24f89 => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:38.892464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:38.893626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:38.921243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:38.921849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:38.922349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:38.923738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:38.925889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:38.926995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.068372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.086311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e1a74c6-65af-4df8-92a7-ab7378712c47 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1275 microversion: 2.1 time: 0.202644 Oct 28 17:29:39.088989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 290/546] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:38 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:39.156408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.168291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.185628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.186859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8727d440-3066-40f6-b709-8f7130c08f85 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.855688 Oct 28 17:29:39.187455 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 257/547] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:38 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:39.208609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:39.209240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:39.226370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.227125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.227775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.228740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.229410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.230065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.390222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:39.394673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.395740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.396186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.396915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.397362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.397944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.436563 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a20b0c5-ca9a-40be-a11f-fd714818d3f2 tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.329080 Oct 28 17:29:39.438083 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 291/548] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:29:39 2022] GET /compute/v2.1/os-services => generated 949 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:39.443796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1862db1c-df9f-4d57-8a01-3e9f3fee6ab4 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75246020d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-493310554", "description": "tempest-description-1462183247"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:39.594321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.607351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6eb79e16-f1f4-4607-9985-b340cad6d4f4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.418822 Oct 28 17:29:39.608423 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 258/549] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:39 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:39.620012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:39.621319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:39.632250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.633385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.634151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.634947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.635801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.636535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.884232 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1862db1c-df9f-4d57-8a01-3e9f3fee6ab4 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.444980 Oct 28 17:29:39.894945 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 292/550] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:39.900608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8490c85-575e-43e1-80d5-d6d29f94c5fb", "name": "network-vif-plugged", "status": "completed", "tag": "330285af-8dac-4717-8a98-1b709b53f61e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:39.918342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.919069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.919537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.932386 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] Creating event network-vif-plugged:330285af-8dac-4717-8a98-1b709b53f61e for instance a8490c85-575e-43e1-80d5-d6d29f94c5fb on n-h1-860864-13 Oct 28 17:29:39.938098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-743d06f4-3f1a-4bb1-8290-e68f560583d1 req-f4eaf5e6-8bf8-41ee-bb8f-1f01b56f0d42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041216 Oct 28 17:29:39.939026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 293/551] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:39.944446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:39.948433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:39.953738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:39.956821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.957567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.958216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.959521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.960186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.960814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.963776 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38bff3f8-e4b4-4837-8cc5-aa3a25be99a7 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.353613 Oct 28 17:29:39.964352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 259/552] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:39 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:39.978171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:39.983952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.985013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.985689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:39.986911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:39.987456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:39.987923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.014196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-609bd427-c3fd-4252-a37b-12cf02e80b0e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-860864-13" status: 200 len: 581 microversion: 2.1 time: 0.048742 Oct 28 17:29:40.014812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 260/553] 10.222.0.48 () {58 vars in 1174 bytes} [Fri Oct 28 17:29:39 2022] GET /compute/v2.1/os-services?host=n-d-860864-13 => generated 581 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:40.019509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3198b2f-d1b2-4ce2-aed7-3a281f842231 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75247d0af0>, body: {"security_group_rule": {"parent_group_id": "2c5b05d2-7a34-47ed-ad5b-d5ab12916ca4", "ip_protocol": "tcp", "from_port": 1986821828, "to_port": 22}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:40.119451 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d3198b2f-d1b2-4ce2-aed7-3a281f842231 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Invalid port range 1986821828:22. Former value cannot be greater than the later Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3198b2f-d1b2-4ce2-aed7-3a281f842231 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 146 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: {"security_group_rule": {"parent_group_id": "2c5b05d2-7a34-47ed-ad5b-d5ab12916ca4", "ip_protocol": "tcp", "from_port": 1986821828, "to_port": 22}} Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid port range 1986821828:22. Former value cannot be greater than the later Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2c5b05d2-7a34-47ed-ad5b-d5ab12916ca4', 'ip_protocol': 'tcp', 'from_port': 1986821828, 'to_port': 22}}} Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1986821828:22. Former value cannot be greater than the later Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1986821828:22. Former value cannot be greater than the later Oct 28 17:29:40.122383 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1986821828:22. Former value cannot be greater than the later Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3198b2f-d1b2-4ce2-aed7-3a281f842231 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: Invalid port range 1986821828:22. Former value cannot be greater than the later {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3198b2f-d1b2-4ce2-aed7-3a281f842231 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.108127 Oct 28 17:29:40.126919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 261/554] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:40 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:40.132410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.137029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.137522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.138488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.139573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.140226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.140824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.154119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.157716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:40.163479 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bad710d8-8d21-4154-9d13-a232537bd0df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.223198 Oct 28 17:29:40.164650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 294/555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:39 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:40.179456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.181317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:40.185437 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c73e46c9-2f95-44ba-84c4-5727b4b0d28b tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.059120 Oct 28 17:29:40.186055 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 262/556] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:40.190895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7347da51-a803-4620-a95f-870cd3a55a7c tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f7524914790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1099825643", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:40.193148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-7347da51-a803-4620-a95f-870cd3a55a7c tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Security group id should be uuid Oct 28 17:29:40.194417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.195175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7347da51-a803-4620-a95f-870cd3a55a7c tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 131 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1099825643", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group id should be uuid Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1099825643', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:40.195495 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:40.200235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 28 17:29:40.200235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.200512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.200663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7347da51-a803-4620-a95f-870cd3a55a7c tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: Security group id should be uuid {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:40.200797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.200930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7347da51-a803-4620-a95f-870cd3a55a7c tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009705 Oct 28 17:29:40.201060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.201060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.201296 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 263/557] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:40 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:29:40.204828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.208264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.208741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.209176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.209905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.210436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.210868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.222426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:40.237901 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0f22ec6-5db4-48ef-b66d-300bbc2d686e tempest-ServicesAdminTestJSON-1081859490 tempest-ServicesAdminTestJSON-1081859490-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.039281 Oct 28 17:29:40.238815 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 264/558] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:40.246642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d98621fd-64d3-4c76-bffe-66efe5b19322 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f752476c430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1111145635", "description": "tempest-description-1473615775"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:40.401643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.417403 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b24535d-2d32-4497-aa2e-bd311294b6b8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.251311 Oct 28 17:29:40.419413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 295/559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:40.426449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.427058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:40.443271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.443920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.444581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.445847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.446308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.446880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.504262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d98621fd-64d3-4c76-bffe-66efe5b19322 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.264050 Oct 28 17:29:40.505555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 265/560] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:40 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:40.518930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c65701f-4913-4a1f-b655-5c34892c6f00 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75248891f0>, body: {"security_group_rule": {"parent_group_id": "012a8583-9849-4e1f-b39c-88160e827dba", "ip_protocol": "tempest-999-2008079903", "from_port": 22, "to_port": 22}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:40.618859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-8c65701f-4913-4a1f-b655-5c34892c6f00 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Invalid IP protocol tempest-999-2008079903. Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c65701f-4913-4a1f-b655-5c34892c6f00 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 157 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: {"security_group_rule": {"parent_group_id": "012a8583-9849-4e1f-b39c-88160e827dba", "ip_protocol": "tempest-999-2008079903", "from_port": 22, "to_port": 22}} Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid IP protocol tempest-999-2008079903. Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '012a8583-9849-4e1f-b39c-88160e827dba', 'ip_protocol': 'tempest-999-2008079903', 'from_port': 22, 'to_port': 22}}} Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2008079903. Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2008079903. Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.620412 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2008079903. Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c65701f-4913-4a1f-b655-5c34892c6f00 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: Invalid IP protocol tempest-999-2008079903. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c65701f-4913-4a1f-b655-5c34892c6f00 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.107045 Oct 28 17:29:40.629475 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 266/561] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:40 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 17:29:40.632973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.633575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:40.643038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.643589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.644022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.644788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.645237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.645658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.670541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.680372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.683211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.685445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-341817d6-9ddf-4a39-ab1f-4ef55561443a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.264041 Oct 28 17:29:40.686444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 296/562] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:40.696119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-914a5333-a0ee-4770-8a54-da2a599d67d0 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f752469c1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-607291548", "description": "tempest-description-474204890"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:40.876252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:40.896754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a03a13c8-da45-4b92-8844-fea8aea5e8a5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1469 microversion: 2.1 time: 0.268049 Oct 28 17:29:40.908397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 267/563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:40.988176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:40.989363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:40.995726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.996287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.997465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:40.998394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:40.999091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:40.999726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.194736 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-914a5333-a0ee-4770-8a54-da2a599d67d0 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.507187 Oct 28 17:29:41.195660 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 297/564] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:40 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:41.208411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:41.209278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:41.216183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.220225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.220929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.221575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.222284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.222648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.388057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:41.400057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a3c1631-975a-42b3-b691-7f353c2d2f72 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.416201 Oct 28 17:29:41.400717 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 268/565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:40 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:29:41.425809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bad5295-760b-4fb5-b488-722f473ea8ae tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f7524735f70>, body: {"security_group_rule": {"parent_group_id": "24c4434e-cc39-4395-8959-5ed6a7f24f9b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:41.558046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:41.567182 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1024027b-b19e-4712-b70b-0d415404b64b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.370296 Oct 28 17:29:41.571052 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 298/566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:41 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:41.576241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:41.576847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:41.581533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4bad5295-760b-4fb5-b488-722f473ea8ae tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bad5295-760b-4fb5-b488-722f473ea8ae tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 138 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: {"security_group_rule": {"parent_group_id": "24c4434e-cc39-4395-8959-5ed6a7f24f9b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'security_group_rule': {'parent_group_id': '24c4434e-cc39-4395-8959-5ed6a7f24f9b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 17:29:41.583059 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bad5295-760b-4fb5-b488-722f473ea8ae tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bad5295-760b-4fb5-b488-722f473ea8ae tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.167414 Oct 28 17:29:41.587248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 269/567] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:41 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:41.589306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.589801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.591052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.591566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.596956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c605668b-1d27-4164-a668-00fa1bbb8db9 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f752476c8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-683648023", "description": "tempest-description-1905492969"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:41.608371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.609037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.967308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:41.976010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0c984a5-6562-467d-9d9c-7c248f9e17db tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.403863 Oct 28 17:29:41.977807 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 299/568] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:41 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:41.983327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:41.984229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:41.990378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.991114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.991817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:41.992802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:41.993454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:41.994230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.160034 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c605668b-1d27-4164-a668-00fa1bbb8db9 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.566684 Oct 28 17:29:42.168527 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 270/569] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:29:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:42.172752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76256e9-6b96-4b69-9132-bf281acfa725", "tag": "56d90cbe-37a4-4cf4-9bf8-b42dce342282"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:42.196651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.197147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.197581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.217768 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] Creating event network-changed:56d90cbe-37a4-4cf4-9bf8-b42dce342282 for instance c76256e9-6b96-4b69-9132-bf281acfa725 on n-h1-860864-13 Oct 28 17:29:42.225021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-17b69234-a528-48c6-83a4-1be60dbb464b req-5a325bf3-61f3-40e7-9914-8be558471542 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062726 Oct 28 17:29:42.227521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.228041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 271/570] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:42.233005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.234119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:42.241985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.242487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.242931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.243819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.244283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.244767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.248175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.249929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.251140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77d645d2-6078-46ed-ac9d-68e54b512d2e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.272024 Oct 28 17:29:42.251914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 300/571] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:41 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:42.256845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be4d4568-2ec5-428b-825f-94dc4475a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f75245b45e0>, body: {"security_group_rule": {"parent_group_id": "b7b8f028-7ebd-4b22-9c45-0de511f4d400", "ip_protocol": "tcp", "from_port": 22, "to_port": 984387300}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:42.347586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-be4d4568-2ec5-428b-825f-94dc4475a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be4d4568-2ec5-428b-825f-94dc4475a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 145 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: {"security_group_rule": {"parent_group_id": "b7b8f028-7ebd-4b22-9c45-0de511f4d400", "ip_protocol": "tcp", "from_port": 22, "to_port": 984387300}} Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b7b8f028-7ebd-4b22-9c45-0de511f4d400', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 984387300}}} Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 Oct 28 17:29:42.349733 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 Oct 28 17:29:42.353506 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.355613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be4d4568-2ec5-428b-825f-94dc4475a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 400 to user: Invalid port range 22:984387300. Valid TCP ports should be between 1-65535 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:42.357258 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-be4d4568-2ec5-428b-825f-94dc4475a8e1 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.104189 Oct 28 17:29:42.362900 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 301/572] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:42 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:29:42.369697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Action: 'create', calling method: .version_select at 0x7f7524572280>, body: {"security_group_rule": {"parent_group_id": "8788b4b6-ccfb-4fd1-95e9-c92d33304e88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:42.422482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:29:42.423083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Neutron security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:29:42.423633 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.423633 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 138 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: {"security_group_rule": {"parent_group_id": "8788b4b6-ccfb-4fd1-95e9-c92d33304e88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8788b4b6-ccfb-4fd1-95e9-c92d33304e88', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:29:42.442046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 404 to user: Security group 8788b4b6-ccfb-4fd1-95e9-c92d33304e88 does not exist Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ed8cff48-a947-433f-a696-c6697c6e223e'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c818059f-9c25-40bd-862d-592349c83f94 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.080663 Oct 28 17:29:42.446204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 302/573] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:29:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:29:42.459674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.459674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:42.472370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.472871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.473562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.474275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.474733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.475165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.485882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.498894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f99d87dd-a240-4000-b128-e39253aa5ccf tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1475 microversion: 2.1 time: 0.269041 Oct 28 17:29:42.499748 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 272/574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:42 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:42.506022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f75247cf3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.531502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:29:42.532115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Neutron security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 not found {{(pid=120568) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 28 17:29:42.532920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] HTTP exception thrown: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.532920 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Request method failure captured: Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-security-group-rules/f410e2e4-4a6d-425e-884d-12777e8162c5 HTTP/1.1 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGAed_QTtRLquFDPXu2pqN0qufvkVYRjny_muBq0oGOGSL7uH4DkBRhq66zgVA-0gmo2GmvJuvrUPeQ2s18AX-XRWN9itRfes03aCLH7QRPOLkHdj8HrCBQpV8lsdCkFFa8Yd2UgM_LbzfNKU8Jl5OSBed99cxsxDWTw483oqWM6Ww Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e54348cfa65940e787dbf714dbd43b55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e54348cfa65940e787dbf714dbd43b55"}]}] Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e54348cfa65940e787dbf714dbd43b55 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e2f6298def5248bab768275848caeff8 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'f410e2e4-4a6d-425e-884d-12777e8162c5'} Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:29:42.537914 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] Oct 28 17:29:42.541571 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:42.545928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Returning 404 to user: Security group rule f410e2e4-4a6d-425e-884d-12777e8162c5 does not exist Oct 28 17:29:42.545928 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-79bf551b-d145-488e-aca7-af9a4b15d909'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:42.547098 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-791e6278-a255-459d-afcd-b684dfe48bf5 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/f410e2e4-4a6d-425e-884d-12777e8162c5" status: 404 len: 199 microversion: 2.1 time: 0.046294 Oct 28 17:29:42.552283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 273/575] 10.222.0.48 () {58 vars in 1287 bytes} [Fri Oct 28 17:29:42 2022] DELETE /compute/v2.1/os-security-group-rules/f410e2e4-4a6d-425e-884d-12777e8162c5 => generated 199 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:29:42.557369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9635b08e-acc2-4830-8c44-98fb0a199989 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f752469a670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.716531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.725054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e76ffa1-b122-42e7-ae61-e69d4dd876be tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.278351 Oct 28 17:29:42.725614 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 303/576] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:42 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:42.740081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.741246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:42.749523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.750223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.750971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.751930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:42.752851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:42.753274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:42.938975 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9635b08e-acc2-4830-8c44-98fb0a199989 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b7b8f028-7ebd-4b22-9c45-0de511f4d400" status: 202 len: 0 microversion: 2.1 time: 0.385226 Oct 28 17:29:42.939822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 274/577] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:42 2022] DELETE /compute/v2.1/os-security-groups/b7b8f028-7ebd-4b22-9c45-0de511f4d400 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:42.944312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:42.955628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f759bb30-d474-4767-829e-821bdcb3c2e4 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f752469ac10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:42.956186 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dca315dc-da3f-450c-86b8-e76c2733f5bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.228813 Oct 28 17:29:42.967069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 304/578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:42 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:43.009268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.009864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:43.019544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.020037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.020469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.021171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.021624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.022048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.246552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:43.258429 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3fbb2097-9f8a-4d33-9182-25ae63425675 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.260016 Oct 28 17:29:43.260515 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 305/579] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:42 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:43.273236 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f759bb30-d474-4767-829e-821bdcb3c2e4 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/24c4434e-cc39-4395-8959-5ed6a7f24f9b" status: 202 len: 0 microversion: 2.1 time: 0.327963 Oct 28 17:29:43.274726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 275/580] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:42 2022] DELETE /compute/v2.1/os-security-groups/24c4434e-cc39-4395-8959-5ed6a7f24f9b => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:43.284169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19b73748-b203-4e10-b72d-18b95badcbcb tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f752469a8b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.294338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.295204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:43.302095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.303095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.303697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.304942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.305549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.306197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.542930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:43.551950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:43.553536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:43.554796 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dc3e317-3458-4a53-9f72-d9677c9853f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.278536 Oct 28 17:29:43.555706 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 306/581] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:43 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:43.560961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff093b2f-eb15-4457-b502-f685dd093792", "name": "network-vif-plugged", "status": "completed", "tag": "7e6e831d-487d-491a-9eb1-dcd0ee5936ac"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:43.571030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.571915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.572709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.586015 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] Creating event network-vif-plugged:7e6e831d-487d-491a-9eb1-dcd0ee5936ac for instance ff093b2f-eb15-4457-b502-f685dd093792 on n-h2-860864-13 Oct 28 17:29:43.592062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a176a2cf-4cab-4bc9-b721-cb303efa23cd req-e4c9bf8a-4c5e-4a37-beeb-70e35400fc1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034737 Oct 28 17:29:43.592996 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 307/582] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:43.599236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.600650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:43.608119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.608829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.609468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.610244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.610704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.611199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.628313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19b73748-b203-4e10-b72d-18b95badcbcb tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/012a8583-9849-4e1f-b39c-88160e827dba" status: 202 len: 0 microversion: 2.1 time: 0.348868 Oct 28 17:29:43.629479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 276/583] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:43 2022] DELETE /compute/v2.1/os-security-groups/012a8583-9849-4e1f-b39c-88160e827dba => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:29:43.639195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4fa742d0-6668-4f3b-8faa-efb006ac29b0 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f752469a3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.898362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:43.908210 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4783bce-2a35-4253-ace8-c22f4baee152 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1475 microversion: 2.1 time: 0.313395 Oct 28 17:29:43.909511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 308/584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:43 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1475 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:43.914786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:43.915538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:43.922478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.923221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.923846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:43.924641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:43.925204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:43.925718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.053394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4fa742d0-6668-4f3b-8faa-efb006ac29b0 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/2c5b05d2-7a34-47ed-ad5b-d5ab12916ca4" status: 202 len: 0 microversion: 2.1 time: 0.419518 Oct 28 17:29:44.055769 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 277/585] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:43 2022] DELETE /compute/v2.1/os-security-groups/2c5b05d2-7a34-47ed-ad5b-d5ab12916ca4 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:29:44.062007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:44.062800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:44.071323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.071909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.072501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.073383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.074111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.075488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.096769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:44.108364 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb605ea4-5f53-4dbf-a93e-0c1c6e46bacb tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1314 microversion: 2.1 time: 0.197711 Oct 28 17:29:44.115581 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 309/586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:43 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:44.115581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f74a212-3f06-4f8e-ba64-eb2f31b87c59 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] Calling method '.version_select at 0x7f7524620790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:44.334214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:44.350143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29e8b18b-14f6-4609-af90-1e48a4fd05e1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1311 microversion: 2.1 time: 0.293030 Oct 28 17:29:44.353091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 278/587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:44 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:44.361952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:44.362981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:44.379747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.380621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.381161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.382712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.383454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.384813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.433648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f74a212-3f06-4f8e-ba64-eb2f31b87c59 tempest-SecurityGroupRulesNegativeTestJSON-1711257167 tempest-SecurityGroupRulesNegativeTestJSON-1711257167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/db1a47c4-80d1-4e30-89ad-47fa1e2ae539" status: 202 len: 0 microversion: 2.1 time: 0.322809 Oct 28 17:29:44.435827 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 310/588] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:29:44 2022] DELETE /compute/v2.1/os-security-groups/db1a47c4-80d1-4e30-89ad-47fa1e2ae539 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:44.585907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:44.586869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:44.595414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.595922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.596602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:44.597996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:44.598891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:44.599687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.065111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:45.079853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fd85381-73ab-4dac-a8c4-d875981b43a6 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.723446 Oct 28 17:29:45.082784 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 279/589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:44 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:45.100406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:45.101298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:45.115290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.117302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.119945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.123091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.127845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.128591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.548108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:45.559619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:45.561667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:45.563300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dddf2a88-6efe-41dc-9f0b-154e36582012 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 0.983340 Oct 28 17:29:45.564390 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 311/590] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:44 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:29:45.569685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:45.570825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:45.594894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.595757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.596392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.597298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.604518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.605185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.803346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:45.815839 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffbb5dac-aa6d-40cb-b692-c99587f4a2f5 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1475 microversion: 2.1 time: 0.731718 Oct 28 17:29:45.817348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 280/591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:45 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1475 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:45.823180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:45.826605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:45.836391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.837097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.837705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:45.838763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:45.839222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:45.839777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.089168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:46.108714 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d96fc4bb-68a1-497d-ac22-94ffa64f6193 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1464 microversion: 2.1 time: 0.542558 Oct 28 17:29:46.127704 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 312/592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:45 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1464 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:46.139728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-unplugged", "status": "completed", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:46.166882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.167392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.170382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.190016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] Creating event network-vif-unplugged:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:29:46.195949 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4ee6a743-aa6f-4a39-8151-a6246427abd5 req-9a32aaa2-2b40-4c44-92e8-3ac8b8f72eec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066727 Oct 28 17:29:46.196975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 313/593] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:46.207459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:46.208505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:46.218370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.219135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.219772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.220656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.221399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.222164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.283913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:46.298416 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5678f544-fa3f-4da1-b23e-5726ff85ee2e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1493 microversion: 2.1 time: 0.479419 Oct 28 17:29:46.300514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 281/594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:45 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1493 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:46.656058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:46.672697 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-677e3171-cd63-4b75-80ab-a0a90fd37393 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.473787 Oct 28 17:29:46.673747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 314/595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:46 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:46.688182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Calling method '.version_select at 0x7f7524efea60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:46.724994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.726480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.726946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.778990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.779532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.779974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.824139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1ec52f23-261f-4e04-bdf3-bf18c284a35a tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/f5fba61ca50f4905bace527a2d67123a?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329" status: 200 len: 647 microversion: 2.1 time: 0.522104 Oct 28 17:29:46.839802 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 282/596] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Oct 28 17:29:46 2022] GET /compute/v2.1/os-simple-tenant-usage/f5fba61ca50f4905bace527a2d67123a?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329 => generated 647 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:46.846194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:46.847004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:46.853760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.854463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.855098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.856079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:46.857350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:46.857937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:46.962940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:47.013761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:47.014056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:47.029057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:47.029432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:47.029878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:47.030608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:47.031062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:47.031520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:47.443004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=19,nova_cell0:UPDATE=5 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:47.845582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:47.861879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:47.863629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:47.864853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79f9f1ae-76d6-4995-b704-cb875f6eb1df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1569 microversion: 2.25 time: 1.022445 Oct 28 17:29:47.865565 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 283/597] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:46 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1569 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:47.875918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:47.876748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:47.886399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:47.897263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:47.897879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:47.898787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:47.899412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:47.900030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:47.948060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cdf2eb8-4483-411a-8e16-2a1c3d6f0e1f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1646 microversion: 2.1 time: 1.267168 Oct 28 17:29:47.967246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 315/598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:46 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1646 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:47.988284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '.version_select at 0x7f75245723a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:48.027122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.028205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.029301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.069910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=27 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:48.071320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.071833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.072273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.121067 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5069f5e2-2e07-4225-b1d9-95d2a25eb9c2 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/f5fba61ca50f4905bace527a2d67123a?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329" status: 200 len: 643 microversion: 2.1 time: 0.152223 Oct 28 17:29:48.131405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 316/599] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Oct 28 17:29:47 2022] GET /compute/v2.1/os-simple-tenant-usage/f5fba61ca50f4905bace527a2d67123a?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329 => generated 643 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:48.141076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:48.142226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:48.149674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.150494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.151142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.152115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.152857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.153600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.608925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:48.629693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4e460a8-6e86-4e16-9061-b87b230b5df2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1461 microversion: 2.1 time: 0.762853 Oct 28 17:29:48.644456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 284/600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:47 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1461 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:48.658788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:48.659438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:48.676560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:48.681023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.682111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.682918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.685981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.686838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.687727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.732278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:48.749982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a47c8f0-4a23-4c36-b278-0e03980c0bf9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.626459 Oct 28 17:29:48.753327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 317/601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:48 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:48.764031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Calling method '.version_select at 0x7f7524aebdc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:48.777191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.779116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.779821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.820449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.821371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.821933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.825400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:48.918913 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a43e599e-daf7-45d4-a4b2-59847d3e6212 tempest-TenantUsagesTestJSON-1669043508 tempest-TenantUsagesTestJSON-1669043508-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329&detailed=1" status: 200 len: 5921 microversion: 2.1 time: 0.163885 Oct 28 17:29:48.922394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 318/602] 10.222.0.48 () {58 vars in 1335 bytes} [Fri Oct 28 17:29:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T17%3A29%3A46.129329&end=2022-10-29T17%3A29%3A46.129329&detailed=1 => generated 5921 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:48.942143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:48.952111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:48.972540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.973533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.977253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:48.978937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:48.979690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:48.980374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.352737 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d67e6bf7-acaa-4409-a87b-c020b2f5ca42 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1646 microversion: 2.1 time: 0.706887 Oct 28 17:29:49.353348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 285/603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:48 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1646 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:49.386213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:49.386821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:49.396762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.397615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.398298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.399160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.399809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.400534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.491889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:49.502742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6aae15bb-2a92-480e-b9a8-561bbf8ecba9 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1461 microversion: 2.1 time: 0.576890 Oct 28 17:29:49.503726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 319/604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:48 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1461 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:49.519833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:49.520601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:49.531561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.540235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.540843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.541750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.549481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.557599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.614058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:29:49.774345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:49.778532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96cfd044-a6d1-498f-8eda-8b155885cf14 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 204 len: 0 microversion: 2.1 time: 0.269674 Oct 28 17:29:49.780345 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 320/605] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:29:49 2022] DELETE /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:29:49.787209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:49.788119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:49.795680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.796180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.796625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.797369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.797485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:49.797822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.800364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.809883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebe3c68f-1216-4070-9077-ef21df038827 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1559 microversion: 2.25 time: 0.444331 Oct 28 17:29:49.819548 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 286/606] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:49 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1559 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:49.837792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:49.837792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:49.847782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.849199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.850049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.851039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.852669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.853434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.875739 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c9eedca8-ad34-4f7c-b1e6-e45259a3d71f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.094006 Oct 28 17:29:49.890178 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 321/607] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:29:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:49.897027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-plugged", "status": "completed", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:49.911167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.911934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.912579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.927327 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] Creating event network-vif-plugged:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:29:49.939650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-af9bdd6f-0714-4a56-9c3d-2d83e4865d07 req-9cbd298a-fc96-447c-b212-eb50c8233537 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047780 Oct 28 17:29:49.940530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 322/608] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:49.964795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:49.965712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:49.982491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:49.985704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.985932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.986626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:49.987142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:49.988248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:49.988897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:49.989301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:49.989756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:49.990521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:49.993811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.100570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:50.108568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.109305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.109952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.110868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.111529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.112106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.145367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83d19966-ad9f-4f00-b387-2d4c0ea7b09e tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 1065 microversion: 2.1 time: 0.324402 Oct 28 17:29:50.146853 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 287/609] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:49 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 1065 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 17:29:50.153704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:50.154637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:50.168922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.173639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.175998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.177310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.179058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.179525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.391689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:50.399904 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97a3b4eb-96f1-44dc-93c8-806acd2bb938 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.458330 Oct 28 17:29:50.404184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 323/610] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:49 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:50.421026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-529ac36e-6a84-4fce-bc61-244fc7a12fe8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '.version_select at 0x7f7524602a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:50.426703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-529ac36e-6a84-4fce-bc61-244fc7a12fe8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.428086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-529ac36e-6a84-4fce-bc61-244fc7a12fe8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.428731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-529ac36e-6a84-4fce-bc61-244fc7a12fe8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.454983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-529ac36e-6a84-4fce-bc61-244fc7a12fe8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.049703 Oct 28 17:29:50.455636 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 324/611] 10.222.0.48 () {60 vars in 1184 bytes} [Fri Oct 28 17:29:50 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:29:50.460537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:50.463884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:50.468967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:50.471074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.471616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.472058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.472779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:50.473492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:50.477039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:50.477433 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb83b3f4-bef7-4e6b-9a97-7f91a90700da tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1470 microversion: 2.1 time: 0.329340 Oct 28 17:29:50.478253 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 288/612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:50 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:50.521059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lazy-loading 'flavor' on Instance uuid a8490c85-575e-43e1-80d5-d6d29f94c5fb {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:50.538464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Going to try to live migrate instance to n-h2-860864-13 {{(pid=120567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:29:50.570742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-222609194", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:50.683623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] validate_networks() for [('8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:51.550036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:51.551156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:51.551883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:51.552514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:51.553073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:51.570597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:51.571622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:51.572223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:51.573202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:51.574871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:51.578354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:51.607958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Getting quotas for project 94b73acb57c54ec3b7ca1a065cc0a86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:51.615144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Getting quotas for user 94ec1482fbdb4e65ad339ab01b7a557e and project 94b73acb57c54ec3b7ca1a065cc0a86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:51.632222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:51.635420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:51.732338 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c08bde2c-f1e4-4709-a21c-b3a000248836 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.252756 Oct 28 17:29:51.733585 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 289/613] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:29:51.738946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:51.740213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:51.749291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:51.751323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:51.751687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:51.753692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:51.754638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:51.756064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:51.764392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:52.067598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:52.076904 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62fa4251-8836-4256-b953-f8167e55a819 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.341912 Oct 28 17:29:52.095563 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 290/614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:51 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:52.104248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:52.105286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:52.112576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:52.113396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:52.114082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:52.115089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:52.115833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:52.116566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:52.453299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid ff8abcba-e8d9-4d0d-920b-29e60391d599 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:29:52.499919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4afa797-c5bb-4c26-9a7f-52cd8e6d32ee tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 2054 microversion: 2.25 time: 0.397234 Oct 28 17:29:52.502154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 291/615] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:52 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 2054 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:52.514415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:52.516851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:52.542867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:52.545230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:52.547032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:52.549549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:52.550278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:52.552276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.460210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:53.473865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b2e17c27-ba57-4bca-b5d1-6c525dce93ba tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.969718 Oct 28 17:29:53.474449 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 292/616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:52 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:53.474953 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fba200a0-ae11-42ae-8f09-89e7de84dce3 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb/action" status: 202 len: 0 microversion: 2.1 time: 3.017691 Oct 28 17:29:53.476283 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 325/617] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:29:50 2022] POST /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb/action => generated 0 bytes in 3020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:29:53.480172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:53.482324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:53.490496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.491535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.492221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.493390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.494099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.494771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.510577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:53.511501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:53.552985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.557153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.562417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.563306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.567088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.567946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.609158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb6d66fdaf64a17aae2bd316b727788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5fba61ca50f4905bace527a2d67123a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:53.627995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4dee1be-c231-49a5-8935-cb6afad8355a tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 200 len: 1428 microversion: 2.1 time: 0.149814 Oct 28 17:29:53.628989 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 293/618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:53 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:53.670398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1588700186", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "0cbf4b98-e322-48fb-b131-dac3c084f709"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:53.772359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:53.794460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df462a3d-d6ab-454d-ab0a-3aa89f94d1e9 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1275 microversion: 2.1 time: 0.316700 Oct 28 17:29:53.814012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 326/619] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:53 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1275 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:53.851532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] validate_networks() for [('0cbf4b98-e322-48fb-b131-dac3c084f709', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:29:53.852246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:53.853081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:53.866613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.867412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.868016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:53.868893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:53.869502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:53.870086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:54.693534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:54.720569 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d46869f4-118b-4388-8caf-4fb92dc4dadc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.904984 Oct 28 17:29:54.724510 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 327/620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:53 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:54.740775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff093b2f-eb15-4457-b502-f685dd093792", "name": "network-vif-deleted", "tag": "7e6e831d-487d-491a-9eb1-dcd0ee5936ac"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:54.753544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:54.754783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:54.755476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:54.773134 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] Creating event network-vif-deleted:7e6e831d-487d-491a-9eb1-dcd0ee5936ac for instance ff093b2f-eb15-4457-b502-f685dd093792 on n-h2-860864-13 Oct 28 17:29:54.780959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-65d4601d-01f6-4150-93f9-896fa8743868 req-f902d866-7bcb-46dd-9ceb-8c6850534c0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050128 Oct 28 17:29:54.783542 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 328/621] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:54.794511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:54.796785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:54.800489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:54.813529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:54.814195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:54.814854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:54.816088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:54.816736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:54.818148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.038117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:29:55.038575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:29:55.039026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:29:55.039485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:29:55.039889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:29:55.062800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.063290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.063757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.064496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.064953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.065380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.090934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:29:55.096291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for user 5121cf58427a48738ec1c70fbf5e922d and project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:29:55.114906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:29:55.116587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:29:55.142342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.151623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21630bf1-9322-4824-b83c-5c0ac6f60d3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.365170 Oct 28 17:29:55.155705 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 329/622] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:54 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:55.160604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:55.161218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:55.175271 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ee6b730-629e-41a9-bad7-3ac6bd4b7f84 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.524838 Oct 28 17:29:55.176114 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 294/623] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:29:55.181084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:55.182250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] [instance: ff093b2f-eb15-4457-b502-f685dd093792] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:55.188803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.189295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.190469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.191627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.192275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.192868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.194136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.194575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.195013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.203701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.203825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.207634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.208102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] HTTP exception thrown: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Request method failure captured: Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 HTTP/1.1 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFxUF53ACJ9lXqpTTxGZcWDR88Lo9PZy12lBgqZoTFhFSnj4-sC7ak1Xsdday8GPm4t-Xvu8RB_O0ew5yVb5NGtj7O7Vp3F8kjhQ6mCFZdAeXo5NSOon6FAHlgMt-FiSAdaWkXgjPsKj5g36VqMEgwLHqrGKYdJ9WUIv-7hz0oJ-SQ Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: f5fba61ca50f4905bace527a2d67123a Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TenantUsagesTestJSON-543182191 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5fba61ca50f4905bace527a2d67123a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f5fba61ca50f4905bace527a2d67123a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f5fba61ca50f4905bace527a2d67123a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f5fba61ca50f4905bace527a2d67123a"}]}] Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TenantUsagesTestJSON-543182191 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: f5fba61ca50f4905bace527a2d67123a Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TenantUsagesTestJSON-543182191 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TenantUsagesTestJSON-543182191-project Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ecb6d66fdaf64a17aae2bd316b727788 Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TenantUsagesTestJSON-543182191-project Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ff093b2f-eb15-4457-b502-f685dd093792'} Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:29:55.210197 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. Oct 28 17:29:55.214698 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:29:55.216522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] Returning 404 to user: Instance ff093b2f-eb15-4457-b502-f685dd093792 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:29:55.217866 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71b2b870-dd60-429f-af08-1a6b79422088 tempest-TenantUsagesTestJSON-543182191 tempest-TenantUsagesTestJSON-543182191-project] 10.222.0.48 "GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792" status: 404 len: 111 microversion: 2.1 time: 0.040408 Oct 28 17:29:55.219120 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 295/624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:55 2022] GET /compute/v2.1/servers/ff093b2f-eb15-4457-b502-f685dd093792 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:29:55.241265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:55.242074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:55.255511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.256709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.258859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.260590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.262132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.263188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.498582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.512653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0244adda-fdbf-4da9-8223-4dbbcad07695 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1281 microversion: 2.1 time: 0.292270 Oct 28 17:29:55.524288 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 296/625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:55 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:55.542852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:55.544446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:55.619554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.628641 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a45c6ffc-5262-47b4-8356-84fe1737fa29 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.471704 Oct 28 17:29:55.635960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 330/626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:55 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:55.728753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.740686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.742529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:55.744685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6081fa6-dcdc-4023-b5b9-d57ac06530de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1262 microversion: 2.25 time: 0.218666 Oct 28 17:29:55.745756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 297/627] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:55 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1262 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:55.752995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:55.753622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:55.766113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.766641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.770941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.771728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.772200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.772632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:55.933813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76256e9-6b96-4b69-9132-bf281acfa725", "name": "network-vif-plugged", "status": "completed", "tag": "56d90cbe-37a4-4cf4-9bf8-b42dce342282"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:55.975380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:55.976339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:55.977249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.006703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] Creating event network-vif-plugged:56d90cbe-37a4-4cf4-9bf8-b42dce342282 for instance c76256e9-6b96-4b69-9132-bf281acfa725 on n-h1-860864-13 Oct 28 17:29:56.020575 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-caf4b975-caaa-4da3-82cb-b57659ab090c req-40589c64-396b-4ae6-80e1-ed89f774a220 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092285 Oct 28 17:29:56.023750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 298/628] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:29:56.180135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:56.181100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:56.191893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.192591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.193249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.194108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.195153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.196090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.583654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:56.598221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36f82f16-df1c-41da-861a-99b5661e002b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.853076 Oct 28 17:29:56.600146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 331/629] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:55 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:56.612398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:56.618595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:56.625004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd51b116-e728-4467-9464-94b013b9eb12 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.451997 Oct 28 17:29:56.629032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 299/630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:56 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:56.629166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:56.639198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.639721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.640408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.641345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.642234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.643037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.661179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:56.662122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:56.674225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.675129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.675858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:56.676982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:56.681327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:56.682035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.268237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:57.281316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63eaf1dd-6081-4524-aced-995aef680cc3 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.623876 Oct 28 17:29:57.289313 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 300/631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:56 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:29:57.311317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:57.315894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:57.343888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.345004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.346864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.347642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.352337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.353284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.519878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:57.525439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:57.538452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:57.546411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:57.548004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65f774af-51e4-420e-8559-b5a0905d340b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1332 microversion: 2.25 time: 0.253680 Oct 28 17:29:57.548121 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97b7af58-10b8-4abc-8097-fec3a5523417 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.946595 Oct 28 17:29:57.569859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 301/632] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:57 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1332 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:57.573575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 332/633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:56 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:57.580514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8490c85-575e-43e1-80d5-d6d29f94c5fb", "name": "network-vif-unplugged", "status": "completed", "tag": "330285af-8dac-4717-8a98-1b709b53f61e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:57.596841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.597303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.597889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.611310 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] Creating event network-vif-unplugged:330285af-8dac-4717-8a98-1b709b53f61e for instance a8490c85-575e-43e1-80d5-d6d29f94c5fb on n-h1-860864-13 Oct 28 17:29:57.616918 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f04df11e-b84f-4c52-b202-c1795892bbed req-112a143b-78ce-4cbc-9b02-e0f76939aaf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045667 Oct 28 17:29:57.617939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 302/634] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:57.629090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:57.629712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:57.639387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.639907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.640366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.641034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.641490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.641918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.660197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:57.660893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:57.674406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.675275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.675968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:57.676894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:57.677526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:57.678859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.131503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:58.144680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-610ff897-2d57-4828-80c6-2ef420e7b75b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.488766 Oct 28 17:29:58.145803 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 303/635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:57 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:58.156239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:58.164128 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee19c1f0-d263-4cbc-a29e-947ccfd149d4 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.539556 Oct 28 17:29:58.180584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 333/636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:57 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:29:58.314282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:58.314880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:58.344524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.345507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.346992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.368302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.376579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.380546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.582285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:58.583737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:58.595224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.595822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.597357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.598500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.599862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.600343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.622280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:29:58.816276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:58.824637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f246dab8-7bc3-4a53-bcf9-0e88f3745f4e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1323 microversion: 2.1 time: 0.513988 Oct 28 17:29:58.825926 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 304/637] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:58 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:58.830835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:58.831755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:58.837683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.838415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.839072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:58.840119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:58.840647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:58.841142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.177046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.191285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.204116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.206734 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83b17788-6f51-48cf-a891-01777a8c3035 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.632425 Oct 28 17:29:59.207885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 334/638] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:29:58 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:29:59.216780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:59.227741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.228307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.228795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.242516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] Creating event network-changed:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:29:59.250193 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-971d60bc-0c1a-44e1-bc09-4388d80d8fad req-0632d4c7-3deb-4355-a7ed-1707a02ff77a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038323 Oct 28 17:29:59.252220 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 335/639] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:59.253025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.260811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:59.262312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:59.264139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05f0c27a-8ddc-4d42-94c1-e7291856f71e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.436872 Oct 28 17:29:59.264718 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 305/640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:58 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:59.271193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.271780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.272275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.273049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.273772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.274269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.276758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:59.278209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:59.284713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.285525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.286640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.287600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.288319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.289025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.658522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.664204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:29:59.671237 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da1c6776-a97f-4440-b67e-c2f244034cf3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.417303 Oct 28 17:29:59.672710 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 336/641] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:59 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:59.673785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2da33d7f-5f66-4bba-a476-b170c92783bc tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.407719 Oct 28 17:29:59.675067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 306/642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:59 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:29:59.679110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8490c85-575e-43e1-80d5-d6d29f94c5fb", "tag": "330285af-8dac-4717-8a98-1b709b53f61e"}, {"name": "network-changed", "server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:29:59.690998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.691514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.692024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.705317 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Creating event network-changed:330285af-8dac-4717-8a98-1b709b53f61e for instance a8490c85-575e-43e1-80d5-d6d29f94c5fb on n-h1-860864-13 Oct 28 17:29:59.705772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] Creating event network-changed:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h2-860864-13 Oct 28 17:29:59.713976 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ea989b22-74bf-4ec7-a451-38ce2fd157df req-5e22bc42-94bd-4e19-8d4c-3db0c70a068b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039660 Oct 28 17:29:59.714605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 337/643] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:29:59.849117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:29:59.850104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:29:59.857860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.858562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.859163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:29:59.860019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:29:59.860705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:29:59.861346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.113267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:00.125945 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-005602a1-ef1e-46b5-a301-35182cde1ad8 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1473 microversion: 2.1 time: 0.281320 Oct 28 17:30:00.127009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 307/644] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:29:59 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:00.153266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:00.159399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:00.159996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:00.166883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.167399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.168074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.168682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.169093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.169516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.196667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Request method failure captured: Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725/diagnostics HTTP/1.1 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBF-zUbtiINWmIzddEU1hiwva-lQdxRAu2wlP0Z01iZBGGwL9ufbbZVdyZRp9KYinm1utpcWytlExyNTDF2SCPJe4C4jqYor2eaWPAw-AGXTRDHiH9h0JyouOB3GLCcbFZmO2lZE0rA4YugankneFym9Kbl3yprxU8CMyeHJ5zL3nuc Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77fa7eb671e6455bb68c17a15d4e3578 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77fa7eb671e6455bb68c17a15d4e3578"}]}] Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77fa7eb671e6455bb68c17a15d4e3578 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiagnosticsNegativeTest-1348338021-project Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 1d202e8bf5e846bdb2a528008a322856 Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1348338021-project Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': 'c76256e9-6b96-4b69-9132-bf281acfa725'} Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:00.198847 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 17:30:00.203937 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:00.205184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:00.206206 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d82b3112-2cd8-4b81-8d96-224087d7da5e tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.055413 Oct 28 17:30:00.206918 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 338/645] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:30:00 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725/diagnostics => generated 117 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:30:00.219822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:00.220316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:00.233841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:00.234450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:00.236538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.237741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.238383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.239292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.239988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.240720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.244234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.245094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.245744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.247268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.247960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.248625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.291569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:30:00.359569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:00.411160 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-032f4ba7-7159-4841-889b-ce2dc40e56e9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 204 len: 0 microversion: 2.1 time: 0.196241 Oct 28 17:30:00.415234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 308/646] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:30:00 2022] DELETE /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:00.431728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:00.433906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:00.442180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.442988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.443649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.444526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.445172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.445880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.941752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:00.956386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:00.958033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:00.959276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47d26ef7-c6cd-4938-a4a3-07be1d6d6489 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.730120 Oct 28 17:30:00.959974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 339/647] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:00 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:00.967545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:00.968359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:00.977355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.978119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.978900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:00.979896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:00.981567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:00.983509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:01.035051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:01.044026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd01157d-a627-4f5d-a545-801a7c242a65 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.616367 Oct 28 17:30:01.059848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 309/648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:00 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:01.065709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:01.066581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:01.073276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:01.074703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:01.075322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:01.076316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:01.077126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:01.077710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:01.373905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:01.382385 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5997d27-9ebb-4603-9b1f-e5d4610be0c9 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1479 microversion: 2.1 time: 0.420530 Oct 28 17:30:01.383270 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 340/649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:00 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1479 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:01.403101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:01.407398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:01.408271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:01.411556 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8b4aa3a-4c05-4608-9eae-994989d2742c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.350253 Oct 28 17:30:01.412143 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 310/650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:01 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:01.415244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:01.416056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:01.417133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:01.418190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:01.419117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:01.419793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:01.634518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:01.644557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f9c3d25-fdb8-46a8-b2f8-99e67c4e55cb tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.246720 Oct 28 17:30:01.645259 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 341/651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:01 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:02.002746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:02.003730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:02.013096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.016095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.016889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.017783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.018586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.019011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.073247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:02.074722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:02.086648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.099756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.100401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.101652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.107005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.108126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.766699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:02.781470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:02.782929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:02.792565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1369c565-c2f1-4997-a024-08870975c8c3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.800404 Oct 28 17:30:02.796912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 311/652] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:01 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:02.822209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:02.823083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:02.835136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:02.835676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.836946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.837550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.838452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.839060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.840252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.844471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8eae7ce0-35e8-4d78-acf1-a8ed54be5a21 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.775731 Oct 28 17:30:02.845065 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 342/653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:02 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:02.870425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:02.872112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:02.899248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.899785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.900350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:02.900942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:02.901403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:02.901833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:03.360642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:03.378133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-05a7c5ef-0bcc-4cc9-b32a-0732b6cd612a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.514212 Oct 28 17:30:03.378498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:03.390659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c36848bb-b70a-4291-b6f8-76a2ba62349b tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1479 microversion: 2.1 time: 0.592323 Oct 28 17:30:03.391786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 312/655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:02 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1479 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:03.391944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 343/655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:02 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:03.400242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:03.400853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:03.407908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:03.408736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:03.409563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:03.410441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:03.411047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:03.411644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:03.822688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:03.825077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:03.832331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:03.833115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:03.834023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:03.834949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:03.835606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:03.836222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:03.997104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:04.005493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b8fe979-fd66-4575-9a7e-53312d130501 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.612452 Oct 28 17:30:04.006704 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 344/656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:03 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:04.023911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:04.024608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:04.038567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.039619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.040293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.041243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.041922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.043092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.249952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:04.258657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:04.264523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:04.265944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2daf1e4-f280-4dcc-bacc-9dbdecfa2727 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.447872 Oct 28 17:30:04.270055 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 313/657] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:03 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:30:04.375018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76256e9-6b96-4b69-9132-bf281acfa725", "name": "network-vif-deleted", "tag": "56d90cbe-37a4-4cf4-9bf8-b42dce342282"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:04.395115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.395994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.396696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.432993 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] Creating event network-vif-deleted:56d90cbe-37a4-4cf4-9bf8-b42dce342282 for instance c76256e9-6b96-4b69-9132-bf281acfa725 on n-h1-860864-13 Oct 28 17:30:04.454423 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-846f24a1-f9a4-4853-97ad-fd033d43863f req-450093a2-c8bd-4d39-b312-7bf75bd7cda0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085730 Oct 28 17:30:04.455907 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 314/658] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:30:04.467388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:04.469448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:04.484990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:04.486801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.493032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.493811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.494766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.496345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.497938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.548010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:04.579423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-017802e0-95e3-4979-bdf3-429590d19289 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.569263 Oct 28 17:30:04.595344 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 345/659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:04 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:04.595954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:04.599777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:04.633000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.633512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.642171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.643265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.644534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.645166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.765224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:04.766757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:04.767224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:04.767793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lazy-loading 'fault' on Instance uuid c76256e9-6b96-4b69-9132-bf281acfa725 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:04.993207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d202e8bf5e846bdb2a528008a322856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77fa7eb671e6455bb68c17a15d4e3578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.004261 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dbb4b466-0f13-43a0-8668-5440085d35f2 tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 200 len: 1313 microversion: 2.1 time: 0.420044 Oct 28 17:30:05.005862 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 346/660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:04 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:05.030634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:05.031552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:05.041641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.042384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.043015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.045275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.045949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.046599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.051650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.069605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ff3c215-e6db-4572-8973-fa081517b419 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.604500 Oct 28 17:30:05.070528 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 315/661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:04 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:05.295631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:05.296581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:05.310105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:05.316156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.318091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.319980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.321304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.326107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.326696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.693975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.703883 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-814e5bef-8d2e-4f48-9fbe-c15fd8f7652c tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.677583 Oct 28 17:30:05.704485 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 347/662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:05 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:30:05.716115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:05.716735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:05.735610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:05.744095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.744901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.745512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.746566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:05.747198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:05.747812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:05.871734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.888195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.915271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:05.924611 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0e614e2-2260-423e-b4ab-5c26796c3d14 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.633965 Oct 28 17:30:05.925235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 316/663] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:05 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:06.043555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:06.045855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] [instance: c76256e9-6b96-4b69-9132-bf281acfa725] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:06.063785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.065914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.066675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:06.068042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.070002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.070642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:06.114570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] HTTP exception thrown: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Request method failure captured: Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 HTTP/1.1 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBF-zUbtiINWmIzddEU1hiwva-lQdxRAu2wlP0Z01iZBGGwL9ufbbZVdyZRp9KYinm1utpcWytlExyNTDF2SCPJe4C4jqYor2eaWPAw-AGXTRDHiH9h0JyouOB3GLCcbFZmO2lZE0rA4YugankneFym9Kbl3yprxU8CMyeHJ5zL3nuc Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 77fa7eb671e6455bb68c17a15d4e3578 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77fa7eb671e6455bb68c17a15d4e3578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77fa7eb671e6455bb68c17a15d4e3578"}]}] Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 77fa7eb671e6455bb68c17a15d4e3578 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1348338021 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerDiagnosticsNegativeTest-1348338021-project Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 1d202e8bf5e846bdb2a528008a322856 Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1348338021-project Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c76256e9-6b96-4b69-9132-bf281acfa725'} Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:06.123552 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. Oct 28 17:30:06.129075 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:06.132564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] Returning 404 to user: Instance c76256e9-6b96-4b69-9132-bf281acfa725 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:06.138949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ece57e4-8b32-424a-85f7-eaad8838a46d tempest-ServerDiagnosticsNegativeTest-1348338021 tempest-ServerDiagnosticsNegativeTest-1348338021-project] 10.222.0.48 "GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725" status: 404 len: 111 microversion: 2.1 time: 0.113043 Oct 28 17:30:06.141324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 317/664] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:06 2022] GET /compute/v2.1/servers/c76256e9-6b96-4b69-9132-bf281acfa725 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:30:06.158719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:06.159779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:06.175928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.189974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.201351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:06.205908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.210304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.211715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:06.337274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:06.348812 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd77a4fb-e346-4a7d-9e13-a4bcd8ab2a4e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.643214 Oct 28 17:30:06.355731 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 348/665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:05 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:06.727667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:06.728485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:06.739557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.740873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.746779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:06.747854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:06.748647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:06.749241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:07.460555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:07.471220 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f58b8089-2294-46ea-b149-d3dd233d7bf5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 1.326924 Oct 28 17:30:07.474719 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 318/666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:06 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:07.479784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:07.486242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:07.503015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:07.503676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:07.504107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:07.504974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:07.505629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:07.506204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:08.232886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:08.284241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:08.290392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:08.301698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:08.310559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f198a76-16c9-4068-ae28-d201c4a9be33 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.816502 Oct 28 17:30:08.321633 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f31a2ff6-81c8-42f7-8119-1327ad3a50d2 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 1.598577 Oct 28 17:30:08.340550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 319/667] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:07 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:08.342776 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 349/668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:06 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:08.375430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:08.378377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:08.395543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:08.396364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:08.397975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:08.399564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:08.404430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:08.405728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:08.963256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:09.000676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93980f87-776e-41be-88fa-f23e71093a31 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.653875 Oct 28 17:30:09.001531 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 350/669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:08 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:09.028626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60052554-4dc1-414e-9c50-acc7560858f2 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Action: 'create', calling method: .version_select at 0x7f752460a5e0>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:09.042476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:09.043329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:09.052529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:09.053283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:09.053909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:09.054792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:09.055440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:09.056017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:09.644612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:09.654956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-399c0d39-ee0f-4b79-a4a6-edd1157adbc5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1503 microversion: 2.1 time: 0.635614 Oct 28 17:30:09.668463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 351/670] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:09 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1503 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:09.678299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "name": "network-vif-plugged", "status": "completed", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:09.691880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:09.692878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:09.693797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:09.715942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] Creating event network-vif-plugged:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:30:09.723931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b0253061-f5d9-4cf3-a963-fa82e30ad157 req-a81e669e-968d-46a8-827b-8d83778a9f4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053692 Oct 28 17:30:09.725129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 352/671] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:09.733281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:09.734816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:09.756096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:09.759425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:09.760418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:09.763027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:09.765648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:09.766356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:09.772443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:10.347652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:10.359775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:10.363128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:10.364702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7057baa2-a3dd-4f50-a91b-4388ac91b043 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.638281 Oct 28 17:30:10.365507 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 353/672] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:09 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:10.373056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:10.373897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:10.380713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:10.381614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:10.382196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:10.383931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:10.384414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:10.384844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:10.750600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:10.758786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-464800e5-956f-4d04-85d2-24588dc67e6a tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.392042 Oct 28 17:30:10.775390 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 354/673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:10 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:10.781310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:10.782129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:10.788803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:10.789573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:10.790240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:10.791500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:10.792753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:10.793631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:11.402327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:11.412313 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fca54603-0d9e-49fd-b9a0-a4390ba955a6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1323 microversion: 2.1 time: 0.635380 Oct 28 17:30:11.427776 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 355/674] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:10 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:11.434273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:11.435113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:11.441539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:11.442303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:11.442928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:11.443928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:11.444408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:11.444856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:11.777549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:11.790732 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4551cffe-e04f-474e-80b3-3678b5739643 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1493 microversion: 2.1 time: 0.361745 Oct 28 17:30:11.791948 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 356/675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:11 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1493 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:11.796855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:11.798355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:11.805621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:11.806286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:11.807025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:11.807810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:11.808959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:11.809620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.115955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:12.126132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:12.127614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:12.128731 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b604c8b-77d1-46b3-802c-11ef4a25b5d2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.335608 Oct 28 17:30:12.129432 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 357/676] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:11 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:12.275108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1576855717", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:12.374957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:12.375763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:12.377843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:12.378486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:12.379132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:12.393507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.394398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.395064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.396043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.396711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.397343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.416949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Getting quotas for project ca7be8faac6e43e9b40700eff363239a. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:12.423660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Getting quotas for user 0d645fbc6f0a4c67a41bd2ac607438f0 and project ca7be8faac6e43e9b40700eff363239a. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:12.443766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:12.446727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:12.572599 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-20a08ba1-5b29-4f09-8853-2baa2a5ea58f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.441904 Oct 28 17:30:12.576472 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 358/677] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:30:12.590827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "name": "network-vif-plugged", "status": "completed", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:12.616770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.619940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.638396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.670594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] Creating event network-vif-plugged:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h2-860864-13 Oct 28 17:30:12.683154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5abfa874-f136-4d74-a716-4912030f6a6a req-91a4da07-36b3-46d5-8102-c49e1992a1d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102580 Oct 28 17:30:12.685920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 359/678] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:12.720063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:12.721025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:12.739340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.743011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.744098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.745589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.747088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.748047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.905681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60052554-4dc1-414e-9c50-acc7560858f2 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.558793 Oct 28 17:30:12.914660 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 320/679] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:30:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:12.919902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-537705cd-4654-44e3-a40f-2fb95fc85849 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '.version_select at 0x7f752460a700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:12.930509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537705cd-4654-44e3-a40f-2fb95fc85849 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:12.932380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537705cd-4654-44e3-a40f-2fb95fc85849 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:12.934058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537705cd-4654-44e3-a40f-2fb95fc85849 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:12.975348 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-537705cd-4654-44e3-a40f-2fb95fc85849 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 792 microversion: 2.1 time: 0.066176 Oct 28 17:30:12.990078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 321/680] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:30:12 2022] GET /compute/v2.1/os-migrations => generated 792 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:13.003131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:13.003985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:13.020673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:13.022288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:13.024193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:13.031411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:13.031411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:13.033701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:13.281608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:13.294537 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-355c0d4a-be11-4757-af7b-1a2ec12c4678 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.603459 Oct 28 17:30:13.312997 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 360/681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:12 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:13.334932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:13.344125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:13.377482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:13.391427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-537442e1-9260-453f-acbe-909d2dfd3394 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1518 microversion: 2.1 time: 0.398587 Oct 28 17:30:13.392469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 322/682] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:12 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:13.410252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-637d93ce-3831-451c-b330-7c11cb287014 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Action: 'create', calling method: .version_select at 0x7f75246a5ca0>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:13.612083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:13.622048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:13.623642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:13.646859 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4fad2b09-b497-48ed-b115-2958048f2d05 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "PUT /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1359 microversion: 2.75 time: 0.327391 Oct 28 17:30:13.667770 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 361/683] 10.222.0.48 () {62 vars in 1297 bytes} [Fri Oct 28 17:30:13 2022] PUT /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:13.682182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:13.685224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:13.694818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:13.695337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:13.702852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:13.704097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:13.704745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:13.705366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:14.078176 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b19adfc5-ca1e-420c-b48d-d9b6d1483539 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1646 microversion: 2.1 time: 0.408077 Oct 28 17:30:14.088017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 362/684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:13 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1646 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:14.158778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:14.172168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:14.264748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:14.271528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:14.272159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:14.274641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:14.274641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:14.274641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:14.742638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:14.760329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:14.763633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:14.765151 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f887d6f7-b831-4e4b-8c5b-7093b865b627 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1362 microversion: 2.25 time: 0.674332 Oct 28 17:30:14.767998 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 363/685] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:14 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1362 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:14.781051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7714793-e176-4f26-9e13-10949412fd52 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'create', calling method: .version_select at 0x7f7524abb790>, body: {"pool": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:17.019228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-637d93ce-3831-451c-b330-7c11cb287014 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.623308 Oct 28 17:30:17.021483 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 323/686] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:30:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:17.031104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:17.031901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:17.040501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.045134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.045953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.048141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.048821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.049482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.236898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.249458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.251576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.261095 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32615b84-f35a-4906-8ef5-964d256bec50 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1417 microversion: 2.75 time: 0.237718 Oct 28 17:30:17.262854 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 324/687] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:17 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1417 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:17.269363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:17.270350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:17.279822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.280709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.281353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.282449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.283106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.284042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.574822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.583388 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-befe8da7-d5a3-4020-aa07-68cd90034079 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1470 microversion: 2.1 time: 0.319066 Oct 28 17:30:17.584140 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 325/688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:17 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:17.590922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1444117017", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "3a6a8a69-8887-4595-92d7-f0a0dfb49ff9"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:17.650878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] validate_networks() for [('3a6a8a69-8887-4595-92d7-f0a0dfb49ff9', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:17.665131 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7714793-e176-4f26-9e13-10949412fd52 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.893935 Oct 28 17:30:17.666342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 364/689] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:30:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:17.675270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:17.676048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:17.683173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.683982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.684435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.685150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:17.685607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:17.686040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:17.952621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.965255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.967599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:17.968986 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-42be2132-77b7-4e49-ae4c-149b268ccb75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1558 microversion: 2.25 time: 0.299139 Oct 28 17:30:17.980305 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 365/690] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:17 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1558 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:17.996031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-772530824", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "eca1436c-2c5f-429d-bba5-e83d95db5267"}, {"uuid": "78c76527-5c8c-47de-b6de-1b8697138860"}, {"uuid": "eca1436c-2c5f-429d-bba5-e83d95db5267"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:18.076639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] validate_networks() for [('eca1436c-2c5f-429d-bba5-e83d95db5267', None, None, None, None, None), ('78c76527-5c8c-47de-b6de-1b8697138860', None, None, None, None, None), ('eca1436c-2c5f-429d-bba5-e83d95db5267', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:18.385151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:18.385639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:18.386893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:18.387456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:18.388141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:18.397604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:18.398165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:18.398663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:18.399540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:18.400058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:18.400543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:18.421189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:18.427523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for user b5dbc2c295144accbd4d508afb066b03 and project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:18.442626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:18.445195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:18.515313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5661c80-c335-45d3-82a0-2a24aa020eb0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928891 Oct 28 17:30:18.518491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 326/691] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:30:18.535009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1756c97d-8bd6-4bea-9425-d32089951a83 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Action: 'create', calling method: .version_select at 0x7f75249148b0>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:19.602294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:19.602765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:19.603026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:19.604318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:19.604318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:19.614595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:19.615080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:19.615892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:19.616983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:19.617646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:19.618279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:19.631672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:19.642235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Getting quotas for project bedfd84f821d43f58d95630314be6d35. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:19.653926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Getting quotas for user 5192aa33e80d4d6b99db6276d98de21e and project bedfd84f821d43f58d95630314be6d35. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:19.673805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:19.676814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:19.742711 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b83525b-e352-49c8-b64c-62ca04600b10 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760836 Oct 28 17:30:19.743395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 366/692] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:30:19.749338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-71559310", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:19.825405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] validate_networks() for [('8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:21.022283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:21.023532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:21.024029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:21.024444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:21.024863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:21.036367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.037103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.037548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.038289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.038752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.039183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.058403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Getting quotas for project 94b73acb57c54ec3b7ca1a065cc0a86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:21.064044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Getting quotas for user 94ec1482fbdb4e65ad339ab01b7a557e and project 94b73acb57c54ec3b7ca1a065cc0a86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:21.080879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:21.083076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:21.137868 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d5b16ca-a80d-4026-ae28-9f373400966c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393183 Oct 28 17:30:21.142184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1756c97d-8bd6-4bea-9425-d32089951a83 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.621396 Oct 28 17:30:21.144076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 327/693] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:30:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:21.145263 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 367/694] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:30:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:30:21.152240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.153425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.155089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.155722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.162494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.163315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.163875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.164305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.164889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.165162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.165642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.165877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.166077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.169401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.171108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.171858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.332681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.345555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.347518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.353007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6077d26-281c-433c-9e18-4e0f5e7cacb6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1417 microversion: 2.75 time: 0.206688 Oct 28 17:30:21.353573 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 368/695] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1417 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:21.369024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.369237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.377420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.377910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.378342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.379174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.379639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.380061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.414670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:21.428752 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3aaaceb4-f0b2-4a84-a152-5cc52b0a8607 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 2053 microversion: 2.25 time: 0.283430 Oct 28 17:30:21.429335 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 328/696] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 2053 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:21.434817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.435430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.441418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.442076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.442667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.443556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.444007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.444582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.473071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.484239 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13570cd8-3302-40a5-a30e-ac6ddd4fb5f5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1269 microversion: 2.1 time: 0.122283 Oct 28 17:30:21.484858 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 369/697] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1269 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:21.490129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.490985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.501919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.502414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.502847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.503614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.504064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.504577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.625520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.633713 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0f4c955-afe8-4cb0-b897-1a71ef2e5cec tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1216 microversion: 2.1 time: 0.147807 Oct 28 17:30:21.634424 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 370/698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:21.640193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87a32423-a79a-4bf6-921d-67a879d172de tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.641072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87a32423-a79a-4bf6-921d-67a879d172de tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.746899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87a32423-a79a-4bf6-921d-67a879d172de tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.754618 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87a32423-a79a-4bf6-921d-67a879d172de tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1222 microversion: 2.1 time: 0.118932 Oct 28 17:30:21.759778 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 371/699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:21.765515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c135fa0-713a-4380-b480-32d8782017af tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Action: 'create', calling method: .version_select at 0x7f7524abbe50>, body: {"pool": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:21.766032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:21.773910 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4d78786-df35-47a1-90f7-022ff5cd2c89 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1476 microversion: 2.1 time: 0.343392 Oct 28 17:30:21.774488 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 329/700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:21.779660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:21.780471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:21.786770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.787258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.787731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.788427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:21.793529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:21.794092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:21.815392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:22.130046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:22.147033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cf8260e8-ab3e-4950-b59b-cc4f3f32f9ce tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 2053 microversion: 2.25 time: 0.371313 Oct 28 17:30:22.147679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 330/701] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:21 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 2053 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:22.172103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:22.175691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.176172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.176607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:22.177340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.177791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.178217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:22.202259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-339f0cc0-1d66-4675-aa1e-eee8ac41a9f7 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.033686 Oct 28 17:30:22.202859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 331/702] 10.222.0.48 () {60 vars in 1217 bytes} [Fri Oct 28 17:30:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:30:22.215031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:22.215588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:22.221400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.221884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.222314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:22.223268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.223751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.224172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:22.293218 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ae1adb2-d82a-4de7-9183-9226ce65fbd5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162/action" status: 202 len: 0 microversion: 2.25 time: 0.081970 Oct 28 17:30:22.293980 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 332/703] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:30:22 2022] POST /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:30:22.307359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:22.308811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:22.317846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.318333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.318763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:22.319495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:22.320012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:22.320374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.082235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:23.095788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97c247ae-3ce8-4dc1-a6c6-4c81926586cf tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 2058 microversion: 2.25 time: 0.793437 Oct 28 17:30:23.096373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 333/704] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:22 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 2058 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:23.101383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:23.101975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:23.108691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.109152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.109621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.110605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.111410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.112031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.202177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.210471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.211910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.217341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e1e8231-0c39-4767-b266-983d8bc393d6 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1438 microversion: 2.75 time: 0.119783 Oct 28 17:30:23.217906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 334/705] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:23 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:23.222569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:23.223670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:23.232575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.233369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.234043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.235269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.236193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.237002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.608931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.621614 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00437e18-9e62-41cf-9157-4e937771187f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1311 microversion: 2.1 time: 0.402390 Oct 28 17:30:23.633992 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 335/706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:23 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:23.646321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:23.647507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:23.658548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.659299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.660077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.663117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.663894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.664602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.797635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.806523 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86d4f8ef-98f6-403a-869d-91e19bf20acb tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1282 microversion: 2.1 time: 0.171355 Oct 28 17:30:23.819750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 336/707] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:23 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:23.824830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:23.825447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:23.831823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.831992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.832325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.833026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.833480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.834090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.951591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:23.962230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e364f74-806c-4e1c-b8f7-647d0e099a14 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1274 microversion: 2.1 time: 0.141243 Oct 28 17:30:23.962902 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 337/708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:23 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:23.970244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:23.971173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:23.980390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.981150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.982156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:23.989226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:23.989226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:23.989590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.408011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:24.416867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-44f16e26-7a28-4e3c-8fb0-41e76e80cd72 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1476 microversion: 2.1 time: 0.451586 Oct 28 17:30:24.417464 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 338/709] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:23 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:24.422702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:24.425543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:24.431647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.432128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.432697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.433261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.433685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.434103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.518851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:24.519332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:24.519727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:24.520405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:24.520970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:24.591505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:24.598589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.599339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.599977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.600877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.601489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.602073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.782771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:24.797633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:24.803013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:24.809888 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8a663dac-9c51-4f45-a8d1-11e629702e82 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "POST /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381/action" status: 202 len: 1495 microversion: 2.75 time: 0.391102 Oct 28 17:30:24.810992 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 339/710] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:30:24 2022] POST /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381/action => generated 1495 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 17:30:24.816621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9415822a-7891-4cd1-96e6-54b21e887316", "tag": "23cef619-7f5a-482c-9780-5f2a99269678"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:24.829550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.830312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.831023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.846046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] Creating event network-changed:23cef619-7f5a-482c-9780-5f2a99269678 for instance 9415822a-7891-4cd1-96e6-54b21e887316 on n-h2-860864-13 Oct 28 17:30:24.852457 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-144e5499-7e2d-49ca-969a-7ac481c3d942 req-56ac0a80-20dc-4cf1-ac2d-81250697f8f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039806 Oct 28 17:30:24.853519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 340/711] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:24.859982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-unplugged", "status": "completed", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:24.870696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.871491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.872081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.885950 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] Creating event network-vif-unplugged:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:30:24.892378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-109735e2-2be2-42f9-bc03-9d33e3cfa749 req-6aa11767-8bb0-4300-8b43-37057aed5b36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036449 Oct 28 17:30:24.893534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 341/712] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:24.898988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:24.900091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:24.915302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.915837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.916358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.917247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:24.917697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:24.918118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:24.966922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c135fa0-713a-4380-b480-32d8782017af tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.205848 Oct 28 17:30:24.967793 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 372/713] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:30:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:24.983568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:24.984438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:24.994610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.000699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.003225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.005691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.006840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.007935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.588099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:25.601932 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-171051fb-4c5d-4bb7-b5fb-0fc3428725a1 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 2038 microversion: 2.25 time: 0.706721 Oct 28 17:30:25.602519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 342/714] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:24 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 2038 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:25.607941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:25.608539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:25.614585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.615005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.615480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.616253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.616893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.617319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.642995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.651666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7b75490-b8e6-4bf2-91cc-bbe8b4dfe7d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1311 microversion: 2.1 time: 0.681833 Oct 28 17:30:25.652279 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 373/715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:24 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1311 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:25.656961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:25.657557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:25.664004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.664974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.665575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.666468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.667737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.668491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.695323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.704712 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae51b4d7-0890-4f1c-8e61-32788c5eddc4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1270 microversion: 2.1 time: 0.101064 Oct 28 17:30:25.705608 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 343/716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:25 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:25.710288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7383396-1b63-40e7-8626-ba9b3dbf705e tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f752460a940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:25.798725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.807033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.809147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.814382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7b25de9-3ac3-40da-bade-82d767d2b689 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.161139 Oct 28 17:30:25.814951 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 374/717] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:25 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:25.836293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:25.837128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:25.843301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.843830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.844272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.844976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:25.845433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:25.845860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:25.982151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:25.993458 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21be6ec2-65d5-4476-8490-54557931f4f0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1280 microversion: 2.1 time: 0.160707 Oct 28 17:30:25.994430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 375/718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:25 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:25.999892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:26.000505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:26.006777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:26.007265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:26.007731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:26.008429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:26.008884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:26.009313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:26.027812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:26.283107 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7383396-1b63-40e7-8626-ba9b3dbf705e tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/cfea1837-12ba-4c9d-873a-9e9f1954a7d7" status: 200 len: 142 microversion: 2.1 time: 0.576261 Oct 28 17:30:26.291597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 344/719] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:30:25 2022] GET /compute/v2.1/os-floating-ips/cfea1837-12ba-4c9d-873a-9e9f1954a7d7 => generated 142 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:26.296761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": "auto"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:26.299338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:26.305379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:26.305943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:26.306472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:26.307236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:26.308504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:26.309020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:26.392583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:26.405032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b276673-0f5f-4954-b9f9-389071ec587b tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1461 microversion: 2.1 time: 0.409108 Oct 28 17:30:26.405732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 376/720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:25 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1461 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:26.410715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8ee03d4-3b05-426d-b2c7-378025b19b42 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f75245b23a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:26.418775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'flavor' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:26.453305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:26.474426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:30:27.805671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92f69d2c-b6a2-4025-813e-858882fd6414 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162/action" status: 202 len: 0 microversion: 2.25 time: 1.512699 Oct 28 17:30:27.806364 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 345/721] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:30:26 2022] POST /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162/action => generated 0 bytes in 1514 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:27.816158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:27.820689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:27.829334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:27.829813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:27.830945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:27.832964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:27.833710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:27.834364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:27.925671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5f5749f-7b9b-47cd-a7c5-5b04a36be6a4 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 0 microversion: 2.1 time: 0.114247 Oct 28 17:30:27.926827 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 346/722] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:27 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:27.931927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:27.933501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:27.941571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:27.942664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:27.943519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:27.944431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:27.945474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:27.946128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:28.437458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:28.717285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:28.733768 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59bc2ad3-321a-4892-b0ea-097756acf0fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1311 microversion: 2.1 time: 0.803528 Oct 28 17:30:28.749483 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 347/723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:27 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1311 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:28.749483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:28.749483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:28.751109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:28.751109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:28.751267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:28.757680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:28.758582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:28.759826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:28.883038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8ee03d4-3b05-426d-b2c7-378025b19b42 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/cfea1837-12ba-4c9d-873a-9e9f1954a7d7" status: 202 len: 0 microversion: 2.1 time: 2.475922 Oct 28 17:30:28.890774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 377/724] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:30:26 2022] DELETE /compute/v2.1/os-floating-ips/cfea1837-12ba-4c9d-873a-9e9f1954a7d7 => generated 0 bytes in 2484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:28.913904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:28.922029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:28.935049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:28.935759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:28.937975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:28.941114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:28.942859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:28.943535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.127793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.142740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.148609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.155918 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d081f30-7242-48ae-b6e7-15a1b5acd0c9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.262164 Oct 28 17:30:29.156607 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 378/725] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:28 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:29.161638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-plugged", "status": "completed", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:29.172900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.173792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.174426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.186076 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] Creating event network-vif-plugged:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:30:29.191696 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-51643110-5cee-46ee-925e-86dd67f7c0a6 req-d6a71043-be82-4d6b-883a-f99d8e90b571 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Oct 28 17:30:29.197961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 379/726] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:29.203534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:29.204510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:29.212446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.213088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.214928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.215848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.216472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.217128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.468476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.482610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-093337fe-8682-4b4f-83f4-167d5dfff426 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1333 microversion: 2.1 time: 0.746260 Oct 28 17:30:29.483538 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 348/727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:28 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1333 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:29.500735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:29.501341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:29.510074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.511314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.511790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.512501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.512948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.513370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.676557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.685038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50a6b956-13ad-40c6-8ca0-47400e092f9a tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.485574 Oct 28 17:30:29.685616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 380/728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:29 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:29.692167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:29.692946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:29.700820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.701572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.702201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.703118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.703801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.704419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.745493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:29.746452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:29.747083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:29.747746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lazy-loading 'fault' on Instance uuid 91b8092a-21c3-44e2-8fec-86e6d125db39 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:29.857640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.869270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.871021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:29.872125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e32bade7-b6e5-4a69-9a16-1d79f27201de tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1568 microversion: 2.25 time: 0.375987 Oct 28 17:30:29.873302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 349/729] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:29 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:29.882700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c63757b-92e2-44e3-861b-7fb26ee6efbd tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f7524d3c940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:30.186506 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-800dc702-1557-468a-877e-9bc0d588f99b tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1597 microversion: 2.1 time: 0.499525 Oct 28 17:30:30.187391 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 381/730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:29 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1597 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:30.192510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "name": "network-vif-unplugged", "status": "completed", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:30.204825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.205949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.206853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.219959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] Creating event network-vif-unplugged:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h2-860864-13 Oct 28 17:30:30.226348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e628ab8a-99c1-493c-a846-1919883ab132 req-d8ab6d33-4163-44f5-a010-31ac7af612a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037498 Oct 28 17:30:30.227304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 382/731] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:30.235408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:30.236386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:30.245308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.246359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.246801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.247702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.248340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.248934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.275524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c63757b-92e2-44e3-861b-7fb26ee6efbd tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.400911 Oct 28 17:30:30.276192 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 350/732] 10.222.0.48 () {58 vars in 1164 bytes} [Fri Oct 28 17:30:29 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:30:30.281620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:30.282551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:30.292957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.293692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.294310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.295198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.296761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.297489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.481189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:30.494509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:30.498287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:30.504499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-feb17d94-6493-4ab3-9509-765f79aef126 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.226416 Oct 28 17:30:30.506873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 351/733] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:30 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:30.514841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:30.517995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:30.533244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.534502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.535246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.537417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.539305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.541037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.644549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5cb9501f-260b-40b6-863c-ec926481d6f0 tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action" status: 202 len: 0 microversion: 2.1 time: 0.135905 Oct 28 17:30:30.648317 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 352/734] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:30 2022] POST /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:30.650370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8314735-c467-4784-8d10-1c405fe42b3e tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f75246a51f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:30.661187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:30.669949 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95eaa7a2-1f9b-47a3-92f4-f8fb8686f9db tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1311 microversion: 2.1 time: 0.441213 Oct 28 17:30:30.671012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 383/735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:30 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1311 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:30.675890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41a9725-46ea-4060-8ed3-f4e97a2d56b5", "tag": "6fb1b778-3c2b-4c05-b897-251a2b36542b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:30.686148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.686697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.687195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.700133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] Creating event network-changed:6fb1b778-3c2b-4c05-b897-251a2b36542b for instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 on n-h1-860864-13 Oct 28 17:30:30.708422 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c2a2a19b-0b5b-4d64-bc72-f43d522e7d8a req-34a4c1a6-76a4-470b-a8b0-9540fab8212c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033758 Oct 28 17:30:30.709267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 384/736] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:30.715902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:30.717619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:30.724875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.726082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.726535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:30.727257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:30.727803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:30.728234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.047904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:31.422726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:31.437756 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6c02965e-10d3-4e52-8812-55875ad61b77 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.727085 Oct 28 17:30:31.443662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 385/737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:30 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:31.448968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:31.449577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:31.456149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.456588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.457019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.457710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.458190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.458609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.502381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8314735-c467-4784-8d10-1c405fe42b3e tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.856001 Oct 28 17:30:31.506056 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 353/738] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:30:30 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:31.512140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:31.512330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:31.520017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.520745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.521242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.521946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.522432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.523021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.753932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=22 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:31.868636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bab6a67d-5bcb-42ef-b327-12177fbc5f5a tempest-ServersAdminTestJSON-295649262 tempest-ServersAdminTestJSON-295649262-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1614 microversion: 2.1 time: 0.423649 Oct 28 17:30:31.869476 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 386/739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:31 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1614 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:31.875200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:31.875886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:31.882678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.883588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.884377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.885461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.886108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.886718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.914993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:31.926329 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d4aa7c0-837a-499b-98b9-e57125bd8376 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.419147 Oct 28 17:30:31.927006 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 354/740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:31 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:31.937519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9415822a-7891-4cd1-96e6-54b21e887316", "name": "network-vif-plugged", "status": "completed", "tag": "23cef619-7f5a-482c-9780-5f2a99269678"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:31.956996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:31.957490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:31.957935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:31.971461 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] Creating event network-vif-plugged:23cef619-7f5a-482c-9780-5f2a99269678 for instance 9415822a-7891-4cd1-96e6-54b21e887316 on n-h2-860864-13 Oct 28 17:30:31.980097 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c5f54652-2b8f-4073-8d68-ded29f267bfd req-38f425e5-b148-4278-8ba7-6d7892ac1c2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045856 Oct 28 17:30:31.980990 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 355/741] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:31.986539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8bd5cbd-49a7-4cb7-b1b3-d283ac1fd360 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f7524543280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:32.184204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:32.308685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.323567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.326415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.335542 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-078af234-6d16-4d07-a63a-e8ded56267ac tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1568 microversion: 2.25 time: 0.456329 Oct 28 17:30:32.335542 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 387/742] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:31 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:32.335542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:32.335542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:32.342360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.343062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.343692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.344559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.345172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.345752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.476831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.486595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.488085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.495634 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28194be5-532d-46fb-bfe0-8864d35f8c00 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.165426 Oct 28 17:30:32.496213 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 388/743] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:32 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:32.500943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:32.501552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:32.507893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.508368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.508800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.510417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.510417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.510417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.857109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:32.866760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cb53d41-7f45-4623-8f43-cec001d110a4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1311 microversion: 2.1 time: 0.369518 Oct 28 17:30:32.870438 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 389/744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:32 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1311 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:32.874195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:32.874195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:32.880204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.881777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.882381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.882929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:32.883423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:32.883850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:32.915297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:30:33.017972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65f87b23-05b6-4068-9ef4-8b8d087dd305 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 204 len: 0 microversion: 2.1 time: 0.148814 Oct 28 17:30:33.018849 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 390/745] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:30:32 2022] DELETE /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:33.024324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:33.034979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.035536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.035970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.051354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] Creating event network-changed:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h2-860864-13 Oct 28 17:30:33.056836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5e2fbdfc-2e74-4f08-93c0-e5dfc4c2c857 req-d97d913f-8c80-49cb-958d-757a45511ae3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036458 Oct 28 17:30:33.059189 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 391/746] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:33.068512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.070450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:33.077357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.077866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.078278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.079044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.079574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.079996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.280865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.290584 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd108dfa-c391-467d-b398-bd46286ec532 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.229101 Oct 28 17:30:33.297004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 392/747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:33 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:33.301359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.302259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:33.308789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.309284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.309778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.311410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.311410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.311637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.357754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8bd5cbd-49a7-4cb7-b1b3-d283ac1fd360 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/662cdc65-dc55-4d9f-8ba2-6ae1715ff490" status: 202 len: 0 microversion: 2.1 time: 1.375362 Oct 28 17:30:33.361263 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 356/748] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:30:31 2022] DELETE /compute/v2.1/os-floating-ips/662cdc65-dc55-4d9f-8ba2-6ae1715ff490 => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:33.365848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "tag": "2b3822f3-b28e-4253-854e-6dc73d288293"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:33.377692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.378162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.378588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.390745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] Creating event network-changed:2b3822f3-b28e-4253-854e-6dc73d288293 for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:33.395865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-cbb40b73-0ccb-49ec-8179-f669fc99adff req-8fb30737-6255-4a67-b0a2-43dad54d36d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Oct 28 17:30:33.396874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 357/749] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:33.404183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.405073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:33.408462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:33.413620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.414113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.414550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.415253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.415766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.416199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.494071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.504165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a49391ef-8be8-4394-9a84-505c3ba37eba tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.207302 Oct 28 17:30:33.504747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 393/750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:33 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:33.509389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.511588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:33.517478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.518062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.519871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.521136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.521802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.522782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.611180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.620378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60f6fbc4-73ef-4770-b521-e3d3268d2843 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1468 microversion: 2.1 time: 0.221365 Oct 28 17:30:33.620970 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 358/751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:33 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1468 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:33.628039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f64dff6-7e63-4b1f-98e7-719246e4113b tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f7524543820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.841429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.843827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:33.855965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.857482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:33.858689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09166b1d-53f0-4a19-aee3-addcb0d9a938 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1568 microversion: 2.25 time: 0.353016 Oct 28 17:30:33.859287 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 394/752] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:33 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:33.866381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:33.867083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:33.882690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.883241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.883744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:33.884465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:33.886445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:33.886573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:34.185298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:34.199624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:34.201229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:34.208350 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da93bfb1-870f-4a12-a3af-8d49f1183eba tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.347998 Oct 28 17:30:34.211342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 395/753] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:33 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:34.216276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:34.216992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:34.218987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:34.234841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:34.235523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:34.236061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:34.236768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:34.237222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:34.237645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:34.626332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:34.637331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45c722e2-e28a-4575-9b34-3833ae1513a8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1494 microversion: 2.1 time: 0.426154 Oct 28 17:30:34.651402 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 396/754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:34 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1494 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:34.651402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:34.651402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:34.652154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:34.652671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:34.653164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:34.653920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:34.654713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:34.655168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.050793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:35.067231 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6735d1a-2f77-4c3b-84eb-8df3bf5d31db tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.422352 Oct 28 17:30:35.084102 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 397/755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:34 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:35.084102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:35.084102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:35.096102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.096601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.097042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.098004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.098459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.098883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.484028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:35.491736 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f88e3c5-820b-4d0a-a3dc-5b8506135f50 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.420085 Oct 28 17:30:35.504201 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 398/756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:35 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:35.513937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:35.514846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:35.524615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.525104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.526617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.527410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.527855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.528514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.692163 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f64dff6-7e63-4b1f-98e7-719246e4113b tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/2936ff46-89e1-43b1-96db-0038db429ee3" status: 202 len: 0 microversion: 2.1 time: 2.067716 Oct 28 17:30:35.692750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 359/757] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:30:33 2022] DELETE /compute/v2.1/os-floating-ips/2936ff46-89e1-43b1-96db-0038db429ee3 => generated 0 bytes in 2071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:35.698700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:35.700764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:35.712186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.714404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.715131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.718191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.718670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.722049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.844183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:35.852948 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48e009bc-d496-4277-9f18-f4cfdb7e0627 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1468 microversion: 2.1 time: 0.347703 Oct 28 17:30:35.853787 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 399/758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:35 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:35.861826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:35.862441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:35.871248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.871758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.872194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.873080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:35.873683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:35.874117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:35.993670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1882370-1c32-40ec-8d33-f98d1d1eb9fc tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1647 microversion: 2.1 time: 0.299717 Oct 28 17:30:35.994180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 360/759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:35 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1647 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:36.000143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:36.000736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:36.006820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.007402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.008081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:36.009234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.009905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.011714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:36.122683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.137624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.139081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.152744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d1f07ba-b853-4627-a55f-e62b3137379b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.155708 Oct 28 17:30:36.154677 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 361/760] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:35 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:36.162659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6997a7d1-826e-420a-9aab-1229bde88118 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] Calling method '.version_select at 0x7f7524543a60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:36.221344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.242840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.253669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:36.255294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-819f50f9-7071-4390-b3d6-00e1d26ecb93 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1568 microversion: 2.25 time: 0.399735 Oct 28 17:30:36.273451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 400/761] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:35 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1568 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:36.287240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:36.287794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:36.298846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.299345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.299825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:36.300516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.301197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.302437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:36.922308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4ffcf80-ed82-447f-ada8-dcfc8e9de37f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1647 microversion: 2.1 time: 0.646223 Oct 28 17:30:36.924579 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 401/762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:36 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1647 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:36.929418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:36.930305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:36.942324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.944135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.944817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:36.945835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:36.946364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:36.946852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:37.767520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:37.786760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c42076d1-4cef-4b4b-8496-ade0050418e6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.860824 Oct 28 17:30:37.787346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 402/763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:36 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:37.804187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:37.809541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:37.841092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:37.841973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:37.842569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:37.846204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:37.846766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:37.848137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.508664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:38.518120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38258e55-1d8a-4c3e-92e1-a8fc755415cb tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.721570 Oct 28 17:30:38.535794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 403/764] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:37 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:38.547357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:38.549763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:38.566831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.567326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.567941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.568832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.569291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.569714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.619439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.620148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.620784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.621449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lazy-loading 'fault' on Instance uuid 4ae40224-e17e-4f5e-b095-7b9332702681 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:38.681923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:38.691108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0840c802-a51e-454e-9c0f-2c72de8842a7 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 200 len: 1303 microversion: 2.1 time: 0.153980 Oct 28 17:30:38.692236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 404/765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:38 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:38.696652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:38.702356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.703085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.703781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.704716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.705373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.705978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.734147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc99024e-cfa8-4b43-b7f9-815d87370a4f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040705 Oct 28 17:30:38.735357 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 405/766] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:30:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:38.740126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "tag": "4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:38.750963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.751925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.752525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.764233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] Creating event network-changed:4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:38.769155 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-69341026-d065-4532-832f-318ab5650c5b req-cdefb508-bf19-4f66-9d3d-b1891816e2d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032308 Oct 28 17:30:38.770202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 406/767] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:38.776038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:38.777163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:38.783719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.784200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.784624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.785470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.786071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.786490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.905810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:38.924610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:38.926245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:38.928539 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6997a7d1-826e-420a-9aab-1229bde88118 tempest-FloatingIPDetailsTestJSON-682282060 tempest-FloatingIPDetailsTestJSON-682282060-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/b12aeaf6-6511-41c3-9d0e-3aa1b1d9db1c" status: 202 len: 0 microversion: 2.1 time: 2.772312 Oct 28 17:30:38.929644 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 362/768] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:30:36 2022] DELETE /compute/v2.1/os-floating-ips/b12aeaf6-6511-41c3-9d0e-3aa1b1d9db1c => generated 0 bytes in 2774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:38.935706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:38.936497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:38.946705 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3621e5d-459b-4785-9d92-a81ae7640fcc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.175158 Oct 28 17:30:38.948718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.950643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.950911 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 407/769] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:38 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:38.952049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.953640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.956424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.957054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:38.962439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae40224-e17e-4f5e-b095-7b9332702681", "name": "network-vif-deleted", "tag": "5c9e771a-e7f6-42ca-afe9-ae193a4bbecf"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:38.988066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:38.988557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:38.988994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.019449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] Creating event network-vif-deleted:5c9e771a-e7f6-42ca-afe9-ae193a4bbecf for instance 4ae40224-e17e-4f5e-b095-7b9332702681 on n-h1-860864-13 Oct 28 17:30:39.025102 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-21d87862-8518-4529-9ce0-ae517fe5ec8c req-effdeb70-7e7d-40fb-8758-ea1c9dc53b62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071839 Oct 28 17:30:39.026937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 408/770] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:39.032388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:39.033278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:39.041869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.042711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.043449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.044594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.045062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.045496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.162629 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b07d9582-328a-4f88-8861-5811c142cf02 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316/action" status: 202 len: 0 microversion: 2.1 time: 0.133642 Oct 28 17:30:39.170436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 409/771] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:39 2022] POST /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:39.178171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:39.179840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:39.188821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.189904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.190849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.191884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.192570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.193201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.498891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:39.507992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:39.514555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:39.518041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:39.530009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56e5a415-84cc-4c93-ba3e-f90ec20afa3e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1543 microversion: 2.25 time: 0.589253 Oct 28 17:30:39.554487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:39.558058 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 363/772] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:38 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1543 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:39.570953 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5372858d-508f-4d9f-8a73-cb0d3aebfef4 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.397693 Oct 28 17:30:39.571871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:39.572934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:39.573680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 410/773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:39 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:39.595926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41a9725-46ea-4060-8ed3-f4e97a2d56b5", "name": "network-vif-plugged", "status": "completed", "tag": "6fb1b778-3c2b-4c05-b897-251a2b36542b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:39.597704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.598513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.599208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.600173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.601629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.602604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.624374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.624854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.625290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.693498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] Creating event network-vif-plugged:6fb1b778-3c2b-4c05-b897-251a2b36542b for instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 on n-h1-860864-13 Oct 28 17:30:39.708187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e0dfc5a2-d570-4146-bb76-18c02de466df req-e6be32c0-3845-4a96-aa45-fb713b1e7770 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132939 Oct 28 17:30:39.717651 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 411/774] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:39.734038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:39.734758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:39.762439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.766333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.766906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.767700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.768171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.768593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.925915 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e7f70be-6db7-4334-bacb-3cb2178526a9 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1632 microversion: 2.1 time: 0.365975 Oct 28 17:30:39.926451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 364/775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:39 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1632 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:39.931857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a83ea9a-8885-442a-b4f2-b26268d4e333 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '.version_select at 0x7f7524b071f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:39.936701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a83ea9a-8885-442a-b4f2-b26268d4e333 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.937487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a83ea9a-8885-442a-b4f2-b26268d4e333 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.939029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a83ea9a-8885-442a-b4f2-b26268d4e333 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.952580 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a83ea9a-8885-442a-b4f2-b26268d4e333 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.024453 Oct 28 17:30:39.956109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 365/776] 10.222.0.48 () {60 vars in 1184 bytes} [Fri Oct 28 17:30:39 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:39.966181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:39.967485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 4ae40224-e17e-4f5e-b095-7b9332702681] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:39.979967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.980468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.980908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.981623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:39.982075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:39.982499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:39.999280 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] HTTP exception thrown: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Request method failure captured: Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 HTTP/1.1 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBEoxStNsxthxMHdUYKWoIcHtInO1CD-fsQp1ksPHjxJ0-n7pXToq_A07_erwXKrVVjMlyZgx6UkeeHVHZtb6Bbgg-BJY8DrLz7FhOIGkFxY0Y73SncUKBeoJPESZFVeLggnH55ybnmzJfT9YODyOScrtcaEmum5qCi7hMMR_g3E6QM Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51bdbcf44e1646268fc1b36fabb61260"}]}] Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d6161a967d6549ea8275b2d9dd98aa02 Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4ae40224-e17e-4f5e-b095-7b9332702681'} Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:40.001225 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Returning 404 to user: Instance 4ae40224-e17e-4f5e-b095-7b9332702681 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:40.005936 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e972fec-b4ff-4519-8d9d-bf0218a06985 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681" status: 404 len: 111 microversion: 2.1 time: 0.047393 Oct 28 17:30:40.009619 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 366/777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:39 2022] GET /compute/v2.1/servers/4ae40224-e17e-4f5e-b095-7b9332702681 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:30:40.015075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:40.018489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.025503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:40.027732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.029191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.030000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.030903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.031673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.032900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.033413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:40.046575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41adc91b-1f8e-4400-93cc-a039370f25e7 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.326293 Oct 28 17:30:40.048359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 412/778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:39 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:40.056027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:40.057081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.068297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lazy-loading 'flavor' on Instance uuid 9415822a-7891-4cd1-96e6-54b21e887316 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:40.070644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.070644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.070644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.070644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.070972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.071542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.088621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:30:40.244788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 94a4d850-3cbd-494b-93a8-e2002c08f162 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:40.319833 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-421f87a9-0163-4f15-97bf-a5638cce346f tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 2038 microversion: 2.25 time: 0.268594 Oct 28 17:30:40.320621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 413/779] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:40 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 2038 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:40.327514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:40.328130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.334702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.335197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.335673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.336373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.336876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.338930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.431531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:40.442484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:40.444613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:40.451582 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2304a5bd-adb3-41c6-a90c-770e2c156cbc tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.129529 Oct 28 17:30:40.452201 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 414/780] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:40 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:40.457023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:40.457525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.464087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.464594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.465019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.465717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.466342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.466991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.496972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:30:40.583218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d45a919-6f75-4ed0-9028-69b2340ce909 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "DELETE /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 204 len: 0 microversion: 2.1 time: 0.129486 Oct 28 17:30:40.589050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 415/781] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:30:40 2022] DELETE /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:40.594769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f99ae3e-f51a-44cb-972f-f989cea9c2f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: .version_select at 0x7f75246205e0>, body: {"keypair": {"name": "tempest-keypair-1338595218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS0IqcRLKkShvK8ooSFMX3difxJlz3JO5g0JCeuLOSuxbZgTuYHNBEEFbhKUTaz2s5fS3lzzVz2aCn3l+5i0QGOF8cvwJ8QGXsOfnAHE5cVHtjj+IvGLhm1Ll3P3IW4sw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:40.611497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0f99ae3e-f51a-44cb-972f-f989cea9c2f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:40.617440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0f99ae3e-f51a-44cb-972f-f989cea9c2f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for user 5121cf58427a48738ec1c70fbf5e922d and project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:40.643295 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f99ae3e-f51a-44cb-972f-f989cea9c2f3 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.052932 Oct 28 17:30:40.644131 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 416/782] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:30:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:30:40.656025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:40.656797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.663582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.664200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.664504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.665211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.665665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.668347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.853208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:40.863052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e6ed528-bd65-4fd3-8d10-413d940b8848 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1468 microversion: 2.1 time: 0.210308 Oct 28 17:30:40.875435 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 417/783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:40 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:40.875435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:40.875435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:40.877166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.877561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.877995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:40.881051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:40.881051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:40.881051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.086284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:41.103280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b603aff-5b4f-48dc-9793-0cdcd1d4296c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.237464 Oct 28 17:30:41.123841 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 418/784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:40 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:41.123841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "tag": "f38ffe5d-321a-4d8e-a103-a76865b6423d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:41.131601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.132341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.132636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.155812 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] Creating event network-changed:f38ffe5d-321a-4d8e-a103-a76865b6423d for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:41.163134 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ed557f17-24f5-4d3a-b247-c6420bab316c req-ac502aac-594b-49c8-9868-17885bea9fc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053178 Oct 28 17:30:41.165139 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 419/785] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:41.174876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:41.176365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:41.192832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.194314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.194944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.195753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.196868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.197528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.404675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:41.426445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3842369-ebe8-425b-8d57-4322f08ac567 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1322 microversion: 2.1 time: 0.256830 Oct 28 17:30:41.428538 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 420/786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:41 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:41.481114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:41.482175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:41.491301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.498354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.498814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.499582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.500038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.500457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.644924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:41.660036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:41.662183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:41.668170 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-884401c7-4d13-460f-b917-651bec2d411f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.192492 Oct 28 17:30:41.684308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 421/787] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:41 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:41.890440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:41.891245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:41.904835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.908512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.909170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:41.910107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:41.910751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:41.914470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:42.279255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:42.287980 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06a530ab-22bd-45cf-bf30-a80885d8a5be tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1468 microversion: 2.1 time: 0.402537 Oct 28 17:30:42.292978 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 422/788] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:41 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1468 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:30:42.297898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "name": "network-vif-plugged", "status": "completed", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:42.350498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:42.351175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:42.351648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:42.388079 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] Creating event network-vif-plugged:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h1-860864-13 Oct 28 17:30:42.411881 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d9381627-62fe-4ea2-ac49-af04719f3a0b req-f8b1d653-94bc-4261-8e12-9cac416838c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112799 Oct 28 17:30:42.414121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 423/789] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:42.430372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:42.434016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:42.452308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:42.453066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:42.455305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:42.457741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:42.458786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:42.459710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.057781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:43.070649 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-46a9c63c-d022-4d2b-8a76-2be23e290927 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.654259 Oct 28 17:30:43.071781 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 424/790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:42 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:43.078225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:43.079146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:43.086356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.087025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.088627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.089881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.090581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.091163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.473827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:43.482048 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0637386a-6913-416b-b2dd-44ea19cd0dc1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 200 len: 1518 microversion: 2.1 time: 0.408279 Oct 28 17:30:43.482931 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 425/791] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:43 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 1518 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:43.488407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:43.489394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:43.500204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.501015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.501553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.502364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.502941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.503491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.532856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:30:43.640888 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-67c41726-1172-4741-9011-72e5560eb11c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 204 len: 0 microversion: 2.1 time: 0.156774 Oct 28 17:30:43.644255 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 426/792] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:30:43 2022] DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:43.659556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:43.660444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:43.668241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.668740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.669178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:43.669893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:43.670348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:43.670891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:44.023103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:44.035879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:44.037651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:44.052197 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-129c1483-a9f0-4db9-a97f-d9f7cb69eff8 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.397324 Oct 28 17:30:44.053458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 427/793] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:43 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:44.060406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1512381268", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "0cbf4b98-e322-48fb-b131-dac3c084f709"}], "security_groups": [{"name": "tempest-securitygroup--1211455113"}], "key_name": "tempest-keypair-1338595218", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:44.273944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] validate_networks() for [('0cbf4b98-e322-48fb-b131-dac3c084f709', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:44.476386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90af59f4-514f-489a-88eb-35a0578b95d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316/action" status: 202 len: 0 microversion: 2.1 time: 4.464171 Oct 28 17:30:44.480225 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 367/794] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:40 2022] POST /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316/action => generated 0 bytes in 4468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:30:44.488101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:44.488985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:44.501806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:44.502527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:44.503168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:44.504091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:44.505363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:44.506228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:44.593233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:44.614468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d8448ce-3583-4733-a6b3-413ba9f6cff3 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1426 microversion: 2.1 time: 0.133177 Oct 28 17:30:44.615061 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 368/795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:44 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:44.621189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: .version_select at 0x7f752614eaf0>, body: {"addFloatingIp": {"address": "172.25.4.244"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:44.623831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:44.630487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:44.631203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:44.631885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:44.632599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:44.633060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:44.633486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:44.685963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:44.727840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:30:44.728257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquired lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:30:45.157390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:45.158862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:45.159457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:45.159942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:45.160451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:45.169853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:45.170420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:45.171052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:45.171896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:45.172363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:45.172793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:45.180480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:45.196398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:45.203064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for user 5121cf58427a48738ec1c70fbf5e922d and project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:45.224324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:45.226855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:45.294881 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a7333af-7a8e-4090-8e4f-6a943e894ffe tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.239897 Oct 28 17:30:45.303487 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 428/796] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:30:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:30:45.305907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-143783765", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "1449392243", "adminPass": "***", "networks": [{"uuid": "3a881b1a-5b9e-4d56-8641-1d8966e16aeb"}], "security_groups": [{"name": "tempest-securitygroup--498579820"}], "key_name": "tempest-keypair-1065819665", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:45.608213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] validate_networks() for [('3a881b1a-5b9e-4d56-8641-1d8966e16aeb', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:46.895105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:46.895804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:46.896030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:46.896440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:46.896849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:46.906902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:46.907813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:46.908416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:46.909307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:46.909930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:46.910514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:46.929581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for project 1e0865660ba7474c9ad6405d63c64078. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:46.934856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Getting quotas for user 8e76f32ce7d84fde8a2fb8f7597e61a8 and project 1e0865660ba7474c9ad6405d63c64078. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:46.948658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:46.951267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:47.092418 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b74a319-57b0-4712-b568-2ac29812861f tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.788618 Oct 28 17:30:47.094368 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 429/797] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:30:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:30:47.107481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:47.110350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:47.129347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:47.133103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:47.134423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:47.136188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:47.139680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:47.147945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:47.262555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:30:48.154698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:48.162855 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-940c973f-b7b6-4db8-a60e-169c4722e8ac tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 1.063926 Oct 28 17:30:48.187562 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 430/798] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:47 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:48.211748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:48.212507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:48.242935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:48.245058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:48.245512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:48.254464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:48.255788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:48.256170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.266519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.305073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de6e6df1-67f9-4992-be55-eea95f9a2583 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 1.115240 Oct 28 17:30:49.337203 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 431/799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:48 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:49.351510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b00bca-255c-4ee3-bed7-d2cb16cc56a0", "name": "network-vif-deleted", "tag": "45cdaf83-90fb-4f87-bc39-c1cda16ec105"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:49.365883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.367154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.367783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.395686 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] Creating event network-vif-deleted:45cdaf83-90fb-4f87-bc39-c1cda16ec105 for instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 on n-h1-860864-13 Oct 28 17:30:49.409799 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a3404b88-00f4-4b96-a0dd-a89fb2c61e09 req-e0915fdf-a87c-441f-b8f9-3d239e5465a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070406 Oct 28 17:30:49.410413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 432/800] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:49.418545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:49.420749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:49.432727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.433428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.434073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.435277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.436314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.436909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.603732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.614144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.619345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.628702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93285745-abef-4823-89ed-2f3acdfc68f5 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.216554 Oct 28 17:30:49.629806 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 433/801] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:49 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:49.639245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:49.640171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:49.661328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.662524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.663907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.665522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.667887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.668403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.888943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.904264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.905716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:49.909977 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d80a4d3e-dead-45fc-8df4-7a52b8a9cb18 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1344 microversion: 2.25 time: 0.275761 Oct 28 17:30:49.911687 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 434/802] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:49 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1344 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:49.933504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:49.934229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:49.946341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.948109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.950092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:49.952898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:49.954452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:49.957121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.032716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.032716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.033986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.034460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lazy-loading 'fault' on Instance uuid 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:50.147792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:50.161384 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d656234c-68da-4176-8994-e238d5b5f817 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 200 len: 1303 microversion: 2.1 time: 0.248565 Oct 28 17:30:50.161975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 435/803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:49 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:50.189579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1d9434-775e-4090-b961-5d01f144af52", "name": "network-vif-deleted", "tag": "2e195bff-4a7c-40fb-aef8-b61a63fb43a2"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:50.216716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.217212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.217656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.260447 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] Creating event network-vif-deleted:2e195bff-4a7c-40fb-aef8-b61a63fb43a2 for instance 2d1d9434-775e-4090-b961-5d01f144af52 on n-h2-860864-13 Oct 28 17:30:50.273384 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2a22b8c7-148d-4b9d-b2eb-ee39dea6119b req-5350a848-4745-4094-9319-bcf0d015a434 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093153 Oct 28 17:30:50.275670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 436/804] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:50.289397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:50.291455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:50.308053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.308789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.318814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.320663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Updating instance_info_cache with network_info: [{"id": "c316c667-7558-4281-8b0f-5152483e19f0", "address": "fa:16:3e:85:54:cf", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc316c667-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:30:50.321648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.323274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.325634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.352990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Releasing lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:30:50.354513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6987502e-a16c-4c0b-97fa-5cb07f3f3a18 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action" status: 202 len: 0 microversion: 2.1 time: 5.738179 Oct 28 17:30:50.358892 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 369/805] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:44 2022] POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action => generated 0 bytes in 5743 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:30:50.379384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:50.380030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:50.404834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.405397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.405746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.406594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.406972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.407544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.520692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:50.534742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b76cad3-a7fd-43b0-9477-9ce9a0eabb10 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1334 microversion: 2.1 time: 0.257335 Oct 28 17:30:50.536096 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 437/806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:50 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:50.542766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:50.543383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:50.552171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.552870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.553452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:50.554358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:50.555021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:50.555629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.185687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.195300 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d095e2e2-2b56-48cd-a87d-b21bf2e35f0e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.835074 Oct 28 17:30:51.196900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 370/807] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:50 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:51.203799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.244"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:51.206392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:51.214865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.215632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.216680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.217395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.217842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.218260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.251041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.255559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:30:51.255954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquired lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:30:51.261730 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d2b84bb-3527-4b19-a4a9-b9298884dc64 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 0.724428 Oct 28 17:30:51.262574 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 438/808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:50 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:51.270181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-19d15d3d-de45-4675-ba3b-1e586273b0cb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75248e3670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:51.329008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-19d15d3d-de45-4675-ba3b-1e586273b0cb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544" status: 200 len: 662 microversion: 2.1 time: 0.064374 Oct 28 17:30:51.338875 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 439/809] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:51 2022] GET /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:51.344558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:51.345455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:51.352871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.354264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.354898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.355862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.356559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.357190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.507208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.516103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.517475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.522560 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5177cdbb-031a-4c70-a86b-dd38d21cfc6b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.182066 Oct 28 17:30:51.523307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 440/810] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:51 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:51.528897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:51.529494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:51.535214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.535954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.536618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.537534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:51.538191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:51.539865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:51.970687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.985923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.988065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:51.989460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-016e35da-3def-4fe1-8b76-fc045099b5fc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.464885 Oct 28 17:30:52.005694 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 441/811] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:51 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:52.012555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:52.013166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 61b00bca-255c-4ee3-bed7-d2cb16cc56a0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:52.020394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.020890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.021326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.022103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.022517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.022943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.040228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] HTTP exception thrown: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Request method failure captured: Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 HTTP/1.1 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEoxStNsxthxMHdUYKWoIcHtInO1CD-fsQp1ksPHjxJ0-n7pXToq_A07_erwXKrVVjMlyZgx6UkeeHVHZtb6Bbgg-BJY8DrLz7FhOIGkFxY0Y73SncUKBeoJPESZFVeLggnH55ybnmzJfT9YODyOScrtcaEmum5qCi7hMMR_g3E6QM Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51bdbcf44e1646268fc1b36fabb61260"}]}] Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d6161a967d6549ea8275b2d9dd98aa02 Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '61b00bca-255c-4ee3-bed7-d2cb16cc56a0'} Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:52.043287 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Returning 404 to user: Instance 61b00bca-255c-4ee3-bed7-d2cb16cc56a0 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e81ecf99-cbdd-49cc-aece-eda4df8ebc57 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0" status: 404 len: 111 microversion: 2.1 time: 0.038211 Oct 28 17:30:52.047453 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 442/812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:52 2022] GET /compute/v2.1/servers/61b00bca-255c-4ee3-bed7-d2cb16cc56a0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:30:52.053507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68d92f43-6c56-4937-bb41-e9568b18edba tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243c2dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:52.100321 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68d92f43-6c56-4937-bb41-e9568b18edba tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544" status: 200 len: 662 microversion: 2.1 time: 0.053592 Oct 28 17:30:52.101440 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 443/813] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:52 2022] GET /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:52.106971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:52.149330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.150345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.154012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.184898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] Creating event network-changed:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:30:52.195018 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ecd47b12-e80b-4fa8-9d66-03785721c245 req-7feda596-136b-498b-a46e-a561103c8a89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091784 Oct 28 17:30:52.199334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 444/814] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:52.204437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:52.207049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:52.224126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.226971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.227548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.228910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.230135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.230785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.621719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:52.630692 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ff68bcc-fe8f-4290-8039-bc99add9da0c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1389 microversion: 2.1 time: 0.430195 Oct 28 17:30:52.631567 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 445/815] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:52 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1389 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:52.636920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:52.637586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:52.643801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.644507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.645105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.645954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.646557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.647127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.673641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:30:52.774498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-926adb9e-73a4-44ee-965d-106a1b922486 tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "DELETE /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 204 len: 0 microversion: 2.1 time: 0.141345 Oct 28 17:30:52.776720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 446/816] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:30:52 2022] DELETE /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:30:52.783542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:52.784459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:52.792668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.793426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.794015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:52.794874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:52.795503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:52.796073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.442397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:53.451502 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-46a669a2-6b4c-482e-a8b7-a5540444c3d3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.673179 Oct 28 17:30:53.452081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 447/817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:52 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:53.466323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:53.467138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:53.474325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.474851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.475288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.476407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.476666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.477092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.764711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:53.767203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:53.776560 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53a7107a-599e-43d6-8b8a-6dd545a03417 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 0.323179 Oct 28 17:30:53.777178 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 448/818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:53 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:53.782228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9415822a-7891-4cd1-96e6-54b21e887316", "name": "network-vif-unplugged", "status": "completed", "tag": "23cef619-7f5a-482c-9780-5f2a99269678"}, {"name": "network-changed", "server_uuid": "9415822a-7891-4cd1-96e6-54b21e887316", "tag": "23cef619-7f5a-482c-9780-5f2a99269678"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:53.794242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.794727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.795156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.806073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Creating event network-vif-unplugged:23cef619-7f5a-482c-9780-5f2a99269678 for instance 9415822a-7891-4cd1-96e6-54b21e887316 on n-h2-860864-13 Oct 28 17:30:53.806584 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] Creating event network-changed:23cef619-7f5a-482c-9780-5f2a99269678 for instance 9415822a-7891-4cd1-96e6-54b21e887316 on n-h2-860864-13 Oct 28 17:30:53.811575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d9df19bf-cbe7-4ddf-a484-2676a081a04a req-ed20e1b3-1f02-422e-a88e-9adeef7778a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.032938 Oct 28 17:30:53.816331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 449/819] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:53.820541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:53.821243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:53.827889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.828383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.828827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.829533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.830120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.830584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.917812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:53.926156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:53.927644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:53.933851 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88e12d93-0430-429d-890b-47f9ebf3748b tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.117230 Oct 28 17:30:53.934664 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 450/820] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:53 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:53.938888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:53.939510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:53.945273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.945756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.946202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:53.947497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:53.948432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:53.948860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:54.197651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:54.207720 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa3735e2-b1ce-41e1-b602-72725f78cd7d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1467 microversion: 2.1 time: 0.272179 Oct 28 17:30:54.208480 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 451/821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:53 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:54.213845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:54.214651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:54.221383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:54.222003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:54.222955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:54.223786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:54.224338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:54.224887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:54.430476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:54.439142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:54.440823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:54.442163 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6db7f38b-5712-47e3-8baa-6cfa03fdd388 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.232204 Oct 28 17:30:54.443022 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 452/822] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:54 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:54.467075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab32ef9e-aa29-4e10-9d6a-c01866f71137 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752442b160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:54.524485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab32ef9e-aa29-4e10-9d6a-c01866f71137 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6" status: 200 len: 661 microversion: 2.1 time: 0.067579 Oct 28 17:30:54.537025 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 453/823] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:54 2022] GET /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6 => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:54.546686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:54.547426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:54.555525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:54.556937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:54.558047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:54.558944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:54.559593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:54.560178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:54.961644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:54.969624 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.neutron [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] re-assign floating IP 172.25.4.244 from instance 95c19457-7971-4c78-803c-8e15c834787c Oct 28 17:30:54.970783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a11d8a87-887c-4c8a-8e89-a21330bff749 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1389 microversion: 2.1 time: 0.431532 Oct 28 17:30:54.976742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 454/824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:54 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1389 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:54.980138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-plugged", "status": "completed", "tag": "f38ffe5d-321a-4d8e-a103-a76865b6423d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:55.010651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.011344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.011952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.020848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:30:55.030833 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] Creating event network-vif-plugged:f38ffe5d-321a-4d8e-a103-a76865b6423d for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:55.035872 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9583c313-d0b3-4363-86c6-d35a582e10df req-bf5dfc96-b936-4790-891a-251d1e0fe8d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061823 Oct 28 17:30:55.036917 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 455/825] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:55.043417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:55.053232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.053662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.054089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.066371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] Creating event network-changed:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h2-860864-13 Oct 28 17:30:55.073229 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b374ca66-e15b-4c41-bbde-c7fd59a88cd5 req-d0af8b8b-7131-4ac7-9f4f-b935995e40ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034302 Oct 28 17:30:55.073835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 456/826] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:55.078840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:55.079562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:55.085834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.086338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.086765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.087575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.088708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.089137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.411961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:55.422389 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5efa5a82-d882-4734-9fed-befb7638ae1f tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.347239 Oct 28 17:30:55.423241 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 457/827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:55 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:55.428437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9909f31-5fd9-4b07-b873-3f67c9621a87 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243b9280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:55.482042 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9909f31-5fd9-4b07-b873-3f67c9621a87 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6" status: 200 len: 661 microversion: 2.1 time: 0.057263 Oct 28 17:30:55.492612 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 458/828] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:55 2022] GET /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6 => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:55.500609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:55.501411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:55.512248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.512749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.513188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.514024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.514336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.514764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.815754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:55.827032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-250cfb71-2e96-4d08-bac9-5506d25cc239 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 0.333090 Oct 28 17:30:55.843271 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 459/829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:55 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:55.849307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:55.850443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:55.858015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:55.860407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.861002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.861493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.862289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:55.862764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:55.863176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:55.985167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:55.985848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Updating instance_info_cache with network_info: [{"id": "c316c667-7558-4281-8b0f-5152483e19f0", "address": "fa:16:3e:85:54:cf", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc316c667-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:30:55.998824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.001189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.002571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:30:56.012275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54a6142f-b134-471d-a4cb-47c21b8c3d2d tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.169874 Oct 28 17:30:56.013805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 460/830] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:55 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:56.018687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:56.019451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:56.039428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.040068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.040918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.042441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.042441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.042840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.119788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.120573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.129813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.131826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lazy-loading 'fault' on Instance uuid 91b8092a-21c3-44e2-8fec-86e6d125db39 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:30:56.206949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6161a967d6549ea8275b2d9dd98aa02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bdbcf44e1646268fc1b36fabb61260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.215768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95ef28bd-3201-414f-ad47-d51dd0e5cbde tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 200 len: 1302 microversion: 2.1 time: 0.200692 Oct 28 17:30:56.216536 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 461/831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:56 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 1302 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:56.237330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:56.237941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:56.246140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.246642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.247080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.247811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.248284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.248699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.533222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.543981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.548455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:56.550265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-854b5326-8c38-448b-acf9-28f0b1a0195d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.317054 Oct 28 17:30:56.551356 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 462/832] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:56 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:56.562331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8e01b-2af7-4d33-b84d-f6dcb6aa310a", "tag": "8e3f85a3-9d29-4962-87ad-822376eb4367"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:56.595694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.602601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.606143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.642175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] Creating event network-changed:8e3f85a3-9d29-4962-87ad-822376eb4367 for instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a on n-h2-860864-13 Oct 28 17:30:56.652611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3fa306ba-f8ae-4a80-9852-b0190e3da83e req-0685f1fd-0818-4900-8a63-c6a0255a78b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093623 Oct 28 17:30:56.658721 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 463/833] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:56.667259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:56.671978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:56.685563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.687911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.696098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.708404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:56.708949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:56.709307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:56.921422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:56.942066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=16 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:57.470545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:57.481528 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-67ade5cf-a03e-458f-980c-7e5e7b496527 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1389 microversion: 2.1 time: 0.821196 Oct 28 17:30:57.491195 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 464/834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:56 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1389 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:57.499887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:57.501397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:57.509926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.510241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.511429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.512304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.512845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.513354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.526317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Updating instance_info_cache with network_info: [{"id": "6fb1b778-3c2b-4c05-b897-251a2b36542b", "address": "fa:16:3e:94:0e:ea", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fb1b778-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:30:57.544316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Releasing lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:30:57.545533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9beb3d0d-eb38-4b8e-a8d1-64eb30f4ef74 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5/action" status: 202 len: 0 microversion: 2.1 time: 6.346790 Oct 28 17:30:57.550992 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 371/835] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:51 2022] POST /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5/action => generated 0 bytes in 6352 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:30:57.560056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:57.561437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:57.569030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.569904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.570519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.571663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.572977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.573919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.833805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:57.843698 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7bf1f43-8f01-46f8-bf43-6bee5bd1d71c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.350638 Oct 28 17:30:57.844616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 465/836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:57 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:57.849893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:57.850571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:57.859001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.859766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.860425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.861362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.861923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.862583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.872589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:57.887258 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-396c7caf-66e2-4b3d-830e-5c586a8554fe tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 0.334275 Oct 28 17:30:57.888778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 372/837] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:57 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:57.893764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-plugged", "status": "completed", "tag": "2b3822f3-b28e-4253-854e-6dc73d288293"}, {"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-plugged", "status": "completed", "tag": "4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:57.921699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:57.922193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:57.922631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:57.940847 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Creating event network-vif-plugged:2b3822f3-b28e-4253-854e-6dc73d288293 for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:57.941354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] Creating event network-vif-plugged:4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:30:57.947680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-008d4825-16c4-461d-a151-590db32de374 req-33655b4d-3bab-45db-a44e-1124bae2b8b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056831 Oct 28 17:30:57.948891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 373/838] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:57.956477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6a21fc5-fdd5-40a7-9fc5-197c4e470e5f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524796ca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:58.000406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.006435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6a21fc5-fdd5-40a7-9fc5-197c4e470e5f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e" status: 200 len: 662 microversion: 2.1 time: 0.056120 Oct 28 17:30:58.007528 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 374/839] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:57 2022] GET /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e => generated 662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:58.012861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}, {"name": "network-changed", "server_uuid": "f41a9725-46ea-4060-8ed3-f4e97a2d56b5", "tag": "6fb1b778-3c2b-4c05-b897-251a2b36542b"}, {"server_uuid": "91b8092a-21c3-44e2-8fec-86e6d125db39", "name": "network-vif-deleted", "tag": "40f84073-8470-4500-baff-609b9859e6b7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:58.013953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.017135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.023804 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0129e6f-36dc-426e-a66e-9142ac2f1465 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1447 microversion: 2.75 time: 0.177866 Oct 28 17:30:58.024383 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 466/840] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:57 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:58.026044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.026532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.026968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.030205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:58.030957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] [instance: 91b8092a-21c3-44e2-8fec-86e6d125db39] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:58.039697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.041485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.042184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.043639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.044315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.045263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.049679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Creating event network-changed:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:30:58.050185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Creating event network-changed:6fb1b778-3c2b-4c05-b897-251a2b36542b for instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 on n-h1-860864-13 Oct 28 17:30:58.050861 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] Creating event network-vif-deleted:40f84073-8470-4500-baff-609b9859e6b7 for instance 91b8092a-21c3-44e2-8fec-86e6d125db39 on n-h1-860864-13 Oct 28 17:30:58.060810 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] HTTP exception thrown: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Request method failure captured: Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 HTTP/1.1 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBEoxStNsxthxMHdUYKWoIcHtInO1CD-fsQp1ksPHjxJ0-n7pXToq_A07_erwXKrVVjMlyZgx6UkeeHVHZtb6Bbgg-BJY8DrLz7FhOIGkFxY0Y73SncUKBeoJPESZFVeLggnH55ybnmzJfT9YODyOScrtcaEmum5qCi7hMMR_g3E6QM Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51bdbcf44e1646268fc1b36fabb61260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51bdbcf44e1646268fc1b36fabb61260"}]}] Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 51bdbcf44e1646268fc1b36fabb61260 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminTestJSON-204796206 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d6161a967d6549ea8275b2d9dd98aa02 Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminTestJSON-204796206-project Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '91b8092a-21c3-44e2-8fec-86e6d125db39'} Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:58.062799 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. Oct 28 17:30:58.067388 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:30:58.068411 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-12aaf6fe-662b-40bb-9ead-bcb793ad010e req-30080dbe-1ea4-48f1-b8b2-b89a0b6ed706 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.053806 Oct 28 17:30:58.068411 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 375/841] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:58.068578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] Returning 404 to user: Instance 91b8092a-21c3-44e2-8fec-86e6d125db39 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:58.069741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6a36acd-048d-4894-879d-9d3b2029017d tempest-ServersAdminTestJSON-204796206 tempest-ServersAdminTestJSON-204796206-project] 10.222.0.48 "GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39" status: 404 len: 111 microversion: 2.1 time: 0.043569 Oct 28 17:30:58.073780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 467/842] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:58 2022] GET /compute/v2.1/servers/91b8092a-21c3-44e2-8fec-86e6d125db39 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:30:58.074340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: .version_select at 0x7f752614ec10>, body: {"removeFloatingIp": {"address": "172.25.4.244"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:58.085585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:58.086247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:58.094653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.095156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.095643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.096542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.097021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.097700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.491693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:58.500272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.500867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.502112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.505210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.505914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.508032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.591502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.600101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.601460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:58.602592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f667292-5356-48d2-9a6f-8ffd726175e1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.529310 Oct 28 17:30:58.603257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 468/843] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:58 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:58.624861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e06bd3a-1cee-4a9f-b529-6fa7e564a6cb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752442b430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:58.678457 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e06bd3a-1cee-4a9f-b529-6fa7e564a6cb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e" status: 200 len: 662 microversion: 2.1 time: 0.065954 Oct 28 17:30:58.679601 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 469/844] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:30:58 2022] GET /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:30:58.685432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:58.686047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:58.692755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.693657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.694263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:58.695311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:58.696276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:58.697564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.007106 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] HTTP exception thrown: Floating IP 172.25.4.244 is not associated with instance 95c19457-7971-4c78-803c-8e15c834787c. Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Request method failure captured: Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action HTTP/1.1 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 49 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGNtby4kI6bv9-5NbjoGrTinwo2CtFfsJBBuODT-dzuuagmMy0GGxNLLwcAcs0OTY92emEQmPO3flROSNoQmjO-6HoiEiQBL6OTq1HM_0XIWxxfvxqLIfBA8z5GKceqSgx-qJZ4nn8LJj29ucEhzqb2f6iP6GA_SGJ3CA4QB99V6Ho Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/94b73acb57c54ec3b7ca1a065cc0a86c"}]}] Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 94ec1482fbdb4e65ad339ab01b7a557e Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: {"removeFloatingIp": {"address": "172.25.4.244"}} Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: exception: Floating IP 172.25.4.244 is not associated with instance 95c19457-7971-4c78-803c-8e15c834787c. Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '95c19457-7971-4c78-803c-8e15c834787c', 'body': {'removeFloatingIp': {'address': '172.25.4.244'}}} Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.244 is not associated with instance 95c19457-7971-4c78-803c-8e15c834787c. Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.244 is not associated with instance 95c19457-7971-4c78-803c-8e15c834787c. Oct 28 17:30:59.010321 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:30:59.016364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Returning 409 to user: Floating IP 172.25.4.244 is not associated with instance 95c19457-7971-4c78-803c-8e15c834787c. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:30:59.018725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26e2ad2f-9551-46e6-8dc1-42cec966af72 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action" status: 409 len: 146 microversion: 2.1 time: 0.949696 Oct 28 17:30:59.019620 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 376/845] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:58 2022] POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action => generated 146 bytes in 955 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:30:59.035095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1459714613", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:59.037667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.047452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b1e3e60-25c2-4255-91c7-e49cbd3da127 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1389 microversion: 2.1 time: 0.366369 Oct 28 17:30:59.048603 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 470/846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:58 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1389 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:59.058338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:59.059205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:59.074788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.075283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.075750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.076465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.087940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.089764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.096917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:30:59.115015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:30:59.335535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.344918 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06e28b7f-5b4f-485d-87ca-b744f31b59ef tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.292497 Oct 28 17:30:59.350824 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 471/847] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:59 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:59.361653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:59.362723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:59.372597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.373341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.373779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.374490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.374943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.375384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.389028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:30:59.389485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:30:59.389955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:30:59.390534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:30:59.390941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:30:59.401227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.401710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.402297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.403039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.403680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.404110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.422461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Getting quotas for project e5bd90e2ec024648b1b314d6463a85f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:30:59.428088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Getting quotas for user ef893e3030d54f60a982bd54091ad946 and project e5bd90e2ec024648b1b314d6463a85f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:30:59.441059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:30:59.443627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:30:59.501577 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58c43242-1376-4d12-9aa1-9af4f0c43ab9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475310 Oct 28 17:30:59.502371 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 377/848] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:30:59.508089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.244"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:30:59.546872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.560211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02edfb01-5011-4bec-9e3f-adbedfb726c7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1504 microversion: 2.1 time: 0.207850 Oct 28 17:30:59.561003 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 472/849] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:30:59 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:30:59.585815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:59.586438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:59.593053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.593697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.594142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.595437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.595908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.596655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.720128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.744659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.746172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:30:59.760393 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f9d0a0b-8984-4ccc-9120-6ce7d1e6c611 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1453 microversion: 2.75 time: 0.179757 Oct 28 17:30:59.760998 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 473/850] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:59 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:30:59.769548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:30:59.770163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:59.774042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:30:59.782538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.782727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.783519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.783751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.783916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.784759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.785593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.785946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:30:59.786067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.786593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:30:59.786832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:30:59.787429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:00.072334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:00.081428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:31:00.081913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquired lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:31:00.082657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:00.084880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:00.086599 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-adf95803-720f-4335-b4cc-bc7461620e09 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.320344 Oct 28 17:31:00.088111 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 474/851] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:30:59 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:00.094227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1287292345", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:00.157610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:31:00.621722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:31:00.623339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:31:00.624046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:31:00.624794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:31:00.625451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:31:00.640143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:00.640628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:00.641345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:00.642318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:00.642921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:00.643548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:00.668314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Getting quotas for project e5bd90e2ec024648b1b314d6463a85f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:31:00.675882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Getting quotas for user ef893e3030d54f60a982bd54091ad946 and project e5bd90e2ec024648b1b314d6463a85f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:31:00.691865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:31:00.695463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:31:00.751637 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1d55b77-b4f9-4840-8994-785a98e02c3a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661689 Oct 28 17:31:00.753252 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 475/852] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:31:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:31:00.758299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b8e01b-2af7-4d33-b84d-f6dcb6aa310a", "name": "network-vif-plugged", "status": "completed", "tag": "8e3f85a3-9d29-4962-87ad-822376eb4367"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:00.771167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:00.771991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:00.772979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:00.789308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] Creating event network-vif-plugged:8e3f85a3-9d29-4962-87ad-822376eb4367 for instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a on n-h2-860864-13 Oct 28 17:31:00.798413 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-cbd194bf-9fcd-4a08-a8e9-e35c766aa8bd req-5740511c-ee36-4be0-bcde-c48751582243 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043488 Oct 28 17:31:00.799632 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 476/853] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:00.807402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:00.809192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:00.818271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:00.818925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:00.819537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:00.822041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:00.822749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:00.823291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:01.444097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:01.452666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d073f29f-5b48-4a92-b183-c044c75d65f6 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1389 microversion: 2.1 time: 0.651041 Oct 28 17:31:01.453340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 477/854] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:00 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1389 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:01.457983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:01.458588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:01.464977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:01.465466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:01.465906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:01.466601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:01.467057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:01.467525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:01.637976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:31:01.903774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:01.920908 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b24a9f0-8042-47d9-a56c-c8d7fec65e4b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1354 microversion: 2.1 time: 0.466239 Oct 28 17:31:01.922966 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 478/855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:01 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1354 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:01.932055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:01.932973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:01.944805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:01.945516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:01.946108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:01.947527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:01.948137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:01.948915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.202243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.214737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9089a15d-bd0a-4f0c-a0a2-9b33433ac794 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1479 microversion: 2.1 time: 0.289977 Oct 28 17:31:02.215339 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 479/856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:01 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1479 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:02.226014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:02.232217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:02.247198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.250326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.251020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.252012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.254755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.255224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.403405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.414405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96f9ca07-08cb-4c19-ad4a-6a63a39f1144 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1270 microversion: 2.1 time: 0.191630 Oct 28 17:31:02.416519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 480/857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:02 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:02.422912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:02.423665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:02.430697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.431850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.432487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.433345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.433904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.434367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.557222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.568875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.570499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.587690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8041f076-cf0a-4e81-b6ed-548c894fac35 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1453 microversion: 2.75 time: 0.169667 Oct 28 17:31:02.588774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 481/858] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:02 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:02.594521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:02.595965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:02.614857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.615680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.616300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.617211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.617833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.618660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.774256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Updating instance_info_cache with network_info: [{"id": "6fb1b778-3c2b-4c05-b897-251a2b36542b", "address": "fa:16:3e:94:0e:ea", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6fb1b778-3c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:31:02.793014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Releasing lock "refresh_cache-f41a9725-46ea-4060-8ed3-f4e97a2d56b5" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:31:02.794407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e10ceaf1-e116-4d46-8c71-6e9cebdecc5e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5/action" status: 202 len: 0 microversion: 2.1 time: 3.290680 Oct 28 17:31:02.795900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 378/859] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:30:59 2022] POST /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5/action => generated 0 bytes in 3293 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:31:02.844880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.854872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.857156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:02.859361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc11c763-6c23-4dcc-82e7-6bfa78c1e093 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.269235 Oct 28 17:31:02.860436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 482/860] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:02 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:02.868006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41a9725-46ea-4060-8ed3-f4e97a2d56b5", "tag": "6fb1b778-3c2b-4c05-b897-251a2b36542b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:02.878999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.879782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.880365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.892793 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] Creating event network-changed:6fb1b778-3c2b-4c05-b897-251a2b36542b for instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 on n-h1-860864-13 Oct 28 17:31:02.898193 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b73239cf-a4f6-4cdf-b81f-96a87875ddc9 req-adf17a3c-abe5-434b-9680-bdd4f0e338b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036081 Oct 28 17:31:02.903492 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 483/861] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:02.909243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e5ea618-cfa6-4616-b78c-0535b8dbf76d tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '.version_select at 0x7f75243c2310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:02.913346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5ea618-cfa6-4616-b78c-0535b8dbf76d tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.914235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5ea618-cfa6-4616-b78c-0535b8dbf76d tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.914834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5ea618-cfa6-4616-b78c-0535b8dbf76d tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.926150 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e5ea618-cfa6-4616-b78c-0535b8dbf76d tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.021065 Oct 28 17:31:02.926939 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 484/862] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:31:02 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:02.932325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:02.934001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:02.941338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.942043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.942641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:02.943538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:02.944173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:02.944780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.045943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Action: 'update', calling method: .version_select at 0x7f752460a940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:03.053986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.054723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.058168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.084185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.085331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.087637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.097105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:03.103674 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] HTTP exception thrown: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Request method failure captured: Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 HTTP/1.1 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 56 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBHVXo-d3hsY2TOocfgi9EIpHURwJlxUIryniU6ENaNBQR1YgNeHu39NUvx43vHzFXxnSo8aiNHErDQ0Flygaoe5EZHYD86_hOZuDbTTZ0eTap1Md2KZcrGUGHVAp2Rs0E9qBKgWbRS2QCA7tuNC0nK4EdAZoz3u2wAcfeo4757eRmA Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9353995bdf734b9f87d857a83f646ad5"}]}] Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 71152cbf7af04aaab3f15e2fe409c79c Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: exception: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '825e413c-fa8a-49cc-ab59-73ce7750f785', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:31:03.105977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.112711 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.114983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Returning 404 to user: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:03.116295 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc78d176-0bf2-49cb-9f83-35d68c31f156 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785" status: 404 len: 110 microversion: 2.53 time: 0.316959 Oct 28 17:31:03.117399 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 379/863] 10.222.0.48 () {62 vars in 1309 bytes} [Fri Oct 28 17:31:02 2022] PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 => generated 110 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:31:03.137872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:03.138567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.146233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.146817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.147326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.148125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.148655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.149145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.203774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:31:03.313516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:03.329167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-20118356-a31c-4a7c-bd46-99291d7f9f54 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1587 microversion: 2.1 time: 0.400922 Oct 28 17:31:03.331742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 485/864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:02 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1587 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:03.346648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:03.350143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.373152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.373919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.374514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.375444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.376210 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-237959d0-7790-4f42-8612-69a4e9962f45 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 204 len: 0 microversion: 2.1 time: 0.248997 Oct 28 17:31:03.376439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.377157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.377277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 380/865] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:31:03 2022] DELETE /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:31:03.385159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:03.386195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.394737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.395636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.396376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.397444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.398937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.400866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.678430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c30ac71-c51d-4cab-879e-52e681d37a8e tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1632 microversion: 2.1 time: 0.345342 Oct 28 17:31:03.679621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:03.702891 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 486/866] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:03 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1632 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:03.705755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe2acd47-688e-4c58-8fe1-d16f38b99caf tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1803 microversion: 2.1 time: 0.326816 Oct 28 17:31:03.719808 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 381/867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:03 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1803 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:03.720890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Action: 'update', calling method: .version_select at 0x7f7524388700>, body: {"status": "disabled"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:03.725453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.726405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.727333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.737039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:03.737788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.741078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.741683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.742124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.745007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:03.747182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.748086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.748860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.749734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.750340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.750943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.752098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] HTTP exception thrown: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Request method failure captured: Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 HTTP/1.1 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 22 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBHVXo-d3hsY2TOocfgi9EIpHURwJlxUIryniU6ENaNBQR1YgNeHu39NUvx43vHzFXxnSo8aiNHErDQ0Flygaoe5EZHYD86_hOZuDbTTZ0eTap1Md2KZcrGUGHVAp2Rs0E9qBKgWbRS2QCA7tuNC0nK4EdAZoz3u2wAcfeo4757eRmA Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9353995bdf734b9f87d857a83f646ad5"}]}] Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 71152cbf7af04aaab3f15e2fe409c79c Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: {"status": "disabled"} Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: exception: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '825e413c-fa8a-49cc-ab59-73ce7750f785', 'body': {'status': 'disabled'}} Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:31:03.754650 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Returning 404 to user: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c1d5f07-86cf-4611-a9de-fcd66512f5f8 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785" status: 404 len: 110 microversion: 2.53 time: 0.052292 Oct 28 17:31:03.762112 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 487/868] 10.222.0.48 () {62 vars in 1309 bytes} [Fri Oct 28 17:31:03 2022] PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 => generated 110 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:31:03.770910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: .version_select at 0x7f7526afde50>, body: {"addFloatingIp": {"address": "172.25.4.244"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:03.773958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.785265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.785902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.786383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.787887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.788882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.789425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.885055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bbcf3fdc-e306-4b7c-ad32-93a5c6abcfce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164042 Oct 28 17:31:03.885778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 382/869] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:31:03 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:03.886830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:31:03.888267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquired lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:31:03.900292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:03.901023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:03.907463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.907952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.908727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.909594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:03.910199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:03.910776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:03.993690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.005064 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c95fcda5-9643-482f-9cac-36986de712d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1278 microversion: 2.1 time: 0.109086 Oct 28 17:31:04.005700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 383/870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:03 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:04.027852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:04.028464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:04.035697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.036177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.036618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.037383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.037913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.038364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.147811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.162607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.164350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.171809 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11535711-39fd-43d2-9c6e-b86f938c77a7 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1438 microversion: 2.75 time: 0.150417 Oct 28 17:31:04.173059 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 384/871] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:04 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:04.178641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-671a649b-88f7-423c-bf00-af2583e7059f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: .version_select at 0x7f7524543d30>, body: {"keypair": {"name": "tempest-keypair-1474853975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTNvnyQRrArkN+ok/RyYZjx/BkYO2exmY0aZ4FTOjjwW6UuwK6nA9D+/l3SB13a+0XN+Rp2Mt9pWkQHst7crvGyElOuVY1VmzdhQmaHOmh5kXbntS+Dt1g+fMNIilVW5g=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:04.201435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-671a649b-88f7-423c-bf00-af2583e7059f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for project 4745f00281fc4cce985160599bcae8ca. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:31:04.210278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-671a649b-88f7-423c-bf00-af2583e7059f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for user b5dbc2c295144accbd4d508afb066b03 and project 4745f00281fc4cce985160599bcae8ca. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:31:04.245861 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-671a649b-88f7-423c-bf00-af2583e7059f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071361 Oct 28 17:31:04.246815 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 385/872] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:31:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:04.251583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:04.252074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:04.269692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.270101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.270535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.271597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.272061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.272484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.307558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89ca7966-6a45-4a62-b110-340b321193f5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc/ips" status: 200 len: 217 microversion: 2.1 time: 0.059718 Oct 28 17:31:04.308201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 386/873] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:31:04 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc/ips => generated 217 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:04.313294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Action: 'update', calling method: .version_select at 0x7f7524c723a0>, body: {"status": "enabled"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:04.318922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.319865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.320896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.328703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.329376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.330557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.337682 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] HTTP exception thrown: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Request method failure captured: Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 HTTP/1.1 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 21 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBHVXo-d3hsY2TOocfgi9EIpHURwJlxUIryniU6ENaNBQR1YgNeHu39NUvx43vHzFXxnSo8aiNHErDQ0Flygaoe5EZHYD86_hOZuDbTTZ0eTap1Md2KZcrGUGHVAp2Rs0E9qBKgWbRS2QCA7tuNC0nK4EdAZoz3u2wAcfeo4757eRmA Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9353995bdf734b9f87d857a83f646ad5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9353995bdf734b9f87d857a83f646ad5"}]}] Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9353995bdf734b9f87d857a83f646ad5 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230 Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 71152cbf7af04aaab3f15e2fe409c79c Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: {"status": "enabled"} Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: exception: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '825e413c-fa8a-49cc-ab59-73ce7750f785', 'body': {'status': 'enabled'}} Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:31:04.339785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. Oct 28 17:31:04.343699 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:04.344452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Returning 404 to user: Service 825e413c-fa8a-49cc-ab59-73ce7750f785 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:04.345202 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37a5d0ac-1fdd-4e7a-92a4-c1128ab3decf tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785" status: 404 len: 110 microversion: 2.53 time: 0.035679 Oct 28 17:31:04.347551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 387/874] 10.222.0.48 () {62 vars in 1309 bytes} [Fri Oct 28 17:31:04 2022] PUT /compute/v2.1/os-services/825e413c-fa8a-49cc-ab59-73ce7750f785 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:31:04.359736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:04.359736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:04.371028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.372133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.372133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.372867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.373471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.373907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.623316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.639937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.644047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:04.645431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b53041b0-ac47-4b67-ac03-90927e7afbcd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.295033 Oct 28 17:31:04.647939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 388/875] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:04 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:04.873050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:04.892803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:04.904799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.905818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.906476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:04.908863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:04.909531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:04.910153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.041490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:31:05.044381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:31:05.045157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:31:05.046838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:31:05.047434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:31:05.113493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:05.120871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.121377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.122363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.122805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.123332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.124082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.366442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:05.387297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bbf5c76f-d7d8-4539-939a-4b643edec4eb tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381/action" status: 202 len: 1944 microversion: 2.75 time: 0.737950 Oct 28 17:31:05.387986 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 389/876] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:31:04 2022] POST /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381/action => generated 1944 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 17:31:05.394449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:05.395246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:05.433923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.435934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.436778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.437869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.438579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.439976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.489457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:31:05.615002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-47e3bd80-89a5-40c2-b6ee-45e41cb8f676 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 204 len: 0 microversion: 2.1 time: 0.225347 Oct 28 17:31:05.620258 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 390/877] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:31:05 2022] DELETE /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:31:05.622003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:05.626112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.626658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.627099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.627918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.629006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.629006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.658867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-407860ad-0502-4e0b-a76c-e431e3dc181e tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.041578 Oct 28 17:31:05.668070 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 391/878] 10.222.0.48 () {60 vars in 1178 bytes} [Fri Oct 28 17:31:05 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:05.668070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "name": "network-vif-plugged", "status": "completed", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:05.674125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.675402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.675949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.702179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] Creating event network-vif-plugged:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h2-860864-13 Oct 28 17:31:05.708444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-aa80da2f-7664-4b16-a448-58a2a7398b45 req-39d0030e-1ef5-4547-ac08-a8d29be33a04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047687 Oct 28 17:31:05.713333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 392/879] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:05.726316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:05.727033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:05.734698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.735200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.735722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.736372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.736871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.737301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.870628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:05.879508 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84e6073e-7c2d-4590-81a5-2cd5c324f653 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1276 microversion: 2.1 time: 0.164745 Oct 28 17:31:05.889288 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 393/880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:05 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:05.889288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:05.889288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:05.894412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.894989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.895579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.896310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:05.896741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:05.897234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:05.904080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:05.988972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:06.007738 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df5f3f2f-a686-4936-89cc-4c26d44cad93 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.126127 Oct 28 17:31:06.008545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 394/881] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:05 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:06.013378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:06.013979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:06.019827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.020310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.020745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.021439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.021877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.022302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.286883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Building network info cache for instance {{(pid=120567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:31:06.297399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:06.320576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90f12045-0f4e-43df-ab3e-41e5d0ecb83b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1809 microversion: 2.1 time: 0.310670 Oct 28 17:31:06.321183 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 395/882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:06 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:06.326094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:06.329962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.330454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.330892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.331652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.332166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.332596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.367857 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3895c5cc-5307-4706-8740-b74e61a2f974 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044998 Oct 28 17:31:06.367961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 396/883] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Oct 28 17:31:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:06.378597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:06.379207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:06.386465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.386929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.387430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.388236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.388559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.388984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.709318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:06.720235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:06.721681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:06.723068 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b23cd346-53ec-42fd-bbc4-fe82ea4e036d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1412 microversion: 2.25 time: 0.354090 Oct 28 17:31:06.727146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 397/884] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:06 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1412 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:06.739404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:06.772094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.772574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.772999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.795797 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] Creating event network-changed:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:31:06.809586 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d1df3c00-01d6-49db-aadc-b3f0c78b8252 req-fb388306-b45b-4d3f-a45a-f07e8319a86d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079088 Oct 28 17:31:06.810196 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 398/885] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:06.822076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:06.837465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.837860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.838319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.839225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.839509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.839927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.896041 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb6e1d0c-79ac-4e21-b3c6-f7e8b168af51 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.082346 Oct 28 17:31:06.904147 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 399/886] 10.222.0.48 () {60 vars in 1178 bytes} [Fri Oct 28 17:31:06 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:06.920243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:06.948523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:06.949023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:06.949472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:06.978270 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] Creating event network-changed:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:31:06.989177 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-225cf8a5-3b22-4359-897b-2985e079db21 req-e29e4598-6e67-4154-bb96-0efb913c5238 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083385 Oct 28 17:31:06.989851 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 400/887] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:07.020781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:07.023005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:07.041558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.042424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.047115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.048196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.050609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.053352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.302461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Updating instance_info_cache with network_info: [{"id": "c316c667-7558-4281-8b0f-5152483e19f0", "address": "fa:16:3e:85:54:cf", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc316c667-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:31:07.341861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Releasing lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:31:07.342861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de2a464b-4680-4b4d-95aa-a5e7d5a8a962 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action" status: 202 len: 0 microversion: 2.1 time: 3.582975 Oct 28 17:31:07.346576 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 488/888] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:31:03 2022] POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action => generated 0 bytes in 3587 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:31:07.360061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:07.361328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:07.378375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.379135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.381138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.382173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.385616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.386268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.691326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:07.705659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3dbf230-852f-4034-b8b1-58492a363ae0 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1587 microversion: 2.1 time: 0.714537 Oct 28 17:31:07.706487 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 401/889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:06 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1587 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:07.718619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:07.722516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.723013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.723487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.730563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.731063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.731540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.791333 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ecae5f78-7b29-430b-b83a-504904bfca30 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-860864-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.082346 Oct 28 17:31:07.791981 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 402/890] 10.222.0.48 () {60 vars in 1237 bytes} [Fri Oct 28 17:31:07 2022] GET /compute/v2.1/os-services?host=n-d-860864-13&binary=xxx => generated 16 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:07.802807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:07.807559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:07.820843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.822011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.822396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:07.823203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:07.823699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:07.827855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.038074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:08.052469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-059c00ff-c120-4312-b86d-ed949d5777c9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.704077 Oct 28 17:31:08.053445 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 489/891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:07 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:08.057126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:08.060364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:08.061520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:08.075406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.089403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.092038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.094531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.095182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.095823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.111981 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6445de8-4672-40f1-b581-33b75234d322 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.311757 Oct 28 17:31:08.114563 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 403/892] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:07 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:08.138770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:08.141215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37a929f7-f2c6-446e-9dd2-7aec7884ded0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '.version_select at 0x7f75245275e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:08.746222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:08.761981 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77b6580c-7ec3-4e77-b756-9396d2bae6b7 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1809 microversion: 2.1 time: 0.705678 Oct 28 17:31:08.764309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 490/893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:08 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1809 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:08.771008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:08.771971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:08.780756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.781492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.782143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.783192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.783880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.784519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.794123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37a929f7-f2c6-446e-9dd2-7aec7884ded0 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/2eaddd1d-1b94-4334-82e3-c0781e9b5555" status: 200 len: 184 microversion: 2.1 time: 0.677131 Oct 28 17:31:08.794647 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 404/894] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:31:08 2022] GET /compute/v2.1/os-floating-ips/2eaddd1d-1b94-4334-82e3-c0781e9b5555 => generated 184 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:08.809331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:08.816165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.816995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.817601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.825160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:08.825982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:08.826593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:08.857949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b9f02c2-72d5-47ff-b36b-737ed78520d5 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.062167 Oct 28 17:31:08.859150 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 405/895] 10.222.0.48 () {60 vars in 1178 bytes} [Fri Oct 28 17:31:08 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:08.864224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.244"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:09.146652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:09.153653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.154142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.154582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.155286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.155766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.156172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.172924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:09.187243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:09.193300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:09.201053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87769426-e851-479d-9021-b88633e947b9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1609 microversion: 2.25 time: 0.434571 Oct 28 17:31:09.201674 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 491/896] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:08 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1609 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:09.207712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41a9725-46ea-4060-8ed3-f4e97a2d56b5", "name": "network-vif-deleted", "tag": "6fb1b778-3c2b-4c05-b897-251a2b36542b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:09.221979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.222934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.223561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.237271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] Creating event network-vif-deleted:6fb1b778-3c2b-4c05-b897-251a2b36542b for instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 on n-h1-860864-13 Oct 28 17:31:09.242813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-fdee0bc6-98f8-43ff-973f-66c87e192bd4 req-e7f0a417-5626-4da8-99b6-8e05fc168cda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038587 Oct 28 17:31:09.244974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 492/897] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:09.250082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:09.254276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.254958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.255617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.256521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.257140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.257738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.293242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e8c4233c-edae-4bea-a270-73229390cdc1 tempest-ServicesAdminNegativeV253TestJSON-833107230 tempest-ServicesAdminNegativeV253TestJSON-833107230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.046252 Oct 28 17:31:09.294749 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 493/898] 10.222.0.48 () {60 vars in 1239 bytes} [Fri Oct 28 17:31:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:09.299491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b8e01b-2af7-4d33-b84d-f6dcb6aa310a", "tag": "8e3f85a3-9d29-4962-87ad-822376eb4367"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:09.310799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.311549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.312154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.327461 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] Creating event network-changed:8e3f85a3-9d29-4962-87ad-822376eb4367 for instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a on n-h2-860864-13 Oct 28 17:31:09.339985 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1f35015e-a879-474d-bba1-584fba8b6011 req-910368ff-d641-4fe1-bb55-87da5c68c70c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043596 Oct 28 17:31:09.341885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 494/899] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:09.347357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:09.353873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:09.374002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.374508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.374999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.375683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.376206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.376548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.873723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:09.881816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ccf8449a-c5f0-4d67-8ebb-96c71b7d17ae tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.538754 Oct 28 17:31:09.882505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 495/900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:09 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:09.887382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:09.888015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:09.894090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.894896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.895575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.896291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:09.896752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:09.897180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:09.915654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:31:09.916296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquired lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:31:10.040935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:10.059327 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aadb0f57-a98f-4155-b9f0-c2bf91b1d50a tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.175517 Oct 28 17:31:10.060141 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 496/901] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:09 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:10.078469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:10.079380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:10.089246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:10.089928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:10.090387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:10.091107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:10.091606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:10.092025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:10.234885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b03501e8-9a17-4fc2-a6f9-f0be2372d875 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.164334 Oct 28 17:31:10.235833 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 497/902] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:31:10 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:31:10.395702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b1822d0-609f-4cb7-9152-f37eca52a333 tempest-ServicesAdminNegativeV253TestJSON-1372529956 tempest-ServicesAdminNegativeV253TestJSON-1372529956-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:10.401158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b1822d0-609f-4cb7-9152-f37eca52a333 tempest-ServicesAdminNegativeV253TestJSON-1372529956 tempest-ServicesAdminNegativeV253TestJSON-1372529956-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e61469970edd4ab0954918959fd4f7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52424b6c5fef4aa7991df7149783724d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b1822d0-609f-4cb7-9152-f37eca52a333 tempest-ServicesAdminNegativeV253TestJSON-1372529956 tempest-ServicesAdminNegativeV253TestJSON-1372529956-project] Request method failure captured: Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBHUbJw8zTSH4rZdlOdl8VtuSmlCnVVd7LpM6im5756L-yYM3mAITT1CHFgMZ-D8yWwFKkVSA3jNr0TdomMB2jRTJqo3rCbmDk5PefT6nxM1IZxVoOz7ig_DJLFliRXVxcIIaaSI9kMMwJp9f-NeO9BkGs2bvMiF9S5m2KJFMX0Rzg0 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 52424b6c5fef4aa7991df7149783724d Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1372529956 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52424b6c5fef4aa7991df7149783724d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52424b6c5fef4aa7991df7149783724d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52424b6c5fef4aa7991df7149783724d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52424b6c5fef4aa7991df7149783724d"}]}] Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1372529956 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 52424b6c5fef4aa7991df7149783724d Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1372529956 Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1372529956-project Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e61469970edd4ab0954918959fd4f7ac Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1372529956-project Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: action_args: {} Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:31:10.402913 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b1822d0-609f-4cb7-9152-f37eca52a333 tempest-ServicesAdminNegativeV253TestJSON-1372529956 tempest-ServicesAdminNegativeV253TestJSON-1372529956-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:10.408405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b1822d0-609f-4cb7-9152-f37eca52a333 tempest-ServicesAdminNegativeV253TestJSON-1372529956 tempest-ServicesAdminNegativeV253TestJSON-1372529956-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.167484 Oct 28 17:31:10.411102 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 498/903] 10.222.0.48 () {60 vars in 1178 bytes} [Fri Oct 28 17:31:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:31:10.416274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:10.417341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:10.426621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:10.427435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:10.428072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:10.428973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:10.429739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:10.430355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:10.679143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:10.698585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:10.701622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18e60e31-9f1b-4103-8e02-0583a08da802 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1788 microversion: 2.1 time: 0.289196 Oct 28 17:31:10.716338 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 499/904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:10 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1788 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:10.726273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-unplugged", "status": "completed", "tag": "f38ffe5d-321a-4d8e-a103-a76865b6423d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:10.735552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:10.738719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:10.739479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:10.740615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:10.754038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] Creating event network-vif-unplugged:f38ffe5d-321a-4d8e-a103-a76865b6423d for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:31:10.760794 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6b49f68c-facd-40f2-b4eb-e117c69fe6d5 req-5a51e0b4-4793-440e-806d-3b861fc0e639 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042788 Oct 28 17:31:10.761702 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 500/905] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:10.768304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1828547554", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "3a6a8a69-8887-4595-92d7-f0a0dfb49ff9"}], "security_groups": [{"name": "tempest-securitygroup--1853088952"}], "key_name": "tempest-keypair-1474853975", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:10.993036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] validate_networks() for [('3a6a8a69-8887-4595-92d7-f0a0dfb49ff9', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:31:11.059924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:31:12.098180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:31:12.099057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:31:12.114095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:31:12.116899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:31:12.117633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:31:12.155419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.156967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.158250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.159724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.163131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.164027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.200763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:31:12.208186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for user b5dbc2c295144accbd4d508afb066b03 and project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:31:12.224628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:31:12.227975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:31:12.300183 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e5b3a0b-e6a2-4abe-b223-3c842746447d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.537159 Oct 28 17:31:12.304254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 501/906] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:31:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:31:12.331576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:12.335892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:12.346101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.346839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.347746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.348642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.349320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.349677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.356439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Updating instance_info_cache with network_info: [{"id": "c316c667-7558-4281-8b0f-5152483e19f0", "address": "fa:16:3e:85:54:cf", "network": {"id": "8be3d5b2-25fb-41d1-b6f9-8a5a9be3f2cb", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-792543653-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "94b73acb57c54ec3b7ca1a065cc0a86c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc316c667-75", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:31:12.376605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Releasing lock "refresh_cache-95c19457-7971-4c78-803c-8e15c834787c" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:31:12.378946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc2bc2f8-9ad0-479b-a0b4-f4655b7d0f58 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action" status: 202 len: 0 microversion: 2.1 time: 3.518466 Oct 28 17:31:12.380944 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 406/907] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:31:08 2022] POST /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c/action => generated 0 bytes in 3521 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:31:12.389691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:12.390833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:12.400734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.401600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.402249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.403190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.404053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.404688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.588820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:12.649636 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c57fa5f-2c91-4795-adee-f4600886bd53 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.263027 Oct 28 17:31:12.665067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 407/908] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:12 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:12.690295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-deleted", "tag": "4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f"}, {"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-deleted", "tag": "f38ffe5d-321a-4d8e-a103-a76865b6423d"}, {"name": "network-changed", "server_uuid": "b58839f6-b2c7-4bea-a046-64be87262209", "tag": "22a16875-db48-4f16-8bd0-765c054693cd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:12.716021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.716703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.717905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.736250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Creating event network-vif-deleted:4c3a41c2-73fc-4067-8bc3-92c0f50c1e7f for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:31:12.736826 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Creating event network-vif-deleted:f38ffe5d-321a-4d8e-a103-a76865b6423d for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:31:12.737241 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] Creating event network-changed:22a16875-db48-4f16-8bd0-765c054693cd for instance b58839f6-b2c7-4bea-a046-64be87262209 on n-h1-860864-13 Oct 28 17:31:12.744293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e11d41b9-49ab-4f1b-b06c-931dea3b60a9 req-d66904c7-a0d5-49cf-b535-043aa3dca323 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.077716 Oct 28 17:31:12.745305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 408/909] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:12.750886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:12.769956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.770485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.771086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.798268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] Creating event network-changed:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:31:12.813408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-032974ff-a3b6-4023-a31b-70e2596e883c req-b62bd717-61b8-411f-a983-b5413f4581ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066774 Oct 28 17:31:12.814870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 409/910] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:12.820391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:12.829562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:12.854691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.855456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.856067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.856955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:12.857889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:12.858476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:12.985568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:12.990098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:12.999228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c4797b1-a998-434f-a2e2-8af2c73e8497 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.682703 Oct 28 17:31:12.999858 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 502/911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:12 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:13.002306 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-569b525d-85f6-4fd9-8168-4923091f8dcc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1725 microversion: 2.1 time: 0.186008 Oct 28 17:31:13.013211 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 410/912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:12 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:13.024570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:13.029457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:13.031753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-58a69a86-5192-477b-ae62-18f8b042603f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:13.033741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-58a69a86-5192-477b-ae62-18f8b042603f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:13.041303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.041303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.056104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.057055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.057658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.058204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.080525 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] HTTP exception thrown: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Request method failure captured: Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 HTTP/1.1 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGNtby4kI6bv9-5NbjoGrTinwo2CtFfsJBBuODT-dzuuagmMy0GGxNLLwcAcs0OTY92emEQmPO3flROSNoQmjO-6HoiEiQBL6OTq1HM_0XIWxxfvxqLIfBA8z5GKceqSgx-qJZ4nn8LJj29ucEhzqb2f6iP6GA_SGJ3CA4QB99V6Ho Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/94b73acb57c54ec3b7ca1a065cc0a86c"}]}] Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 94ec1482fbdb4e65ad339ab01b7a557e Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'f41a9725-46ea-4060-8ed3-f4e97a2d56b5'} Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:31:13.084436 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.088924 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.095819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Returning 404 to user: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:13.097479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-403a8cc3-1303-44d2-93df-e98744c78b7c tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 404 len: 111 microversion: 2.1 time: 0.081256 Oct 28 17:31:13.101506 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 411/913] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:31:13 2022] DELETE /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:31:13.110838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-unplugged", "status": "completed", "tag": "2b3822f3-b28e-4253-854e-6dc73d288293"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:13.131477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.132695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.133160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.151200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] Creating event network-vif-unplugged:2b3822f3-b28e-4253-854e-6dc73d288293 for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:31:13.158380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c28410f4-9033-45d2-99cd-242f46818e5f req-d2ad72a6-c0ca-46ae-8765-a88a65532342 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054635 Oct 28 17:31:13.159743 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 412/914] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:13.165647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:13.168527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: f41a9725-46ea-4060-8ed3-f4e97a2d56b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:13.176131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.177040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.177867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.179001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.179770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.181428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.201750 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] HTTP exception thrown: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Request method failure captured: Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 HTTP/1.1 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGNtby4kI6bv9-5NbjoGrTinwo2CtFfsJBBuODT-dzuuagmMy0GGxNLLwcAcs0OTY92emEQmPO3flROSNoQmjO-6HoiEiQBL6OTq1HM_0XIWxxfvxqLIfBA8z5GKceqSgx-qJZ4nn8LJj29ucEhzqb2f6iP6GA_SGJ3CA4QB99V6Ho Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/94b73acb57c54ec3b7ca1a065cc0a86c"}]}] Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 94ec1482fbdb4e65ad339ab01b7a557e Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'f41a9725-46ea-4060-8ed3-f4e97a2d56b5'} Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.204356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. Oct 28 17:31:13.208708 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:13.209208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-58a69a86-5192-477b-ae62-18f8b042603f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:13.210897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Returning 404 to user: Instance f41a9725-46ea-4060-8ed3-f4e97a2d56b5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:13.212194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39775a39-a1b3-4b61-ac7e-935dbc11e854 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5" status: 404 len: 111 microversion: 2.1 time: 0.051064 Oct 28 17:31:13.216837 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 413/915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:13 2022] GET /compute/v2.1/servers/f41a9725-46ea-4060-8ed3-f4e97a2d56b5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:31:13.217554 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-58a69a86-5192-477b-ae62-18f8b042603f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1235 microversion: 2.1 time: 0.214456 Oct 28 17:31:13.230757 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 503/916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:13 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1235 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:13.248444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-469d21c0-edaa-4a38-9991-aa267734f31f tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '.version_select at 0x7f752434aa60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:13.687301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:13.688895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:13.702368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.703531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.703994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:13.706268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:13.706760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:13.710053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.217097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:14.219894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:14.263841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3095e5ed-d674-4923-aa52-d5e97f6f9fc1 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.582271 Oct 28 17:31:14.264964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 504/917] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:13 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:14.284205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:14.284852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:14.301566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:14.302206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:14.302724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.303545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:14.304349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:14.304951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.795537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:14.803315 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5fc6bf09-ebd2-4156-b1a9-e1540e1d0005 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.533943 Oct 28 17:31:14.808397 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 505/918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:14 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:14.822753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:14.823607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:14.841826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:14.851078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:14.851462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.854890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:14.862450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:14.863054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.933106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:14.935903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:14.940026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:14.941308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lazy-loading 'fault' on Instance uuid 09f5e1e0-7698-4a0b-b7b7-9299952c17fc {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:15.063679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:15.076836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78c961ec-fe8c-4805-b83c-7adedf797a63 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 200 len: 1302 microversion: 2.1 time: 0.267135 Oct 28 17:31:15.077641 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 506/919] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:14 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 1302 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:15.084448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:15.088494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:15.102030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.102938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.103595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.104704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.105164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.105593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.251347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:15.279804 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6367f5d8-ad50-496b-adba-2c047db115d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1293 microversion: 2.1 time: 0.199522 Oct 28 17:31:15.297170 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 507/920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:15 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:15.309203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f5e1e0-7698-4a0b-b7b7-9299952c17fc", "name": "network-vif-deleted", "tag": "2b3822f3-b28e-4253-854e-6dc73d288293"}, {"name": "network-changed", "server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:15.321150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-469d21c0-edaa-4a38-9991-aa267734f31f tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/2eaddd1d-1b94-4334-82e3-c0781e9b5555" status: 202 len: 0 microversion: 2.1 time: 2.102403 Oct 28 17:31:15.323708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 414/921] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:31:13 2022] DELETE /compute/v2.1/os-floating-ips/2eaddd1d-1b94-4334-82e3-c0781e9b5555 => generated 0 bytes in 2106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:31:15.331383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:15.332539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:15.336073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.338785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.339237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.344348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:15.347868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.348625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.351682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.353679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.354948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.356025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.386375 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Creating event network-vif-deleted:2b3822f3-b28e-4253-854e-6dc73d288293 for instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc on n-h1-860864-13 Oct 28 17:31:15.387155 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] Creating event network-changed:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h2-860864-13 Oct 28 17:31:15.398310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4fcc8430-4781-4dbd-af9a-d99d38c30646 req-8b1630ce-3fc7-49be-8ad5-1de8de24c5f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099251 Oct 28 17:31:15.399720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 508/922] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:15.406784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:15.407712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:15.416188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.417446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.418238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.419817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.420540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.420965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.459163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:31:15.491750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:15.512886 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a93fffb-2968-4e27-b593-12d19e5bd776 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.186732 Oct 28 17:31:15.514081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 415/923] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:15 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:15.519549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-plugged", "status": "completed", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:15.542268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.544469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.545278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.588740 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] Creating event network-vif-plugged:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:31:15.597656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7dd52ca5-ff75-4f95-b1d2-b176b962a149 req-a82e130a-b6b1-469d-aeed-b22390e03472 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081418 Oct 28 17:31:15.599396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 416/924] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:15.601887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66aa2118-7b82-486b-aba5-0f71bbff24a5 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 204 len: 0 microversion: 2.1 time: 0.200372 Oct 28 17:31:15.603177 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 509/925] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:31:15 2022] DELETE /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:31:15.613151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:15.614216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:15.626663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.627156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.627619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.628328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.630860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.631304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.838853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:15.841131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:15.851839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.853748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.855166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.856369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:15.858614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:15.859516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:15.925812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:15.934580 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9865ce09-1ab6-4aa6-8a07-17a6cf1f4215 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1524 microversion: 2.1 time: 0.327004 Oct 28 17:31:15.935566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 417/926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:15 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:16.103870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:16.104661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:16.119847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.122485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.123347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.126526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.127645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.129311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.156187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc HTTP/1.1 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '09f5e1e0-7698-4a0b-b7b7-9299952c17fc'} Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:16.157867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-234fecea-a525-429e-8d1e-e1a368d7b2fe tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 404 len: 111 microversion: 2.1 time: 0.060511 Oct 28 17:31:16.161813 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 418/927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:16 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:31:16.195624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:16.200144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:16.205227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1f0e16f-10e5-4c4c-80eb-950460f68bff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.372463 Oct 28 17:31:16.206032 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 510/928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:15 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:16.317521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:16.318567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:16.335776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.338644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.339534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.340647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.356590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.359152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.402402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:16.544292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:16.545624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:16.561623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.562407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.563325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.564298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.565082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.565818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.644255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:16.657948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0338cafa-28e4-4982-bf59-05cf0f6819c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.349619 Oct 28 17:31:16.658547 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 419/929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:16 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:16.710923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:16.737450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56f67f9b-615d-49f2-b7df-593143a83e35 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.197961 Oct 28 17:31:16.738513 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 511/930] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:16 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:16.960386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:16.962751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:16.978213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.978950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.979691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:16.981693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:16.983142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:16.983935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.232058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:17.234122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:17.250233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.252012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.252674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.253964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.254610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.255231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.334040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:17.343755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a11cda69-f4aa-468d-80a0-c171a16ebf3e tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1524 microversion: 2.1 time: 0.389317 Oct 28 17:31:17.345849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 420/931] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:16 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:17.574653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:17.583846 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17eaacbc-3f02-4bbd-8951-5b2a6c191063 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.358639 Oct 28 17:31:17.600299 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 512/932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:17 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:17.683222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:17.684453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:17.692709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.693605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.694194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.695165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.697964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.698879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.770577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:17.776386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:17.785654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.786540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.787203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.788298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:17.788949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:17.789622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:17.965184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:18.002725 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0834711-96e4-4c19-a663-4fc395802257 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.237509 Oct 28 17:31:18.003688 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 513/933] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:17 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:18.012399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:18.028714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:18.031592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.032313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.032821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.042924 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f38c753-58ae-4087-90af-cb9f5a5c30f4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.365016 Oct 28 17:31:18.043611 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 421/934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:17 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:18.052568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] Creating event network-changed:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h2-860864-13 Oct 28 17:31:18.054851 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-28a41c46-7bbb-415d-bf65-dc36e8919ec0 req-375aadd8-e57e-4ab5-813d-d21f10c3ef87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049043 Oct 28 17:31:18.060883 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 514/935] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:18.369713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:18.371031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:18.390536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.391758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.392427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.395474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.400295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.401635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.609727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:18.611047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:18.620965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.622029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.623109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.624198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.624928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.625602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.837697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:18.918551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:18.934679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67081489-5ec5-46e5-98ba-1bac7f49ee9b tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1524 microversion: 2.1 time: 0.569324 Oct 28 17:31:18.936657 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 422/936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:18 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1524 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:18.943151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58839f6-b2c7-4bea-a046-64be87262209", "name": "network-vif-plugged", "status": "completed", "tag": "22a16875-db48-4f16-8bd0-765c054693cd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:18.980716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:18.981444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:18.986001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:18.999000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] Creating event network-vif-plugged:22a16875-db48-4f16-8bd0-765c054693cd for instance b58839f6-b2c7-4bea-a046-64be87262209 on n-h1-860864-13 Oct 28 17:31:19.005671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-10f4b9ae-b6b6-4273-99aa-96a210e9f9cd req-ad9af510-bd32-4fba-b28e-f4ffdd4f5fe3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067537 Oct 28 17:31:19.006286 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 423/937] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:19.040282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:19.043351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:19.056853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.057795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.058849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:19.062211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.064683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.065691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:19.190009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:19.206109 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9df65e2a-ab14-4030-bed4-d4907d5b8fa2 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.601046 Oct 28 17:31:19.207680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 515/938] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:18 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:19.239092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:19.240691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:19.251406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.252144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.252754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:19.254774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.258935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.259616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:19.303157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:19.349779 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4f285ec-9c68-43c9-97f3-47efab4778c8 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.316968 Oct 28 17:31:19.359404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 424/939] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:19 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:19.818571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:19.837318 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe130813-9741-4be7-bbc0-99824fb48cae tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.627450 Oct 28 17:31:19.854486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 516/940] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:19 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:19.960969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:19.962495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:19.987981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.988585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.989108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:19.991240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:19.991845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:19.992344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.106511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:20.114581 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f94df658-b37f-4a76-a044-aae500c59dd6 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1482 microversion: 2.1 time: 0.158302 Oct 28 17:31:20.115758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 425/941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:19 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1482 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:20.152096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c19457-7971-4c78-803c-8e15c834787c", "name": "network-vif-deleted", "tag": "c316c667-7558-4281-8b0f-5152483e19f0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:20.166525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.167436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.168143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.187622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] Creating event network-vif-deleted:c316c667-7558-4281-8b0f-5152483e19f0 for instance 95c19457-7971-4c78-803c-8e15c834787c on n-h2-860864-13 Oct 28 17:31:20.199924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f39b1cae-7ea0-49d0-9015-38d5b97e2133 req-928c4078-d8c0-46b8-bb8d-b6844cccabf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053862 Oct 28 17:31:20.201562 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 517/942] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:31:20.231631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:20.232709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:20.242309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.243537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.244101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.244884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.245469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.245972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.384365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:20.386322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:20.396610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.397107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.397543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.398253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.398703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.399180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.448922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:20.464500 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51cf575a-2e20-4d56-8bc3-187f98e57c8a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1318 microversion: 2.1 time: 0.237049 Oct 28 17:31:20.472313 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 426/943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:20 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:20.510021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:20.528469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6b82d70-aea1-4aaa-856b-9b53f2ab9ad2 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.151184 Oct 28 17:31:20.531731 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 518/944] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:20 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:20.864857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:20.865812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:20.873332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.874179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.874842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:20.875777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:20.876413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:20.877012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.142116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:21.143651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:21.153818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.154315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.154762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.156795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.157470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.158160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.193695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.194436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.195025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.196382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lazy-loading 'fault' on Instance uuid 95c19457-7971-4c78-803c-8e15c834787c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:21.255054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:21.271493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-033d85a1-6fcc-4cbd-babd-9b29487d50c9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.410272 Oct 28 17:31:21.272900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 427/945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:20 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:21.282099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:21.291213 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9cd44927-2b0f-4b61-a6e5-d3ce603d1583 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1313 microversion: 2.1 time: 0.155451 Oct 28 17:31:21.292517 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 519/946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:21 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:21.489226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:21.489945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:21.496464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.497098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.497765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.498690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.499428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.500103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.559515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:21.562142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:21.571066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.572448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.572999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.573884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.575169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.575786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.711046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:21.786573 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c6686ca-2bee-4d20-96cd-daaa78382906 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.232274 Oct 28 17:31:21.789298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:21.790277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 520/947] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:21 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:21.802517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0e02de3-afbd-444a-911b-e366b9f261ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1467 microversion: 2.1 time: 0.314027 Oct 28 17:31:21.822283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 428/948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:21 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1467 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:21.832127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:21.832739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:21.840546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.841049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.841535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:21.842249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:21.842940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:21.843603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.037191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:22.051725 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-210a0ef8-e69c-40f8-a92e-e5effb793ac8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1468 microversion: 2.1 time: 0.223552 Oct 28 17:31:22.067554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 521/949] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:21 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:22.085910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1561810992"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:22.091692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:22.099001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.099771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.100399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.108469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.109053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.109543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.296853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:22.297457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:22.301624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:22.306899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.307415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.307858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.309566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.309566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.309566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.414731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd1ebd83-c642-4cf0-96ee-aad214497057 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "POST /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f/action" status: 202 len: 0 microversion: 2.1 time: 0.342480 Oct 28 17:31:22.417048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 429/950] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:31:22 2022] POST /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:31:22.427024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:22.429079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:22.438866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.439984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.440766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.441736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.443024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.444258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.488660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.489016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:22.489603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.490381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.491837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lazy-loading 'fault' on Instance uuid 95c19457-7971-4c78-803c-8e15c834787c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:22.501469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9b4a3eec-5968-40b7-b9ed-8701cc8f3be8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.208196 Oct 28 17:31:22.520166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 522/951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:22 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:22.528491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55348231-1abf-4752-bbb2-036713ff49ef tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242e7820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:22.562421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec1482fbdb4e65ad339ab01b7a557e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b73acb57c54ec3b7ca1a065cc0a86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:22.579586 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fabb9252-1c93-4552-945f-2429aefddf89 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 200 len: 1313 microversion: 2.1 time: 0.160772 Oct 28 17:31:22.580754 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 430/952] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:22 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:22.589993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55348231-1abf-4752-bbb2-036713ff49ef tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.068351 Oct 28 17:31:22.590863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 523/953] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:22 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:22.824526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:22.825162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:22.832702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.833183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.833618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.834318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:22.834768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:22.835194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:22.977890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:22.997636 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-41a3d2bd-fe1a-4fbd-9522-46b7c5418bb0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.176832 Oct 28 17:31:22.998844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 431/954] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:22 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:23.465693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-237001864", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "5333ef76-c7f9-4662-a3af-639e2a351438"}, {"uuid": "c5c074d6-8b69-435c-8aaf-f0edbf71d7e0"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:23.478742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:23.526327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:23.527955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:23.538455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:23.542901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:23.543424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:23.544243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:23.544709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:23.545137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:23.550805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] validate_networks() for [('5333ef76-c7f9-4662-a3af-639e2a351438', None, None, None, None, None), ('c5c074d6-8b69-435c-8aaf-f0edbf71d7e0', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:31:23.809249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:23.824944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-889029dc-f19b-4b2d-bf5d-b46884a9e046 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.302582 Oct 28 17:31:23.825870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 432/955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:23 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:23.841480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:23.842097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] [instance: 95c19457-7971-4c78-803c-8e15c834787c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:23.850205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:23.851242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:23.852073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:23.853118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:23.853567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:23.854279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:23.874578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] HTTP exception thrown: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Request method failure captured: Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c HTTP/1.1 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGNtby4kI6bv9-5NbjoGrTinwo2CtFfsJBBuODT-dzuuagmMy0GGxNLLwcAcs0OTY92emEQmPO3flROSNoQmjO-6HoiEiQBL6OTq1HM_0XIWxxfvxqLIfBA8z5GKceqSgx-qJZ4nn8LJj29ucEhzqb2f6iP6GA_SGJ3CA4QB99V6Ho Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_94b73acb57c54ec3b7ca1a065cc0a86c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/94b73acb57c54ec3b7ca1a065cc0a86c"}]}] Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 94b73acb57c54ec3b7ca1a065cc0a86c Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1130183048 Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 94ec1482fbdb4e65ad339ab01b7a557e Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1130183048-project Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '95c19457-7971-4c78-803c-8e15c834787c'} Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:23.876305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] Returning 404 to user: Instance 95c19457-7971-4c78-803c-8e15c834787c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2396ae82-f38f-4b64-a72a-bcee2c989dd1 tempest-FloatingIPsAssociationTestJSON-1130183048 tempest-FloatingIPsAssociationTestJSON-1130183048-project] 10.222.0.48 "GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c" status: 404 len: 111 microversion: 2.1 time: 0.050437 Oct 28 17:31:23.881191 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 433/956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:23 2022] GET /compute/v2.1/servers/95c19457-7971-4c78-803c-8e15c834787c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:31:23.883941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa2ef2e8-1a0a-419f-9b5d-b9751d6d98f5 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243bc820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:23.952855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa2ef2e8-1a0a-419f-9b5d-b9751d6d98f5 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.072733 Oct 28 17:31:23.963436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 434/957] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:23 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:24.031825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:24.032648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:24.040720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.041899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.042506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.043740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.044781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.045515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.246632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:24.260360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:24.294257 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-648106dc-1427-4520-9cdd-b8a43df83499 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.267067 Oct 28 17:31:24.294720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 435/958] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:24 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:24.715165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:31:24.715777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:31:24.716451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:31:24.716864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:31:24.717279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:31:24.728858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.729356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.729796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.730603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.731535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.732153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.782856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Getting quotas for project bedfd84f821d43f58d95630314be6d35. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:31:24.803295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Getting quotas for user 5192aa33e80d4d6b99db6276d98de21e and project bedfd84f821d43f58d95630314be6d35. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:31:24.824622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:31:24.828385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:31:24.854502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:24.855257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:24.876031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.878924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.880633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.885357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:24.886037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:24.886564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:24.921510 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c2eb760-789b-43a3-bdd1-0c1171dfd091 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461139 Oct 28 17:31:24.922227 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 524/959] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:31:24.938640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37881edc-57e2-46bd-8e63-cab946d4d3ca tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:24.941509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37881edc-57e2-46bd-8e63-cab946d4d3ca tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:24.955789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:25.198284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37881edc-57e2-46bd-8e63-cab946d4d3ca tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:25.209651 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37881edc-57e2-46bd-8e63-cab946d4d3ca tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1212 microversion: 2.1 time: 0.279926 Oct 28 17:31:25.210519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 525/960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:24 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1212 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:25.225721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80071f44-ce2a-4003-8898-d8d851dc30db tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524246310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:25.301102 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80071f44-ce2a-4003-8898-d8d851dc30db tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.086246 Oct 28 17:31:25.310312 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 526/961] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:25 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:25.324757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:25.325365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:25.351274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:25.352967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:25.353663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:25.354803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:25.355441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:25.356375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:25.531763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:25.537752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:25.555678 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1548a780-3e0a-4da6-9e32-8bcca4772d6c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.708046 Oct 28 17:31:25.556937 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 436/962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:24 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:25.589575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1af2df04-c39f-4e81-beab-e040cec81388 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.269587 Oct 28 17:31:25.591306 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 527/963] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:25 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:26.236694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:26.237411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:26.255245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.259386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.261094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.262866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.266280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.266806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.324083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d95b7a2-282c-4de9-825e-c81f69b4488c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752428bd30>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:26.404627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d95b7a2-282c-4de9-825e-c81f69b4488c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.090648 Oct 28 17:31:26.405204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 528/964] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:26 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:26.564513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:26.577567 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-121ec66c-5af5-4382-893b-3314b1e8a2b6 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1264 microversion: 2.1 time: 0.345084 Oct 28 17:31:26.580713 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 437/965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:26 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1264 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:26.580863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:26.581644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:26.602845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.603498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.603972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.604763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.605129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.605539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.620663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:26.621452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:26.631555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.636880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.637588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.638507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:26.639554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:26.639980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:26.794425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:26.827284 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6a35984-0678-4f1a-8e48-5f4c1b02fee9 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.210809 Oct 28 17:31:26.828421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 438/966] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:26 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:27.029601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:27.039677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc56582f-bb2e-4f09-9467-9123a5cb8128 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.463255 Oct 28 17:31:27.048568 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 529/967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:26 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:27.420665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf7eeb20-e50c-4e39-9baa-66c82378300e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752448b3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:27.504186 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf7eeb20-e50c-4e39-9baa-66c82378300e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.087747 Oct 28 17:31:27.504766 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 439/968] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:27 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:27.607156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:27.607908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:27.633615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:27.634130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:27.634748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:27.642603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:27.649444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:27.650010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:27.818722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:27.832364 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a77c7a75-c13c-42ac-af0e-d49bf72424b3 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1270 microversion: 2.1 time: 0.229195 Oct 28 17:31:27.833198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 530/969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:27 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:27.861232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:27.862447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:27.876885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:27.878340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:27.878825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:27.882237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:27.883120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:27.886095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:28.078121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:28.079035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:28.088625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:28.096590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:28.097359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:28.098299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:28.098829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:28.099478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:28.134759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:28.151003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:28.182685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e84e15f3-0691-49c0-9b59-ce0b49c670a0 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.327098 Oct 28 17:31:28.185636 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 440/970] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:27 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:28.447592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:28.462054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ada4d87a-74e9-4a30-a630-6486fca89ec2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.387401 Oct 28 17:31:28.465539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 531/971] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:28 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:28.522624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e12e101-a8aa-48b2-a8ad-ef0988dc1ce4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243bc430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:28.591327 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e12e101-a8aa-48b2-a8ad-ef0988dc1ce4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.072508 Oct 28 17:31:28.599937 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 441/972] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:28 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:28.865913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:28.866544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:28.880038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:28.880538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:28.880979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:28.881881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:28.885025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:28.885676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:29.218035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:29.218709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:29.226204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:29.227068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:29.227833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:29.228706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:29.229796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:29.230395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:29.366497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:29.428375 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b18ce84-1775-4547-aeab-97991d3ac794 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.214033 Oct 28 17:31:29.431452 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 442/973] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:29 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:29.490398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:29.491256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:29.504971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:29.532958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:29.534026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:29.534812 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5d9d552-3dd8-4e49-9798-76b8d83fcba5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1312 microversion: 2.1 time: 0.670021 Oct 28 17:31:29.535807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:29.537048 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 532/974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:28 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1312 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:29.537316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:29.538446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:29.540707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:29.610184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85270ec2-00ca-419c-a791-8947da4684ac tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524263b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:29.686354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85270ec2-00ca-419c-a791-8947da4684ac tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.082059 Oct 28 17:31:29.687199 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 533/975] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:29 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:29.978539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:29.996308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83458fbc-1e55-4740-9ba6-6eec74634175 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.511100 Oct 28 17:31:29.997079 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 443/976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:29 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:30.474645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:30.475901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:30.491782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:30.493521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:30.495439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:30.498296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:30.498942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:30.499567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:30.562826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:30.563631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:30.578105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:30.578789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:30.580366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:30.588969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:30.589597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:30.590244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:30.872406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:30.916027 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66c073fa-e5d4-47a4-ae9b-a534c602c7fa tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1931 microversion: 2.75 time: 0.451081 Oct 28 17:31:30.932243 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 534/977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:30 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1931 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:30.948689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ae46774-9f5a-4aea-abab-d560ffeb330d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752478d9d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:31.008463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ae46774-9f5a-4aea-abab-d560ffeb330d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.073403 Oct 28 17:31:31.009330 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 535/978] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:30 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:31.013947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "name": "network-vif-plugged", "status": "completed", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:31.026907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:31.027919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:31.028519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:31.044089 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] Creating event network-vif-plugged:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h2-860864-13 Oct 28 17:31:31.062823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0970b9bb-83f0-4304-af37-816bb40c6661 req-9d8b760a-20e5-42a7-abab-cbeaf4a80481 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044763 Oct 28 17:31:31.063834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 536/979] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:31.080892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:31.085230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:31.105708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:31.106545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:31.107179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:31.108132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:31.110286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:31.110898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:31.206896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:31.215123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-41272ca6-5239-44af-ba3b-58370f5368aa tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.656862 Oct 28 17:31:31.227038 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 444/980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:30 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:31.823581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:31.856044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d2a8d6f-9496-4bf4-9c98-bf12ad535ba3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 0.787441 Oct 28 17:31:31.860421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 537/981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:31 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:31.957870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:31.959836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:31.979215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:31.982107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:31.990417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:31.996636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:31.999713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:32.000667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:32.026537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b669cb8-5bd6-4a47-9780-9cb34bb3218e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242989d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:32.135043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b669cb8-5bd6-4a47-9780-9cb34bb3218e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.114558 Oct 28 17:31:32.143108 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 538/982] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:32 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:32.241085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:32.241968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:32.255300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:32.256005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:32.256613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:32.257494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:32.260010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:32.260652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:32.399555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:32.439944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a118f44c-d44e-4fa6-9484-7628fb2d6782 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1949 microversion: 2.75 time: 0.491199 Oct 28 17:31:32.441859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 445/983] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:31 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1949 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:32.886516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:32.887204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:32.901547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:32.904093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:32.905192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:32.908219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:32.911099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:32.911766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:33.499902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:33.520525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c2cb68c6-7973-4087-860d-dfb21b16e9d5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.282706 Oct 28 17:31:33.521198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 539/984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:32 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:33.546679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed1c15da-915a-4cdb-a801-41273d2ef555 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752424faf0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:33.620091 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed1c15da-915a-4cdb-a801-41273d2ef555 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.096442 Oct 28 17:31:33.620684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 540/985] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:33 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:33.640983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "tag": "c5844adf-a104-4465-b2b0-6b756bf18788"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:33.660103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:33.660590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:33.661026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:33.690170 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] Creating event network-changed:c5844adf-a104-4465-b2b0-6b756bf18788 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:31:33.703473 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-fa1cfb60-378f-443e-9810-41678f182138 req-02f76cd0-a7e1-4f37-912b-de39d25d6e9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077983 Oct 28 17:31:33.704363 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 541/986] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:33.712788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:33.714512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:33.722960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:33.723928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:33.724706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:33.725588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:33.726442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:33.727671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:33.984732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:33.999693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f4ad280-4d57-4abd-b47e-f13b055e951e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1361 microversion: 2.1 time: 1.122191 Oct 28 17:31:34.007118 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 446/987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:32 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1361 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:34.020899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:34.082531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9b8dc146-9acf-473b-abd3-cb03c9b67f4c tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1937 microversion: 2.75 time: 0.372690 Oct 28 17:31:34.082845 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 542/988] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:33 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1937 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:34.549768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:34.550506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:34.563200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:34.563928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:34.564312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:34.568607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:34.569099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:34.575815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:34.640384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41589aa5-3c3d-4510-8e1a-12b89c9b06ac tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752433b160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:34.756367 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41589aa5-3c3d-4510-8e1a-12b89c9b06ac tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.124681 Oct 28 17:31:34.756989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 543/989] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:34 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:34.901033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:34.909882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb8aa883-d096-477a-8c1d-4d3159381cc0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.364675 Oct 28 17:31:34.928100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 447/990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:34 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:35.028314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:35.034270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:35.035122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:35.061802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.062537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.063818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.068205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.068959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.069612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.114678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:35.115279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:35.124934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.125433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.131073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.135526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.136049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.136598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.203331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:35.378671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:35.430434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:35.443906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2e85a3d-713f-4c19-85f6-5e22adb0f6fc tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1937 microversion: 2.75 time: 0.331018 Oct 28 17:31:35.444277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f1f3b350-cb30-4827-9254-a0e85369f2de tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1544 microversion: 2.1 time: 0.411948 Oct 28 17:31:35.445347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 448/991] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:35 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1937 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:35.452349 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 544/992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:35 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1544 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:35.468831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-plugged", "status": "completed", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:35.473393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:35.488809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:35.494301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.500627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.501896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.510029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.512591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.514046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.514902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.521474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.522222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.563779 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] Creating event network-vif-plugged:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:31:35.576957 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-21926777-f8d1-4934-a290-d73219a680d1 req-6a9bdab8-be49-4b3d-b6ff-6fbdb305a040 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130141 Oct 28 17:31:35.588567 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 449/993] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:35.743990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fad45613-d407-4fab-af3d-6a88ed7e81b6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274690 Oct 28 17:31:35.745029 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 545/994] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:31:35 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:35.772687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7c30bd4-f24f-4999-9f1f-c9040a2ef61e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524322820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:35.935048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:35.938496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:35.962485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.964878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.968510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:35.969905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:35.979498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:35.980346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:37.699650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:37.735401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d392bf5-c7cb-403b-8df8-dc4de8366aa0 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.802855 Oct 28 17:31:37.748606 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 546/995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:35 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:37.753153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:37.753768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:37.818497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:37.819266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:37.820680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:37.821418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:37.837929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:37.840038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:39.167281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] Lazy-loading 'services' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:39.239530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e567dee-f32c-4b33-841d-f8ca4a936431 tempest-ServersAdmin275Test-740629990 tempest-ServersAdmin275Test-740629990-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1922 microversion: 2.75 time: 1.489895 Oct 28 17:31:39.251714 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 547/996] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:37 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1922 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:39.260628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "tag": "c82e98b5-46c5-4c28-aa8b-ef31aa906b04"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:39.304477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:39.315576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:39.316355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:39.361752 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] Creating event network-changed:c82e98b5-46c5-4c28-aa8b-ef31aa906b04 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:31:39.389925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-17064a85-54b8-4346-8f6a-87594021d3ee req-960fc386-55c2-49fb-96aa-81959d04bbc1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141824 Oct 28 17:31:39.397895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 548/997] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:39.416274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:39.419653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:39.446046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:39.456146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:39.456877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:39.459669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:39.460404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:39.461914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:40.656827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:40.670355 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1e14a74c-0139-48f8-ab0c-0eebe9ed3f74 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.269703 Oct 28 17:31:40.671145 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 549/998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:39 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:40.688172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:40.700125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:40.719311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:40.719888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:40.723753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:40.724561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:40.725040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:40.725472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:40.758846 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7c30bd4-f24f-4999-9f1f-c9040a2ef61e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 4.990568 Oct 28 17:31:40.759482 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 450/999] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:35 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 4992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:40.804785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:31:40.985159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d63a0c2-5346-4c1c-bf89-14900286a085 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 204 len: 0 microversion: 2.75 time: 0.307540 Oct 28 17:31:40.998275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 550/1000] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:31:40 2022] DELETE /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:31:41.006108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:41.006842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:41.024716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:41.025311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:41.025765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:41.028135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:41.028612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:41.029056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:41.214198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:41.230867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:41.232478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:41.255533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56a891a4-ee7a-4547-a12c-a25e3518a9f1 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1444 microversion: 2.75 time: 0.251981 Oct 28 17:31:41.256355 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 451/1001] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:41 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1444 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:41.411150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:41.425263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:41.426122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:41.427232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:41.448065 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] Creating event network-changed:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h2-860864-13 Oct 28 17:31:41.463346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-31b05476-94f3-4ecc-8070-368cfd97c17b req-8cc46937-a381-4ac5-a2ed-ed6d1363b9e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056056 Oct 28 17:31:41.465485 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 551/1002] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:41.705956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:41.707115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:41.724268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:41.727592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:41.730891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:41.734483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:41.735128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:41.738318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:41.777343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c561a774-30a6-4f2c-ad47-7b4938389511 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752425c9d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:41.869676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c561a774-30a6-4f2c-ad47-7b4938389511 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.099147 Oct 28 17:31:41.878174 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 552/1003] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:41 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:42.301163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:42.302169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:42.323172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:42.326265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:42.327953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:42.330047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:42.334415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:42.338031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:42.805198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:42.832663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:42.839219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:42.876016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2cc83d7f-0401-452f-a6c5-7e404f219c58 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1444 microversion: 2.75 time: 0.578800 Oct 28 17:31:42.884407 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 553/1004] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:42 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1444 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:42.903611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fdfac92f-9d4c-4312-b797-517032a7585d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75248cbee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:42.982519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fdfac92f-9d4c-4312-b797-517032a7585d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.088058 Oct 28 17:31:42.992792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 554/1005] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:42 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:43.426884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:43.448675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46e12c49-fca6-421a-b548-5f63dfef261e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.749885 Oct 28 17:31:43.455764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 452/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:41 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:43.914836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:43.915629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:43.940516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:43.941323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:43.941942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:43.942840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:43.943491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:43.944076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:44.006347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fc3d1e1-c781-42ed-800a-1f8ad9297fb9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75245810d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:44.027913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:44.092367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fc3d1e1-c781-42ed-800a-1f8ad9297fb9 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.090359 Oct 28 17:31:44.095189 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 453/1007] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:44 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:44.436785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:44.454948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:44.456635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:44.481258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:44.481939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:44.489524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a9b9b24a-0ce3-4e53-ac97-af3d89e6c816 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1444 microversion: 2.75 time: 0.581638 Oct 28 17:31:44.493856 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 555/1008] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:43 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1444 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:31:44.497025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:44.500991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:44.503584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:44.506353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:44.509155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:44.510724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:45.113232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d234103f-d198-42f1-8c16-eae71a1997b4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524377c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:45.210590 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d234103f-d198-42f1-8c16-eae71a1997b4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.101553 Oct 28 17:31:45.222763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 556/1009] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:45 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:45.526904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:45.527907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:45.550298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:45.551088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:45.551727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:45.552640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:45.553323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:45.553950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:45.776979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:45.791192 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64684b9e-439e-4423-88a9-c8ffc71f0c0c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.314122 Oct 28 17:31:45.839799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 454/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:44 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:45.906932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:45.928309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:45.936925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:45.946990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-718d7101-f3c8-4ab5-8b30-c92edf7c0888 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1444 microversion: 2.75 time: 0.424619 Oct 28 17:31:45.960943 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 557/1011] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:45 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1444 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:46.243834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7e6ff1c8-6fdb-4eb0-bfd5-8c44439b55b3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75245c2430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:46.348066 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7e6ff1c8-6fdb-4eb0-bfd5-8c44439b55b3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.121672 Oct 28 17:31:46.374936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 455/1012] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:46 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:46.847904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:46.848751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:46.863551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:46.864057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:46.864540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:46.865222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:46.865676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:46.866105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:46.990273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:46.990868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:47.006548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:47.008809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:47.009247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:47.009685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:47.037932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:47.038502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:47.048308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:47.166003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:47.240364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:47.243777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:47.244636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:47.250282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lazy-loading 'fault' on Instance uuid 7f615f50-e561-4cf8-b8ec-c71fe5397381 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:31:47.464561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:47.474822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:47.497669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d645fbc6f0a4c67a41bd2ac607438f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7be8faac6e43e9b40700eff363239a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:47.527350 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-107a4506-9381-4257-9a0b-156ee455e9a9 tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 200 len: 1449 microversion: 2.75 time: 0.542735 Oct 28 17:31:47.527965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 456/1013] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:46 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 1449 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:31:47.559038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c9e4b8c-b20e-4711-a012-6fa7aa9e0e8f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242f5040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:47.765139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c9e4b8c-b20e-4711-a012-6fa7aa9e0e8f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.225886 Oct 28 17:31:47.765734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 457/1014] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:47 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:47.979738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:48.006087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7d2fba5b-9d9e-4621-8375-6494664c9348 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.162287 Oct 28 17:31:48.033572 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 558/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:46 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:48.576017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:48.577413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] [instance: 7f615f50-e561-4cf8-b8ec-c71fe5397381] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:48.611326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:48.620208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:48.622604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:48.623673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:48.624394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:48.625069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:48.666238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] HTTP exception thrown: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Request method failure captured: Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 HTTP/1.1 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGijWtaXLe7shxjOeIQvuRfO1Vuhu1AKz16gy9LzPl8NP3eHcnF7e1Idw80towJoVjTzq8Hp2L-IJ8MVL4f-gZ66neWcmJ_YIlUj0mrf2XNKI2PMOWRABjmDnPqGYHI1JksA6eahSgXnx5N_d_A5W0J3JWPGKSkPfRTXZAxfMlKhUE Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.75 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ca7be8faac6e43e9b40700eff363239a Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdmin275Test-693200727 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca7be8faac6e43e9b40700eff363239a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca7be8faac6e43e9b40700eff363239a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca7be8faac6e43e9b40700eff363239a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca7be8faac6e43e9b40700eff363239a"}]}] Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdmin275Test-693200727 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ca7be8faac6e43e9b40700eff363239a Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdmin275Test-693200727 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdmin275Test-693200727-project Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0d645fbc6f0a4c67a41bd2ac607438f0 Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdmin275Test-693200727-project Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7f615f50-e561-4cf8-b8ec-c71fe5397381'} Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:48.669173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. Oct 28 17:31:48.687302 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:48.692760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] Returning 404 to user: Instance 7f615f50-e561-4cf8-b8ec-c71fe5397381 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:48.694879 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb318e5c-8778-4105-a26f-712dcefd405f tempest-ServersAdmin275Test-693200727 tempest-ServersAdmin275Test-693200727-project] 10.222.0.48 "GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381" status: 404 len: 111 microversion: 2.75 time: 0.130614 Oct 28 17:31:48.697620 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 458/1016] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:31:48 2022] GET /compute/v2.1/servers/7f615f50-e561-4cf8-b8ec-c71fe5397381 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:31:48.783804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dbe449c-02bd-4d13-bfd5-3a171b6a21bf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524303310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:48.944220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dbe449c-02bd-4d13-bfd5-3a171b6a21bf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.159577 Oct 28 17:31:48.948670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 559/1017] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:48 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:31:49.086095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:49.086704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:49.101991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:49.104755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:49.105399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:49.107540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:49.110606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:49.111279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:49.965099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9ad1d47-55b4-42a2-9cf3-e01123b715e3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243779d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:50.056950 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9ad1d47-55b4-42a2-9cf3-e01123b715e3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1453 microversion: 2.1 time: 0.095729 Oct 28 17:31:50.066171 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 560/1018] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:49 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:50.522174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:50.576416 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-204d9b1b-53ed-4726-9961-d0998c5ad466 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 1.497443 Oct 28 17:31:50.581352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 459/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:49 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:51.074483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ccd5e4b-e10e-4372-84fa-1a2bffdb687a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242231f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:51.604608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:51.606341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:51.622482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:51.624543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:51.627569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:51.628530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:51.629136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:51.629718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:52.269774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:52.286785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f698c5fe-950d-4a30-ab0b-6161a9e80f6a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.688095 Oct 28 17:31:52.293155 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 460/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:51 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:52.309368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "name": "network-vif-plugged", "status": "completed", "tag": "c5844adf-a104-4465-b2b0-6b756bf18788"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:52.382691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:52.382966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:52.399879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:52.473311 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] Creating event network-vif-plugged:c5844adf-a104-4465-b2b0-6b756bf18788 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:31:52.500147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d7f154b6-2acb-4573-b710-9cf1685155be req-23c5a2bc-7b2a-4f15-9bc0-e8bd77e3fed8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203348 Oct 28 17:31:52.508458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 461/1021] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:53.315733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:53.316469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:53.337910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:53.343095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:53.346816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:53.348360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:53.365156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:53.365620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:53.890752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:53.900143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b30b8845-fbf5-44c7-83d6-81ac153ac7b9 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.589176 Oct 28 17:31:53.900741 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 462/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:53 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:54.606624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1554852082", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "a21ca55f-dca1-4f3c-8ed6-ab9340767e1f"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:56.854276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:31:57.789539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ccd5e4b-e10e-4372-84fa-1a2bffdb687a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1462 microversion: 2.1 time: 6.720301 Oct 28 17:31:57.790521 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 561/1023] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:51 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1462 bytes in 6722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:57.795322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "name": "network-vif-plugged", "status": "completed", "tag": "c82e98b5-46c5-4c28-aa8b-ef31aa906b04"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:57.808698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] validate_networks() for [('a21ca55f-dca1-4f3c-8ed6-ab9340767e1f', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:31:57.812702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:57.813389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:57.813990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:57.826892 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] Creating event network-vif-plugged:c82e98b5-46c5-4c28-aa8b-ef31aa906b04 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:31:57.832866 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-85138589-f545-4ff8-a08d-ec1c60e1fbbe req-9bed538e-40e5-4523-991d-3ec2ca3bf02c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041175 Oct 28 17:31:57.833732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 562/1024] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:57.841279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:57.850291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:57.870085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:57.875707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:57.876380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:57.877401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:57.878382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:57.878970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.149425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:58.161091 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2b05cfe-4112-4363-a2de-d6d5fbfa3e26 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.324757 Oct 28 17:31:58.179616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 563/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:57 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:58.364194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.378082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.383506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.384297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.385339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.386253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.386774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.426312 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de1331bc-dbaa-4c6c-844d-e2fadb76b096 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.243895 Oct 28 17:31:58.427662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 564/1026] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:58.433707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b0b46e1-5139-43b9-8e1d-660b38c1dc5a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242234c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.500676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b0b46e1-5139-43b9-8e1d-660b38c1dc5a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 200 len: 1462 microversion: 2.1 time: 0.071099 Oct 28 17:31:58.501942 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 565/1027] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:58.506479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.511037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.511819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.512340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.514582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.515759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.522016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.558913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:31:58.559697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:31:58.560373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:31:58.560986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:31:58.561582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:31:58.573558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d610975-9db3-47a4-b889-b60b362fb6ba tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.070350 Oct 28 17:31:58.573765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.574230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.574667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.575601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.576211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.581432 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 566/1028] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:58.582136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.588612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.589304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:58.601702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.602518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.603430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.604351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.604816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.605247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.613622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Getting quotas for project 50f6085e85d3461ca542bda9b569e630. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:31:58.624723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Getting quotas for user 39f7bfc7459544c1ad4ccc2e76fdcd51 and project 50f6085e85d3461ca542bda9b569e630. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:31:58.639505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:31:58.641598 n-d-860864-13 devstack@n-api.service[120568]: WARNING nova.utils [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1554852082 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-155485208 Oct 28 17:31:58.642322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:31:58.713667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e637f0a-716e-4aec-872b-9bc8d574e03c tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.656505 Oct 28 17:31:58.720508 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 463/1029] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:31:58.725502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.730057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.730527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.731754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.732655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.733094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.733827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.759308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c17b261-e26d-452f-a8b7-8baff9a4d1d1 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.037663 Oct 28 17:31:58.759948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 464/1030] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:58.764373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22565d89-3031-4a73-bbac-e523c75f7355 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.765167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22565d89-3031-4a73-bbac-e523c75f7355 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:58.848778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22565d89-3031-4a73-bbac-e523c75f7355 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:58.861735 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22565d89-3031-4a73-bbac-e523c75f7355 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1232 microversion: 2.1 time: 0.100736 Oct 28 17:31:58.862958 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 465/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1232 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:58.863580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:58.868991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.872527 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0da59cd-d1c6-4824-9872-0c41d6091495 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1468 microversion: 2.1 time: 0.292713 Oct 28 17:31:58.873113 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 567/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:58.877325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.877961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.878552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.879933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.880551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.881197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.903148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-790414992"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:31:58.905635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:58.914313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d8e2fe0-43ff-43f6-aec4-c7e98a6c12c8 tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-860864-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.049615 Oct 28 17:31:58.915922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 466/1033] 10.222.0.48 () {58 vars in 1196 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/os-services?host=n-d-860864-13&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:31:58.924671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.925260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.925704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.926426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.926884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.927311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.934235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:58.940470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.940983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.941504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.943252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:58.944573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:58.945204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:58.996667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8262d48-d9c6-4fd2-820b-346291cc5ccd tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.069629 Oct 28 17:31:59.007112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 467/1034] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:31:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:31:59.014054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:59.020413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.021074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.021672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:59.023764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.023917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.024236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:59.066927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-904d30fa-67cc-4f3f-a862-910429fe8d6e tempest-ServicesAdminNegativeTestJSON-253374807 tempest-ServicesAdminNegativeTestJSON-253374807-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.057348 Oct 28 17:31:59.078660 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 468/1035] 10.222.0.48 () {58 vars in 1198 bytes} [Fri Oct 28 17:31:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:31:59.312555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d0abeaf-a075-443e-931d-a638b93b3789 tempest-ServicesAdminNegativeTestJSON-34832999 tempest-ServicesAdminNegativeTestJSON-34832999-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:59.316543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d0abeaf-a075-443e-931d-a638b93b3789 tempest-ServicesAdminNegativeTestJSON-34832999 tempest-ServicesAdminNegativeTestJSON-34832999-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '614a5aaa71ad47f9b97e8e4078022f6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00bd79db2b514ddea960b45a00bc1c93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d0abeaf-a075-443e-931d-a638b93b3789 tempest-ServicesAdminNegativeTestJSON-34832999 tempest-ServicesAdminNegativeTestJSON-34832999-project] Request method failure captured: Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBILg-QAPWA4VDhv-DANjbulwLF-FbQNW4GXs-hcNjkiK00j_i2Sj5xyF1ERcMZJ-nL40ik9zTBX12vqNQ7g6yc_AC0253QuxVPtftTZWFLib-jkZEfgVlePrwH4Cw9G3199jlH5QCSwp3Tt9FUpM6rw2QFgVBRTeaeiiPQ5aVBR8sY Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 00bd79db2b514ddea960b45a00bc1c93 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-34832999 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00bd79db2b514ddea960b45a00bc1c93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/00bd79db2b514ddea960b45a00bc1c93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_00bd79db2b514ddea960b45a00bc1c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/00bd79db2b514ddea960b45a00bc1c93"}]}] Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-34832999 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 00bd79db2b514ddea960b45a00bc1c93 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-34832999 Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServicesAdminNegativeTestJSON-34832999-project Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 614a5aaa71ad47f9b97e8e4078022f6a Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-34832999-project Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:59.322400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 17:31:59.327677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:31:59.331137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d0abeaf-a075-443e-931d-a638b93b3789 tempest-ServicesAdminNegativeTestJSON-34832999 tempest-ServicesAdminNegativeTestJSON-34832999-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:31:59.348420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d0abeaf-a075-443e-931d-a638b93b3789 tempest-ServicesAdminNegativeTestJSON-34832999 tempest-ServicesAdminNegativeTestJSON-34832999-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.268241 Oct 28 17:31:59.348964 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 469/1036] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:31:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:31:59.382598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:59.383630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:59.433040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.435465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.437072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:59.439495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.440280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.441691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:59.445053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dac8a92-54bb-4b64-8493-14e12842400b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "POST /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209/action" status: 202 len: 0 microversion: 2.1 time: 0.548863 Oct 28 17:31:59.454922 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 568/1037] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:31:58 2022] POST /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 17:31:59.465916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86e23810-d29a-40cb-830c-1b674e717505 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524223b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:59.541579 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86e23810-d29a-40cb-830c-1b674e717505 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.082431 Oct 28 17:31:59.553349 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 569/1038] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:31:59 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:59.750228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:31:59.761384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df0f86e7-3203-4f3f-9985-41c5bcac247d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1333 microversion: 2.1 time: 0.400812 Oct 28 17:31:59.762076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 470/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:59 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1333 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:31:59.885827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:31:59.886484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:31:59.900887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.901397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.901822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:31:59.908093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:31:59.909612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:31:59.910426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:00.013711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:00.036493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd65aeee-0e6c-4ca0-ae35-52a0d5c7d4dd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1284 microversion: 2.1 time: 0.155328 Oct 28 17:32:00.037948 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 570/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:31:59 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:00.559361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27662b26-f3cb-4707-ba0a-cd03238cf79a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752433e700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:00.644894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-27662b26-f3cb-4707-ba0a-cd03238cf79a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.089622 Oct 28 17:32:00.646144 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 471/1041] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:00 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:00.785443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:00.786059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:00.793854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:00.794876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:00.795542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:00.797219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:00.797879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:00.798496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.095756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:01.096905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:01.107845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.108553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.110901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.111834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.112419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.113391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.347695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:01.354011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:01.364123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f3f3058-e3d0-4716-88c2-2cdf5a613bcd tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1290 microversion: 2.1 time: 0.304904 Oct 28 17:32:01.367738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 472/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:01 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:01.378637 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-caeb383a-5046-487c-b0e7-58958b965ed5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1669 microversion: 2.1 time: 0.596940 Oct 28 17:32:01.379663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 571/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:00 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1669 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:01.405090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:01.405797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:01.418986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.420083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.420731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.422976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.424634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.425297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.478010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6bd58829-faac-4b01-a13d-da5cdb217c37 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a/ips" status: 200 len: 180 microversion: 2.1 time: 0.077079 Oct 28 17:32:01.479841 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 473/1044] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:32:01 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a/ips => generated 180 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:01.495253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:01.495972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:01.503969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.509456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.510619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.511420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.511914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.512399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.574789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:32:01.633430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-unplugged", "status": "completed", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:01.653284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.663642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.664555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.699952 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] Creating event network-vif-unplugged:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:32:01.721129 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-788307c3-bca7-4556-8968-8a4affcec145 req-464a87b9-735a-41ae-9824-7152a35a5873 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094192 Oct 28 17:32:01.722528 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 474/1045] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:32:01.735459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80dd05dc-efeb-4800-b1e5-689e653adb4d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524cf7f70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:01.740820 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56e29311-72e1-4934-8747-bf39cfcd14e5 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 204 len: 0 microversion: 2.1 time: 0.250334 Oct 28 17:32:01.745382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 572/1046] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:01 2022] DELETE /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:32:01.753013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:01.754890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:01.762689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.763505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.764158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.765060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:01.765677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:01.766309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:01.836681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80dd05dc-efeb-4800-b1e5-689e653adb4d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.111494 Oct 28 17:32:01.837264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 475/1047] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:01 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:02.084140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:02.094204 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd09f19a-19d5-4b13-a404-0278279a0690 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1675 microversion: 2.1 time: 0.346318 Oct 28 17:32:02.111540 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 573/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:01 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1675 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:02.391206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:02.392128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:02.405613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:02.406255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:02.406824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:02.407680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:02.408293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:02.408916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:02.852894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-686120ff-fbf8-4044-80ac-f220073eacd0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524377ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:03.007250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:03.035255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d8a6d2b-29b2-43ee-bbec-5033b8f1fe66 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.649498 Oct 28 17:32:03.051284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 476/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:02 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:03.063726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546831d9-b44b-467a-aec0-ba5e688bf9df", "tag": "ebff8a76-2ce9-4994-9e40-85818dbcac6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:03.079480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:03.080515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:03.081205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:03.096756 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] Creating event network-changed:ebff8a76-2ce9-4994-9e40-85818dbcac6a for instance 546831d9-b44b-467a-aec0-ba5e688bf9df on n-h2-860864-13 Oct 28 17:32:03.104090 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9a4988bb-a941-41c6-845d-5c3a3dd520ad req-f3de2d86-d5df-412f-8282-6d314f16e034 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050109 Oct 28 17:32:03.105271 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 477/1050] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:03.123945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:03.125036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:03.135782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:03.136559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:03.136994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:03.137717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:03.138170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:03.138819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:03.403556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:03.403828 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-686120ff-fbf8-4044-80ac-f220073eacd0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.556161 Oct 28 17:32:03.417252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b4c9ce7-f050-40d0-b2a0-bc3eb349845a tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1675 microversion: 2.1 time: 0.302105 Oct 28 17:32:03.419669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 478/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:03 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1675 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:03.428791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 574/1052] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:02 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:03.437884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a33f282-88d7-4814-b69e-2777621c94fa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f752438d9d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:03.508264 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a33f282-88d7-4814-b69e-2777621c94fa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8" status: 200 len: 636 microversion: 2.1 time: 0.085294 Oct 28 17:32:03.508950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 479/1053] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:03 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8 => generated 636 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:03.524055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cbe26df9-7878-4ea4-843f-4c455fdb8bde tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f7524228310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:03.593552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-cbe26df9-7878-4ea4-843f-4c455fdb8bde tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:03.608069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-cbe26df9-7878-4ea4-843f-4c455fdb8bde tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:03.998438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "name": "network-vif-deleted", "tag": "c5844adf-a104-4465-b2b0-6b756bf18788"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:04.008805 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cbe26df9-7878-4ea4-843f-4c455fdb8bde tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.488872 Oct 28 17:32:04.013798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 575/1054] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:03 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:04.018317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:04.018826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1fbab50-63b8-4e41-9f5c-fbd3c4ef98aa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f7524223ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:04.019145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:04.019722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:04.053731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] Creating event network-vif-deleted:c5844adf-a104-4465-b2b0-6b756bf18788 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:32:04.065158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3248e243-043a-40e7-af7c-ccd6a57a3871 req-b7860d17-c25e-400b-b7ca-0316d148829f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071300 Oct 28 17:32:04.069950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 480/1055] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:04.085646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:04.087521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:04.105868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:04.106911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:04.108786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:04.109803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:04.112190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:04.114461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:04.385851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:04.398723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b61600d2-3949-4599-8a70-b77edee411a0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.327129 Oct 28 17:32:04.403726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 481/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:04 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:04.404846 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1fbab50-63b8-4e41-9f5c-fbd3c4ef98aa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "DELETE /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.389692 Oct 28 17:32:04.405541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 576/1057] 10.222.0.48 () {58 vars in 1296 bytes} [Fri Oct 28 17:32:04 2022] DELETE /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_version => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:32:04.420103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56b72b79-dd61-48c1-8bd4-490476052302 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524246b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:04.426680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07cf027e-1354-4350-bd2e-9e250aa0908b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f75242fe5e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:04.491744 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56b72b79-dd61-48c1-8bd4-490476052302 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.074420 Oct 28 17:32:04.501785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 577/1058] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:04 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:04.504508 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-07cf027e-1354-4350-bd2e-9e250aa0908b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.094365 Oct 28 17:32:04.511267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 482/1059] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:04 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 37 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:04.511504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:04.511504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:04.521273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f2f74142-00a9-412e-ab1b-6371799449b6 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f752433e5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:04.525413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:04.525908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:04.526343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:04.527039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:04.527523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:04.527945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:04.629229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f2f74142-00a9-412e-ab1b-6371799449b6 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:04.647763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f2f74142-00a9-412e-ab1b-6371799449b6 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:04.663241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5192aa33e80d4d6b99db6276d98de21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bedfd84f821d43f58d95630314be6d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:04.676473 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95d659c7-ce33-4e2c-843c-d71419d3cd1b tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 200 len: 1453 microversion: 2.1 time: 0.175043 Oct 28 17:32:04.678423 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 578/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:04 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:05.113259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f2f74142-00a9-412e-ab1b-6371799449b6 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.597342 Oct 28 17:32:05.118758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 483/1061] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:04 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:05.126605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b794d70a-54c3-4438-86f9-93c68bfe78aa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f752424fb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:05.183662 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b794d70a-54c3-4438-86f9-93c68bfe78aa tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.063494 Oct 28 17:32:05.184620 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 579/1062] 10.222.0.48 () {58 vars in 1290 bytes} [Fri Oct 28 17:32:05 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_distro => generated 33 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:05.196881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ddd98d9-022f-4ac7-bd02-aeffca51727b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f75242fea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:05.253428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2ddd98d9-022f-4ac7-bd02-aeffca51727b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:05.258910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2ddd98d9-022f-4ac7-bd02-aeffca51727b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:05.424391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:05.425779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:05.435254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:05.436044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:05.436493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:05.437216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:05.437680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:05.438761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:05.461410 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ddd98d9-022f-4ac7-bd02-aeffca51727b tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.269352 Oct 28 17:32:05.462204 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 484/1063] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:05 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:05.471830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e366725-9510-4062-89ff-567c81fb2f4c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f75245275e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:05.535175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e366725-9510-4062-89ff-567c81fb2f4c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.067473 Oct 28 17:32:05.536347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 485/1064] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:05 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:05.545779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e93f26c9-de51-434e-b931-87a47908b5d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752431cdc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:05.610941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e93f26c9-de51-434e-b931-87a47908b5d4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.073325 Oct 28 17:32:05.612270 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 486/1065] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:05 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:05.617638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac280ed0-3e73-4c16-8277-64f795b1232c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f75243229d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:05.644289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:05.654264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-597e76cf-fe6d-448e-be63-399ea7ae2a93 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.234113 Oct 28 17:32:05.655664 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 580/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:05 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:05.671854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ac280ed0-3e73-4c16-8277-64f795b1232c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:05.677328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ac280ed0-3e73-4c16-8277-64f795b1232c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:05.702162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:05.702773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:05.708991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:05.710034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:05.710650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:05.711655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:05.712278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:05.712866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:05.730142 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a HTTP/1.1 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '01336e32-64cb-4dde-86e5-ebe426245a9a'} Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:05.732090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:05.736905 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edfb16f8-a535-4878-9c03-896aff46329e tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 404 len: 111 microversion: 2.1 time: 0.035175 Oct 28 17:32:05.737583 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 581/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:05 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:05.854440 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac280ed0-3e73-4c16-8277-64f795b1232c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.240767 Oct 28 17:32:05.855190 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 487/1068] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:05 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:05.864841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c406d227-a5a6-4001-872b-e73361e32e17 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f7524228160>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:05.934690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c406d227-a5a6-4001-872b-e73361e32e17 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:05.941333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c406d227-a5a6-4001-872b-e73361e32e17 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:06.140244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01336e32-64cb-4dde-86e5-ebe426245a9a", "name": "network-vif-deleted", "tag": "c82e98b5-46c5-4c28-aa8b-ef31aa906b04"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:06.174557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:06.177359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:06.177984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:06.203714 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] Creating event network-vif-deleted:c82e98b5-46c5-4c28-aa8b-ef31aa906b04 for instance 01336e32-64cb-4dde-86e5-ebe426245a9a on n-h1-860864-13 Oct 28 17:32:06.221894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-51814dcd-e89f-4bfe-b057-4ee276422e98 req-8fe99f4e-2862-47fe-9c13-5f8cf61cce79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085345 Oct 28 17:32:06.222577 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 488/1069] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:06.530541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c406d227-a5a6-4001-872b-e73361e32e17 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.669580 Oct 28 17:32:06.531779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 582/1070] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:05 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 64 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:06.541819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a491ab3-6a02-4ac4-b0f8-9f418b637745 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f7524322940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:06.609412 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a491ab3-6a02-4ac4-b0f8-9f418b637745 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.071765 Oct 28 17:32:06.610275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 489/1071] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:06 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 64 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:06.624204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83eccf2a-304a-41c0-ac88-a416dc8dd971 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f75242235e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:06.641343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d02c11c7-e718-4940-b0b3-717937f45390 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752433eaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:06.758402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d02c11c7-e718-4940-b0b3-717937f45390 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.129255 Oct 28 17:32:06.759289 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 490/1072] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:06 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:06.764343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:06.765926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:06.767827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-83eccf2a-304a-41c0-ac88-a416dc8dd971 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:06.782420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-83eccf2a-304a-41c0-ac88-a416dc8dd971 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:06.789027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:06.790243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:06.791051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:06.792084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:06.792784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:06.793424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:07.283873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83eccf2a-304a-41c0-ac88-a416dc8dd971 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.665879 Oct 28 17:32:07.284770 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 583/1073] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:06 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:07.289350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:07.293378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58839f6-b2c7-4bea-a046-64be87262209", "name": "network-vif-plugged", "status": "completed", "tag": "22a16875-db48-4f16-8bd0-765c054693cd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:07.297482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7edb69c0-f057-40ba-b697-25c2e3bd86a7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.536896 Oct 28 17:32:07.307532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 491/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:06 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:07.307730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:07.307730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:07.307730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:07.325574 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] Creating event network-vif-plugged:22a16875-db48-4f16-8bd0-765c054693cd for instance b58839f6-b2c7-4bea-a046-64be87262209 on n-h1-860864-13 Oct 28 17:32:07.331862 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1d202afd-3f2f-4940-8fcd-20e21e86f423 req-cf1e603b-5a3c-4f9e-b404-c9d4c06d5e0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045087 Oct 28 17:32:07.332469 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 584/1075] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:07.339971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3331703a-4f1c-400a-aec6-4e34a2c992e9 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update', calling method: .version_select at 0x7f75242e7d30>, body: {"meta": {"os_version": "alt"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:07.402319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3331703a-4f1c-400a-aec6-4e34a2c992e9 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:07.409639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3331703a-4f1c-400a-aec6-4e34a2c992e9 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:07.562469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70601664-8d7c-45a1-bb7f-d10cdcb23506 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Action: 'create', calling method: .version_select at 0x7f7524429c10>, body: {"keypair": {"name": "tempest-keypair-227439975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwyeW+CSa4gcQyhjUVDbdMAVkfuKSdq/6u3fvvfWy2VmxVTlrTFQN1aXVkHvDK1/goDi7wWJrZYZ2kJl67ZUooeqzphmCKGiBIh3y1nRFr9tpCLohc6k1KjU2b/wa2v3g=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:07.583354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:07.590621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70601664-8d7c-45a1-bb7f-d10cdcb23506 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Getting quotas for project c4744fa0a3c14442b1252b4349209b6d. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:07.597729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70601664-8d7c-45a1-bb7f-d10cdcb23506 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Getting quotas for user 8817c763274745478f78228177c8d690 and project c4744fa0a3c14442b1252b4349209b6d. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:07.627908 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70601664-8d7c-45a1-bb7f-d10cdcb23506 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.324497 Oct 28 17:32:07.629152 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 492/1076] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:32:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:07.762234 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3331703a-4f1c-400a-aec6-4e34a2c992e9 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.427847 Oct 28 17:32:07.763725 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 585/1077] 10.222.0.48 () {60 vars in 1313 bytes} [Fri Oct 28 17:32:07 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata/os_version => generated 31 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:07.774772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-95534b62-ff99-40cc-a1e4-70321185f84c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f75242f5f70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:07.775411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9d0a534-5f03-4e7e-b3e6-0b60fe27943e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242e79d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:07.844632 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-95534b62-ff99-40cc-a1e4-70321185f84c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.075157 Oct 28 17:32:07.848277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9d0a534-5f03-4e7e-b3e6-0b60fe27943e tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.078823 Oct 28 17:32:07.851295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 586/1078] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:07 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:07.857445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-decacd68-abc0-4151-9221-c8f8c0fe6c2a tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'update_all', calling method: .version_select at 0x7f75242143a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:07.865479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 493/1079] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:07 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 58 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:07.939064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-decacd68-abc0-4151-9221-c8f8c0fe6c2a tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:07.945549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-decacd68-abc0-4151-9221-c8f8c0fe6c2a tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:08.326861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:08.328596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:08.343594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-decacd68-abc0-4151-9221-c8f8c0fe6c2a tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.489558 Oct 28 17:32:08.344370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 587/1080] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:07 2022] PUT /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 61 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:08.354992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d5490d9-c0a6-4aac-b3a5-162ca5bd02e2 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Action: 'create', calling method: .version_select at 0x7f752424f040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.373597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.450563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6d5490d9-c0a6-4aac-b3a5-162ca5bd02e2 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:08.456705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6d5490d9-c0a6-4aac-b3a5-162ca5bd02e2 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Getting quotas for user 062590d8ccf54b3ca9f5d5b1209479d5 and project 254320bd4a3f4f63a626c8945119ebca. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:08.541085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:08.543667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:08.554902 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20fd14e4-3c14-437f-9cc4-8748835b911e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.237075 Oct 28 17:32:08.555576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 494/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:08 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:08.579027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:08.579630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:08.587008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.588314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.588978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.589860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.590477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.591063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.609746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a HTTP/1.1 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '01336e32-64cb-4dde-86e5-ebe426245a9a'} Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:08.611722 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.617340 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.619568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:08.620817 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f20464bb-631f-4aa2-80c4-dfcf4f2b17fc tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 404 len: 111 microversion: 2.1 time: 0.051895 Oct 28 17:32:08.622017 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 495/1082] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:08 2022] DELETE /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:08.634455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:08.637204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 01336e32-64cb-4dde-86e5-ebe426245a9a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:08.651460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.651903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.652343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.653061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.653526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.653951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.680328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a HTTP/1.1 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '01336e32-64cb-4dde-86e5-ebe426245a9a'} Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.681868 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 01336e32-64cb-4dde-86e5-ebe426245a9a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2eb8d597-55da-46d6-9079-feca02477d0d tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a" status: 404 len: 111 microversion: 2.1 time: 0.057438 Oct 28 17:32:08.686453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 496/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:08 2022] GET /compute/v2.1/servers/01336e32-64cb-4dde-86e5-ebe426245a9a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:08.692398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:08.693001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:08.700504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.701307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.701860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.702673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.703263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.703831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.720158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc HTTP/1.1 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '09f5e1e0-7698-4a0b-b7b7-9299952c17fc'} Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:08.722939 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.727789 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.728595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:08.729538 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f102e35-bca5-4e37-9af9-7c4e54029b52 tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 404 len: 111 microversion: 2.1 time: 0.041271 Oct 28 17:32:08.730522 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 497/1084] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:08 2022] DELETE /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:08.739265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:08.740062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] [instance: 09f5e1e0-7698-4a0b-b7b7-9299952c17fc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:08.748347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.748957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.749514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.750334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:08.750975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:08.751819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:08.769625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] HTTP exception thrown: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Request method failure captured: Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc HTTP/1.1 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBGkEyR8c1ZqsmJIpdLf3mJO6PtRuBaDDcW9dyFcmacC9IIK0DZOqmh40sbFRAR1GLCpbs_R5HGquLC4p724vSN0vUKEp0zw3LR-MC8m3ZfF5H-MOlwqL19OIkQaU3Khbbp0ZuJ-RrBdXaZ22vb6tlxot-E7JK91SRNbET_GUVayxp0 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bedfd84f821d43f58d95630314be6d35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bedfd84f821d43f58d95630314be6d35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bedfd84f821d43f58d95630314be6d35"}]}] Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bedfd84f821d43f58d95630314be6d35 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestMultiNic-807565774 Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5192aa33e80d4d6b99db6276d98de21e Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestMultiNic-807565774-project Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '09f5e1e0-7698-4a0b-b7b7-9299952c17fc'} Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:08.773187 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. Oct 28 17:32:08.778146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:08.781302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] Returning 404 to user: Instance 09f5e1e0-7698-4a0b-b7b7-9299952c17fc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:08.783278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49a72c2f-45c4-439f-8ab6-cd4a0e04d95c tempest-ServersTestMultiNic-807565774 tempest-ServersTestMultiNic-807565774-project] 10.222.0.48 "GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc" status: 404 len: 111 microversion: 2.1 time: 0.048097 Oct 28 17:32:08.784345 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 498/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:08 2022] GET /compute/v2.1/servers/09f5e1e0-7698-4a0b-b7b7-9299952c17fc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:08.867945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5300a960-4853-487f-b8df-4e058f584125 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75243221f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:09.007218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d5490d9-c0a6-4aac-b3a5-162ca5bd02e2 tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "POST /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.655605 Oct 28 17:32:09.012268 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 588/1086] 10.222.0.48 () {60 vars in 1281 bytes} [Fri Oct 28 17:32:08 2022] POST /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 85 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:32:09.018652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01e913c3-b31b-47fa-b81a-f3bde9d6a48c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] Calling method '.version_select at 0x7f75242149d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:09.023972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5300a960-4853-487f-b8df-4e058f584125 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.161193 Oct 28 17:32:09.029589 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 499/1087] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:08 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:09.104741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01e913c3-b31b-47fa-b81a-f3bde9d6a48c tempest-ImagesMetadataTestJSON-1305113808 tempest-ImagesMetadataTestJSON-1305113808-project] 10.222.0.48 "GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.090698 Oct 28 17:32:09.105628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 589/1088] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:09 2022] GET /compute/v2.1/images/08491ac9-2ad5-4dad-b104-a078e91adfc8/metadata => generated 85 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:32:09.578918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:09.586032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:09.590603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:09.599861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:09.602109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:09.602801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:09.604750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:09.605480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:09.606200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:09.633673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:09.949172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:09.965978 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0067a4cb-6e04-481d-ba21-a7b7c6132967 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.385294 Oct 28 17:32:09.974785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546831d9-b44b-467a-aec0-ba5e688bf9df", "name": "network-vif-plugged", "status": "completed", "tag": "ebff8a76-2ce9-4994-9e40-85818dbcac6a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:09.981501 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 500/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:09 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:10.014312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:10.015738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:10.018680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:10.040963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a99a7762-5ead-443c-82e8-a82ef8e47c22 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75245274c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:10.080692 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] Creating event network-vif-plugged:ebff8a76-2ce9-4994-9e40-85818dbcac6a for instance 546831d9-b44b-467a-aec0-ba5e688bf9df on n-h2-860864-13 Oct 28 17:32:10.100165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b3ba7e94-4e22-4c4d-ba26-d2f35bfa9785 req-a0ba9425-3006-4dc0-89f5-778c91a7861a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131568 Oct 28 17:32:10.101611 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 590/1090] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:32:10.111201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2006581641", "imageRef": "29513de9-1e7d-4cd5-b7b5-c8afa9a45263", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "47f11159-e3d2-4568-8e82-1160b0da1e22"}], "security_groups": [{"name": "tempest-securitygroup--233685796"}], "key_name": "tempest-keypair-227439975", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:10.140864 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a99a7762-5ead-443c-82e8-a82ef8e47c22 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.103818 Oct 28 17:32:10.144231 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 501/1091] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:10 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:10.381169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] validate_networks() for [('47f11159-e3d2-4568-8e82-1160b0da1e22', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:32:11.010584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:11.011909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:11.069735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:11.075013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:11.077817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:11.082490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:11.083097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:11.086100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:11.160391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:32:11.160867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:32:11.161274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:32:11.161675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:32:11.162080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:32:11.178208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:11.178793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:11.179235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:11.179997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:11.180454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:11.180869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:11.216234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:11.244665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Getting quotas for project c4744fa0a3c14442b1252b4349209b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:11.253232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Getting quotas for user 8817c763274745478f78228177c8d690 and project c4744fa0a3c14442b1252b4349209b6d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:11.258591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:11.270973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:32:11.274393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29513de9-1e7d-4cd5-b7b5-c8afa9a45263',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:32:11.362960 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a9e16143-a9f6-4a2d-8ec7-375cb67b5e8a tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.258108 Oct 28 17:32:11.369231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 591/1092] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:32:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:32:11.382607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9ed9c32b-2ddb-4079-8e63-1fdddaa8b298 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752425cca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:11.483324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9ed9c32b-2ddb-4079-8e63-1fdddaa8b298 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.110719 Oct 28 17:32:11.485871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 592/1093] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:11 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:11.498053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d933a65-bfca-4bcd-9ed6-325162acdf37 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:11.499189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7d933a65-bfca-4bcd-9ed6-325162acdf37 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:11.503023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:11.513641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91a33d7c-06e4-4b6f-919c-85237ee4a6b6 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1332 microversion: 2.1 time: 0.507643 Oct 28 17:32:11.533945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 502/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:11 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1332 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:11.693340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7d933a65-bfca-4bcd-9ed6-325162acdf37 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:11.701058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7d933a65-bfca-4bcd-9ed6-325162acdf37 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1245 microversion: 2.1 time: 0.211172 Oct 28 17:32:11.704794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 593/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:11 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1245 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:12.508626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3326f86e-c685-4e48-9b5b-29a2f19840fb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242f5310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:12.545923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:12.548050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:12.571527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:12.575802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:12.578395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:12.580331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:12.589747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:12.591110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:12.635585 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3326f86e-c685-4e48-9b5b-29a2f19840fb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.137491 Oct 28 17:32:12.636777 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 503/1096] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:12 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:12.729981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:12.731012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:12.743768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:12.747940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:12.748972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:12.752549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:12.753252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:12.753861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:13.368727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:13.386468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1ebdf2a-5dfc-41b8-afe9-5311c1ab55d1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1297 microversion: 2.1 time: 0.661780 Oct 28 17:32:13.389764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 504/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:12 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1297 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:13.508277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:13.521300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff1732cf-9a15-4cfb-9985-dad23e5c274e tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1537 microversion: 2.1 time: 0.983760 Oct 28 17:32:13.522303 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 594/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:12 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1537 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:13.549793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df73ca61-070e-4349-93a8-b7a57511c3b7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'create', calling method: .version_select at 0x7f7524cf7940>, body: {"pool": "f69034d8-b578-4aec-ab1c-b999c04b7776"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:13.652168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f7d963d-7caa-45db-8d31-3e91d887d7ba tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75241c1790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:13.723354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f7d963d-7caa-45db-8d31-3e91d887d7ba tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1452 microversion: 2.1 time: 0.075034 Oct 28 17:32:13.723983 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 595/1099] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:13 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:14.411832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:14.412823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:14.430428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:14.431041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:14.431581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:14.432324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:14.432792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:14.433248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:14.601674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:14.626565 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ca4e12b-3e48-4f74-935b-f8ab04aa8653 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1303 microversion: 2.1 time: 0.218687 Oct 28 17:32:14.628101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 596/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:14 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:14.739785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f8e7f0c-1767-454e-91e8-13e2b438fb4b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524232550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:16.425144 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df73ca61-070e-4349-93a8-b7a57511c3b7 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.879622 Oct 28 17:32:16.426393 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 505/1101] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:32:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:16.431980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:16.432882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:16.457384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:16.457864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:16.467752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:16.469030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:16.469668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:16.470269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:16.686257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:16.699921 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80c7c757-0686-45a3-9b3f-01e27c92f750 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1303 microversion: 2.1 time: 0.272147 Oct 28 17:32:16.701106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 506/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:16 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1303 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:16.723648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.74"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:16.727314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:16.749404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:16.750182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:16.750787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:16.753988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:16.754615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:16.755231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:16.841288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:32:16.841970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquired lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:32:17.608616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=24 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:20.109291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:32:21.215686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:21.540658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Updating instance_info_cache with network_info: [{"id": "ebff8a76-2ce9-4994-9e40-85818dbcac6a", "address": "fa:16:3e:4a:f0:b8", "network": {"id": "a21ca55f-dca1-4f3c-8ed6-ab9340767e1f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1914879966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "50f6085e85d3461ca542bda9b569e630", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapebff8a76-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:32:21.557364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Releasing lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:32:21.564066 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb3360a6-79a4-4960-9e8c-742bf9638cf3 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 202 len: 0 microversion: 2.1 time: 4.860191 Oct 28 17:32:21.564695 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 507/1103] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:16 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 0 bytes in 4863 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:32:21.593464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:21.598275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:21.633726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:21.635966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:21.636588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:21.640842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:21.642146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:21.649647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:21.701102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=32 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:22.796454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:22.817153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0df0630a-97c6-43c5-b3be-4799e03b6977 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 1.244482 Oct 28 17:32:22.821022 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 508/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:21 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:22.835100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546831d9-b44b-467a-aec0-ba5e688bf9df", "tag": "ebff8a76-2ce9-4994-9e40-85818dbcac6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:22.858007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:22.858501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:22.858929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:22.876393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] Creating event network-changed:ebff8a76-2ce9-4994-9e40-85818dbcac6a for instance 546831d9-b44b-467a-aec0-ba5e688bf9df on n-h2-860864-13 Oct 28 17:32:22.885982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1a975ab1-dc70-4c0b-88ef-097ada6d8e6a req-093038a6-ef6f-4da9-bae9-88fd69b910a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062666 Oct 28 17:32:22.886991 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 509/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:22.894781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddc7a9-f843-484c-8f6e-edf06a0343a7", "tag": "0442ef4e-ba83-4e6c-9702-ac9a43e96e32"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:22.908547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:22.909152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:22.909585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:22.929497 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] Creating event network-changed:0442ef4e-ba83-4e6c-9702-ac9a43e96e32 for instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 on n-h1-860864-13 Oct 28 17:32:22.939829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f94b6167-eaf5-4b9d-936f-6b0bac3d8509 req-447871da-0cc6-4c53-90b1-0b8796d3036a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050540 Oct 28 17:32:22.948862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 510/1106] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:22.981083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-630f277b-b179-4a72-8198-d0c8f7973222 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'create', calling method: .version_select at 0x7f75242f58b0>, body: {"pool": "f69034d8-b578-4aec-ab1c-b999c04b7776"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:24.431029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:24.622050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:27.305750 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f8e7f0c-1767-454e-91e8-13e2b438fb4b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1461 microversion: 2.1 time: 12.565357 Oct 28 17:32:27.309334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 597/1107] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:14 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1461 bytes in 12574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:27.329403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:27.332842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:27.365042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:27.367700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:27.370165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:27.378629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:27.382796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:27.383520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:28.126317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:28.143271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de430a2b-6268-4435-83f9-256f8fb28757 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.831092 Oct 28 17:32:28.144633 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 598/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:27 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:28.166470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82edbb03-cf8a-419d-9d24-32bd1b53283c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427a820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:28.215274 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-630f277b-b179-4a72-8198-d0c8f7973222 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.261369 Oct 28 17:32:28.216564 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 511/1109] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:32:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:28.230049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.52"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:28.232588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:28.257505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:28.261603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:28.263318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:28.264307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:28.266597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:28.269872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:28.271203 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82edbb03-cf8a-419d-9d24-32bd1b53283c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 200 len: 1461 microversion: 2.1 time: 0.122666 Oct 28 17:32:28.274894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 599/1110] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:28 2022] GET /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:28.291074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:28.292774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:28.312437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:28.313913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:28.314896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:28.315957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:28.317387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:28.318681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:28.381672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:32:28.382179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquired lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:32:29.050303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:29.063887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-67559246-1c6c-41c4-b532-363e30cadbc4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1467 microversion: 2.1 time: 0.777779 Oct 28 17:32:29.067140 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 600/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:28 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1467 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:29.106879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1385889405"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:29.120218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:29.134964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:29.135782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:29.138201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:29.138201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:29.138201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:29.138201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:29.805589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffd38bbc-d3f2-4da2-8af3-7d63c40c4a81 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "POST /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f/action" status: 202 len: 0 microversion: 2.1 time: 0.710806 Oct 28 17:32:29.814146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 601/1112] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:29 2022] POST /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:32:29.829470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:29.830846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:29.854671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:29.856350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:29.857178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:29.858130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:29.858766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:29.859357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:30.998618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:31.000843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776.", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:32:31.001442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Releasing lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:32:31.002155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.002155 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Request method failure captured: Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action HTTP/1.1 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 45 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIJXRSzM4MXd75ywD-JhTnqA-OUFXa35Ke8rjI0VkT0tD5LDmAivLGp3uGwlbMbQ-Zmg7snCpSY9XcYDseywtFc2mf_qaHRFEF9uyGplXFhEngZ0fIQDnEozqeeqae2L63ispALWx8iW0l0Dt5O1gmOZFZLlD906mPsfsXrRUVRhXE Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50f6085e85d3461ca542bda9b569e630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50f6085e85d3461ca542bda9b569e630"}]}] Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39f7bfc7459544c1ad4ccc2e76fdcd51 Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: {"addFloatingIp": {"address": "172.25.4.52"}} Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '546831d9-b44b-467a-aec0-ba5e688bf9df', 'body': {'addFloatingIp': {'address': '172.25.4.52'}}} Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:32:31.004828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] Oct 28 17:32:31.010474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:31.016518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Returning 400 to user: Cannot associate floating IP 172.25.4.52 (a00edb35-f9a5-4f02-ab08-a9422ee136d5) with port ebff8a76-2ce9-4994-9e40-85818dbcac6a using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f69034d8-b578-4aec-ab1c-b999c04b7776. Oct 28 17:32:31.016518 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-f269b5aa-a9f5-4649-a609-2f1eadaaa729'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:31.016518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b81cc56b-5307-4c0d-94c3-d50b0894beae tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 400 len: 381 microversion: 2.1 time: 2.786060 Oct 28 17:32:31.016518 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 512/1113] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:28 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 381 bytes in 2788 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:32:31.027807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bf05d21-3597-4bb0-887b-ac61769651f2 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 1.210124 Oct 28 17:32:31.028922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8db6600-4844-46b6-b85d-37112337aef3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752433e310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:31.029816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 602/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:29 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:31.043715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64fd0f5e-ea5c-455e-9821-699b86bc3b22 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '.version_select at 0x7f7524691040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:31.180835 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8db6600-4844-46b6-b85d-37112337aef3 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.165555 Oct 28 17:32:31.191281 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 513/1115] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:31 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:31.266442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58839f6-b2c7-4bea-a046-64be87262209", "name": "network-vif-unplugged", "status": "completed", "tag": "22a16875-db48-4f16-8bd0-765c054693cd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:31.286527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:31.291238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:31.295083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:31.324568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] Creating event network-vif-unplugged:22a16875-db48-4f16-8bd0-765c054693cd for instance b58839f6-b2c7-4bea-a046-64be87262209 on n-h1-860864-13 Oct 28 17:32:31.338813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c0b70a11-b9ac-4679-b899-7d4662106576 req-66af4cb6-d8af-4b89-9f5d-3ae5bd450bb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079538 Oct 28 17:32:31.341667 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 514/1116] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:32:31.853185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-782916568", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "6f58091a-dd3f-4769-a287-dcf2e8cd11d9"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:31.987706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] validate_networks() for [('6f58091a-dd3f-4769-a287-dcf2e8cd11d9', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:32:32.797059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:32:32.798270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:32:32.799161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:32:32.800413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:32:32.801198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:32:32.812478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:32.813289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:32.813917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:32.814844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:32.815538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:32.816161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:32.852152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Getting quotas for project 1e052dece9c84b8981684affb60fc467. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:32.858547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Getting quotas for user 5f060165c6564f4d9416ec665426a1c8 and project 1e052dece9c84b8981684affb60fc467. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:32.884598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:32:32.887587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:32:32.944925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64fd0f5e-ea5c-455e-9821-699b86bc3b22 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/a00edb35-f9a5-4f02-ab08-a9422ee136d5" status: 202 len: 0 microversion: 2.1 time: 1.913701 Oct 28 17:32:32.946935 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 603/1117] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:32:31 2022] DELETE /compute/v2.1/os-floating-ips/a00edb35-f9a5-4f02-ab08-a9422ee136d5 => generated 0 bytes in 1916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:32:32.953277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:32.954310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:32.954467 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd8517ff-d829-47cf-8470-a132ab1c1bcf tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344946 Oct 28 17:32:32.955352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 515/1118] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:32:32.961015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82ba87a4-6b91-4c7c-a46e-cd96eab5ee49 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242f50d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:32.964043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:32.964549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:32.964995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:32.965841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:32.968780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:32.969572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:33.022057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82ba87a4-6b91-4c7c-a46e-cd96eab5ee49 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.063221 Oct 28 17:32:33.031760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 516/1119] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:32 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:33.122296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1117664747", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "ce304769-837a-473e-831c-48d535b3ac0b"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:33.196060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] validate_networks() for [('ce304769-837a-473e-831c-48d535b3ac0b', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:32:33.370690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:33.382425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b7f1c03-9fa6-4ca4-869f-59cc8a0e3fba tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.433989 Oct 28 17:32:33.383009 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 604/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:32 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:33.398235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: .version_select at 0x7f752639d310>, body: {"removeFloatingIp": {"address": "172.25.4.74"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:33.692065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:33.699851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:33.700537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:33.701142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:33.708709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:33.711653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:33.712350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.065735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:32:34.066298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquired lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:32:34.073104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:32:34.073602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:32:34.074101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:32:34.074607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:32:34.075082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:32:34.084818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.085303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.085872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.086604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.087057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.087515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.108280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Getting quotas for project 997381eec6414c2c9d8abd45d38e09f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:32:34.113267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Getting quotas for user 8abef9f47be241a09deb20c3e8b6bc39 and project 997381eec6414c2c9d8abd45d38e09f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:32:34.126240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:32:34.128500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:32:34.178749 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2caa2070-806c-4048-a106-baee15c0315d tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145226 Oct 28 17:32:34.185348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 517/1121] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:32:34.185348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:34.185348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:34.191230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.191749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.192180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.192917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.193370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.193795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.290053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:34.307413 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8a6c4746-5766-49e7-86ad-96e1c28c5d27 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1267 microversion: 2.1 time: 0.126934 Oct 28 17:32:34.308500 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 518/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:34 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:34.314277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88b34678-3d99-4326-a9c3-fb859884e219 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242daee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:34.376761 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88b34678-3d99-4326-a9c3-fb859884e219 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.066920 Oct 28 17:32:34.377848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 519/1123] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:34 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:34.383771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a861d4bb-b365-4d28-8a1e-690b2c6e290a tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:34.384374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a861d4bb-b365-4d28-8a1e-690b2c6e290a tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:34.483259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a861d4bb-b365-4d28-8a1e-690b2c6e290a tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:34.493964 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a861d4bb-b365-4d28-8a1e-690b2c6e290a tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1225 microversion: 2.1 time: 0.114874 Oct 28 17:32:34.494726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 520/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:34 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:34.499265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:34.499967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:34.506209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.506696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.507134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.507888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:34.508344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:34.509358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:34.781079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:34.790488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df29eb4e-b61f-4076-9938-516deaaa4d77 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.294564 Oct 28 17:32:34.791592 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 521/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:34 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:34.971761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Building network info cache for instance {{(pid=120567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:32:34.981237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546831d9-b44b-467a-aec0-ba5e688bf9df", "tag": "ebff8a76-2ce9-4994-9e40-85818dbcac6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:34.998144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.003275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.003821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.024415 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] Creating event network-changed:ebff8a76-2ce9-4994-9e40-85818dbcac6a for instance 546831d9-b44b-467a-aec0-ba5e688bf9df on n-h2-860864-13 Oct 28 17:32:35.048569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-92a85be4-ca4a-44a0-af5a-1fb06ae64f8c req-e9be235d-595f-44dd-b0f6-5160d170e607 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058949 Oct 28 17:32:35.050164 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 522/1126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:35.331456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:35.332152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:35.365410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.366685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.367402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.368610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.369285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.369927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.516439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:35.555212 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-625e3858-6179-45a9-bc5d-59c371e39489 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1267 microversion: 2.1 time: 0.222847 Oct 28 17:32:35.560156 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 523/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:35 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:35.583031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-479ad06d-14c5-4bdf-93d1-5923b01e39bc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242da040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:35.685720 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-479ad06d-14c5-4bdf-93d1-5923b01e39bc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.123652 Oct 28 17:32:35.686654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 524/1128] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:35 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:35.691602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:35.698333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:35.704998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.705838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.706486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.707400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.708035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.709277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.856409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:35.881446 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f5612ed-9f59-4231-9a9d-dc8952c54492 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1229 microversion: 2.1 time: 0.191775 Oct 28 17:32:35.885904 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 525/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:35 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1229 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:35.901658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:35.902667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:35.912890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.914987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.915659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:35.917370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:35.918294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:35.919402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:36.260840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Updating instance_info_cache with network_info: [{"id": "ebff8a76-2ce9-4994-9e40-85818dbcac6a", "address": "fa:16:3e:4a:f0:b8", "network": {"id": "a21ca55f-dca1-4f3c-8ed6-ab9340767e1f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1914879966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "50f6085e85d3461ca542bda9b569e630", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapebff8a76-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:32:36.280620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Releasing lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:32:36.281504 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f8e5f8f-7b3f-4535-96fe-3d437f21fe4f tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 202 len: 0 microversion: 2.1 time: 2.894258 Oct 28 17:32:36.285422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 605/1130] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:33 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 0 bytes in 2896 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:32:36.293408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8bd74083-0e2d-41d5-ab1b-391aa2a50744 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '.version_select at 0x7f75244d14c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:36.424893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:36.436604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7247d854-7c66-40ef-882e-f14a4c39bb2f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.547266 Oct 28 17:32:36.453144 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 526/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:35 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:36.587425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:36.588608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:36.601519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:36.604127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:36.604975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:36.606012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:36.606684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:36.607417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:37.469888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:37.482530 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5ec3f3a-36db-42ca-b500-b99fc9ace534 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1267 microversion: 2.1 time: 0.902617 Oct 28 17:32:37.491948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 527/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:36 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1267 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:37.497387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-409e51af-f420-481c-bcd9-30f5c8ead84f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524cf7ee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:37.578303 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-409e51af-f420-481c-bcd9-30f5c8ead84f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.084985 Oct 28 17:32:37.581376 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 528/1133] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:37 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:37.587503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:37.588189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:37.595075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:37.595918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:37.596667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:37.597591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:37.598227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:37.599484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:37.805686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:37.815816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04a476fd-3a4f-463a-9feb-2e25a9235ef8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1277 microversion: 2.1 time: 0.233258 Oct 28 17:32:37.817167 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 529/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:37 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:37.825784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:37.829117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:37.838637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:37.841473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:37.842254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:37.843122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:37.851329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:37.852159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:37.853363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:37.879152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:37.904084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:32:38.053140 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-825dda3c-f764-4b3d-8a5f-50e950a68436 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 204 len: 0 microversion: 2.1 time: 0.230940 Oct 28 17:32:38.053994 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 530/1135] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:37 2022] DELETE /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:32:38.062718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.064421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.078495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.079612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.086729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.088875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.089902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.090576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.394084 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8bd74083-0e2d-41d5-ab1b-391aa2a50744 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/20e09336-e175-4e3c-9264-6bfe36737f0f" status: 202 len: 0 microversion: 2.1 time: 2.104134 Oct 28 17:32:38.394681 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 606/1136] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:32:36 2022] DELETE /compute/v2.1/os-floating-ips/20e09336-e175-4e3c-9264-6bfe36737f0f => generated 0 bytes in 2109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:32:38.412741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.413283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.421060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:38.421800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.424137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.425495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.426497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.427520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.428153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.429682 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53648afb-17ce-437a-8925-64fa4b097948 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.373892 Oct 28 17:32:38.433590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 531/1137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:38 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:38.438509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3901d65a-c127-4190-bd72-e96930cfd0d4 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3901d65a-c127-4190-bd72-e96930cfd0d4 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Request method failure captured: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action HTTP/1.1 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 34 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIJXRSzM4MXd75ywD-JhTnqA-OUFXa35Ke8rjI0VkT0tD5LDmAivLGp3uGwlbMbQ-Zmg7snCpSY9XcYDseywtFc2mf_qaHRFEF9uyGplXFhEngZ0fIQDnEozqeeqae2L63ispALWx8iW0l0Dt5O1gmOZFZLlD906mPsfsXrRUVRhXE Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50f6085e85d3461ca542bda9b569e630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50f6085e85d3461ca542bda9b569e630"}]}] Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39f7bfc7459544c1ad4ccc2e76fdcd51 Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: {"addFloatingIp": {"address": ""}} Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '546831d9-b44b-467a-aec0-ba5e688bf9df', 'body': {'addFloatingIp': {'address': ''}}} Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '' Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:32:38.443404 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.447496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3901d65a-c127-4190-bd72-e96930cfd0d4 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:38.450298 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3901d65a-c127-4190-bd72-e96930cfd0d4 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 400 len: 142 microversion: 2.1 time: 0.014011 Oct 28 17:32:38.459765 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 532/1138] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:38 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 142 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:32:38.467253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:38.469520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.488402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.489732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.491726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.492682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.493553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.495582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.566405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:32:38.566926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquired lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:32:38.734994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Releasing lock "refresh_cache-546831d9-b44b-467a-aec0-ba5e688bf9df" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:32:38.735632 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] HTTP exception thrown: floating IP not found Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Request method failure captured: Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action HTTP/1.1 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 41 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIJXRSzM4MXd75ywD-JhTnqA-OUFXa35Ke8rjI0VkT0tD5LDmAivLGp3uGwlbMbQ-Zmg7snCpSY9XcYDseywtFc2mf_qaHRFEF9uyGplXFhEngZ0fIQDnEozqeeqae2L63ispALWx8iW0l0Dt5O1gmOZFZLlD906mPsfsXrRUVRhXE Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50f6085e85d3461ca542bda9b569e630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50f6085e85d3461ca542bda9b569e630"}]}] Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39f7bfc7459544c1ad4ccc2e76fdcd51 Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: exception: floating IP not found Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '546831d9-b44b-467a-aec0-ba5e688bf9df', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 28 17:32:38.737424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Returning 404 to user: floating IP not found {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83147416-3dee-4057-a67f-9aa200610bdb tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 404 len: 67 microversion: 2.1 time: 0.275726 Oct 28 17:32:38.742255 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 533/1139] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:38 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 67 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:32:38.747485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.748171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:38.748314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.755241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.755241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.755750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.756531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.757053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.757546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.758429 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44394705-5ad8-426d-99e7-b9b7c039c44c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1711 microversion: 2.1 time: 0.356490 Oct 28 17:32:38.759278 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 607/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:38 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1711 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:38.764180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-plugged", "status": "completed", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:38.775076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.775959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.776559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.792239 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] Creating event network-vif-plugged:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:32:38.797711 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6608dd20-cee1-4cbb-a5e4-0fbadd77114f req-1ee13899-3759-41a0-8378-688601486caa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Oct 28 17:32:38.798626 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 608/1141] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:38.804465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b59b6cd-9505-4d21-b94f-49bbd087596d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524228940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.865784 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b59b6cd-9505-4d21-b94f-49bbd087596d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.065920 Oct 28 17:32:38.866377 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 609/1142] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:38 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:38.871088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a2a8105-4e88-4a5e-9058-b7934ad19695 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:38.921050 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9a2a8105-4e88-4a5e-9058-b7934ad19695 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a2a8105-4e88-4a5e-9058-b7934ad19695 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Request method failure captured: Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action HTTP/1.1 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 44 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIJXRSzM4MXd75ywD-JhTnqA-OUFXa35Ke8rjI0VkT0tD5LDmAivLGp3uGwlbMbQ-Zmg7snCpSY9XcYDseywtFc2mf_qaHRFEF9uyGplXFhEngZ0fIQDnEozqeeqae2L63ispALWx8iW0l0Dt5O1gmOZFZLlD906mPsfsXrRUVRhXE Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50f6085e85d3461ca542bda9b569e630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50f6085e85d3461ca542bda9b569e630"}]}] Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39f7bfc7459544c1ad4ccc2e76fdcd51 Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: exception: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '546831d9-b44b-467a-aec0-ba5e688bf9df', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 28 17:32:38.923003 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a2a8105-4e88-4a5e-9058-b7934ad19695 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a2a8105-4e88-4a5e-9058-b7934ad19695 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action" status: 404 len: 88 microversion: 2.1 time: 0.057926 Oct 28 17:32:38.928182 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 610/1143] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:32:38 2022] POST /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df/action => generated 88 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:38.935200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.936043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.942742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.943549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.944080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.944864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.945536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.946033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.951581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:38.960090 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6047e4da-a154-4218-a58a-e4affbbe1013 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.218362 Oct 28 17:32:38.960659 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 534/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:38 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:38.966612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:38.967419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:38.973980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.974731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.975414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:38.976463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:38.977001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:38.977490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.012644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:32:39.021678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:39.030300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7665897a-cc5b-4133-8230-0eb2a696b0a9 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1283 microversion: 2.1 time: 0.100022 Oct 28 17:32:39.031386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 611/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:38 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:39.117245 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f9b542ce-163a-4951-b9e2-7d8dcda88f4d tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "DELETE /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 204 len: 0 microversion: 2.1 time: 0.154905 Oct 28 17:32:39.118379 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 535/1146] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:38 2022] DELETE /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:32:39.126152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:39.127177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:39.135428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.135997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.136517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.137293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.137805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.138241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.360761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:39.371520 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98c0a3ed-4f54-477c-99dd-38a7a7379ab0 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1543 microversion: 2.1 time: 0.249150 Oct 28 17:32:39.372114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 612/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:39 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1543 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:39.461490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:39.462805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:39.471628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.472052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.472489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.473261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.474228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.475000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.627392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:39.635294 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-083b818c-aa36-446f-906b-2df09113f46e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.182707 Oct 28 17:32:39.635948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 536/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:39 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:39.782251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:39.783034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:39.789606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.790098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.790538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.791239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.791726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.792154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.883108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10fa1e44-3a92-40d7-a7f7-7600279507cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75248894c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:39.951200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:39.952859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10fa1e44-3a92-40d7-a7f7-7600279507cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.074798 Oct 28 17:32:39.953455 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 537/1149] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:39 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:39.960591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40ea3606-60c8-4f25-bdea-77bd4e9e3b50 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1711 microversion: 2.1 time: 0.182200 Oct 28 17:32:39.966014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ced120d-9550-4505-8a20-7eae75bdabe2", "tag": "a9f38323-0d39-4d63-9961-c4b194ad84b5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:39.977962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 613/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:39 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1711 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:39.979360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.980025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.980532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.985039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:39.985862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:39.993234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.993902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.994385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] Creating event network-changed:a9f38323-0d39-4d63-9961-c4b194ad84b5 for instance 4ced120d-9550-4505-8a20-7eae75bdabe2 on n-h1-860864-13 Oct 28 17:32:39.994709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.995624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:39.996229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:39.996812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:39.999396 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-03561e1d-393e-466d-851d-78a14f17f6de req-56828a27-259e-4f33-90d6-a18e1fdd5cf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041777 Oct 28 17:32:40.000519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 538/1151] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:40.058294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.059189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:40.067566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.068434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.069127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.070864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.071411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.072052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.188863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:40.198036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-080b3845-1121-446a-8b06-88e6d8c59328 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.216720 Oct 28 17:32:40.203758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 614/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:39 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:40.237294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:40.245385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f3903f3-a380-4739-bcf1-5c5c623e70c4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.194435 Oct 28 17:32:40.246051 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 539/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:40.401902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.402513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:40.408473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.408955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.409390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.410117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.410761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.411826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.542437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:40.550780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f3951e7-969e-405e-b716-19a7154c0230 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1543 microversion: 2.1 time: 0.152826 Oct 28 17:32:40.551513 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 615/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1543 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:40.658117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.658728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:40.665211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.665696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.666159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.666850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.667303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.667758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.744308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.744893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:40.750827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.751310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.751773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.752471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.752926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.753349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.808612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:40.816474 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0eb292b-cc87-4c94-b1ff-ba587a62f2e6 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.162292 Oct 28 17:32:40.817789 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 540/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:40.821997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ddc7a9-f843-484c-8f6e-edf06a0343a7", "name": "network-vif-plugged", "status": "completed", "tag": "0442ef4e-ba83-4e6c-9702-ac9a43e96e32"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:40.831469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.832021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.832523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.845435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] Creating event network-vif-plugged:0442ef4e-ba83-4e6c-9702-ac9a43e96e32 for instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 on n-h1-860864-13 Oct 28 17:32:40.851110 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6df8b576-9027-483e-85c3-b9ac3edddd85 req-c3ccdff8-b754-4e0f-a450-407aa17d1b32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Oct 28 17:32:40.851738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 541/1156] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:40.892541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:32:40.906363 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b5ed4f1-3448-48a6-9ef2-85ac2e37b782 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 2348 microversion: 2.25 time: 0.165821 Oct 28 17:32:40.906932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 616/1157] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 2348 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:32:40.931723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.935263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.935784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.936216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.936936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.937384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.937803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.962126 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b18c18e-762b-4862-99aa-2813df9edb52 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.035084 Oct 28 17:32:40.962724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 542/1158] 10.222.0.48 () {60 vars in 1217 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:32:40.969627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08d54a0e-3017-46ff-a530-fd363d8662b0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427aee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.984511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:40.985352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:40.993726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.994525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.995354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:40.996445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:40.997148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:40.997826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.014623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08d54a0e-3017-46ff-a530-fd363d8662b0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.048685 Oct 28 17:32:41.020980 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 617/1159] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:41.222111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:41.223065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:41.230057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.230671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.231403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.232230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.232800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.233321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.242155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:41.250409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17cc2147-cc0a-4fd6-8733-3a02cd792196 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1711 microversion: 2.1 time: 0.269680 Oct 28 17:32:41.251510 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 543/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:40 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1711 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:41.268717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:41.269319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:41.277500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.277834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.278462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.279159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.279812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.280392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.735455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:41.740200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:41.746817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-624d8146-df65-4599-94c2-62e5511f75fd tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.529508 Oct 28 17:32:41.747411 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 618/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:41 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:41.752970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:41.754529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:41.766714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:41.778987 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efd2eee5-27fd-4e77-a4aa-fc80591c9a20 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.514389 Oct 28 17:32:41.779686 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 544/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:41 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:41.782195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.782638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.783080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.783821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.784276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.784700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.840764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:41.841480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:41.855984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.857406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.857930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:41.858917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:41.860805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:41.861311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.014023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f7bfc7459544c1ad4ccc2e76fdcd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f6085e85d3461ca542bda9b569e630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:42.033951 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e37f24f-7fdb-4b88-8f7c-2ad7d8369ce5 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 200 len: 1501 microversion: 2.1 time: 0.274236 Oct 28 17:32:42.034803 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 619/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:41 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:42.040458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48e90d3-4cb7-4b5e-8af4-878f5b26caae", "tag": "aee1f7a5-5358-4a7a-b827-c3de6ba07b3c"}, {"server_uuid": "546831d9-b44b-467a-aec0-ba5e688bf9df", "name": "network-vif-deleted", "tag": "ebff8a76-2ce9-4994-9e40-85818dbcac6a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:42.078355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.078845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.079536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.124340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Creating event network-changed:aee1f7a5-5358-4a7a-b827-c3de6ba07b3c for instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae on n-h1-860864-13 Oct 28 17:32:42.124340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] Creating event network-vif-deleted:ebff8a76-2ce9-4994-9e40-85818dbcac6a for instance 546831d9-b44b-467a-aec0-ba5e688bf9df on n-h2-860864-13 Oct 28 17:32:42.144057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6bfaf41f-67a5-4ba7-bc52-761b924dba8a req-1064f5ed-10e5-4470-8405-5d2165682d35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107395 Oct 28 17:32:42.148146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 620/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:42.162419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ad123e8-e234-4d65-b5cd-bd46be76cbfc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242149d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:42.273437 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ad123e8-e234-4d65-b5cd-bd46be76cbfc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.123346 Oct 28 17:32:42.274561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 621/1165] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:42 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:42.281088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:42.282054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:42.304096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.306344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.308108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.312524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.313215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.315612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.322782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:42.333823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f875dd6e-8690-461c-a6e3-14d94d37621b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 0.495539 Oct 28 17:32:42.334611 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 545/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:41 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:42.611295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:42.625702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffea5ff4-8383-4667-bf04-0b7ce4701ca2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1711 microversion: 2.1 time: 0.349837 Oct 28 17:32:42.626920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 622/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:42 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1711 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:42.774212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:42.776108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:42.791011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.794034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.795524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.796873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.798870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.801493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.808077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:42.808823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:42.820264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.821616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.822826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:42.825981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:42.827926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:42.830300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.363158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:43.377513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-640fccb6-2ec9-4821-8e75-e8132c1cfe84 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.608918 Oct 28 17:32:43.378835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 546/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:42 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:43.385163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:43.386408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] [instance: 546831d9-b44b-467a-aec0-ba5e688bf9df] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:43.412332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.413712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.414365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.416410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.420149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.420873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.456071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] HTTP exception thrown: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Request method failure captured: Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df HTTP/1.1 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIJXRSzM4MXd75ywD-JhTnqA-OUFXa35Ke8rjI0VkT0tD5LDmAivLGp3uGwlbMbQ-Zmg7snCpSY9XcYDseywtFc2mf_qaHRFEF9uyGplXFhEngZ0fIQDnEozqeeqae2L63ispALWx8iW0l0Dt5O1gmOZFZLlD906mPsfsXrRUVRhXE Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50f6085e85d3461ca542bda9b569e630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50f6085e85d3461ca542bda9b569e630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50f6085e85d3461ca542bda9b569e630"}]}] Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 50f6085e85d3461ca542bda9b569e630 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39f7bfc7459544c1ad4ccc2e76fdcd51 Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '546831d9-b44b-467a-aec0-ba5e688bf9df'} Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. Oct 28 17:32:43.459936 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. Oct 28 17:32:43.464769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:43.467143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] Returning 404 to user: Instance 546831d9-b44b-467a-aec0-ba5e688bf9df could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:43.469015 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52fb804b-03c7-4417-af2a-a7cbbede3500 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548 tempest-FloatingIPsAssociationNegativeTestJSON-1175508548-project] 10.222.0.48 "GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df" status: 404 len: 111 microversion: 2.1 time: 0.087890 Oct 28 17:32:43.469788 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 547/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:43 2022] GET /compute/v2.1/servers/546831d9-b44b-467a-aec0-ba5e688bf9df => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:43.476005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c6b1344-491a-40fe-9453-0a1494b5fe36 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242d0c10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:43.546240 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c6b1344-491a-40fe-9453-0a1494b5fe36 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.074961 Oct 28 17:32:43.547133 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 548/1170] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:43 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:43.552936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:43.553809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:43.570633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.571463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.572080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.573184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.574368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.575197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.607857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:43.634880 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3d63b1a-7182-4e44-942b-0b4880c53321 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.830694 Oct 28 17:32:43.643088 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 623/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:42 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:43.661252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b8e01b-2af7-4d33-b84d-f6dcb6aa310a", "name": "network-vif-deleted", "tag": "8e3f85a3-9d29-4962-87ad-822376eb4367"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:43.662722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:43.695188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.699998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.704071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.731557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] Creating event network-vif-deleted:8e3f85a3-9d29-4962-87ad-822376eb4367 for instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a on n-h2-860864-13 Oct 28 17:32:43.745130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b0b7c05b-eada-4687-b5f8-78a8c3b06355 req-72b0ff0a-0cc8-4bd0-84fe-5cf524a44358 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100475 Oct 28 17:32:43.749496 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 624/1172] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:43.765980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:43.768516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:43.786541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.789947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.790623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.791601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.794438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.795611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.885338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:43.886139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:43.887877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:43.888537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lazy-loading 'fault' on Instance uuid 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:32:44.225767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e76f32ce7d84fde8a2fb8f7597e61a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0865660ba7474c9ad6405d63c64078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:44.247924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa83593c-43da-44e9-b1fc-c66b2d7e39ce tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 200 len: 1354 microversion: 2.1 time: 0.496669 Oct 28 17:32:44.270806 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 625/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:43 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 1354 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:44.409067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:44.412186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:44.428002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:44.432059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:44.433500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:44.436102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:44.438202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:44.439570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:44.488402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:44.852716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:44.861232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0650cf04-1f30-4a5b-bd1f-03409a0564ac tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1370 microversion: 2.1 time: 1.312732 Oct 28 17:32:44.861814 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 549/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:43 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1370 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:44.872367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebc50a8b-1f54-4070-a092-906ee0490c1f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524429ca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:44.944648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebc50a8b-1f54-4070-a092-906ee0490c1f tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.075127 Oct 28 17:32:44.947160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 550/1175] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:44 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:44.952421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:44.953196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:44.963498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:44.964331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:44.965157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:44.966059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:44.966825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:44.967632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.014292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:45.033992 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd12b8bb-b38a-4551-81b5-33f8b3c70506 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.632147 Oct 28 17:32:45.057730 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 626/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:44 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:45.175901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:45.201571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d13ba43-5f8e-4efe-99dc-01e842095cf8 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.252946 Oct 28 17:32:45.203453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51c36d8e-4079-4a45-96c4-3ecd2617a6a5", "device": "/dev/xvdb"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:45.209155 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 551/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:44 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:45.209740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:45.218038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.219192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.219887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.221091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.221770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.222418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.273727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:45.274630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:45.286712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.287222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.294838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.295678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.297162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.297400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.338434 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a HTTP/1.1 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '39b8e01b-2af7-4d33-b84d-f6dcb6aa310a'} Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.340159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:45.344995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-960ecfed-5e98-4024-addf-83f8aaaf35f3 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 404 len: 111 microversion: 2.1 time: 0.073496 Oct 28 17:32:45.347078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 552/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:45 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:45.352404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:45.352890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:45.363132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.363649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.364855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.365830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.368534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.369036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.392251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 HTTP/1.1 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2d1d9434-775e-4090-b961-5d01f144af52'} Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:45.393791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:45.398358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4b13745-b10f-4851-8334-2f5ff00fd956 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 404 len: 111 microversion: 2.1 time: 0.047086 Oct 28 17:32:45.400220 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 553/1179] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:45 2022] DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:45.409995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:45.410692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:45.428286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.428775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.429218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.430674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.431134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.432698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.481123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 HTTP/1.1 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2d1d9434-775e-4090-b961-5d01f144af52'} Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.488463 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbd68b5b-33e3-4574-bc47-2d8627478c23 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 404 len: 111 microversion: 2.1 time: 0.090213 Oct 28 17:32:45.495642 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 554/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:45 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:45.501035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4e9fd86-82dc-4b62-8416-de949525041c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '.version_select at 0x7f75245274c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:45.532483 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4e9fd86-82dc-4b62-8416-de949525041c tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065819665" status: 202 len: 0 microversion: 2.1 time: 0.034870 Oct 28 17:32:45.537472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 555/1181] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065819665 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:32:45.815602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb29d0d3-da47-4255-ba32-4b93a8930514 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.616178 Oct 28 17:32:45.823911 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 627/1182] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Oct 28 17:32:45 2022] POST /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:32:45.884047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:45.884666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:45.890923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.891441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.891887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.892610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:45.893058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:45.893483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:45.971199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-126ea7f8-f36f-4310-b000-40118ef520ff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524214c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:46.095083 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-126ea7f8-f36f-4310-b000-40118ef520ff tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.128165 Oct 28 17:32:46.106756 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 628/1183] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:45 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:46.113278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:46.114677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:46.122130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.122921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.123586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:46.124486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.125731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.126342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:46.665738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:46.674376 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b5760dc-6d3f-4310-b0cf-5c2cf006c941 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.566088 Oct 28 17:32:46.679290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 629/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:46 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:46.691683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:46.699304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:46.702507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:46.705380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f56c9e5f-a844-4aa7-8426-0a056a22e2bb tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1557 microversion: 2.1 time: 0.825739 Oct 28 17:32:46.709847 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 556/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:45 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1557 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:46.722468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.723227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.724225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:46.725486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.727036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.728575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:46.736012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:46.736813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:46.747871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.754136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.761547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:46.762581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:46.765934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:46.766392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.054096 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9196ae38-e37d-4e3b-885b-7c85d6500ffe tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.322273 Oct 28 17:32:47.055515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 557/1186] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:32:46 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:47.060920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10842ebb-6962-487a-b958-63818a09d225 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.119360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10842ebb-6962-487a-b958-63818a09d225 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1112582634" status: 202 len: 0 microversion: 2.1 time: 0.055322 Oct 28 17:32:47.120838 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 558/1187] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:32:47 2022] DELETE /compute/v2.1/flavors/1112582634 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:32:47.126490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-154b0e26-d7a8-4326-818e-b50d1ccd2fdc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427ef70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.268669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-154b0e26-d7a8-4326-818e-b50d1ccd2fdc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.146379 Oct 28 17:32:47.269989 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 559/1188] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:47.276972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20e375f5-6f5e-4d5d-9fcb-7e770b7473d3 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.346690 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20e375f5-6f5e-4d5d-9fcb-7e770b7473d3 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.074599 Oct 28 17:32:47.367853 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 560/1189] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:47.387917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e6ce668-4dd9-4e10-ba71-82e0c351a5f8 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.432080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:47.443049 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-988e11f7-1aa7-4d06-aaeb-f138c352ca53 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.762063 Oct 28 17:32:47.455585 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 630/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:46 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:47.465844 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e6ce668-4dd9-4e10-ba71-82e0c351a5f8 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1449392243" status: 202 len: 0 microversion: 2.1 time: 0.081652 Oct 28 17:32:47.466428 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 561/1191] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:32:47 2022] DELETE /compute/v2.1/flavors/1449392243 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:32:47.474939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c75545c-5230-4bc9-a400-30a0cd4ad163 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.574760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c75545c-5230-4bc9-a400-30a0cd4ad163 tempest-ServersWithSpecificFlavorTestJSON-371294809 tempest-ServersWithSpecificFlavorTestJSON-371294809-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103574 Oct 28 17:32:47.585331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 631/1192] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:47.618375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.619037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:47.637360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.638537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.639069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.653630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.655685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.656758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.691009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a HTTP/1.1 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '39b8e01b-2af7-4d33-b84d-f6dcb6aa310a'} Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:47.693977 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.699609 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.702794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.703046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:47.703544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:47.704352 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b829d1a9-9dca-4937-bea5-13b8c0edfe09 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 404 len: 111 microversion: 2.1 time: 0.091199 Oct 28 17:32:47.705407 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 562/1193] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:47 2022] DELETE /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:47.711572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ced120d-9550-4505-8a20-7eae75bdabe2", "name": "network-vif-plugged", "status": "completed", "tag": "a9f38323-0d39-4d63-9961-c4b194ad84b5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:47.717508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.721634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.722361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.723456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.723963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.724627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.724754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.725187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.726948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.740875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] Creating event network-vif-plugged:a9f38323-0d39-4d63-9961-c4b194ad84b5 for instance 4ced120d-9550-4505-8a20-7eae75bdabe2 on n-h1-860864-13 Oct 28 17:32:47.748483 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6af5c0a7-b3f4-43de-a02c-6b5d05dabc9c req-fb2315c1-3c26-4ee6-80a7-68d8fb3d997d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041182 Oct 28 17:32:47.749822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 563/1194] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:47.757020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.757937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:47.766177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.766875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.767528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.768396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.769020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.769640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.798479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a HTTP/1.1 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '39b8e01b-2af7-4d33-b84d-f6dcb6aa310a'} Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.804126 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.808332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 39b8e01b-2af7-4d33-b84d-f6dcb6aa310a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:47.809025 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b2fbb3d-5dc2-4af5-a402-517f6f0e4cf8 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a" status: 404 len: 111 microversion: 2.1 time: 0.057375 Oct 28 17:32:47.810436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 564/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/servers/39b8e01b-2af7-4d33-b84d-f6dcb6aa310a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:47.827595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.828248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:47.856227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.857881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.860548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.861791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.864865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.866208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.904233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 HTTP/1.1 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2d1d9434-775e-4090-b961-5d01f144af52'} Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:47.906855 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:47.911330 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df6e4f4a-8090-4b0a-9dad-919f7dbcf4c2 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 404 len: 111 microversion: 2.1 time: 0.092849 Oct 28 17:32:47.913776 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 565/1196] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:47 2022] DELETE /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:47.929557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:47.931702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] [instance: 2d1d9434-775e-4090-b961-5d01f144af52] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:47.949433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.950080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.951316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:47.952548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:47.967483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:47.973012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:48.015646 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] HTTP exception thrown: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Request method failure captured: Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 HTTP/1.1 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFSMgyVAaEoKFWm-o6ZulSsgSVuOgvO4uxvbkES2VOequTKwpvKJwkgf2XFsZCKZDDyBG10-b4TBT8EgwPB_cSIJnRfHZZBjQLH7OMJdoPLaaWgGr3vu5lYIb6weDpbN8oxYGXQGAD6SmP5e_nqKFtLgkIDwGg1YJi5xgEyKVKsZ-4 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e0865660ba7474c9ad6405d63c64078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e0865660ba7474c9ad6405d63c64078"}]}] Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e0865660ba7474c9ad6405d63c64078 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8e76f32ce7d84fde8a2fb8f7597e61a8 Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-698567724-project Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2d1d9434-775e-4090-b961-5d01f144af52'} Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:48.018468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] Returning 404 to user: Instance 2d1d9434-775e-4090-b961-5d01f144af52 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a23f6e23-b27f-4ca8-8ce0-d8422f06f998 tempest-ServersWithSpecificFlavorTestJSON-698567724 tempest-ServersWithSpecificFlavorTestJSON-698567724-project] 10.222.0.48 "GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52" status: 404 len: 111 microversion: 2.1 time: 0.104311 Oct 28 17:32:48.023141 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 566/1197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/servers/2d1d9434-775e-4090-b961-5d01f144af52 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:48.130289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:48.148883 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dfbcf30e-73ae-4972-b2e2-ec3e845f8164 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 0.450624 Oct 28 17:32:48.151091 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 632/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:47 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:48.285042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9484294-8f8a-4565-b20b-4cd6bad4778d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427ee50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:48.360844 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9484294-8f8a-4565-b20b-4cd6bad4778d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.079532 Oct 28 17:32:48.361779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 567/1199] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:48 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:48.470450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:48.472525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:48.486165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:48.487191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:48.487896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:48.490567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:48.492766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:48.494037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:48.939599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:48.951952 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63168667-912f-4501-995f-75595fca081e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.485601 Oct 28 17:32:48.952868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 633/1200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:48 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:49.175029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:49.175877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:49.197711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:49.209440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:49.209907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:49.221194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:49.222011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:49.222624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:49.395414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb837754-1846-4ba7-959e-718397e984c7 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524137f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:49.492447 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb837754-1846-4ba7-959e-718397e984c7 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.118985 Oct 28 17:32:49.501428 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 634/1201] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:49 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:49.981621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:49.982638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:49.997757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:49.998544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:49.999139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:50.000761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:50.001418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:50.002000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:50.507430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:50.523035 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0338880f-d24f-4ebb-bab4-d9435c1945eb tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1315 microversion: 2.1 time: 1.352581 Oct 28 17:32:50.532119 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 568/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:49 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:50.543953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10ed1c0a-8df4-452c-90d0-7b3e0a5c6f15 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242daee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:50.595344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:50.610553 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa809022-21c2-45f9-b706-27cfdf963cc5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.631834 Oct 28 17:32:50.611223 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 635/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:49 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:50.651666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10ed1c0a-8df4-452c-90d0-7b3e0a5c6f15 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.118294 Oct 28 17:32:50.653177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 569/1204] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:50 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:51.549749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:51.550610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:51.567817 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 17:32:51.568310 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 17:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 (ip 10.222.0.48) !!! Oct 28 17:32:51.604720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:51.606453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:51.608251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:51.609385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:51.612498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:51.613280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:51.635319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:51.636298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:51.640441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:51.669073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:51.669633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:51.670077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:51.673305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:51.677285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:51.677931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.212362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:52.223110 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d7074cb-55bc-4d31-a1aa-bd8fe31db890 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.590934 Oct 28 17:32:52.226736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 570/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:51 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:52.237060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f9121fc-9f9c-4968-b89b-e0419bdc7682 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242daaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:52.325189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f9121fc-9f9c-4968-b89b-e0419bdc7682 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.096784 Oct 28 17:32:52.325873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 571/1206] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:52 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:52.345697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48e90d3-4cb7-4b5e-8af4-878f5b26caae", "name": "network-vif-plugged", "status": "completed", "tag": "aee1f7a5-5358-4a7a-b827-c3de6ba07b3c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:52.371891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.371891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.372155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.398436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:52.404044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] Creating event network-vif-plugged:aee1f7a5-5358-4a7a-b827-c3de6ba07b3c for instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae on n-h1-860864-13 Oct 28 17:32:52.411985 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07f51c99-9a24-4642-9404-5fd364d6f868 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1502 microversion: 2.1 time: 0.865115 Oct 28 17:32:52.412316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 636/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:51 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1502 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:52.424170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ddc7a9-f843-484c-8f6e-edf06a0343a7", "tag": "0442ef4e-ba83-4e6c-9702-ac9a43e96e32"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:52.434428 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-afeb8b30-5338-438f-bfce-0c8c2e30008f req-46b0f325-2e8b-413d-aa38-b514e29f8076 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104953 Oct 28 17:32:52.437048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 572/1208] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:52.457323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.459419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.463686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.464008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:52.464800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:52.482122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.484371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.486739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.489467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.490610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.491221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.497792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] Creating event network-changed:0442ef4e-ba83-4e6c-9702-ac9a43e96e32 for instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 on n-h1-860864-13 Oct 28 17:32:52.515654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2b07a2dc-2908-46f8-bf5f-f4ef5839b232 req-07e71619-883f-4afa-ae8d-4dfe086ebb01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101007 Oct 28 17:32:52.516910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 637/1209] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:52.556508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:32:52.758603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:52.765608 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3bff6616-2ac6-426e-8113-db4903a66b7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 204 len: 0 microversion: 2.1 time: 0.324717 Oct 28 17:32:52.770691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 573/1210] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:52 2022] DELETE /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:32:52.776532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:52.777238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:52.791880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.792366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.793059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:52.794719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:52.799670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:52.800401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:53.255338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:53.256775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:53.274905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:53.278746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:53.279540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:53.288191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:53.291033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:53.291553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:53.669299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:53.679698 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ba180ed-5a52-449c-aca2-b964293e1854 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1508 microversion: 2.1 time: 0.907365 Oct 28 17:32:53.689683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 638/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:52 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1508 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:53.706803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8fc28356-6144-499e-bc09-3f51de06664b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75240fb3a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:53.806361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8fc28356-6144-499e-bc09-3f51de06664b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.115519 Oct 28 17:32:53.807715 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 639/1212] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:53 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:54.191247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:54.201523 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ca52fd9-c2ba-482c-ab3d-99c4f6792b6c tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.951875 Oct 28 17:32:54.221618 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 574/1213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:53 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:54.712092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:54.712718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:54.714807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=67 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:54.733208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:54.733707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:54.734147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:54.740271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:54.744894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:54.745665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:54.823458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9de86b98-3f4e-45bd-8667-63e4b021dfef tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242c7d30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:54.916775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9de86b98-3f4e-45bd-8667-63e4b021dfef tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.097978 Oct 28 17:32:54.917518 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 575/1214] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:54 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:55.186596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:55.189095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:55.207852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc6b429c-98bc-4635-94dd-8a869a740af1 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1508 microversion: 2.1 time: 0.493331 Oct 28 17:32:55.209098 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 640/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:54 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:55.237452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:55.238098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:55.250866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:55.251675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:55.267319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:55.268632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:55.275922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:55.278557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:55.900684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:55.908875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0d8ba95-5cb3-4217-b9ff-b5ee4324f288 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1325 microversion: 2.1 time: 0.680752 Oct 28 17:32:55.914248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 576/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:55 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:55.937163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abd05f09-7623-4e74-bc26-16749acb2c04 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75241be040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:56.023355 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abd05f09-7623-4e74-bc26-16749acb2c04 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.091558 Oct 28 17:32:56.023959 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 641/1217] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:55 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:56.245570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:56.247226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:56.260099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:56.262291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:56.264218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:56.275791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:56.276781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:56.277475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:56.457066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:56.472675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5ac6a4b2-13f9-4c08-9486-2d56e719bf87 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1466 microversion: 2.1 time: 0.231515 Oct 28 17:32:56.473600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 577/1218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:56 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1466 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:56.942339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:56.946804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:56.961099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:56.961849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:56.962459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:56.966040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:56.967282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:56.968052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:56.969312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ced120d-9550-4505-8a20-7eae75bdabe2", "name": "network-vif-deleted", "tag": "a9f38323-0d39-4d63-9961-c4b194ad84b5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:57.003964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.006750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.008265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:57.063117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] Creating event network-vif-deleted:a9f38323-0d39-4d63-9961-c4b194ad84b5 for instance 4ced120d-9550-4505-8a20-7eae75bdabe2 on n-h1-860864-13 Oct 28 17:32:57.077606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-acf9fb71-e60a-4dc2-b4ff-ccdd0bb27bc7 req-2bf6d713-55d4-4be6-b1eb-85286569f1dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115683 Oct 28 17:32:57.078531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 578/1219] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:32:57.084100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03406585-9bcd-4092-aca1-faa9e6e22157 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242dfc10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:57.222708 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03406585-9bcd-4092-aca1-faa9e6e22157 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.142596 Oct 28 17:32:57.224098 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 579/1220] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:57 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:57.496528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:57.498238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:57.511105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.513216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.513916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:57.515001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.516080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.516712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:57.589093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.589750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.590193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:57.590650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lazy-loading 'fault' on Instance uuid 4ced120d-9550-4505-8a20-7eae75bdabe2 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:32:57.741818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f060165c6564f4d9416ec665426a1c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e052dece9c84b8981684affb60fc467', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:57.750439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9838675c-0766-487a-8ef6-97d6670182cc tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 200 len: 1305 microversion: 2.1 time: 0.257672 Oct 28 17:32:57.768344 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 580/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:57 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:57.854228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:57.869288 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6bdd339-6094-47e9-ab83-e8e490581d10 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1523 microversion: 2.1 time: 0.931651 Oct 28 17:32:57.893239 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 642/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:56 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1523 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:57.908374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:57.916810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:57.938032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.938855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.939736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:57.944161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:57.945445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:57.945942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.005598 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] HTTP exception thrown: Action 999 not found Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Request method failure captured: Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae/os-instance-actions/999 HTTP/1.1 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIw6Hjw39Jjwl-Mfm1Pku_Cf-LlCrgE30VYMr8giyoNrIOiunprqXH96-8wAf1Q0Ph40wN908PbkUhsX0m_war8Ukl6V9s5fCiHw8cgGIHsH118y5H9Aq_NdZFbgBRcrMU7G2h678SMluIKBSPL51O_Q0Fp3m-4H6c7XXeDIcp7RZo Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/997381eec6414c2c9d8abd45d38e09f9"}]}] Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8abef9f47be241a09deb20c3e8b6bc39 Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: exception: Action 999 not found Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': 'e48e90d3-4cb7-4b5e-8af4-878f5b26caae', 'id': '999'} Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 28 17:32:58.010009 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.016967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Returning 404 to user: Action 999 not found {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:58.017944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f705be3a-724a-4d09-b966-ea41c8938d3e tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.125715 Oct 28 17:32:58.018791 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 581/1223] 10.222.0.48 () {58 vars in 1308 bytes} [Fri Oct 28 17:32:57 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:58.030664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '.version_select at 0x7f75240fc430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:58.032031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: 9884a9e9-a367-45a4-8a59-b985d9b69850] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:58.040571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] HTTP exception thrown: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Request method failure captured: Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/9884a9e9-a367-45a4-8a59-b985d9b69850/os-instance-actions HTTP/1.1 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIw6Hjw39Jjwl-Mfm1Pku_Cf-LlCrgE30VYMr8giyoNrIOiunprqXH96-8wAf1Q0Ph40wN908PbkUhsX0m_war8Ukl6V9s5fCiHw8cgGIHsH118y5H9Aq_NdZFbgBRcrMU7G2h678SMluIKBSPL51O_Q0Fp3m-4H6c7XXeDIcp7RZo Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/997381eec6414c2c9d8abd45d38e09f9"}]}] Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8abef9f47be241a09deb20c3e8b6bc39 Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': '9884a9e9-a367-45a4-8a59-b985d9b69850'} Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:58.042982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. Oct 28 17:32:58.047061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.053095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Returning 404 to user: Instance 9884a9e9-a367-45a4-8a59-b985d9b69850 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:58.054482 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92b7ea6f-d59c-43c4-a27e-a24d63ea8af5 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/9884a9e9-a367-45a4-8a59-b985d9b69850/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029243 Oct 28 17:32:58.055456 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 643/1224] 10.222.0.48 () {58 vars in 1296 bytes} [Fri Oct 28 17:32:58 2022] GET /compute/v2.1/servers/9884a9e9-a367-45a4-8a59-b985d9b69850/os-instance-actions => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:58.069397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:58.070727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:58.079191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.080122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.080792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.081717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.083321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.084006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.089851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:32:58.164518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:32:58.241345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35d82dd1-5d95-49be-b06a-f5c0650b249d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524125af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:58.321517 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35d82dd1-5d95-49be-b06a-f5c0650b249d tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.086601 Oct 28 17:32:58.338901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 644/1225] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:58 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:32:58.362144 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3cb4329-0ebe-44a3-9954-18d6e2c21708 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 204 len: 0 microversion: 2.1 time: 0.300110 Oct 28 17:32:58.364633 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 582/1226] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:58 2022] DELETE /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:32:58.374187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:58.374805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:58.385600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.386275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.386715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.387978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.388437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.389075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.616705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:58.631604 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1aacd21d-2044-4c5e-baf3-a8441fe922bb tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1529 microversion: 2.1 time: 0.259557 Oct 28 17:32:58.632632 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 645/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:58 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1529 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:58.780468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:58.781087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:58.792551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.793066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.793503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.794225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.794675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.795100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.857673 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 HTTP/1.1 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4ced120d-9550-4505-8a20-7eae75bdabe2'} Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.864445 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.869657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.871934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:58.879676 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e45b57b1-bb2e-47fd-896a-d75496a56646 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 404 len: 111 microversion: 2.1 time: 0.102823 Oct 28 17:32:58.881264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 583/1228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:58 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:58.891704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1598861637", "metadata": {"image_type": "test"}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:58.895411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:58.914266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.917056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.917867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.921625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:58.924450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:58.925294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:58.961498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2/action HTTP/1.1 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 112 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1598861637", "metadata": {"image_type": "test"}}} Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '4ced120d-9550-4505-8a20-7eae75bdabe2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1598861637', 'metadata': {'image_type': 'test'}}}} Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 17:32:58.964714 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:58.969860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:58.980382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:58.981839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b608a9b-2604-4a3b-aa81-fb0efbc06c19 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "POST /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2/action" status: 404 len: 111 microversion: 2.1 time: 0.095793 Oct 28 17:32:58.983140 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 646/1229] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Oct 28 17:32:58 2022] POST /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2/action => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:58.994375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-408717618", "metadata": {"image_type": "test"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:58.997038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Failed to fetch instance by id tempest-invalid-1039084079 {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:32:58.997551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance tempest-invalid-1039084079 could not be found. Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/tempest-invalid-1039084079/action HTTP/1.1 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 111 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-408717618", "metadata": {"image_type": "test"}}} Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance tempest-invalid-1039084079 could not be found. Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'tempest-invalid-1039084079', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-408717618', 'metadata': {'image_type': 'test'}}}} Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1039084079 could not be found. Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:59.002117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1039084079 could not be found. Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1039084079 could not be found. Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance tempest-invalid-1039084079 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af5de601-a42e-4447-a810-206c2735cf1c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "POST /compute/v2.1/servers/tempest-invalid-1039084079/action" status: 404 len: 101 microversion: 2.1 time: 0.013323 Oct 28 17:32:59.006925 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 584/1230] 10.222.0.48 () {60 vars in 1249 bytes} [Fri Oct 28 17:32:58 2022] POST /compute/v2.1/servers/tempest-invalid-1039084079/action => generated 101 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:32:59.017758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-476756827"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:59.024213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:32:59.024739 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 56 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: {"createImage": {"name": "tempest-test-snap-476756827"}} Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-476756827'}}} Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.028296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.033757 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e1040c3-c8fc-443b-9dff-ad41be162f73 tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.016069 Oct 28 17:32:59.041123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1509336465"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:59.045247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:32:59.045752 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 57 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: {"createImage": {"name": "tempest-test-snap-1509336465"}} Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1509336465'}}} Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.047712 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.053300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.054296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0a1faf9-bead-4d50-95e7-1286b4e76d7c tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017507 Oct 28 17:32:59.054296 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 585/1232] 10.222.0.48 () {60 vars in 1281 bytes} [Fri Oct 28 17:32:59 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:59.054451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 647/1232] 10.222.0.48 () {60 vars in 1275 bytes} [Fri Oct 28 17:32:59 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:59.076439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.077049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:59.092673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.093850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.096271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.098820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.102344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.102344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.137726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 HTTP/1.1 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4ced120d-9550-4505-8a20-7eae75bdabe2'} Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:59.141851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.146071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23d3ecc4-5b60-4a00-aac9-3cd16352db7e tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 404 len: 111 microversion: 2.1 time: 0.082119 Oct 28 17:32:59.149909 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 586/1233] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:32:59 2022] DELETE /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:32:59.156035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.156666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] [instance: 4ced120d-9550-4505-8a20-7eae75bdabe2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:59.169662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.170032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.170474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.171173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.171665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.172118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.188770 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] HTTP exception thrown: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Request method failure captured: Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 HTTP/1.1 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIvfuyQdoxZYIRpZoGV-ji_KtvltCFStTleqUAWZC14bnPv3eXE4pr5-YDZL0oOUf5vyCaFuKfAirUKI_tKEx5C3b3it6myzLB_vtS5Rozqhjg3KWgJC_uzMvMcXUgTWRmoCN4REhwU1s9_aNzRBbXr5avIpdAttm1WxofI186JVMs Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1e052dece9c84b8981684affb60fc467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1e052dece9c84b8981684affb60fc467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1e052dece9c84b8981684affb60fc467"}]}] Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1e052dece9c84b8981684affb60fc467 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1931076074 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5f060165c6564f4d9416ec665426a1c8 Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesNegativeTestJSON-1931076074-project Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '4ced120d-9550-4505-8a20-7eae75bdabe2'} Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.190294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] Returning 404 to user: Instance 4ced120d-9550-4505-8a20-7eae75bdabe2 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.194915 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ce17696c-c9f9-4b59-b38b-5ca8c8fdf67f tempest-ImagesNegativeTestJSON-1931076074 tempest-ImagesNegativeTestJSON-1931076074-project] 10.222.0.48 "GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2" status: 404 len: 111 microversion: 2.1 time: 0.040728 Oct 28 17:32:59.196448 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 648/1234] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:59 2022] GET /compute/v2.1/servers/4ced120d-9550-4505-8a20-7eae75bdabe2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:32:59.359076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1f2579c-2446-4f32-8a84-778aff34c198 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752412aa60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.418887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1f2579c-2446-4f32-8a84-778aff34c198 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.068806 Oct 28 17:32:59.420132 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 649/1235] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:32:59 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:32:59.566510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd1af012-9c0a-45c4-94e5-abc571458c0d tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Calling method '.version_select at 0x7f752438ddc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.600963 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-bd1af012-9c0a-45c4-94e5-abc571458c0d tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd1af012-9c0a-45c4-94e5-abc571458c0d tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/78d6775d-51ef-4fc8-bbe7-2ad2970080cd/metadata/os_distro HTTP/1.1 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'image_id': '78d6775d-51ef-4fc8-bbe7-2ad2970080cd', 'id': 'os_distro'} Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 78d6775d-51ef-4fc8-bbe7-2ad2970080cd Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.611448 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78d6775d-51ef-4fc8-bbe7-2ad2970080cd could not be found. Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.617202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd1af012-9c0a-45c4-94e5-abc571458c0d tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.620696 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd1af012-9c0a-45c4-94e5-abc571458c0d tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "DELETE /compute/v2.1/images/78d6775d-51ef-4fc8-bbe7-2ad2970080cd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.330760 Oct 28 17:32:59.620696 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 587/1236] 10.222.0.48 () {58 vars in 1293 bytes} [Fri Oct 28 17:32:59 2022] DELETE /compute/v2.1/images/78d6775d-51ef-4fc8-bbe7-2ad2970080cd/metadata/os_distro => generated 62 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:59.629198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c47026-8cde-4fb7-8c6d-395a665d39f0 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Calling method '.version_select at 0x7f75241250d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.657198 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a2c47026-8cde-4fb7-8c6d-395a665d39f0 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c47026-8cde-4fb7-8c6d-395a665d39f0 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/images/769525d2-aec3-4959-ace4-18616efe02df/metadata/os_version HTTP/1.1 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'image_id': '769525d2-aec3-4959-ace4-18616efe02df', 'id': 'os_version'} Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 769525d2-aec3-4959-ace4-18616efe02df Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.659738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 769525d2-aec3-4959-ace4-18616efe02df could not be found. Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c47026-8cde-4fb7-8c6d-395a665d39f0 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.665882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2c47026-8cde-4fb7-8c6d-395a665d39f0 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "GET /compute/v2.1/images/769525d2-aec3-4959-ace4-18616efe02df/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.036871 Oct 28 17:32:59.678366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.678366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:32:59.678805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 650/1237] 10.222.0.48 () {58 vars in 1293 bytes} [Fri Oct 28 17:32:59 2022] GET /compute/v2.1/images/769525d2-aec3-4959-ace4-18616efe02df/metadata/os_version => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:59.684605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.685096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.685599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.686305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:32:59.687038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e235f159-c38e-4bb3-a328-0055d5db3d91 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Calling method '.version_select at 0x7f752412a430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:32:59.687158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:32:59.687557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:32:59.716060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e235f159-c38e-4bb3-a328-0055d5db3d91 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e235f159-c38e-4bb3-a328-0055d5db3d91 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/images/597d213e-1851-4979-8118-7ba7777525eb/metadata HTTP/1.1 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'image_id': '597d213e-1851-4979-8118-7ba7777525eb'} Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 597d213e-1851-4979-8118-7ba7777525eb Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.718399 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 597d213e-1851-4979-8118-7ba7777525eb could not be found. Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.722727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.730673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e235f159-c38e-4bb3-a328-0055d5db3d91 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.732271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e235f159-c38e-4bb3-a328-0055d5db3d91 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "GET /compute/v2.1/images/597d213e-1851-4979-8118-7ba7777525eb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062752 Oct 28 17:32:59.733358 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 651/1238] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:32:59 2022] GET /compute/v2.1/images/597d213e-1851-4979-8118-7ba7777525eb/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:59.744708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35b4a128-aa3c-457a-8d0b-0c1c65ced214 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Action: 'update_all', calling method: .version_select at 0x7f752412a040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:59.769433 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-35b4a128-aa3c-457a-8d0b-0c1c65ced214 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35b4a128-aa3c-457a-8d0b-0c1c65ced214 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/images/501d533a-ba40-403d-949d-e5f7cfd05498/metadata HTTP/1.1 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 57 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'image_id': '501d533a-ba40-403d-949d-e5f7cfd05498', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 501d533a-ba40-403d-949d-e5f7cfd05498 Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.771801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 501d533a-ba40-403d-949d-e5f7cfd05498 could not be found. Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.776688 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.783674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35b4a128-aa3c-457a-8d0b-0c1c65ced214 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.783674 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35b4a128-aa3c-457a-8d0b-0c1c65ced214 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "PUT /compute/v2.1/images/501d533a-ba40-403d-949d-e5f7cfd05498/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040685 Oct 28 17:32:59.783674 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 652/1239] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:32:59 2022] PUT /compute/v2.1/images/501d533a-ba40-403d-949d-e5f7cfd05498/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:32:59.792086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e01ca24-f165-4f51-97e5-c42bbd2c4853 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Action: 'update', calling method: .version_select at 0x7f7524125c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:59.819866 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7e01ca24-f165-4f51-97e5-c42bbd2c4853 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e01ca24-f165-4f51-97e5-c42bbd2c4853 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/images/1ae4c7f2-5551-4446-a72a-491a48266d1d/metadata/os_distro HTTP/1.1 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 30 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: {"meta": {"os_distro": "alt"}} Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'image_id': '1ae4c7f2-5551-4446-a72a-491a48266d1d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1ae4c7f2-5551-4446-a72a-491a48266d1d Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.822916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ae4c7f2-5551-4446-a72a-491a48266d1d could not be found. Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.827030 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.836216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e01ca24-f165-4f51-97e5-c42bbd2c4853 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.836216 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e01ca24-f165-4f51-97e5-c42bbd2c4853 tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "PUT /compute/v2.1/images/1ae4c7f2-5551-4446-a72a-491a48266d1d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048033 Oct 28 17:32:59.836955 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 653/1240] 10.222.0.48 () {60 vars in 1310 bytes} [Fri Oct 28 17:32:59 2022] PUT /compute/v2.1/images/1ae4c7f2-5551-4446-a72a-491a48266d1d/metadata/os_distro => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:59.845987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75ce6c28-2b31-44e8-9daa-400c78fed16a tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Action: 'create', calling method: .version_select at 0x7f752412a040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:32:59.872597 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-75ce6c28-2b31-44e8-9daa-400c78fed16a tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] HTTP exception thrown: Image not found. Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75ce6c28-2b31-44e8-9daa-400c78fed16a tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Request method failure captured: Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/images/aaf23b36-b74b-4017-9c39-c6f5faad8e56/metadata HTTP/1.1 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 57 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJLzPvqYFc_dioIvfvIT4x9rsjAr2A8PbuRQEVSn5NND74bQW7On4mCrT3ix3q3i8pC3KfJcV93-FjK2j4MnZljmTDYxAIDR3ohdgXoUiku-UAMhZOAvb5MQtW_eIeTyq3r-RVKl5OwNqzYnGxEf8R3AM8wnMjAxPZBJCAc7Aq-j7E Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bffb973f82984699a6ed0d5b4e79e83d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bffb973f82984699a6ed0d5b4e79e83d"}]}] Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: bffb973f82984699a6ed0d5b4e79e83d Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200478156 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fba3ea318ef644f3a645d84ead92e255 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200478156-project Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'image_id': 'aaf23b36-b74b-4017-9c39-c6f5faad8e56', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aaf23b36-b74b-4017-9c39-c6f5faad8e56 Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:32:59.874958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aaf23b36-b74b-4017-9c39-c6f5faad8e56 could not be found. Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:32:59.879036 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:32:59.888830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75ce6c28-2b31-44e8-9daa-400c78fed16a tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:32:59.890191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75ce6c28-2b31-44e8-9daa-400c78fed16a tempest-ImagesMetadataNegativeTestJSON-200478156 tempest-ImagesMetadataNegativeTestJSON-200478156-project] 10.222.0.48 "POST /compute/v2.1/images/aaf23b36-b74b-4017-9c39-c6f5faad8e56/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048334 Oct 28 17:32:59.891269 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 654/1241] 10.222.0.48 () {60 vars in 1281 bytes} [Fri Oct 28 17:32:59 2022] POST /compute/v2.1/images/aaf23b36-b74b-4017-9c39-c6f5faad8e56/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:32:59.953033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:32:59.968519 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d164dd53-af62-48e7-8492-d038e05e71d4 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1529 microversion: 2.1 time: 0.311593 Oct 28 17:32:59.969507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 588/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:32:59 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1529 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:00.436817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aae35a4a-85b8-4dc1-b6af-0e1c81a57916 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752412a8b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:00.497325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aae35a4a-85b8-4dc1-b6af-0e1c81a57916 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.065024 Oct 28 17:33:00.498649 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 655/1243] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:00 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:00.993070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:00.993683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:01.006127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:01.007772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:01.008434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:01.009345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:01.011797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:01.012461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:01.208035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8abef9f47be241a09deb20c3e8b6bc39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997381eec6414c2c9d8abd45d38e09f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:01.221731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f9a23f5-8e20-4942-bdc6-676d35df0db3 tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 200 len: 1487 microversion: 2.1 time: 0.229295 Oct 28 17:33:01.232247 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 589/1244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:00 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 1487 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:01.493779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48e90d3-4cb7-4b5e-8af4-878f5b26caae", "name": "network-vif-deleted", "tag": "aee1f7a5-5358-4a7a-b827-c3de6ba07b3c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:01.505355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:01.505906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:01.506405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:01.514388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82a44b60-791b-4a7c-a08e-8fa7f056b79c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242feee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:01.559713 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] Creating event network-vif-deleted:aee1f7a5-5358-4a7a-b827-c3de6ba07b3c for instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae on n-h1-860864-13 Oct 28 17:33:01.578052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2ab0c1e3-f4ce-484b-829e-9918a46cd094 req-0216c662-33f0-4a19-948c-46e4e2211f76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.522429 Oct 28 17:33:01.590554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 656/1245] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:33:01.603860 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82a44b60-791b-4a7c-a08e-8fa7f056b79c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.093800 Oct 28 17:33:01.607600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 590/1246] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:01 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:02.255099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:02.255869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] [instance: e48e90d3-4cb7-4b5e-8af4-878f5b26caae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:02.267231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:02.267750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:02.268178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:02.271229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:02.274033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:02.274664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:02.310857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] HTTP exception thrown: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Request method failure captured: Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae HTTP/1.1 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBIw6Hjw39Jjwl-Mfm1Pku_Cf-LlCrgE30VYMr8giyoNrIOiunprqXH96-8wAf1Q0Ph40wN908PbkUhsX0m_war8Ukl6V9s5fCiHw8cgGIHsH118y5H9Aq_NdZFbgBRcrMU7G2h678SMluIKBSPL51O_Q0Fp3m-4H6c7XXeDIcp7RZo Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_997381eec6414c2c9d8abd45d38e09f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/997381eec6414c2c9d8abd45d38e09f9"}]}] Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 997381eec6414c2c9d8abd45d38e09f9 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1522038201 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8abef9f47be241a09deb20c3e8b6bc39 Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1522038201-project Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e48e90d3-4cb7-4b5e-8af4-878f5b26caae'} Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:02.321385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:02.325796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] Returning 404 to user: Instance e48e90d3-4cb7-4b5e-8af4-878f5b26caae could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:02.326395 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76025a55-d365-4155-ac9e-9e1c7caba5cf tempest-InstanceActionsNegativeTestJSON-1522038201 tempest-InstanceActionsNegativeTestJSON-1522038201-project] 10.222.0.48 "GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae" status: 404 len: 111 microversion: 2.1 time: 0.074525 Oct 28 17:33:02.328560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 657/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:02 2022] GET /compute/v2.1/servers/e48e90d3-4cb7-4b5e-8af4-878f5b26caae => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:33:02.621200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-315bbfac-dd5b-4cff-8401-9e2faa4c7675 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752429da60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:02.736391 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-315bbfac-dd5b-4cff-8401-9e2faa4c7675 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.119585 Oct 28 17:33:02.739251 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 591/1248] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:02 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:03.760639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-998942d9-2a89-4e48-a9a3-499049f5e1eb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524322af0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:03.866014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-998942d9-2a89-4e48-a9a3-499049f5e1eb tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.116801 Oct 28 17:33:03.867335 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 592/1249] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:03 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:03.877118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Calling method '.version_select at 0x7f752412a1f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:03.910646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:03.917029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:03.924914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:03.926133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:03.929463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:03.932380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:04.033783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-33de7109-99bd-4e37-96db-42e3f0f48b32 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.518797 Oct 28 17:33:04.039094 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 658/1250] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Oct 28 17:33:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:04.178975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1665882447", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:04.288852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:04.370165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:04.372077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:04.388310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:04.389076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:04.389696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:04.390585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:04.391212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:04.392573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:04.848612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Getting quotas for project 850a994cf02344dcb9111a25550e96de. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:04.865486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Getting quotas for user 0aa7f85dda6a4a16b98c634efa296f9f and project 850a994cf02344dcb9111a25550e96de. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:04.888571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Request method failure captured: Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 1752 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJPswppU2bqG2r6MFDkyKjynSICz9NzVTq-jAfbs7s8zVpiYG7ENAdRApYV7136qtU1mYG6HlVxWpvhZEUSh23zlAtNo39NomRHbTR8aBRDKnjDU3sFQwBsEJ2C5NRNtUi6mgJA129FLvyl5nqLecrdYOmUx5sxQFtgFOmrK35k63U Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 850a994cf02344dcb9111a25550e96de Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1197170588 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/850a994cf02344dcb9111a25550e96de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/850a994cf02344dcb9111a25550e96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_850a994cf02344dcb9111a25550e96de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/850a994cf02344dcb9111a25550e96de"}]}] Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1197170588 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 850a994cf02344dcb9111a25550e96de Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1197170588 Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0aa7f85dda6a4a16b98c634efa296f9f Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1665882447", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:33:04.891032 n-d-860864-13 devstack@n-api.service[120568]: exception: Maximum number of metadata items exceeds 128 Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1665882447', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:33:04.893701 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 28 17:33:04.897092 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:04.899033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:04.902763 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f93b305-2e85-411f-ac8e-2c777e959d40 tempest-AbsoluteLimitsNegativeTestJSON-1197170588 tempest-AbsoluteLimitsNegativeTestJSON-1197170588-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.743818 Oct 28 17:33:04.904267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 593/1251] 10.222.0.48 () {60 vars in 1148 bytes} [Fri Oct 28 17:33:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 747 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:33:04.931487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b240a497-0cf8-4fb1-a5cc-94c247d0ac6b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752429d550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:05.041716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b240a497-0cf8-4fb1-a5cc-94c247d0ac6b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.134358 Oct 28 17:33:05.053935 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 594/1252] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:04 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:05.322387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:33:05.412575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ea8f72c-fd11-450d-a18e-234aa0b3f7d5 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 2426 microversion: 2.25 time: 1.072817 Oct 28 17:33:05.415233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 659/1253] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:04 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 2426 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:05.445639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": "auto"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:05.450559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:05.479340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:05.479947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:05.480397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:05.483562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:05.484934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:05.486180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:05.554226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'flavor' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:33:05.595468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:33:06.060104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53ba32c5-5c17-47cb-a35a-710bf195364b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752414b5e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:06.153034 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53ba32c5-5c17-47cb-a35a-710bf195364b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.097637 Oct 28 17:33:06.164405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 660/1254] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:06 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:07.170976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1d14177-6259-47a8-b2e4-5f65e811a1ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75240b8b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:07.276792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1d14177-6259-47a8-b2e4-5f65e811a1ee tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1453 microversion: 2.1 time: 0.110731 Oct 28 17:33:07.277695 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 661/1255] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:07 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:07.291589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:07.292728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:07.307404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:07.310028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:07.310857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:07.318996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:07.320126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:07.320913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.356165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8d41f7b-ef2b-45de-b662-e81fe0c1cda1 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1816 microversion: 2.1 time: 1.075615 Oct 28 17:33:08.358960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 662/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:07 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1816 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:08.372522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87a0a26a-8803-4af7-b466-e547da58d00a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75240fb8b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:08.485098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87a0a26a-8803-4af7-b466-e547da58d00a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1462 microversion: 2.1 time: 0.122255 Oct 28 17:33:08.485956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 663/1257] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:08 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1462 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:08.491543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:08.496532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.497545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.498253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.499314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.500037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.500914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.546100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69a65a69-17c7-4447-b7f1-e4aad219e56a tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.058733 Oct 28 17:33:08.547726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 664/1258] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:33:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:08.555060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30578c07-22eb-4829-92b5-c61669e5bf66 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752422bee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:08.677082 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30578c07-22eb-4829-92b5-c61669e5bf66 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 200 len: 1462 microversion: 2.1 time: 0.127743 Oct 28 17:33:08.678005 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 665/1259] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:08 2022] GET /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 1462 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:08.697222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:08.697862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:08.720001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.720752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.729210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.730076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.730567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.733409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.891394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5bc4b307-fc28-40fd-ba3c-5c787a0175a3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/action" status: 202 len: 0 microversion: 2.25 time: 3.452742 Oct 28 17:33:08.892327 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 595/1260] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:33:05 2022] POST /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/action => generated 0 bytes in 3455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:08.901509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:08.902121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:08.925067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.925986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.926566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:08.935040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:08.937785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:08.939388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:09.197653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:09.207267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5530c1ad-8ac8-4d72-a849-c93cefa1a75c tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1468 microversion: 2.1 time: 0.519113 Oct 28 17:33:09.212587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 666/1261] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:08 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:09.236007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb425002-177b-47f4-8336-a814c69c59b4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752414b550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:09.506389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:09.516638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:09.523225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:09.528193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f30616c-0ab2-4005-9219-90ff9e5354bf tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.630786 Oct 28 17:33:09.529441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 596/1262] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:08 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:09.567296 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb425002-177b-47f4-8336-a814c69c59b4 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?changes-since=2022-10-28T17%3A30%3A56Z" status: 200 len: 2329 microversion: 2.1 time: 0.335708 Oct 28 17:33:09.569904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 667/1263] 10.222.0.48 () {58 vars in 1199 bytes} [Fri Oct 28 17:33:09 2022] GET /compute/v2.1/images?changes-since=2022-10-28T17%3A30%3A56Z => generated 2329 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:09.585054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cdcaa78-9027-4a6b-add5-199e2481e4fd tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242a4040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:09.753181 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cdcaa78-9027-4a6b-add5-199e2481e4fd tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1101015533" status: 200 len: 485 microversion: 2.1 time: 0.172916 Oct 28 17:33:09.755305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 597/1264] 10.222.0.48 () {58 vars in 1231 bytes} [Fri Oct 28 17:33:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1101015533 => generated 485 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:09.769327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-79376913-fc75-4bdf-b61f-96d1ac87db0b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75241693a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:09.923840 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-79376913-fc75-4bdf-b61f-96d1ac87db0b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?server=a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 958 microversion: 2.1 time: 0.159151 Oct 28 17:33:09.933523 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 668/1265] 10.222.0.48 () {58 vars in 1209 bytes} [Fri Oct 28 17:33:09 2022] GET /compute/v2.1/images?server=a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 958 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:09.944845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64ed9fec-5572-44f0-a4da-f184ed863d83 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524322280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.044552 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64ed9fec-5572-44f0-a4da-f184ed863d83 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 484 microversion: 2.1 time: 0.109424 Oct 28 17:33:10.047324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 598/1266] 10.222.0.48 () {58 vars in 1317 bytes} [Fri Oct 28 17:33:09 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209 => generated 484 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:10.060327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0515c83-97d2-487c-b255-7652a36ca4cc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752422bdc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.122481 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0515c83-97d2-487c-b255-7652a36ca4cc tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 484 microversion: 2.1 time: 0.066042 Oct 28 17:33:10.123615 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 669/1267] 10.222.0.48 () {58 vars in 1303 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209 => generated 484 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:10.136596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4f274f9-6309-44c9-995a-78f74abbc610 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752429d5e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.310628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4f274f9-6309-44c9-995a-78f74abbc610 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.177513 Oct 28 17:33:10.311777 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 599/1268] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:10.330362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-446da85f-9c7e-4d62-88c6-94ab3fce5809 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242feaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.437255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-446da85f-9c7e-4d62-88c6-94ab3fce5809 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.112213 Oct 28 17:33:10.438170 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 600/1269] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:10.453030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02a83c11-7d01-444d-9867-c6a1174be310 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752429d550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.553724 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-02a83c11-7d01-444d-9867-c6a1174be310 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.105083 Oct 28 17:33:10.561004 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 601/1270] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:33:10.574437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.576580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:10.592772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:10.596209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:10.599221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:10.601344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:10.602712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:10.603896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:10.724791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1497601-4c31-4a72-b80c-016c30342502 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f75241695e0>, body: {"keypair": {"name": "tempest-keypair-1525489666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORdfn06SdUnIhsRsfrptc5YbWfBRFh/2ViJapE2bzflrTsnKkYpkZ6dBSaJVP65BQsZv3vxA5KI9re5UL1u4LmMXtBPz47hIiJb6jlFbIkZ0rMkaWt6H0q/ahhpFUWBGA=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:10.748339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1497601-4c31-4a72-b80c-016c30342502 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:10.757208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1497601-4c31-4a72-b80c-016c30342502 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:10.825161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1497601-4c31-4a72-b80c-016c30342502 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.604407 Oct 28 17:33:10.831473 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 670/1271] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 606 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:33:10.831473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5acae63b-507c-43c7-bc15-dbbcb7b06830 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427a670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.920538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:10.938455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:10.940010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:10.945285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-417ccfe9-de57-4b1a-85e7-7640ccd79d0a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.379026 Oct 28 17:33:10.947556 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 602/1272] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:10.953889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-237a2877-de34-4824-84e1-4cb3159d12c0 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242da790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:10.976244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-237a2877-de34-4824-84e1-4cb3159d12c0 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1525489666" status: 200 len: 513 microversion: 2.2 time: 0.026481 Oct 28 17:33:10.976850 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 603/1273] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1525489666 => generated 513 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:10.994044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29de8c7c-dccb-44b6-b218-b54c6587475f tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f7524e0dee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.014759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5acae63b-507c-43c7-bc15-dbbcb7b06830 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?changes-since=2022-10-28T17%3A30%3A49Z" status: 200 len: 7016 microversion: 2.1 time: 0.187176 Oct 28 17:33:11.016023 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 671/1274] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Oct 28 17:33:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-28T17%3A30%3A49Z => generated 7016 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.043095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5ca615f-17b3-4ac3-a4ce-f0a119487c02 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75241c1dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.057599 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29de8c7c-dccb-44b6-b218-b54c6587475f tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525489666" status: 204 len: 0 microversion: 2.2 time: 0.071161 Oct 28 17:33:11.059129 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 604/1275] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Oct 28 17:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525489666 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:11.073679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45f7254a-0535-4ea2-af2f-114b06ae77a9 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f75242adc10>, body: {"keypair": {"name": "tempest-keypair-144636369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6Jb6qhbtte79s6uN0PZnYd+tIHZoOsIwmkUOgGgUfHWn+Kh+2dOA0D+hncUSpm1oUg8PGmTM7bEXkaEMzf/9jUJC+dQ76vFWHOS05rrZnpsACux6gSVPvNn3pRmC1avg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.116303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-45f7254a-0535-4ea2-af2f-114b06ae77a9 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:11.127596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-45f7254a-0535-4ea2-af2f-114b06ae77a9 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:11.162838 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5ca615f-17b3-4ac3-a4ce-f0a119487c02 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1101015533" status: 200 len: 665 microversion: 2.1 time: 0.125114 Oct 28 17:33:11.164434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 672/1276] 10.222.0.48 () {58 vars in 1252 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1101015533 => generated 665 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:11.184525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ab547f6-5ea6-439c-a756-d94ace81ed69 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752414e820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.199002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45f7254a-0535-4ea2-af2f-114b06ae77a9 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.131705 Oct 28 17:33:11.200010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 605/1277] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 17:33:11.219101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd41e5b8-3e10-40a9-a4de-b2a9806a5f1d tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242ad5e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.256740 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd41e5b8-3e10-40a9-a4de-b2a9806a5f1d tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144636369" status: 204 len: 0 microversion: 2.2 time: 0.045301 Oct 28 17:33:11.257709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 606/1278] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Oct 28 17:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144636369 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:11.268808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a85bb37-274e-497f-82ff-69059b19b204 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f752427e4c0>, body: {"keypair": {"name": "tempest-keypair-1219368747", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.308173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a85bb37-274e-497f-82ff-69059b19b204 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:11.314233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a85bb37-274e-497f-82ff-69059b19b204 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:11.318593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ab547f6-5ea6-439c-a756-d94ace81ed69 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1464 microversion: 2.1 time: 0.139871 Oct 28 17:33:11.322695 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 673/1279] 10.222.0.48 () {58 vars in 1338 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.349487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0fc1090-c85d-4e26-87fc-e53f2d72b698 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524169310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.388866 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a85bb37-274e-497f-82ff-69059b19b204 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.125948 Oct 28 17:33:11.396292 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 607/1280] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:33:11.404555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f528776-3c28-4b7c-9c15-50f41de6abeb tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242c7820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.430891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0fc1090-c85d-4e26-87fc-e53f2d72b698 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1464 microversion: 2.1 time: 0.092643 Oct 28 17:33:11.435972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 674/1281] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2Fb58839f6-b2c7-4bea-a046-64be87262209 => generated 1464 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.455070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7c896d08-ae4f-4b39-9c1f-1553b8486ac1 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752422be50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.455724 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f528776-3c28-4b7c-9c15-50f41de6abeb tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219368747" status: 204 len: 0 microversion: 2.2 time: 0.057675 Oct 28 17:33:11.456493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 608/1282] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Oct 28 17:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219368747 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:11.475073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-702bc741-6859-4c14-81c3-6444832a404c tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f752427e790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1787439345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkDcmWFIrHcoojjl1T9DA5CdXnbjQ+tOmcDBXNVj6DU+VdjPVoaAGW8YdwEk78VUu7Rtyxns+nBtP39gSEbWhMZUnWBXwIvKO/wFIn6DuKaupXBCyB3/MEKWTUtiystOQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.493266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-702bc741-6859-4c14-81c3-6444832a404c tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:11.499548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-702bc741-6859-4c14-81c3-6444832a404c tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:11.518803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:11.530216 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-702bc741-6859-4c14-81c3-6444832a404c tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.065079 Oct 28 17:33:11.531122 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 609/1283] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:33:11.550195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b955d1cb-c004-42b1-b830-aaf4920ba38a tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f75242ad5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1682335132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS1j0RRIwCOP1nDoD6ey1pR9/rjg4ac1d13zcargEdjX/lirQaPmN1XDLgwf1Tr2scn77YElluzLaGd8y41e53Uxw+xexzpX31A0dI8wIkn4UX65XmIZ6XmPTw/kC3guQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.578716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b955d1cb-c004-42b1-b830-aaf4920ba38a tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:11.583627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7c896d08-ae4f-4b39-9c1f-1553b8486ac1 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7791 microversion: 2.1 time: 0.133183 Oct 28 17:33:11.586408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b955d1cb-c004-42b1-b830-aaf4920ba38a tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:11.601635 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 675/1284] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.610200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ded78b8d-d52a-4377-a106-5306c55c6469 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75240b8f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.656881 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b955d1cb-c004-42b1-b830-aaf4920ba38a tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.115439 Oct 28 17:33:11.657702 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 610/1285] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 17:33:11.671458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bac82e1c-4b63-4844-af44-f26a66d2fe92 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f75242d0160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2076632371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJb28mj+d72Qg7UnIXDq7ysF3VZlbXO49fyDG8/ACNUe7Nj5vPpqQ9SOtRWjdL6gyScGXPpwQimajflLnz7uCvc8W5NXn7GHZ2JWTUpPGfHG3DIFwUX0zcxs0eQSIBbOQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.712156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-bac82e1c-4b63-4844-af44-f26a66d2fe92 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:11.728984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-bac82e1c-4b63-4844-af44-f26a66d2fe92 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:11.759838 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ded78b8d-d52a-4377-a106-5306c55c6469 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.157083 Oct 28 17:33:11.776415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 676/1286] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.779869 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bac82e1c-4b63-4844-af44-f26a66d2fe92 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.112460 Oct 28 17:33:11.780476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 611/1287] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:33:11.781140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c471f57-6f56-4913-bb5a-3d75f3b15d62", "device": "/dev/xvdb"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:11.788013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8443f618-a596-42c1-be73-474df800f072 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242fe4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.788659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:11.808836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:11.811016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:11.811631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:11.816603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:11.820891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:11.821918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:11.861033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8443f618-a596-42c1-be73-474df800f072 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6" status: 200 len: 784 microversion: 2.1 time: 0.078897 Oct 28 17:33:11.861953 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 612/1288] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6 => generated 784 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:11.882840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f97521c-e930-4365-a416-e28ca99f3774 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242a4ee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:11.892336 n-d-860864-13 devstack@n-api.service[120568]: WARNING oslo_db.sqlalchemy.utils [None req-9f97521c-e930-4365-a416-e28ca99f3774 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:33:11.924786 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f97521c-e930-4365-a416-e28ca99f3774 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.057767 Oct 28 17:33:11.926912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 613/1289] 10.222.0.48 () {60 vars in 1177 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:11.955357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e764f572-0f44-495f-a54e-fe82eb480727 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752429d700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.183712 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e764f572-0f44-495f-a54e-fe82eb480727 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.250604 Oct 28 17:33:12.187009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 614/1290] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:33:11 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:12.202533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91eff189-098f-45d9-b6ab-3a6cdf24ed81 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242a4af0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.287236 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91eff189-098f-45d9-b6ab-3a6cdf24ed81 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2076632371" status: 204 len: 0 microversion: 2.2 time: 0.096321 Oct 28 17:33:12.288072 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 615/1291] 10.222.0.48 () {60 vars in 1321 bytes} [Fri Oct 28 17:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2076632371 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:12.322222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.325200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:12.346487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:12.349579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:12.351277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:12.354607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:12.356588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:12.358101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:12.451836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9354c0dc-a39d-4cd6-80b6-12c7f19e01d1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683305 Oct 28 17:33:12.453246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 677/1292] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:33:11 2022] POST /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:12.474237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8f2fac2-4d78-49d9-bc3c-47b8d69855fa tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524118940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.725495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:12.742728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:12.745077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:12.751916 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed7c8608-5477-42ea-a1bd-a064696b9cc2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.456397 Oct 28 17:33:12.753700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 616/1293] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:12 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:12.768002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3d8d1e5-ffea-4779-bb51-e8ef6922a34b tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242a4280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.827620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3d8d1e5-ffea-4779-bb51-e8ef6922a34b tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1682335132" status: 204 len: 0 microversion: 2.2 time: 0.069038 Oct 28 17:33:12.828268 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 617/1294] 10.222.0.48 () {60 vars in 1321 bytes} [Fri Oct 28 17:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1682335132 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:12.846231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b92aa115-9b86-44d2-a5a0-574a3f7a8dbf tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f752429dd30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:12.911566 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b92aa115-9b86-44d2-a5a0-574a3f7a8dbf tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1787439345" status: 204 len: 0 microversion: 2.2 time: 0.077598 Oct 28 17:33:12.919186 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 618/1295] 10.222.0.48 () {60 vars in 1321 bytes} [Fri Oct 28 17:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1787439345 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:12.925750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-802a5610-2b09-4388-abd0-aa05f60cf1f5 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f7524286ca0>, body: {"keypair": {"name": "tempest-keypair-450358956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO422fCUk5hGtkrxeFtRoOFFO1DL9C1mn1bhx3iRAmR0FJeJ6EU4bPXhVzyF/oDxKj3Lv9DSGl/s+szM9rPAs39rITrWzjQfuby35HNL+ckpERvZihwsbNCvl6YTjCrzHw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:12.982654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-802a5610-2b09-4388-abd0-aa05f60cf1f5 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:13.001203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-802a5610-2b09-4388-abd0-aa05f60cf1f5 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:13.054488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-802a5610-2b09-4388-abd0-aa05f60cf1f5 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.133703 Oct 28 17:33:13.063788 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 619/1296] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Oct 28 17:33:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 28 17:33:13.070962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-unplugged", "status": "completed", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:13.085896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:13.086594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:13.087214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:13.104215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] Creating event network-vif-unplugged:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:33:13.111150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0f5c2cb7-0454-4088-8e80-02f06f3eb0de req-e68f8b9b-318b-43d7-a716-8747a56a25ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045389 Oct 28 17:33:13.112827 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 620/1297] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:13.120101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3385372-a245-42c4-a408-e0ed7d0cb2df tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f7524286700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:13.154813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3385372-a245-42c4-a408-e0ed7d0cb2df tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-450358956" status: 200 len: 512 microversion: 2.2 time: 0.039460 Oct 28 17:33:13.156346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 621/1298] 10.222.0.48 () {60 vars in 1255 bytes} [Fri Oct 28 17:33:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-450358956 => generated 512 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:13.171203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5859a35-a3a2-4dfc-a7f9-7003bfa15852 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242d0670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:13.177327 n-d-860864-13 devstack@n-api.service[120568]: WARNING oslo_db.sqlalchemy.utils [None req-b5859a35-a3a2-4dfc-a7f9-7003bfa15852 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:33:13.204640 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5859a35-a3a2-4dfc-a7f9-7003bfa15852 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.037262 Oct 28 17:33:13.213376 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 622/1299] 10.222.0.48 () {60 vars in 1177 bytes} [Fri Oct 28 17:33:13 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:13.220421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5117e03c-a405-4758-99d3-12ac460642cb tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75245274c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:13.292592 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5117e03c-a405-4758-99d3-12ac460642cb tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450358956" status: 204 len: 0 microversion: 2.2 time: 0.076721 Oct 28 17:33:13.293233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 623/1300] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Oct 28 17:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450358956 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:13.304729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Action: 'create', calling method: .version_select at 0x7f75242c7f70>, body: {"keypair": {"name": "tempest-keypair-489874395", "type": "x509"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:13.383255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:13.390803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:13.492826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.processutils [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp6_uxui1g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6_uxui1g/temp.key -subj /CN=f7edd650164a4c8596ec0744311fcab6 -extensions v3_req_client {{(pid=120568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 17:33:13.701769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8f2fac2-4d78-49d9-bc3c-47b8d69855fa tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f" status: 204 len: 0 microversion: 2.1 time: 1.243207 Oct 28 17:33:13.702961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 678/1301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:12 2022] DELETE /compute/v2.1/images/daa567e7-4f0a-4154-ba94-653d39c2e15f => generated 0 bytes in 1245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:13.712837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9efdf19e-588b-4fc8-b85a-f5566ceb6b6b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f7524107430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:14.108040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.processutils [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp6_uxui1g/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp6_uxui1g/temp.key -subj /CN=f7edd650164a4c8596ec0744311fcab6 -extensions v3_req_client" returned: 0 in 0.615s {{(pid=120568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 17:33:14.109556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.processutils [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp6_uxui1g/temp.key -password pass: {{(pid=120568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 17:33:14.177167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.processutils [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp6_uxui1g/temp.key -password pass:" returned: 0 in 0.067s {{(pid=120568) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 17:33:14.249017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:14.264459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Getting quotas for user f7edd650164a4c8596ec0744311fcab6 and project cd7fda6914c34dc988c0739b5590830a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:14.327515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd8dc971-5d99-4581-bdf3-2c04acdc7496 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.023856 Oct 28 17:33:14.329045 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 624/1302] 10.222.0.48 () {62 vars in 1198 bytes} [Fri Oct 28 17:33:13 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:14.343687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:14.344818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:14.363192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:14.363998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:14.364643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:14.365604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:14.370848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:14.371559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:14.602245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:14.618452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:14.620229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:14.630334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6caec1f3-5e52-4058-9d5b-758785b8d856 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.290639 Oct 28 17:33:14.651653 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 625/1303] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:14 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:14.658711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d335a252-a977-4c1f-8840-b96c99773f56 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f752429d820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:14.680324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d335a252-a977-4c1f-8840-b96c99773f56 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-489874395" status: 200 len: 1533 microversion: 2.2 time: 0.025790 Oct 28 17:33:14.680919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 626/1304] 10.222.0.48 () {60 vars in 1255 bytes} [Fri Oct 28 17:33:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-489874395 => generated 1533 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:14.700267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9642ae2-0695-417b-ac51-0b816daa0752 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f75242dfd30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:14.704275 n-d-860864-13 devstack@n-api.service[120568]: WARNING oslo_db.sqlalchemy.utils [None req-a9642ae2-0695-417b-ac51-0b816daa0752 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:33:14.724039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9642ae2-0695-417b-ac51-0b816daa0752 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.027670 Oct 28 17:33:14.724809 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 627/1305] 10.222.0.48 () {60 vars in 1177 bytes} [Fri Oct 28 17:33:14 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:14.748239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79a347ca-beff-476e-9d10-772ff9b97868 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] Calling method '.version_select at 0x7f7524286550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:14.783743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79a347ca-beff-476e-9d10-772ff9b97868 tempest-KeyPairsV22TestJSON-1923552861 tempest-KeyPairsV22TestJSON-1923552861-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489874395" status: 204 len: 0 microversion: 2.2 time: 0.039335 Oct 28 17:33:14.789427 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 628/1306] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Oct 28 17:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489874395 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:15.191605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9efdf19e-588b-4fc8-b85a-f5566ceb6b6b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc" status: 204 len: 0 microversion: 2.1 time: 1.483225 Oct 28 17:33:15.193783 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 679/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:13 2022] DELETE /compute/v2.1/images/86fc6135-40ee-4ceb-8ae1-8a1f93eb08bc => generated 0 bytes in 1487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:33:15.211573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96f81def-a254-4c9a-a9b6-ec3d0e7dcac0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752423c700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:15.665673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:15.666716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:15.681088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:15.681596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:15.685190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:15.686097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:15.687039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:15.687524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:16.618954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:16.633937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:16.644402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:16.647010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-84c22113-e157-4bad-b734-702c128a5f6d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.989019 Oct 28 17:33:16.694342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 680/1308] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:15 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:33:17.033387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-96f81def-a254-4c9a-a9b6-ec3d0e7dcac0 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189" status: 204 len: 0 microversion: 2.1 time: 1.832649 Oct 28 17:33:17.034301 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 629/1309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:15 2022] DELETE /compute/v2.1/images/99f7e278-418f-4862-a764-2763e7faf189 => generated 0 bytes in 1835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:17.043555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:17.044083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:17.064848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:17.065338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:17.065838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:17.066729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:17.069401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:17.069891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:17.128056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:33:17.203040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1984567872", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:17.293454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=90,nova_api:DELETE=5 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:17.334296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b640aeaa-d4f1-43c9-b08b-8b49f1536a38 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 204 len: 0 microversion: 2.1 time: 0.295320 Oct 28 17:33:17.347823 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 630/1310] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:33:17 2022] DELETE /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:33:17.354245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:17.362251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:17.387268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:17.401889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:17.402396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:17.402832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:17.403581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:17.404041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:17.404467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:18.140119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:18.149141 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31df4835-0116-452a-b6cc-ff57cb79d585 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1473 microversion: 2.1 time: 0.799494 Oct 28 17:33:18.153560 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 631/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:17 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1473 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:18.164563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:18.168087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:18.182832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:18.184097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:18.185861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:18.187515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:18.189499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:18.193041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:18.237328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:18.291753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:33:18.292271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:33:18.292621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:33:18.293044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:33:18.293449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:33:18.321982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:18.322466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:18.322895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:18.331837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:18.332382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:18.332829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:18.390179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Getting quotas for project 93d97c7650dc43b9a839ec46b4a86d45. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:18.400903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Getting quotas for user 96982d859d5944e19ab3f68b52d32953 and project 93d97c7650dc43b9a839ec46b4a86d45. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:18.430099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:33:18.434005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:18.510903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:18.528403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:18.553490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a4024941-aef2-4444-b719-6b6117032e51 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589522 Oct 28 17:33:18.561240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:18.561450 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 681/1312] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:33:18.562493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-744d83a9-08aa-483d-a6f7-a961f947c404 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.407625 Oct 28 17:33:18.567541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ebe9500-9e26-48de-9697-30a55561a732 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:18.568372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ebe9500-9e26-48de-9697-30a55561a732 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:18.573732 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 632/1313] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:18 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:18.860852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ebe9500-9e26-48de-9697-30a55561a732 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:18.869603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ebe9500-9e26-48de-9697-30a55561a732 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1220 microversion: 2.1 time: 0.306778 Oct 28 17:33:18.871533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 682/1314] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:18 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1220 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:19.180170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:19.180780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:19.191150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:19.191720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:19.192297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:19.192997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:19.196610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:19.204166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:19.608421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:19.609213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:19.622213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:19.622720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:19.626789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:19.638020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:19.641009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9cc46ef-7be2-42ee-90bf-3c0a2f009bd6 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1473 microversion: 2.1 time: 0.464850 Oct 28 17:33:19.642090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:19.642952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:19.643835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 633/1315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:19 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1473 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:19.644454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:19.898823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73037db6-7823-4cf8-acb5-cc9e65dd1b4f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:19.899468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73037db6-7823-4cf8-acb5-cc9e65dd1b4f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:20.042231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73037db6-7823-4cf8-acb5-cc9e65dd1b4f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:20.061489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73037db6-7823-4cf8-acb5-cc9e65dd1b4f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1220 microversion: 2.1 time: 0.166948 Oct 28 17:33:20.064705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 634/1316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:19 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1220 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:20.079072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:20.090961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:20.092114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:20.093832 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6241cf3-1b1b-4144-ba47-22658a43b67d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.492115 Oct 28 17:33:20.094773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 683/1317] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:19 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:33:20.668466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:20.671243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:20.696912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:20.707011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:20.709524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:20.714430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:20.719134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:20.727731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:20.919467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58839f6-b2c7-4bea-a046-64be87262209", "name": "network-vif-deleted", "tag": "22a16875-db48-4f16-8bd0-765c054693cd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:20.935042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:20.935772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:20.936385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:20.949120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] Creating event network-vif-deleted:22a16875-db48-4f16-8bd0-765c054693cd for instance b58839f6-b2c7-4bea-a046-64be87262209 on n-h1-860864-13 Oct 28 17:33:20.955156 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a89686c4-9910-44e3-a827-04a2017095cb req-1dba4593-78da-43a0-8efc-58a32f87de55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041337 Oct 28 17:33:20.957559 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 684/1318] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:33:21.088987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:21.089667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:21.102691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:21.104405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:21.107313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:21.108747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:21.112725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:21.113903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:21.425571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:21.438678 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e09d6679-a224-4913-bb33-e0c0a33c0df8 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 200 len: 1431 microversion: 2.1 time: 0.774254 Oct 28 17:33:21.455233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 635/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:20 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 1431 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:21.473150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:21.474227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:21.487006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:21.491343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:21.494000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:21.496555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:21.497145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:21.500284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:21.514287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:21.528869 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-009ef46e-b45a-49d1-ad49-8248e96a093d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1272 microversion: 2.1 time: 0.443548 Oct 28 17:33:21.549318 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 685/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:21 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1272 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:22.336683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:22.374199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:22.375967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:22.377370 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3da3793f-c481-4f58-bdd4-d9d0aa6cc1f6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.919727 Oct 28 17:33:22.378654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 636/1321] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:21 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:22.464072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:22.464592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: b58839f6-b2c7-4bea-a046-64be87262209] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:22.475388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.482118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.482669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.484578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.485059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.485491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.542744 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] HTTP exception thrown: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Request method failure captured: Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 HTTP/1.1 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBHISFtXfrJICX9YtuGe_UwWBJhHZnA6M6kxUQc_lDj5ht2CYP0Ghww8cZGJtdNC-F5u2dOWBiJSVsZ3KoV47KPZq72Z4xcmJ9J-T_r6xAVdBQCEuNoF_WOz15DcpOIpT7MwRCYJy2z_GylhF1U2Kc1DblQwfRNBa3ZCm90auP_l_gQ Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e5bd90e2ec024648b1b314d6463a85f4 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5bd90e2ec024648b1b314d6463a85f4"}]}] Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e5bd90e2ec024648b1b314d6463a85f4 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListImageFiltersTestJSON-886635879-project Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ef893e3030d54f60a982bd54091ad946 Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListImageFiltersTestJSON-886635879-project Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b58839f6-b2c7-4bea-a046-64be87262209'} Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:22.555296 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Returning 404 to user: Instance b58839f6-b2c7-4bea-a046-64be87262209 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:22.560821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-846240bd-b2ee-48e8-a212-234c7c21c1fe tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209" status: 404 len: 111 microversion: 2.1 time: 0.099636 Oct 28 17:33:22.562286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:22.562796 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 686/1322] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:22 2022] GET /compute/v2.1/servers/b58839f6-b2c7-4bea-a046-64be87262209 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:33:22.563297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:22.579878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.582586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.583358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.584427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.585142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.586284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:22.586899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.587302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:22.602352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.603967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.606365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.607707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.609656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.610446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.676978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:33:22.858207 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a33ed86-0379-4c86-8843-8a3ecbde3760 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 204 len: 0 microversion: 2.1 time: 0.290465 Oct 28 17:33:22.862123 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 687/1323] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:33:22 2022] DELETE /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:22.868322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:22.869029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:22.880145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.880646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.881098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.881817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:22.882277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:22.895026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:22.899845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:22.972644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:22.984346 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb219bd5-424a-4706-ab32-e6ef76893010 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1278 microversion: 2.1 time: 0.432806 Oct 28 17:33:22.988199 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 637/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:22 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1278 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:23.405941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:23.407279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:23.428727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:23.429230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:23.429666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:23.430691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:23.431353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:23.432099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:23.457685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:23.475154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6633aa6c-640e-46fe-b0f9-743d938e29cf tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1474 microversion: 2.1 time: 0.608477 Oct 28 17:33:23.479688 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 688/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:22 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1474 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:33:23.916617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:23.932140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:23.941567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:23.943070 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7add0d36-9efe-4048-b170-3834787613d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.541938 Oct 28 17:33:23.944188 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 638/1326] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:23 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:33:24.011804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:24.013086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:24.025952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:24.026919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:24.027642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:24.028622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:24.031459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:24.032218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:24.502252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:24.504369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:24.523621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:24.526808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:24.528570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:24.529844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:24.531867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:24.532566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:24.578343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:24.594669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1571cf6-6030-4232-93d8-87c534d4da3e tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.588321 Oct 28 17:33:24.618340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 689/1327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:24 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:24.879081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7214bacc-5e46-4a7d-9560-f6358c2de959 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f75241fa940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-669125093", "description": "tempest-description-1445923408"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:25.177078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:25.186656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1844dab5-9198-422a-a942-2ef6a6b9909b tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1474 microversion: 2.1 time: 0.688295 Oct 28 17:33:25.202360 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 639/1328] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:24 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:25.212879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:25.213841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:25.231888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:25.232392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:25.232834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:25.233556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:25.234009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:25.234433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:25.750697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:25.769321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:25.772355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:25.774780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8a5e6587-1074-497d-a640-8ca43acbecef tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.579105 Oct 28 17:33:25.775396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 640/1329] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:25 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:25.793535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:25.794154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:25.806668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:25.807152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:25.807615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:25.808323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:25.818404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:25.822298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:25.946530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7214bacc-5e46-4a7d-9560-f6358c2de959 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.326992 Oct 28 17:33:25.955690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 690/1330] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:25.962942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ef561ed-66fe-45ef-ab3e-18c13e05a666 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f75241c10d0>, body: {"security_group_rule": {"parent_group_id": "d4578732-e41e-44df-9d22-0a93960d578d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:26.517502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:26.542636 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-24a40ce2-d1b1-4d84-853f-7e5a0980c43f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.760552 Oct 28 17:33:26.547627 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 641/1331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:25 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:26.566774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:26.572105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:26.594951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.604907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.605433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:26.606274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.607040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.607579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:26.720160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.720906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.725212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:26.725960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lazy-loading 'fault' on Instance uuid a4bd4921-d896-43e2-b09b-5dd2d64b238f {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:33:26.854499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef893e3030d54f60a982bd54091ad946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd90e2ec024648b1b314d6463a85f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:26.862955 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae98274c-bd12-4fd9-891a-291f19907108 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 200 len: 1308 microversion: 2.1 time: 0.311971 Oct 28 17:33:26.877536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 642/1332] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:26 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:26.894568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd4921-d896-43e2-b09b-5dd2d64b238f", "name": "network-vif-deleted", "tag": "004b1037-3e3c-4b84-9ed3-4910cfef144d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:26.917599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.918103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.918540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:26.948153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] Creating event network-vif-deleted:004b1037-3e3c-4b84-9ed3-4910cfef144d for instance a4bd4921-d896-43e2-b09b-5dd2d64b238f on n-h2-860864-13 Oct 28 17:33:26.958132 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-767fbe7d-ad13-49f9-8e94-bca918babf6f req-4c4b71c3-388f-4da9-8b7e-e966b30d40b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079011 Oct 28 17:33:26.960350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 643/1333] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:26.973282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:26.975738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:26.990664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.996396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.997089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:26.998101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:26.998896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:26.999595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:27.292887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ef561ed-66fe-45ef-ab3e-18c13e05a666 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.336220 Oct 28 17:33:27.293830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 691/1334] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:27.448721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35db45b8-e070-419d-8ecd-c48dbabca1b5", "tag": "9853bdb8-6be0-4f14-bced-06a7da0d2966"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:27.474629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:27.476812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:27.482029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:27.488889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:27.526567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] Creating event network-changed:9853bdb8-6be0-4f14-bced-06a7da0d2966 for instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 on n-h2-860864-13 Oct 28 17:33:27.537771 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3c0515dd-c841-4fcb-aad6-d65cd1950911 req-4300dbd2-b1b4-48c1-92da-44cda07d411d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242279 Oct 28 17:33:27.547268 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 692/1335] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:27.562059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a8d923f-9bdc-4193-85f3-d3fc640fe726 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f7524228700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1439763680", "description": "tempest-description-175957201"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:28.175134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:28.189772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:28.192217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:28.193418 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee037a58-f21b-43d9-a1a8-b4232e7c7a16 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 1.229059 Oct 28 17:33:28.207790 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 644/1336] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:26 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:28.218928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:28.219836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:28.234095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:28.234835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:28.235786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:28.238410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:28.239141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:28.245023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:28.372904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:28.408191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a8d923f-9bdc-4193-85f3-d3fc640fe726 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.858632 Oct 28 17:33:28.409597 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 693/1337] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:28.415357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:28.416823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] [instance: a4bd4921-d896-43e2-b09b-5dd2d64b238f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:28.443557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:28.448255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:28.449145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:28.454930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:28.456496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:28.457200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:28.491760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] HTTP exception thrown: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Request method failure captured: Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f HTTP/1.1 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBHISFtXfrJICX9YtuGe_UwWBJhHZnA6M6kxUQc_lDj5ht2CYP0Ghww8cZGJtdNC-F5u2dOWBiJSVsZ3KoV47KPZq72Z4xcmJ9J-T_r6xAVdBQCEuNoF_WOz15DcpOIpT7MwRCYJy2z_GylhF1U2Kc1DblQwfRNBa3ZCm90auP_l_gQ Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e5bd90e2ec024648b1b314d6463a85f4 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5bd90e2ec024648b1b314d6463a85f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5bd90e2ec024648b1b314d6463a85f4"}]}] Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e5bd90e2ec024648b1b314d6463a85f4 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-886635879 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListImageFiltersTestJSON-886635879-project Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ef893e3030d54f60a982bd54091ad946 Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListImageFiltersTestJSON-886635879-project Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a4bd4921-d896-43e2-b09b-5dd2d64b238f'} Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:28.498294 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. Oct 28 17:33:28.502933 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:28.506106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Returning 404 to user: Instance a4bd4921-d896-43e2-b09b-5dd2d64b238f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:28.507411 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-243f6dc2-4d5c-4e4e-9af2-22a4baf41e17 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f" status: 404 len: 111 microversion: 2.1 time: 0.096434 Oct 28 17:33:28.512874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 694/1338] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:28 2022] GET /compute/v2.1/servers/a4bd4921-d896-43e2-b09b-5dd2d64b238f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:33:28.538127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2481e6d1-6dc0-4054-b71a-74df1f8eda71 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f7524214940>, body: {"security_group_rule": {"parent_group_id": "cc8335f2-00b2-4710-8d36-7b2351ba359f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:28.814661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:28.823918 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a4160f1-5205-4c15-930d-6879c4af9744 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.614611 Oct 28 17:33:28.829743 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 645/1339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:28 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:28.839609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81cf6b94-ddff-43f5-b15a-73472a13da4a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f752427e5e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:28.869883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:29.260536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2481e6d1-6dc0-4054-b71a-74df1f8eda71 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.744859 Oct 28 17:33:29.261644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 695/1340] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:28 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:29.372353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-335210687", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9330f139-8006-49b3-bc9e-54be91c02f21"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:29.479512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] validate_networks() for [('9330f139-8006-49b3-bc9e-54be91c02f21', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:29.619456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81cf6b94-ddff-43f5-b15a-73472a13da4a tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e" status: 204 len: 0 microversion: 2.1 time: 0.788446 Oct 28 17:33:29.623025 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 646/1341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:28 2022] DELETE /compute/v2.1/images/98d444b3-f63b-41bc-a07f-3116e4fc474e => generated 0 bytes in 790 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:29.628909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:29.629836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:29.655420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:29.656259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:29.656909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:29.657842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:29.668225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:29.668701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:30.058093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=38 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:30.100646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:30.129499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:30.131255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:30.132660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9580c3d4-070b-4334-9e05-dc94ab0b4ee6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.508296 Oct 28 17:33:30.133497 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 647/1342] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:29 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:30.140438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f6cc1cd-608b-40b5-82bd-ddc0178fb2f7 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752429d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1921768726", "description": "tempest-description-1821919034"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:30.483082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:33:30.483082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:33:30.483082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:33:30.483833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:33:30.483974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:33:30.499389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:30.500209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:30.507390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:30.508473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:30.509188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:30.509797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:30.575420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Getting quotas for project 5c45164b59c3403e83844ab0698c594e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:30.605344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Getting quotas for user 46f174f0096144acb1eecea234b820ef and project 5c45164b59c3403e83844ab0698c594e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:30.643848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Going to run 2 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:33:30.650268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: f83018cb-4453-4a58-952d-b53ffd9b6665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:30.727104 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f6cc1cd-608b-40b5-82bd-ddc0178fb2f7 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.590341 Oct 28 17:33:30.728829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 648/1343] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:30.733644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c3bce6e-e9c2-4f10-b8ea-bbccedd55cb5 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75242c73a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:30.744852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=f83018cb-4453-4a58-952d-b53ffd9b6665,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:30.837264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0fc70fa-da83-451a-ae28-6d431c0ffd3d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573983 Oct 28 17:33:30.838286 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 696/1344] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:33:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:33:30.844320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:30.845051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:30.853696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:30.854508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:30.855130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:30.856260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:30.857290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:30.857881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:31.191042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c3bce6e-e9c2-4f10-b8ea-bbccedd55cb5 tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6" status: 204 len: 0 microversion: 2.1 time: 0.459832 Oct 28 17:33:31.194927 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 649/1345] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:30 2022] DELETE /compute/v2.1/images/52cd1a5b-0711-4f0f-abd6-b1db04c403f6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:31.200623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28ec36d0-08ff-40c7-942c-e41b8045353f tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752423e280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2036621707", "description": "tempest-description-924097918"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:31.651451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:31.666264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43fe64ad-f118-4e9a-8cef-fd62be753c81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.826733 Oct 28 17:33:31.667453 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 697/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:30 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:31.676543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:31.689135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:31.695506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Searching by: {'deleted': False, 'project_id': '5c45164b59c3403e83844ab0698c594e'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:33:31.761257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:31.762679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:31.763244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:31.765402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:31.765993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:31.768955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:31.950552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:33:31.999026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28ec36d0-08ff-40c7-942c-e41b8045353f tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.804484 Oct 28 17:33:31.999927 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 650/1347] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:31 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:32.014438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:32.015053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:32.044158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:32.046465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:32.047691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:32.056061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:32.057459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:32.058170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:32.159114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd3c1058-a416-4238-8799-9a7975a88553 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.487218 Oct 28 17:33:32.161042 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 698/1348] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:33:31 2022] GET /compute/v2.1/servers => generated 675 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:32.166518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-043655c6-0563-41bf-ab8a-95223e495acd tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] Calling method '.version_select at 0x7f75241fa8b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:32.598911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:32.618549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:32.622257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:32.627037 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2c677a9-f61c-43d5-a341-67ea625dc77f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.614907 Oct 28 17:33:32.630707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 651/1349] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:31 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:32.638794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50025554-fb15-43c6-bd1a-96b87ce91562 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752429d550>, body: {"security_group_rule": {"parent_group_id": "3b569913-a105-4969-97f5-8093a9b38151", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5ec6a49e-a99a-4749-9c31-09117376b6a9"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:32.689603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-043655c6-0563-41bf-ab8a-95223e495acd tempest-ListImageFiltersTestJSON-886635879 tempest-ListImageFiltersTestJSON-886635879-project] 10.222.0.48 "DELETE /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544" status: 204 len: 0 microversion: 2.1 time: 0.527261 Oct 28 17:33:32.690756 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 699/1350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:32 2022] DELETE /compute/v2.1/images/ad4ec03e-5086-46ff-a0af-e3fe42f5c544 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:32.696461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:32.697208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:32.725527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:32.730896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:32.731464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:32.732232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:32.732702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:32.736657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:33.015420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:33.028236 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d13342ee-b239-4669-a6aa-4490ab31140a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1215 microversion: 2.1 time: 0.334547 Oct 28 17:33:33.042935 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 700/1351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:32 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:33.045488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:33.046336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:33.063358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:33.067775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:33.069183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:33.071425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:33.072823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:33.074402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:33.634596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:33.657694 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-52e0fddc-2de2-4a9b-b980-3062e483aead tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.623150 Oct 28 17:33:33.661311 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 701/1352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:33 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:33.676848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:33.678613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:33.693773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:33.697729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:33.698193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:33.698951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:33.699435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:33.699876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:34.123571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50025554-fb15-43c6-bd1a-96b87ce91562 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.491372 Oct 28 17:33:34.124850 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 652/1353] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:32 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:34.384772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:34.394757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:34.396257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:34.397485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cf09eb0-ad57-4522-9319-324e343f314f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.733413 Oct 28 17:33:34.404663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 702/1354] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:33 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:34.428303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:34.431144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:34.450042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:34.451216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:34.452085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:34.453236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:34.454224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:34.456466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:34.772191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f6288bb-cffe-47c9-8aa1-05c70b4179f6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f75242d08b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1133787004", "description": "tempest-description-684634842"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:34.850755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:34.860758 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6665de4-dee7-4f33-b215-68ec396beaea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1277 microversion: 2.1 time: 0.442836 Oct 28 17:33:34.871526 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 703/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:34 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1277 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:34.876642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cec3c44-ea26-423b-9eaf-9bc9b2a17f49 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f7524214160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-693165825", "description": "tempest-description-1010860359"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:35.494150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f6288bb-cffe-47c9-8aa1-05c70b4179f6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.367854 Oct 28 17:33:35.495292 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 653/1356] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:35.500389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:35.501476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:35.534636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:35.537067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:35.538307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:35.539205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:35.540516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:35.541970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:35.758036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cec3c44-ea26-423b-9eaf-9bc9b2a17f49 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.885065 Oct 28 17:33:35.758750 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 704/1357] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:34 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:35.765074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:35.765996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:35.776127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:35.777085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:35.777687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:35.778814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:35.779512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:35.780166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:36.108299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:36.122122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-371b0af1-dccf-43c7-8bf3-f3a8aed99eed tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.624914 Oct 28 17:33:36.123087 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 654/1358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:35 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:36.128592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b501418a-cb43-4dae-9d00-2c5ab7980889 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f7524286040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1413999994", "description": "tempest-description-839107420"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:36.305230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:36.331351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:36.340629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:36.342311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec7c3f6d-29d3-40c3-80a6-cc8e43cf6234 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.582196 Oct 28 17:33:36.343020 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 705/1359] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:35 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:36.541832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6979e10b-12c8-4488-8833-e584ed244d4a tempest-ListImageFiltersNegativeTestJSON-669075169 tempest-ListImageFiltersNegativeTestJSON-669075169-project] Calling method '.version_select at 0x7f7524223550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:36.569870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6979e10b-12c8-4488-8833-e584ed244d4a tempest-ListImageFiltersNegativeTestJSON-669075169 tempest-ListImageFiltersNegativeTestJSON-669075169-project] HTTP exception thrown: Image not found. Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6979e10b-12c8-4488-8833-e584ed244d4a tempest-ListImageFiltersNegativeTestJSON-669075169 tempest-ListImageFiltersNegativeTestJSON-669075169-project] Request method failure captured: Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/images/5bd578e4-c72c-4de6-b63a-aa8f3497183c HTTP/1.1 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJvvWxIb8AFx_6RQE0-ScVgbONxRfs_bmGULx0fkAilWaOgdXNQANOduz6_z25X4wTbYWHGd_O2YhLE9KlfNmyw6f6VJpX0v0VLzp8FOYKcM9-ybQv7y90QhI9875JXFg58YBngRm3AoFEZ_CWyvW2oh0GBdY7ehhl5gXKTeWBYpv0 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 243d29988bb7492eb165c316964b3909 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-669075169 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/243d29988bb7492eb165c316964b3909"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/243d29988bb7492eb165c316964b3909"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_243d29988bb7492eb165c316964b3909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/243d29988bb7492eb165c316964b3909"}]}] Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-669075169 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 243d29988bb7492eb165c316964b3909 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-669075169 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListImageFiltersNegativeTestJSON-669075169-project Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: c12ff958f4c544a288eb19b8a3263506 Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-669075169-project Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5bd578e4-c72c-4de6-b63a-aa8f3497183c'} Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5bd578e4-c72c-4de6-b63a-aa8f3497183c Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:33:36.572239 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5bd578e4-c72c-4de6-b63a-aa8f3497183c could not be found. Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6979e10b-12c8-4488-8833-e584ed244d4a tempest-ListImageFiltersNegativeTestJSON-669075169 tempest-ListImageFiltersNegativeTestJSON-669075169-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:36.576975 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6979e10b-12c8-4488-8833-e584ed244d4a tempest-ListImageFiltersNegativeTestJSON-669075169 tempest-ListImageFiltersNegativeTestJSON-669075169-project] 10.222.0.48 "GET /compute/v2.1/images/5bd578e4-c72c-4de6-b63a-aa8f3497183c" status: 404 len: 62 microversion: 2.1 time: 0.229356 Oct 28 17:33:36.586570 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 706/1360] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:33:36 2022] GET /compute/v2.1/images/5bd578e4-c72c-4de6-b63a-aa8f3497183c => generated 62 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:33:36.598895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4dc430c-82c4-4f69-bb4b-3ffa92b47ded tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f7524232550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-711721835", "description": "tempest-description-45564134"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:36.864288 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b501418a-cb43-4dae-9d00-2c5ab7980889 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.739031 Oct 28 17:33:36.866504 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 655/1361] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:36.891134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "name": "network-vif-unplugged", "status": "completed", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:36.915290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:36.916075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:36.917742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:36.940831 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] Creating event network-vif-unplugged:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h2-860864-13 Oct 28 17:33:36.976751 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4535afd9-9fdf-4b2b-ad16-dad1cacf867b req-421b8de3-ee7f-4fd7-936f-fb4e192fe13a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102875 Oct 28 17:33:36.991236 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 656/1362] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:37.003819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:37.006174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:37.018889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:37.020263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:37.020714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:37.022066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:37.022534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:37.023049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:37.324806 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4dc430c-82c4-4f69-bb4b-3ffa92b47ded tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.737032 Oct 28 17:33:37.325477 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 707/1363] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:36 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:37.630504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db45b8-e070-419d-8ecd-c48dbabca1b5", "name": "network-vif-plugged", "status": "completed", "tag": "9853bdb8-6be0-4f14-bced-06a7da0d2966"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:37.652229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:37.652724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:37.653165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:37.678829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:37.682058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] Creating event network-vif-plugged:9853bdb8-6be0-4f14-bced-06a7da0d2966 for instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 on n-h2-860864-13 Oct 28 17:33:37.687870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7cf2026d-0212-43aa-bc41-e775fb7ff1bd req-4fad57eb-a2a5-4411-bbcd-3c259f738c3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351201 Oct 28 17:33:37.689238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-555a2268-60e8-45de-a8ca-5897c09f1602 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1319 microversion: 2.1 time: 0.696367 Oct 28 17:33:37.690621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 708/1364] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:37.693696 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 657/1365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:36 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:37.717698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:37.718636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:37.721994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-75494352", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f31be05a-e5f0-421d-873b-8a293965faf2"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:37.731951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:37.733064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:37.733693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:37.735290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:37.736165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:37.738031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:37.793390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:37.837965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] validate_networks() for [('f31be05a-e5f0-421d-873b-8a293965faf2', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:38.677691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:38.690937 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f405dc8d-31df-4462-816d-2f99b0cf1c61 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1320 microversion: 2.1 time: 0.995752 Oct 28 17:33:38.697093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 658/1366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:37 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1320 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:38.702224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9c845da-4d83-480b-bc26-0fdf78276dde tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752427e790>, body: {"security_group_rule": {"parent_group_id": "884ba06b-9db3-4b9d-b372-8c159ca512c2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c75a00f6-47d7-4210-b6c0-4c263d0fbef2"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:39.436858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:33:39.441274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:33:39.442416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:33:39.443165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:33:39.444053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:33:39.455654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.456695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.457643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:39.458629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.459806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.460607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:39.508679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Getting quotas for project 752dac7c550f4373a66e681d9d7bef55. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:39.516300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Getting quotas for user fa1e1df5315948d3894f8ecbd3c264c0 and project 752dac7c550f4373a66e681d9d7bef55. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:39.547902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:33:39.552225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:39.621067 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bfb62e49-2a43-4811-8e3f-0b70fa8fb59e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928572 Oct 28 17:33:39.629307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 709/1367] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:33:39.635711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:39.636323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:39.644776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.645644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.646306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:39.647190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.647917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.652244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:39.867387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9c845da-4d83-480b-bc26-0fdf78276dde tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.168614 Oct 28 17:33:39.875439 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 659/1368] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:38 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:39.875439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:39.875439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:39.888189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.894424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.895272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:39.896543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:39.897236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:39.897894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.391900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:40.405140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:40.406584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:40.407800 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92142822-b73d-4642-84eb-8c1ae2538168 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.777399 Oct 28 17:33:40.408356 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 710/1369] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:39 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:40.413794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:40.424804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:40.449380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.450501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.452208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.453131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.453763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.454374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.577411 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98566d3e-7350-4c21-90e8-0eda91fad6ce tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1862 microversion: 2.1 time: 0.708207 Oct 28 17:33:40.592721 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 660/1370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:39 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1862 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:40.603861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:40.614393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.614993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.615553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.629266 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] Creating event network-changed:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h2-860864-13 Oct 28 17:33:40.636597 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-baca3226-aab6-4d2b-b002-967256da3cf5 req-16ab7a5f-a5e9-4034-bb6a-ca66dad8e1f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041493 Oct 28 17:33:40.640051 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 661/1371] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:40.655921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2e382e-4d4a-4e73-8929-4ce4606d0594", "tag": "f8915686-fae8-4aae-a533-3b67f51b80d8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:40.673061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.673862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.675578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.689191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] Creating event network-changed:f8915686-fae8-4aae-a533-3b67f51b80d8 for instance 6c2e382e-4d4a-4e73-8929-4ce4606d0594 on n-h2-860864-13 Oct 28 17:33:40.696175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-770b2f2a-f58e-404c-af21-dd4bdd6adf9c req-6d147710-5a72-4caf-8397-310d125e57ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053957 Oct 28 17:33:40.699921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 662/1372] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:40.706906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:40.707922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:40.715972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.716962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.717637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.720736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:40.721989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:40.722771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:40.960761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:40.976573 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00cabdb1-71fd-46cb-ab44-b2b884337931 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1210 microversion: 2.1 time: 0.275079 Oct 28 17:33:40.982386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 663/1373] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:40 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1210 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:40.989538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:41.000305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:41.008897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:41.010149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:41.012701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:41.013692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:41.019550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:41.020238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:41.046331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:41.060639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa703628-2c25-4e74-8ce6-ef614c0416f5 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1319 microversion: 2.1 time: 0.650324 Oct 28 17:33:41.061237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 711/1374] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:40 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:41.070350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be0f6818-8b0c-4cb5-841f-3d980d96b55a tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f752414e280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:41.454179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:41.510701 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72e999b7-5f85-4a3a-8506-a5818bb3b703 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1469 microversion: 2.1 time: 0.525483 Oct 28 17:33:41.512920 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 664/1375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:40 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:41.528117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": true, "disk_over_commit": false}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:41.535847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:41.557579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:41.558323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:41.558914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:41.560181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:41.560977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:41.566671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:41.598902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lazy-loading 'flavor' on Instance uuid 9296eac6-dd58-4654-adce-1d025ea51036 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:33:41.625080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:33:42.093967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-be0f6818-8b0c-4cb5-841f-3d980d96b55a tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/c75a00f6-47d7-4210-b6c0-4c263d0fbef2" status: 202 len: 0 microversion: 2.1 time: 1.031656 Oct 28 17:33:42.100664 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 712/1376] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:41 2022] DELETE /compute/v2.1/os-security-groups/c75a00f6-47d7-4210-b6c0-4c263d0fbef2 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:42.106359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:42.107351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:42.127826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:42.133558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:42.134796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:42.148278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:42.148879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:42.149581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:42.565551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:42.580045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:42.584493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:42.588154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d895e0e-3198-4fa3-b695-8fdf6714c642 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.484869 Oct 28 17:33:42.588795 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 713/1377] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:42 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:42.954977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:42.955910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:42.964703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:42.966236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:42.966922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:42.967972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:42.969023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:42.969708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.008658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:33:43.115803 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cd1cf15-dc40-44df-b490-e6b3b0a6a1e3 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 204 len: 0 microversion: 2.1 time: 0.524108 Oct 28 17:33:43.117308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 714/1378] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:33:42 2022] DELETE /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:43.125835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:43.126946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:43.136291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.137129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.138311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.139476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.140159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.140800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.168800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:43.285977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:43.295655 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78a74993-defe-4fd8-a123-25f479c75e37 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1272 microversion: 2.1 time: 0.176802 Oct 28 17:33:43.299783 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 715/1379] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:43 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:43.311865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:43.312734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:43.323342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.323912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.324554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.325778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.326542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.327522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.531570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:43.542953 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c628327e-5b14-4c8a-9350-765b58a37bb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1319 microversion: 2.1 time: 0.234939 Oct 28 17:33:43.543581 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 716/1380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:43 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:43.562623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc63d788-7502-4871-a1d3-109fad46db3c tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f7524118280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:43.821247 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc63d788-7502-4871-a1d3-109fad46db3c tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/884ba06b-9db3-4b9d-b372-8c159ca512c2" status: 200 len: 247 microversion: 2.1 time: 0.264552 Oct 28 17:33:43.823928 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 717/1381] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:33:43 2022] GET /compute/v2.1/os-security-groups/884ba06b-9db3-4b9d-b372-8c159ca512c2 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:43.842113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83018cb-4453-4a58-952d-b53ffd9b6665", "tag": "5238aad4-1467-4c75-babf-ab98211e6b5e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:43.857386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.858504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.859311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.877233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] Creating event network-changed:5238aad4-1467-4c75-babf-ab98211e6b5e for instance f83018cb-4453-4a58-952d-b53ffd9b6665 on n-h1-860864-13 Oct 28 17:33:43.886811 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1c566436-78ac-4008-80be-f3370727d60d req-b0796bab-9bd2-4e85-9ad7-c74d53e3b67b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059162 Oct 28 17:33:43.888962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 718/1382] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:43.903036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:43.904039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:43.920481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.921090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.921610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:43.922420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:43.923094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:43.923801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:44.169560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:44.178922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3cfb22a-9ac9-4add-813b-ac2eb4da8379 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 200 len: 1475 microversion: 2.1 time: 0.288361 Oct 28 17:33:44.191899 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 719/1383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:43 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:44.201038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:44.201915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:44.208935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:44.209633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:44.210244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:44.211158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:44.211895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:44.212491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:44.577755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:44.603818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:44.606986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:44.612279 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b10264d-88af-4df1-901d-c446644784c0 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.415818 Oct 28 17:33:44.613145 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 720/1384] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:44 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:44.625295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a8a5138-af30-4772-93aa-57c762129cab tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752420e1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-249955126", "description": "tempest-description-2102739143"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:45.675257 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a8a5138-af30-4772-93aa-57c762129cab tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.059556 Oct 28 17:33:45.677517 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 721/1385] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:33:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:45.693994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:45.703871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:45.738158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:45.740970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:45.741457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:45.757792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:45.758963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:45.759656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:46.819293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:46.832971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ff3c08a-e9d3-4b50-a8e9-e9c64a6b7521 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1314 microversion: 2.1 time: 1.153800 Oct 28 17:33:46.833621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 722/1386] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:45 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:46.838833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:46.840098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:46.847975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:46.848924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:46.849548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:46.856009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:46.856690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:46.857700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:47.319953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:47.328055 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9009a4fe-4368-461b-9b9a-4ac9a9b1a36d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1319 microversion: 2.1 time: 0.493475 Oct 28 17:33:47.331068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 723/1387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:46 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:47.351437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:47.352283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:47.374881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:47.375516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:47.375935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:47.376661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:47.377868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:47.383947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:47.406256 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 HTTP/1.1 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '35db45b8-e070-419d-8ecd-c48dbabca1b5'} Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:47.409323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:33:47.414438 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:33:47.416462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:47.417456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc2fe7bf-d963-4e09-9bca-f9e62f1f1558 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 404 len: 111 microversion: 2.1 time: 0.074814 Oct 28 17:33:47.419101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 724/1388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:47 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:33:47.586455 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd9eb44b-0f8c-4de3-b3b6-237dcc0fa6d4 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/action" status: 202 len: 0 microversion: 2.1 time: 6.072013 Oct 28 17:33:47.589631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 665/1389] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:33:41 2022] POST /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/action => generated 0 bytes in 6076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:47.600418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a52a25e-21e0-41cf-b70d-1a34424acca2 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f7524286430>, body: {"security_group_rule": {"parent_group_id": "b0943a87-eca3-4f17-bfbd-b58643f3978d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:47.711169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:47.711795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:47.721616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:47.722118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:47.725598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:47.726390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:47.726953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:47.727552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.070829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:48.079826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:48.082052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:48.083182 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cd4b9ce-edbb-41e6-9a66-5cf1e194de5b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.662785 Oct 28 17:33:48.098183 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 725/1390] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:47 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:48.103647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db45b8-e070-419d-8ecd-c48dbabca1b5", "name": "network-vif-deleted", "tag": "9853bdb8-6be0-4f14-bced-06a7da0d2966"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:48.113580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.114064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.114500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.125780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] Creating event network-vif-deleted:9853bdb8-6be0-4f14-bced-06a7da0d2966 for instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 on n-h2-860864-13 Oct 28 17:33:48.131257 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2ca367d1-9f49-4edb-81a2-fd41869a6c46 req-f1349c87-ed10-4d7d-9af1-71e70edcbcd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Oct 28 17:33:48.132084 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 726/1391] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:48.136920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2e382e-4d4a-4e73-8929-4ce4606d0594", "name": "network-vif-plugged", "status": "completed", "tag": "f8915686-fae8-4aae-a533-3b67f51b80d8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:48.147509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.148114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.148587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.161669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] Creating event network-vif-plugged:f8915686-fae8-4aae-a533-3b67f51b80d8 for instance 6c2e382e-4d4a-4e73-8929-4ce4606d0594 on n-h2-860864-13 Oct 28 17:33:48.167521 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8eeba5b6-e8d2-4536-b0bb-c34847704ae3 req-d3c85ae5-d454-4e6b-827b-aa9847efc174 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Oct 28 17:33:48.168120 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 727/1392] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:48.171537 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a52a25e-21e0-41cf-b70d-1a34424acca2 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.580225 Oct 28 17:33:48.172269 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 666/1393] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:48.178019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1587534024", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:48.178193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:48.181173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:48.192435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.193489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.193936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.194696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.195278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.195753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.223992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:48.269668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:48.881069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:48.889545 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80b8bf0e-710d-4c35-badf-3e133b7184bd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.719862 Oct 28 17:33:48.890118 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 728/1394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:48 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:48.896599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:48.896599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:48.901661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.902142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.902749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:48.903521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:48.904122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:48.904686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.134085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:33:49.134556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:33:49.134984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:33:49.135395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:33:49.135803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:33:49.145397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.145879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.146307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.147026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.147500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.147919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.169312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Getting quotas for project 93d97c7650dc43b9a839ec46b4a86d45. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:49.176498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Getting quotas for user 96982d859d5944e19ab3f68b52d32953 and project 93d97c7650dc43b9a839ec46b4a86d45. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:49.189446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:33:49.193103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:49.245353 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5de7fbfa-1ba5-4d86-8b47-e78e84bae4fc tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071496 Oct 28 17:33:49.246859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 667/1395] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:33:49.251714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66ee954d-ad17-4c8e-9a24-df6c0e5e70e2 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Action: 'create', calling method: .version_select at 0x7f752423e670>, body: {"security_group_rule": {"parent_group_id": "b0943a87-eca3-4f17-bfbd-b58643f3978d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:49.271527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:49.288444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76a6b14e-4578-4042-ae66-d467c9e0d7a2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1314 microversion: 2.1 time: 0.396801 Oct 28 17:33:49.288872 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 729/1396] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:48 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:49.294113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:49.294761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:49.301823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.302351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.302787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.303508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.304555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.305002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.478309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:49.536766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:49.622100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:49.632705 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-083cf4e9-e85b-4b1a-b64d-d9211224f715 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1319 microversion: 2.1 time: 0.342560 Oct 28 17:33:49.655395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 730/1397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:49 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:49.663776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:49.665000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:49.674227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.675167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.676317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:49.678228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:49.678895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:49.679859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.453577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:50.465025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:50.466491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:50.480405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5e78ed3-c789-469f-aa5c-d2b2ad43e18d tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.810787 Oct 28 17:33:50.481581 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 731/1398] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:49 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:50.496461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:50.497391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:50.500175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:50.506129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.506620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.507258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.508261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.508883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.509312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.522877 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66ee954d-ad17-4c8e-9a24-df6c0e5e70e2 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.274606 Oct 28 17:33:50.530090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 668/1399] 10.222.0.48 () {60 vars in 1195 bytes} [Fri Oct 28 17:33:49 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:50.530090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:50.530090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:50.550595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.551458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.552099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.554334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.555120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.556923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.641108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:50.656626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4ecb459-e504-496b-a712-02307fb22469 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1216 microversion: 2.1 time: 0.172570 Oct 28 17:33:50.659938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 732/1400] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:50 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:50.669426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4", "tag": "67f2f158-76a4-406b-a4b6-9f09938b15aa"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:50.696004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.701402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.702182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.719505 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] Creating event network-changed:67f2f158-76a4-406b-a4b6-9f09938b15aa for instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 on n-h1-860864-13 Oct 28 17:33:50.727734 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-be5093da-eee9-4498-9ecb-0444e80f7238 req-53a411d1-fc46-4339-8ea3-0fe208ace308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066141 Oct 28 17:33:50.728727 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 733/1401] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:50.734716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83018cb-4453-4a58-952d-b53ffd9b6665", "name": "network-vif-plugged", "status": "completed", "tag": "5238aad4-1467-4c75-babf-ab98211e6b5e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:50.770422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.771212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.771904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.793584 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] Creating event network-vif-plugged:5238aad4-1467-4c75-babf-ab98211e6b5e for instance f83018cb-4453-4a58-952d-b53ffd9b6665 on n-h1-860864-13 Oct 28 17:33:50.809912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-511113d5-6b69-486e-a5a2-aa148144d97c req-c370b6d2-643c-4ea6-ad2f-4d1f76655cf5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079437 Oct 28 17:33:50.810473 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 734/1402] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:50.819725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:50.844249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:50.858105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.875479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.878734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:50.879939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:50.885014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:50.886263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.024745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:51.034998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d56c2f7a-f677-48c7-80d4-dc3931267854 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.509653 Oct 28 17:33:51.035950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 669/1403] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:50 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:51.041727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5fc2a906-5f81-4f4b-99f7-e906499a26ac tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f7524286280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.178823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5fc2a906-5f81-4f4b-99f7-e906499a26ac tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/b0943a87-eca3-4f17-bfbd-b58643f3978d" status: 200 len: 664 microversion: 2.1 time: 0.141584 Oct 28 17:33:51.179514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 670/1404] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:33:51 2022] GET /compute/v2.1/os-security-groups/b0943a87-eca3-4f17-bfbd-b58643f3978d => generated 664 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:51.188297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.188297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:51.210761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.213918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.214900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.217025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.220152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.221197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.229733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:51.238709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87d98163-6eea-405b-8542-a58ca0a00693 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1314 microversion: 2.1 time: 0.425685 Oct 28 17:33:51.239298 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 735/1405] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:50 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:51.260631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd965d47-3921-4f8c-bfd8-c0eccf8b37ea tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f7524232160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.604517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:51.620692 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb320776-491e-484c-bba7-faed945f6dac tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 200 len: 1507 microversion: 2.1 time: 0.438720 Oct 28 17:33:51.621536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 671/1406] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:51 2022] GET /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 1507 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:51.635347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.637391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:51.653371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.653371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.653371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.653371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.653767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.655978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.686073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd965d47-3921-4f8c-bfd8-c0eccf8b37ea tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/5bb9d9d2-a277-4001-8264-68c8883b28c5" status: 202 len: 0 microversion: 2.1 time: 0.438584 Oct 28 17:33:51.688009 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 736/1407] 10.222.0.48 () {58 vars in 1287 bytes} [Fri Oct 28 17:33:51 2022] DELETE /compute/v2.1/os-security-group-rules/5bb9d9d2-a277-4001-8264-68c8883b28c5 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:51.696000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.698587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: f83018cb-4453-4a58-952d-b53ffd9b6665] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:51.712213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.712866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.713419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.714461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:51.715031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:51.715601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:51.980706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:51.981387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:51.991577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8e1063f-c8f2-45ac-8a3f-440714fe9ad3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665" status: 200 len: 1319 microversion: 2.1 time: 0.302099 Oct 28 17:33:51.992874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 737/1408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:51 2022] GET /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:51.998326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:51.999271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:52.004218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:52.007860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:52.008156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:52.008889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:52.009573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:52.010606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:52.011279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:52.011958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:52.012262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7721a5a1-993f-4f95-afcf-eb803e3ac071 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.385249 Oct 28 17:33:52.013949 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 672/1409] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:51 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:52.037083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45c3821e-158e-4ca8-9021-674a6c2cc265 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f7524260c10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:52.364813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:52.370180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:52.377425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae5edaaa-67d3-487d-accc-857e8a45613f tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1280 microversion: 2.1 time: 0.382973 Oct 28 17:33:52.388170 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 738/1410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:51 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1280 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:52.401433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:52.402282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:52.415833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:52.416489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:52.420054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:52.422354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:52.423161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:52.424528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:52.946479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:52.963089 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ba45eeb-733c-459a-b676-96614254f45a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.573462 Oct 28 17:33:52.967191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 739/1411] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:52 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:52.985231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:52.986415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:53.000943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.001457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.002479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.005936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.006927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.007970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.272267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:53.286822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-484e9543-dea5-48ad-8ffe-611328f2724d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1314 microversion: 2.1 time: 0.315047 Oct 28 17:33:53.287784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 740/1412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:52 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:53.310308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:53.311581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: f83018cb-4453-4a58-952d-b53ffd9b6665] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:53.328143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.329554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.330958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.332099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.332860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.335285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.416053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45c3821e-158e-4ca8-9021-674a6c2cc265 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b0943a87-eca3-4f17-bfbd-b58643f3978d" status: 202 len: 0 microversion: 2.1 time: 1.400896 Oct 28 17:33:53.419654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 673/1413] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:52 2022] DELETE /compute/v2.1/os-security-groups/b0943a87-eca3-4f17-bfbd-b58643f3978d => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:53.422882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:53.423397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:53.436140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.436634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.443671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.444637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.445300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.445909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.819222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:53.829145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d413a7f-e3bd-4a1a-8ef8-97b9ed8cabb6 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665" status: 200 len: 1506 microversion: 2.1 time: 0.539911 Oct 28 17:33:53.830277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 741/1414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:53 2022] GET /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:53.843715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:53.848628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:53.852426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:53.856197 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7dc416d9-ef24-4131-ac8a-87234e2c1acc tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1815 microversion: 2.25 time: 0.438023 Oct 28 17:33:53.857893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:53.858406 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 674/1415] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:53 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1815 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:53.859025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:53.866547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.867180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.867640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.868869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:53.869653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:53.870439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:53.872329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f75242600d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:53.963789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:33:53.964928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Neutron security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 not found {{(pid=120568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:33:53.966389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] HTTP exception thrown: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.966389 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Request method failure captured: Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-security-groups/c75a00f6-47d7-4210-b6c0-4c263d0fbef2 HTTP/1.1 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJksmoX97M7hQsWVHQlfuOM9_69f16g2ufpvLNZmDgMv_Vs560fveumtjkDGLExT4wLKVGDf9_H00NSV8na3JjUxyfQncFEZxow-mPoaOpft9fZ9iGLLCozx3x4JLIv1uD5BWJMMpHKZeuT43UCTxuo358aneRBGMyDZAV8AYEBpxg Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: f0f8204e0b014cae9c72686d1889d38a Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1057965167 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0f8204e0b014cae9c72686d1889d38a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f0f8204e0b014cae9c72686d1889d38a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f0f8204e0b014cae9c72686d1889d38a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f0f8204e0b014cae9c72686d1889d38a"}]}] Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1057965167 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: f0f8204e0b014cae9c72686d1889d38a Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1057965167 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupRulesTestJSON-1057965167-project Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 287be5de404b46c9a4ff665db9f70d46 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1057965167-project Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c75a00f6-47d7-4210-b6c0-4c263d0fbef2'} Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:33:53.969388 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] Oct 28 17:33:53.974249 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:33:53.982719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Returning 404 to user: Security group c75a00f6-47d7-4210-b6c0-4c263d0fbef2 does not exist Oct 28 17:33:53.982719 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-26ce0b88-ff59-412b-aa0a-28b6a963f008'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:33:53.988872 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d35e2bdb-9273-4168-b232-8d02c522bc83 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/c75a00f6-47d7-4210-b6c0-4c263d0fbef2" status: 404 len: 194 microversion: 2.1 time: 0.122244 Oct 28 17:33:53.988872 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 675/1416] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:53 2022] DELETE /compute/v2.1/os-security-groups/c75a00f6-47d7-4210-b6c0-4c263d0fbef2 => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:33:53.993608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:53.995404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: f83018cb-4453-4a58-952d-b53ffd9b6665] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:54.004973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.005743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.007224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.008263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.009279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.012524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.022405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:54.037694 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7993eb32-835f-427b-993d-d9bef6e6b617 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1278 microversion: 2.1 time: 0.186312 Oct 28 17:33:54.038486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 742/1417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:53 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:54.059919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:54.060971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:54.065238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: f83018cb-4453-4a58-952d-b53ffd9b6665] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:33:54.075450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.076344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.076978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.077903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.078533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.079132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.232910 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6998349d-a7f0-4f28-a7a8-4e79a3e3a099 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665" status: 204 len: 0 microversion: 2.1 time: 0.242715 Oct 28 17:33:54.237133 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 676/1418] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:33:53 2022] DELETE /compute/v2.1/servers/f83018cb-4453-4a58-952d-b53ffd9b6665 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:54.245669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-829ea716-6850-4858-be2b-b9cfa23ce526 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f75242dfca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:54.500980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:54.516636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9782559c-cc36-431a-8bbb-d6241f720ab8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.470410 Oct 28 17:33:54.517749 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 743/1419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:54 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:54.523236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:54.529708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:54.562719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.563216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.563879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.569383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.570337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.571105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.619338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: 6c2e382e-4d4a-4e73-8929-4ce4606d0594] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:33:54.869259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae1cfa03-fe3e-46bf-b559-bbea82d9eccb tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594" status: 204 len: 0 microversion: 2.1 time: 0.349359 Oct 28 17:33:54.869861 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 744/1420] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:33:54 2022] DELETE /compute/v2.1/servers/6c2e382e-4d4a-4e73-8929-4ce4606d0594 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:33:54.879917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:54.891936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:54.901361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.902157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.906132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.910741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.911611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.912308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:54.913706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-829ea716-6850-4858-be2b-b9cfa23ce526 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/884ba06b-9db3-4b9d-b372-8c159ca512c2" status: 202 len: 0 microversion: 2.1 time: 0.678116 Oct 28 17:33:54.914373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 677/1421] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:54 2022] DELETE /compute/v2.1/os-security-groups/884ba06b-9db3-4b9d-b372-8c159ca512c2 => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:54.922890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4", "name": "network-vif-plugged", "status": "completed", "tag": "67f2f158-76a4-406b-a4b6-9f09938b15aa"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:54.954313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:54.954909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:54.955341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:55.003611 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] Creating event network-vif-plugged:67f2f158-76a4-406b-a4b6-9f09938b15aa for instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 on n-h1-860864-13 Oct 28 17:33:55.020074 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f2a9f526-c723-48b6-ab3b-8cdd4b218731 req-b527cc6b-f831-441d-be60-8a9094d57827 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100605 Oct 28 17:33:55.026630 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 678/1422] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:55.034096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:55.035179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:55.042148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:55.043036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:55.043819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:55.044778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:55.045479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:55.046133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:55.344709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:55.382331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d17f506-aa8f-4a59-9f52-9a012426e641 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1314 microversion: 2.1 time: 0.510983 Oct 28 17:33:55.401652 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 745/1423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:54 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:55.407490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a84f2946-e91d-43eb-971f-4b15c8311a44 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f75240b8f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:55.589976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:55.614435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:55.625314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:55.632503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52d91152-fa7c-4e65-a0b8-ce6525e5dab7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1805 microversion: 2.25 time: 0.604049 Oct 28 17:33:55.635311 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 679/1424] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:55 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1805 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:55.646578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:55.649402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:55.661266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:55.661759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:55.662192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:55.663436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:55.664075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:55.665669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:56.653122 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a84f2946-e91d-43eb-971f-4b15c8311a44 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/5ec6a49e-a99a-4749-9c31-09117376b6a9" status: 202 len: 0 microversion: 2.1 time: 1.249436 Oct 28 17:33:56.654276 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 746/1425] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:55 2022] DELETE /compute/v2.1/os-security-groups/5ec6a49e-a99a-4749-9c31-09117376b6a9 => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:56.660216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-631564244", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9330f139-8006-49b3-bc9e-54be91c02f21"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:56.691887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:56.706411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:56.711777 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d747cda-91e9-43b2-b9c1-a20892483ebb tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 1.075071 Oct 28 17:33:56.715007 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 680/1426] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:55 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:56.721817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:56.722669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:56.729978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:56.730727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:56.731394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:56.732578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:56.733441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:56.734063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:56.773156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] validate_networks() for [('9330f139-8006-49b3-bc9e-54be91c02f21', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:33:57.357525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:57.367512 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-803c2e10-20c2-454c-8abe-6729a429cc3d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.650087 Oct 28 17:33:57.368398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 681/1427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:56 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:57.375695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b6c1dc5-d874-499e-b7b9-e3b3c685f0fb tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '.version_select at 0x7f752423e040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:57.381700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c1dc5-d874-499e-b7b9-e3b3c685f0fb tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:57.383306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c1dc5-d874-499e-b7b9-e3b3c685f0fb tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:57.387554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c1dc5-d874-499e-b7b9-e3b3c685f0fb tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:57.403111 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b6c1dc5-d874-499e-b7b9-e3b3c685f0fb tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2806 microversion: 2.25 time: 0.033452 Oct 28 17:33:57.415307 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 682/1428] 10.222.0.48 () {60 vars in 1184 bytes} [Fri Oct 28 17:33:57 2022] GET /compute/v2.1/os-migrations => generated 2806 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:57.423905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:57.431407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:57.444585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:57.445435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:57.446093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:57.447122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:57.447824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:57.448473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:57.981788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:33:58.003223 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f82e69d6-2b38-4a3f-8a1d-8ce43ee5a3f1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1502 microversion: 2.1 time: 0.586196 Oct 28 17:33:58.003895 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 683/1429] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:57 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:33:58.014990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e043341c-2870-41df-9a8c-15192ce89bc9 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f75242a4670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:58.271008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:33:58.271604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:33:58.272277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:33:58.272790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:33:58.273314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:33:58.286453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:58.287617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:58.289211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:58.292316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:58.292882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:58.293442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:58.337020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Getting quotas for project 5c45164b59c3403e83844ab0698c594e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:33:58.343588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Getting quotas for user 46f174f0096144acb1eecea234b820ef and project 5c45164b59c3403e83844ab0698c594e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:33:58.359659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Going to run 2 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:33:58.384013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:58.437336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=e4de2a39-2696-411a-80a3-491b0a249e1a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:33:58.550054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76fbf66e-fa4f-44f7-8bd3-bd34d84a11fd tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.892156 Oct 28 17:33:58.551593 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 747/1430] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:33:56 2022] POST /compute/v2.1/servers => generated 32 bytes in 1897 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:33:58.566956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:58.568696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:58.614492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:58.615071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:58.619623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:58.621536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:58.622525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:58.622804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:59.157241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:59.184685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:33:59.513651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:33:59.571023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-435e5afd-7633-4e50-9344-b0a2dd465ec3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 2426 microversion: 2.25 time: 1.017574 Oct 28 17:33:59.589735 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 748/1431] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:33:58 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 2426 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:33:59.608905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:33:59.609709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:59.618067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:59.618892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:59.619729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:59.620777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:59.622511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:59.624290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:59.658063 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e043341c-2870-41df-9a8c-15192ce89bc9 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3b569913-a105-4969-97f5-8093a9b38151" status: 202 len: 0 microversion: 2.1 time: 1.651830 Oct 28 17:33:59.659220 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 684/1432] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:33:58 2022] DELETE /compute/v2.1/os-security-groups/3b569913-a105-4969-97f5-8093a9b38151 => generated 0 bytes in 1654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:33:59.664265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541da5d7-1ea2-4ed6-a6b8-97bccbe1f362", "tag": "f0f91e2c-d119-49cb-86a8-78eebd2f7b2f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:59.686500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:59.687314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:59.688380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:59.708769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] Creating event network-changed:f0f91e2c-d119-49cb-86a8-78eebd2f7b2f for instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 on n-h2-860864-13 Oct 28 17:33:59.715431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-807b5c90-37d7-45de-9502-5a29677b2a4c req-a558ed92-ed8d-403e-82b6-ba56f168ef31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054148 Oct 28 17:33:59.716984 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 685/1433] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:33:59.727832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1133787004"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:33:59.728868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:33:59.743434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:59.753671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:59.757445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:33:59.760961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:33:59.762224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:33:59.765810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:00.396884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:00.405346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c51fc1af-542b-40dd-a25d-6a9a45b069de tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 0.814404 Oct 28 17:34:00.410074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 749/1434] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:33:59 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:00.427906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:00.434181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:00.446063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:00.447690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:00.450753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:00.451774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:00.452509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:00.460218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:00.512515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Adding security group 4a30b8ac-4954-4170-b48e-65e018efc8bb to port 67f2f158-76a4-406b-a4b6-9f09938b15aa Oct 28 17:34:00.830861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:00.851688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-885a1fcb-25a0-4431-b0de-6f035230b042 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.435920 Oct 28 17:34:00.853734 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 750/1435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:00 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:00.860952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2e382e-4d4a-4e73-8929-4ce4606d0594", "name": "network-vif-deleted", "tag": "f8915686-fae8-4aae-a533-3b67f51b80d8"}, {"server_uuid": "f83018cb-4453-4a58-952d-b53ffd9b6665", "name": "network-vif-deleted", "tag": "5238aad4-1467-4c75-babf-ab98211e6b5e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:00.901552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:00.918861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:00.919448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:00.963538 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Creating event network-vif-deleted:f8915686-fae8-4aae-a533-3b67f51b80d8 for instance 6c2e382e-4d4a-4e73-8929-4ce4606d0594 on n-h2-860864-13 Oct 28 17:34:00.966211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] Creating event network-vif-deleted:5238aad4-1467-4c75-babf-ab98211e6b5e for instance f83018cb-4453-4a58-952d-b53ffd9b6665 on n-h1-860864-13 Oct 28 17:34:00.994163 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2effb0fa-0e2c-464e-860b-5cae6d8a4ecc req-07db862e-58e4-44c7-8278-fd4013a4907f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138854 Oct 28 17:34:00.997187 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 751/1436] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:01.012738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:01.023030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:01.024893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Searching by: {'deleted': False, 'project_id': '5c45164b59c3403e83844ab0698c594e'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:34:01.035644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.036578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.037783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.039202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.039860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.040451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.088378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:34:01.124222 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2074dcad-eb0c-41ae-bd1a-2437c5fbe68a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.124614 Oct 28 17:34:01.125249 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 752/1437] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:34:00 2022] GET /compute/v2.1/servers => generated 671 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:01.132294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:01.133276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:01.140775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.141539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.142237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.143764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.144419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.145023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.216238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-327a9474-18a3-4397-9c33-56f79b7b2c11 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/action" status: 202 len: 0 microversion: 2.1 time: 1.497452 Oct 28 17:34:01.221165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 686/1438] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:33:59 2022] POST /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/action => generated 0 bytes in 1500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:01.226406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-36db8fc9-1478-4d9e-8f9b-bf5bf330f09e tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f75242863a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:01.544402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:01.576265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35c6e9af-5643-4665-b5ea-e2faf07a2f31 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 2426 microversion: 2.25 time: 0.448489 Oct 28 17:34:01.581679 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 753/1439] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:34:01 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 2426 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:34:01.619957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:01.621398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:01.635576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.640070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.640850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.644710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.647049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.647953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.698992 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-36db8fc9-1478-4d9e-8f9b-bf5bf330f09e tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/cc8335f2-00b2-4710-8d36-7b2351ba359f" status: 202 len: 0 microversion: 2.1 time: 0.476126 Oct 28 17:34:01.700022 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 687/1440] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:01 2022] DELETE /compute/v2.1/os-security-groups/cc8335f2-00b2-4710-8d36-7b2351ba359f => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:01.705851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1413999994"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:01.706500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:01.725876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.726398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.726841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.733417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.734057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.734517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.823813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:01.836454 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3920be31-6492-4712-9db5-2ea0a4b2eb8f tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1213 microversion: 2.1 time: 0.236512 Oct 28 17:34:01.838995 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 754/1441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:01 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:01.858196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:01.860522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:01.883237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.884801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.886340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.890183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:01.892349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:01.894549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:01.913527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:01.989720 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Adding security group 3308f6ff-bcf3-48b6-bbfa-38cdc8af41c7 to port 67f2f158-76a4-406b-a4b6-9f09938b15aa Oct 28 17:34:02.399906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:02.448274 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56fd426c-dabc-422d-9a11-c0de3392254d tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 0.605557 Oct 28 17:34:02.449338 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 755/1442] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:01 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:02.456077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a43f2b51-ab5d-401f-8bdb-bcd719553106 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] Calling method '.version_select at 0x7f752414ed30>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:02.906795 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9db8d6d4-9997-4b0c-ac88-a8d0db96e564 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/action" status: 202 len: 0 microversion: 2.1 time: 1.205695 Oct 28 17:34:02.907702 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 688/1443] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:34:01 2022] POST /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/action => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:02.926963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:02.931098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:02.957034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:02.965050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:02.968587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:02.968587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:02.972410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:02.972997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:03.501558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a43f2b51-ab5d-401f-8bdb-bcd719553106 tempest-SecurityGroupRulesTestJSON-1057965167 tempest-SecurityGroupRulesTestJSON-1057965167-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d4578732-e41e-44df-9d22-0a93960d578d" status: 202 len: 0 microversion: 2.1 time: 1.050822 Oct 28 17:34:03.507024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 756/1444] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:02 2022] DELETE /compute/v2.1/os-security-groups/d4578732-e41e-44df-9d22-0a93960d578d => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:03.518728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4", "tag": "67f2f158-76a4-406b-a4b6-9f09938b15aa"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:03.566008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:03.570319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:03.571853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:03.599678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] Creating event network-changed:67f2f158-76a4-406b-a4b6-9f09938b15aa for instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 on n-h1-860864-13 Oct 28 17:34:03.661289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-56ccf9ca-ae09-4c58-a0b1-80411b374a30 req-c177574d-536c-4f31-88ad-b2ba1a129c01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140865 Oct 28 17:34:03.662369 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 757/1445] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:03.708905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:03.710245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:03.745308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:03.748492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:03.758591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:03.761426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:03.763754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:03.765831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:03.791231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lazy-loading 'services' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:04.050521 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83e092cc-3294-4fd9-a711-b54ada9539bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments/51c36d8e-4079-4a45-96c4-3ecd2617a6a5" status: 202 len: 0 microversion: 2.25 time: 1.139275 Oct 28 17:34:04.054557 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 689/1446] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Oct 28 17:34:02 2022] DELETE /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments/51c36d8e-4079-4a45-96c4-3ecd2617a6a5 => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:34:04.070181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:04.071480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:04.085840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.090309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.090821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:04.096845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.097403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.097854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:04.547349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:04.563250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-27c795aa-6de7-4059-bcad-feee8134ff74 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1269 microversion: 2.1 time: 0.504454 Oct 28 17:34:04.567692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 690/1447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:04 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1269 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:04.585128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:04.585678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:04.613761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.614926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.619120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:04.622836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.624336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.624789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:04.662822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:04.687242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-592e572a-46f5-47c9-ae93-9d3990be2f38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.004171 Oct 28 17:34:04.692261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 758/1448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:03 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:04.738316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:04.747311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:04.828244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.836813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.840685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:04.852225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:04.856051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:04.857679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.011903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:06.028622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5fdbd44-cc2a-40d3-a78b-17e16f24e745 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 1.328674 Oct 28 17:34:06.029265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 759/1449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:04 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:06.035060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:06.056255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:06.069547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.071930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.073331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.075161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.075874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.076502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.145083 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44e32253-494b-42fa-9890-df0f8c5eb975 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114424 Oct 28 17:34:06.154013 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 760/1450] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:06 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:34:06.159667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:06.160533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:06.167605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.168362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.169126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.170019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.170633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.171215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.354066 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66b07a3c-27cf-4161-a148-2b63b6b5e255 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.783940 Oct 28 17:34:06.366799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 691/1451] 10.222.0.48 () {58 vars in 1293 bytes} [Fri Oct 28 17:34:04 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4/os-security-groups => generated 1157 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:06.371809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:06.372406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:06.382730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.387042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.387588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.391729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.393743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.395753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.406758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:06.420956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74ee9220-1e38-42ad-bb76-0d1c9446aea1 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1275 microversion: 2.1 time: 0.265407 Oct 28 17:34:06.421808 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 761/1452] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:06 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:06.433143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4", "tag": "67f2f158-76a4-406b-a4b6-9f09938b15aa"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:06.454401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:06.459131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:06.459810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:06.485332 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] Creating event network-changed:67f2f158-76a4-406b-a4b6-9f09938b15aa for instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 on n-h1-860864-13 Oct 28 17:34:06.504949 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4138a446-c00f-4236-8644-3ad93e27e5e1 req-ab0c798c-5373-4b75-8566-390209bc9cbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079656 Oct 28 17:34:06.506658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 762/1453] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:06.527401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d5636be-9aee-4cd3-88dc-1c3b0c64506a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f7524303d30>, body: {"security_group": {"name": " tempest-securitygroup -120656227 ", "description": "tempest-description-1805310574"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:06.839278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:06.852832 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7aa5baeb-0e22-4743-a266-3ff14761a850 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.484535 Oct 28 17:34:06.867456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 692/1454] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:06 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:07.030363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541da5d7-1ea2-4ed6-a6b8-97bccbe1f362", "name": "network-vif-plugged", "status": "completed", "tag": "f0f91e2c-d119-49cb-86a8-78eebd2f7b2f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:07.057678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.058156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.058584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.114069 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] Creating event network-vif-plugged:f0f91e2c-d119-49cb-86a8-78eebd2f7b2f for instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 on n-h2-860864-13 Oct 28 17:34:07.136097 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-cf1d5e31-29ca-4af1-a703-594ad22c5ad7 req-71f8fcc5-7a56-4c15-89d7-739f0776f650 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109295 Oct 28 17:34:07.139241 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 693/1455] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:07.149636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:07.156701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:07.179093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.179615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.180048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.180757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.181203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.181631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.474212 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d5636be-9aee-4cd3-88dc-1c3b0c64506a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.963059 Oct 28 17:34:07.474212 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 763/1456] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:06 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:07.492006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:07.492006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:07.510208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.512207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.513968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.515042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.518191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.518852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.604948 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23c3fdd0-ada5-4f14-9086-2e3d93fe9e8a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129887 Oct 28 17:34:07.607793 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 764/1457] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:07 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:34:07.618984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:07.623323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:07.637700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.639054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.639712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.640646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:07.642742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:07.643834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:07.814962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:07.828572 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98982100-ff26-489e-9722-56ba3f261e81 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 0.685800 Oct 28 17:34:07.831172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 694/1458] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:07 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:07.842767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1397af54-85d8-4f73-b96f-7fee6f05ba86 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752423e550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:08.022953 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1397af54-85d8-4f73-b96f-7fee6f05ba86 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19" status: 200 len: 223 microversion: 2.1 time: 0.188912 Oct 28 17:34:08.024267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 695/1459] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:07 2022] GET /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 => generated 223 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:08.037112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:08.037725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:08.063151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.064330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.064330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.064999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.065440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.066071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.158897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:08.167693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e52185f-a417-473b-ade2-969a65cc4fea tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.556552 Oct 28 17:34:08.176329 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 765/1460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:07 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:08.181505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0327c197-fe92-4cfc-9fa3-5e438e6910c4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524336c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:08.352609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:08.748977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:08.769635 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5f89a89-d5c8-488a-8a44-922bebcf551e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.736264 Oct 28 17:34:08.770229 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 696/1461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:08 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:08.775171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4de2a39-2696-411a-80a3-491b0a249e1a", "tag": "492d00c5-8f6b-4628-a083-b49ec5c12a4c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:08.790123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.796220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.796869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.834855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] Creating event network-changed:492d00c5-8f6b-4628-a083-b49ec5c12a4c for instance e4de2a39-2696-411a-80a3-491b0a249e1a on n-h2-860864-13 Oct 28 17:34:08.843331 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-bda20c08-69e0-4bc5-8940-cccd71037816 req-0dde0abe-ba80-4525-8be3-b6861607ce9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071623 Oct 28 17:34:08.847855 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 697/1462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:08.868230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:08.873606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:08.884940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.885710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.886345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.887827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.888513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.889187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.934973 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f119bcd-2858-441b-8c27-b69a686cbef2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083412 Oct 28 17:34:08.935844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 698/1463] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:08 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:34:08.945625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:08.946232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:08.953642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.955223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.955974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:08.956893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:08.958236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:08.958856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:09.125554 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0327c197-fe92-4cfc-9fa3-5e438e6910c4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19" status: 202 len: 0 microversion: 2.1 time: 0.947719 Oct 28 17:34:09.128336 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 766/1464] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:08 2022] DELETE /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:09.147077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524303040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:09.211103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:09.222253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:09.225711 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.225711 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 HTTP/1.1 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0311392c-3b7f-40d3-8ea7-c46e729bdd19'} Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:09.235199 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:34:09.242330 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-8e815fc0-b0c0-4f32-8cce-1bbb63ee411b'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:09.249813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4287d8f2-4dea-4182-9e2d-4e69648b919b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19" status: 404 len: 194 microversion: 2.1 time: 0.108078 Oct 28 17:34:09.249813 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 767/1465] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:09 2022] GET /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:34:09.260360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:09.275884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10531fc6-b992-453f-956d-869c51e5b9d2 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1320 microversion: 2.1 time: 0.328547 Oct 28 17:34:09.276000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:09.276000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:09.285846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:09.286348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:09.286792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:09.287550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:09.288007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:09.288443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:09.302473 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 699/1466] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:08 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:09.307428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85dbf364-8b6d-4ce1-87a6-bec5bd3e6428 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f7524103280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1898318797", "description": "tempest-description-1551545137"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:09.773012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:09.785760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c4b2f15-7bdc-4db9-8512-7738c64e6cdf tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.536045 Oct 28 17:34:09.792233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 768/1467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:09 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:09.802838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:09.803490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:09.825026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:09.825937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:09.827878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:09.830148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:09.833289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:09.834077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:09.868116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85dbf364-8b6d-4ce1-87a6-bec5bd3e6428 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.563770 Oct 28 17:34:09.872416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 700/1468] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:09.884690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fadf8471-0713-4e7d-b7fe-7dba63ae4bcb tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f75241f9700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1746884259", "description": "tempest-description-166074011"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:10.182820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:10.197657 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f2e2227-0707-4599-bcfd-356886669339 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.403918 Oct 28 17:34:10.198714 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 769/1469] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:09 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:10.230319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:10.234613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:10.252535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.253046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.253493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.254228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.254682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.259326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.313052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27ebae2a-b480-4f30-9c40-9f2146fea4e6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.112993 Oct 28 17:34:10.314040 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 770/1470] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:10 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:34:10.319007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:10.320133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:10.327564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.328439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.329636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.330582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.331068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.331553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.487817 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fadf8471-0713-4e7d-b7fe-7dba63ae4bcb tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.609084 Oct 28 17:34:10.489031 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 701/1471] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:10.504498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3c8d793-3b73-46ce-b55b-6bb581cf3f55 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f75242a4940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-693703792", "description": "tempest-description-1936474340"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:10.710070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:10.718589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc132614-84af-4245-8e4c-decdc189d4b4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1469 microversion: 2.1 time: 0.403272 Oct 28 17:34:10.720105 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 771/1472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:10 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:10.744281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:10.747472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:10.755603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.756341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.757052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.758375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.759314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.760046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.895291 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73e79c5b-9e5a-4844-aa06-6a346c420fa4 tempest-DeleteServersAdminTestJSON-664635310 tempest-DeleteServersAdminTestJSON-664635310-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362/action" status: 202 len: 0 microversion: 2.1 time: 0.154933 Oct 28 17:34:10.896325 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 772/1473] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:34:10 2022] POST /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:10.904301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:10.904672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:10.922259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3c8d793-3b73-46ce-b55b-6bb581cf3f55 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.424325 Oct 28 17:34:10.928031 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 702/1474] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:10.928491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.929060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.929498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.930208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.930659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.931078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.944524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:10.945179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:10.979014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.979526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.980172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:10.981281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:10.981897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:10.982483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.029852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.030544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.049909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.052061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lazy-loading 'fault' on Instance uuid 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:11.055079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:11.288188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:11.297308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-177a266f-1642-44ca-94a4-a1b2a404d663 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.397050 Oct 28 17:34:11.299875 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 773/1475] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:10 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:11.305353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39ffc3c-934f-4954-ad63-80e87d894535", "tag": "40cbd656-1193-4f0a-b24c-138f9c359e38"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:11.318638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:11.322407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.322976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.323512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.330340 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55c9db00-b3f7-49e9-bd6d-44b633d39876 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1452 microversion: 2.1 time: 0.400096 Oct 28 17:34:11.330965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 703/1476] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:10 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1452 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:11.338163 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] Creating event network-changed:40cbd656-1193-4f0a-b24c-138f9c359e38 for instance b39ffc3c-934f-4954-ad63-80e87d894535 on n-h2-860864-13 Oct 28 17:34:11.347273 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-10253c9e-0091-41f8-9754-d1bfb1eb1f3c req-d12f5ecd-5df2-40a2-800c-fc73e0f193fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045768 Oct 28 17:34:11.348514 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 774/1477] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:11.372259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2b884de-3f3b-4a8c-99e2-8537e5de0fd5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524192af0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:11.373010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:11.373927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:11.381767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.382477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.383186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.384099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.384768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.385369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.681146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:11.703682 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7548c3a5-fe50-4d43-9d6d-8fe37e620be2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.347366 Oct 28 17:34:11.721590 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 775/1478] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:11 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:11.738209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:11.752726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:11.757882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:11.772139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.775635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.776995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.779835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.780531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.781819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.792121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:11.880601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-26ea6e7c-0d88-4594-a4cb-0bc1ae5fdba2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.155316 Oct 28 17:34:11.885324 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 776/1479] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:11 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:34:11.896240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:11.899481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:11.926506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.927338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.927972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.928879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:11.934453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:11.934934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:11.984468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2b884de-3f3b-4a8c-99e2-8537e5de0fd5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.631822 Oct 28 17:34:11.986692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 704/1480] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:34:11 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:12.000731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54314dbe-ef0f-4208-8273-7bfa1d195bdd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752427e0d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:12.023899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:34:12.210503 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bd4af78-2af0-41ce-af30-11d685cda516 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "DELETE /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 204 len: 0 microversion: 2.1 time: 0.325670 Oct 28 17:34:12.211269 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 777/1481] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:11 2022] DELETE /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:34:12.221094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:12.222171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:12.229500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.230340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.231280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.232242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.232919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.233565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.287934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.288819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.289363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.290423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lazy-loading 'fault' on Instance uuid 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:12.322579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54314dbe-ef0f-4208-8273-7bfa1d195bdd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40" status: 202 len: 0 microversion: 2.1 time: 0.326083 Oct 28 17:34:12.323347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 705/1482] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:11 2022] DELETE /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:34:12.329907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:12.331383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:12.339479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.340125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.340670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.341593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.342155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.342684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.862498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:12.869134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:12.870887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6ade8cc-9af0-4f50-8806-1072b477b3a4 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.546196 Oct 28 17:34:12.882580 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f66d5e36-9fd8-458b-a3cb-218d8c7adcee tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1458 microversion: 2.1 time: 0.664949 Oct 28 17:34:12.883734 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 778/1483] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:12 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1458 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:12.888580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75244255e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:12.895093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 706/1484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:12 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:12.900107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "849efccc-c2a9-4714-b1d9-840d128fd424"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:12.902481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:12.922183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:12.922868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.923609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.924230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.924610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group f9599329-9ca0-4e95-a036-3e544ecffc40 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:12.925250 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.925250 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.925602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.926216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.926842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40 HTTP/1.1 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f9599329-9ca0-4e95-a036-3e544ecffc40'} Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:12.928916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-0fa57186-5787-4a17-8b39-ad8ffb0edc5c'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f6ef3a0-9cbe-4112-bdf4-55dc96346bdc tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40" status: 404 len: 194 microversion: 2.1 time: 0.046160 Oct 28 17:34:12.934436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 779/1485] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:12 2022] GET /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:12.962332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:12.963073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:12.983483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.984389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.986854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:12.991803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:12.992374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:12.993297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:13.274282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:13.282471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:13.292729 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f1104ae-44d9-4c3c-a0a0-f045175331eb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.355702 Oct 28 17:34:13.308143 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 780/1486] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:12 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:13.322501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:13.337621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:13.372178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:13.386639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:13.388029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:13.389335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:13.390055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:13.392464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:13.482053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0505a10a-54f8-46a8-b286-5bd896e554b8 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.170780 Oct 28 17:34:13.483744 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 781/1487] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:34:13 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:13.493115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b151593-2910-42a3-b0c1-205bed5ecd3e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524303c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:13.557420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-120dc09f-e652-402b-a73e-efa09cb2bc3b tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "POST /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660954 Oct 28 17:34:13.563547 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 707/1488] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:34:12 2022] POST /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments => generated 194 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:13.903694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:13.906381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:13.926602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:13.927100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:13.927559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:13.928265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:13.928713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:13.929129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.273007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b151593-2910-42a3-b0c1-205bed5ecd3e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327" status: 202 len: 0 microversion: 2.1 time: 0.786596 Oct 28 17:34:14.273594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 782/1489] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:13 2022] DELETE /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327 => generated 0 bytes in 788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:14.285795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:14.286959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:14.303063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:14.304567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:14.305029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.308459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:14.308949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:14.309388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.401368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:14.402670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:14.403335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.404070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lazy-loading 'fault' on Instance uuid 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:14.565158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:14.575553 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4503544b-d3b7-4b3a-9f41-dffafc3ffe08 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.679171 Oct 28 17:34:14.595666 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 708/1490] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:13 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:14.603290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75240b9940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:14.652238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:14.665130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f51d3a77-8fb0-435d-bdd0-ba03621628b6 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1458 microversion: 2.1 time: 0.387420 Oct 28 17:34:14.667247 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 783/1491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:14 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1458 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:14.686894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:14.687705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:14.702421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:14.703763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:14.714132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.715091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:14.715702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:14.716249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:14.746092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:14.747032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 3f279483-4cdd-4e26-aa39-882d9944e327 not found {{(pid=120568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:14.747576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.747576 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327 HTTP/1.1 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3f279483-4cdd-4e26-aa39-882d9944e327'} Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:14.749775 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-72343264-8dde-4955-a1df-3f50a33a57eb'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a3f70a4b-7c11-49c9-80be-be3ec0c362d5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327" status: 404 len: 194 microversion: 2.1 time: 0.157035 Oct 28 17:34:14.758728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 709/1492] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:14 2022] GET /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:14.766783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9081825-4ca2-4146-8d70-bd2f2c8ecf2a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752423e700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:15.114524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:15.126410 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97c577c1-726e-4fba-bd00-c578495ad7f3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.453616 Oct 28 17:34:15.147700 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 784/1493] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:14 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:15.263436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9081825-4ca2-4146-8d70-bd2f2c8ecf2a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92" status: 202 len: 0 microversion: 2.1 time: 0.501704 Oct 28 17:34:15.264314 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 710/1494] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:14 2022] DELETE /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:15.272612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75243c25e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:15.337412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:15.338700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:15.339500 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.339500 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 HTTP/1.1 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92'} Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:15.342514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] Oct 28 17:34:15.348081 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:15.352763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:34:15.352763 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-35c944a2-3b5b-42bd-b8e3-d9413aaa86bf'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:15.353894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3035cb39-e65e-4072-8d08-c63d1d9cc9ab tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92" status: 404 len: 194 microversion: 2.1 time: 0.085294 Oct 28 17:34:15.355069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 785/1495] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:15 2022] GET /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 => generated 194 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:15.372798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3035953a-edaa-45dc-a09a-12630317f723 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75240b9700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:15.604110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:15.609239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:15.618319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:15.619081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:15.619730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:15.620653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:15.621110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:15.621532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:15.683772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3035953a-edaa-45dc-a09a-12630317f723 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.323869 Oct 28 17:34:15.684482 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 711/1496] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:34:15 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:15.700585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:15.701751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:15.711079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:15.711867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:15.712743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:15.713660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:15.714281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:15.714865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:15.750377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:15.751183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:15.751843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:15.752490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lazy-loading 'fault' on Instance uuid 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:15.951093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:15.964901 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fbbb880-2a8f-4dcb-9837-c893b045d2c3 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.366289 Oct 28 17:34:15.976177 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 786/1497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:15 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:15.997479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6bdb317-138a-4396-bfaf-51ce7b0903f6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f75243c2ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1434768698", "description": "tempest-description-916677941"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:16.325832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:16.336089 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fc6b254-4cf8-4c3d-a4b7-1b6450e3b26b tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1458 microversion: 2.1 time: 0.639701 Oct 28 17:34:16.340382 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 712/1498] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:15 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1458 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:16.345691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:16.346321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:16.370155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:16.371424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:16.372990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:16.375604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:16.377983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:16.381368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:17.231938 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6bdb317-138a-4396-bfaf-51ce7b0903f6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.247871 Oct 28 17:34:17.233417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 787/1499] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:17.240362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:17.241239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:17.259968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:17.264459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:17.264920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:17.265775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:17.282958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:17.283383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:17.749202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:17.768604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ff23c80c-ea86-48d1-b291-d637b8250bb7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.426902 Oct 28 17:34:17.781906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 713/1500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:16 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:17.795467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7af706df-7dbf-4d29-929a-44ca87d60317 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f75240b9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1528704795", "description": "tempest-description-915449100"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:17.993455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:18.005069 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9afb5641-e0a8-42fd-ae9e-f88a469401e9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.769037 Oct 28 17:34:18.006474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 788/1501] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:17 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:18.011568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ffc3c-934f-4954-ad63-80e87d894535", "name": "network-vif-plugged", "status": "completed", "tag": "40cbd656-1193-4f0a-b24c-138f9c359e38"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:18.024075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.024939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.025637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.040706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] Creating event network-vif-plugged:40cbd656-1193-4f0a-b24c-138f9c359e38 for instance b39ffc3c-934f-4954-ad63-80e87d894535 on n-h2-860864-13 Oct 28 17:34:18.046989 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-859964cd-0439-4e62-bcd4-6cbcb611e214 req-abce10a8-7d8b-404d-9e8c-4684514fba75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038586 Oct 28 17:34:18.048585 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 789/1502] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:18.073463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:18.075910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:18.085648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.086579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.088265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.089330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.090050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.091122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.178868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.182601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.183652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.185948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lazy-loading 'fault' on Instance uuid 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:18.306580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96982d859d5944e19ab3f68b52d32953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d97c7650dc43b9a839ec46b4a86d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:18.332792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73bbcaf2-2d53-4df5-a942-bae436e08cb4 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 200 len: 1310 microversion: 2.1 time: 0.282663 Oct 28 17:34:18.333383 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 790/1503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:18 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:18.374364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541da5d7-1ea2-4ed6-a6b8-97bccbe1f362", "name": "network-vif-deleted", "tag": "f0f91e2c-d119-49cb-86a8-78eebd2f7b2f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:18.401158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.401870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.402521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.434236 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] Creating event network-vif-deleted:f0f91e2c-d119-49cb-86a8-78eebd2f7b2f for instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 on n-h2-860864-13 Oct 28 17:34:18.443453 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-83892940-a6ed-41b3-a4b5-a64f1add2441 req-0524ac7f-c966-461b-a604-cf021b93a852 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091072 Oct 28 17:34:18.450463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 791/1504] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:18.494134 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7af706df-7dbf-4d29-929a-44ca87d60317 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.711035 Oct 28 17:34:18.495388 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 714/1505] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:34:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:18.665136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1533458301", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f31be05a-e5f0-421d-873b-8a293965faf2"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:18.792909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:18.794238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:18.796363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:18.809027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.809475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.809927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:18.810652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:18.811103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:18.820665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.164046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:19.178393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-486e91c5-cfc2-4cef-b1e0-487f8a8c94c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.389785 Oct 28 17:34:19.185202 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 715/1506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:18 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:19.196727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.200165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.217804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.218300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.218726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.220415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.221724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.222337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.421485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:19.436382 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4b83bc9-d1a3-4438-8891-2d55e767c00b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1317 microversion: 2.1 time: 0.249676 Oct 28 17:34:19.438112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 716/1507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:19 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:19.463618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.464499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.473729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.474256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.474971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.476979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.477445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.477872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.506211 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 HTTP/1.1 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '541da5d7-1ea2-4ed6-a6b8-97bccbe1f362'} Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.511754 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:19.517268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3149f5fd-e919-4174-96be-7057259a6fae tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 404 len: 111 microversion: 2.1 time: 0.057834 Oct 28 17:34:19.519681 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 717/1508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:19 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:19.525781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.526503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.533915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.534659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.535271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.536560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.537180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.537767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.556731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 HTTP/1.1 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '541da5d7-1ea2-4ed6-a6b8-97bccbe1f362'} Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:19.558882 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.564192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.566051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:19.567073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0899ce2-6124-4202-9a78-b50c98cd116a tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "DELETE /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 404 len: 111 microversion: 2.1 time: 0.046239 Oct 28 17:34:19.570977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 718/1509] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:19 2022] DELETE /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:19.576774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.577657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.588782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.589555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.590437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.591385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.592258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.592906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.618476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 HTTP/1.1 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '541da5d7-1ea2-4ed6-a6b8-97bccbe1f362'} Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.624803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. Oct 28 17:34:19.630781 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.637826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:19.644023 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8e44691-4376-4a48-badc-cb340ebf5117 tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362" status: 404 len: 111 microversion: 2.1 time: 0.069732 Oct 28 17:34:19.648245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 719/1510] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:19 2022] GET /compute/v2.1/servers/541da5d7-1ea2-4ed6-a6b8-97bccbe1f362 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:19.660442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.662927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.681396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.685600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.686240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.687818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.689523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.690143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.710488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 HTTP/1.1 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '35db45b8-e070-419d-8ecd-c48dbabca1b5'} Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:19.712471 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.716967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.719336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:19.720729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4596fd6a-bbc6-49b4-abf7-5b380b00ec1c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "DELETE /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 404 len: 111 microversion: 2.1 time: 0.071315 Oct 28 17:34:19.724792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 720/1511] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:19 2022] DELETE /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:19.732367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:19.733587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] [instance: 35db45b8-e070-419d-8ecd-c48dbabca1b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:19.741143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.742230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.742907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.744306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:19.745000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:19.745647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:19.769620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] HTTP exception thrown: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Request method failure captured: Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 HTTP/1.1 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJakfz2-I-1L2A7K_z5OkzvkTsKy9IuvPfdg-Q0yFWJ1UvSVUaRYNYyQ0fAPj3v7w3RzRv5dNibNsV1a_h2Tp103OB1jibk8fZtxJiEzwyMvaC2LNekZFsYrR4iqbEEg3HBdUFZUc42Qmi8yp7yojn9vQfEYTDkyj6s68EyYcQEngg Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d97c7650dc43b9a839ec46b4a86d45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d97c7650dc43b9a839ec46b4a86d45"}]}] Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d97c7650dc43b9a839ec46b4a86d45 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1443737329 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 96982d859d5944e19ab3f68b52d32953 Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersAdminTestJSON-1443737329-project Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '35db45b8-e070-419d-8ecd-c48dbabca1b5'} Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.771545 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. Oct 28 17:34:19.775929 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:19.778188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] Returning 404 to user: Instance 35db45b8-e070-419d-8ecd-c48dbabca1b5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:19.779289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f495a47-5c3c-4781-a2d2-78900175475c tempest-DeleteServersAdminTestJSON-1443737329 tempest-DeleteServersAdminTestJSON-1443737329-project] 10.222.0.48 "GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5" status: 404 len: 111 microversion: 2.1 time: 0.053247 Oct 28 17:34:19.780117 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 721/1512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:19 2022] GET /compute/v2.1/servers/35db45b8-e070-419d-8ecd-c48dbabca1b5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:20.129818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4de2a39-2696-411a-80a3-491b0a249e1a", "name": "network-vif-plugged", "status": "completed", "tag": "492d00c5-8f6b-4628-a083-b49ec5c12a4c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:20.148524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:20.152397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:20.154196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:20.175470 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] Creating event network-vif-plugged:492d00c5-8f6b-4628-a083-b49ec5c12a4c for instance e4de2a39-2696-411a-80a3-491b0a249e1a on n-h2-860864-13 Oct 28 17:34:20.189498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-67596cdb-e136-41ae-aac9-7b5b92e79b01 req-4ac7b626-b3fc-4835-b808-7022b392e8ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063857 Oct 28 17:34:20.192287 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 722/1513] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:20.209571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:20.210555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:20.228123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:20.228636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:20.229373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:20.231081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:20.231581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:20.232013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:20.559350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:20.564741 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e56e6206-fb6b-4638-ac6c-8b78a2620aeb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.358569 Oct 28 17:34:20.575445 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 723/1514] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:20 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:20.580917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:20.581818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:20.588544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:20.589398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:20.590051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:20.591021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:20.591751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:20.592598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:21.032776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:21.045889 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d63e65c-2269-4d40-8b26-24f9826f240a tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 200 len: 1505 microversion: 2.1 time: 0.468926 Oct 28 17:34:21.048098 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 724/1515] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:20 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:21.080858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:21.081642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:21.090909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:21.091773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:21.092956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:21.093874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:21.094901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:21.095780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:21.502401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:21.514855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ca54901-a9ba-4dc5-88e2-4b18c4287137 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1317 microversion: 2.1 time: 0.444872 Oct 28 17:34:21.535897 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 725/1516] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:21 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:22.108534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:22.109140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:22.134318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:22.143773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:22.144410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:22.145381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:22.146017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:22.147058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:22.564320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:22.574169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86df485e-ba47-4ff6-a3ed-e6cd07875319 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.986510 Oct 28 17:34:22.574766 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 726/1517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:21 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:22.589666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:22.590303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:22.605152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:22.606185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:22.606789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:22.607819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:22.608433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:22.609412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.042788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:23.051956 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6de0388b-c6f4-42fc-9432-db0aea9ec599 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1504 microversion: 2.1 time: 0.471597 Oct 28 17:34:23.059967 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 727/1518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:22 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:23.082061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:23.082570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:23.103617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.104122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.104562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.105284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.105744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.106173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.206244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:34:23.418244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0243400f-6aee-401b-9bd8-6d9c44626de8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 204 len: 0 microversion: 2.1 time: 0.341361 Oct 28 17:34:23.423684 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 728/1519] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:23 2022] DELETE /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:34:23.438737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:23.443094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:23.459744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.462234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.462947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.465083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.465784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.469980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.529893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:23.541097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:34:23.723629 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3cd7ac35-4701-4b0b-8909-a68bee83ffe9 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 204 len: 0 microversion: 2.1 time: 0.294896 Oct 28 17:34:23.724652 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 729/1520] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:23 2022] DELETE /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:34:23.737131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "name": "network-vif-unplugged", "status": "completed", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:23.762651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.764895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.765602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.795486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] Creating event network-vif-unplugged:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h2-860864-13 Oct 28 17:34:23.811390 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d1f159ad-f043-4a2a-b98b-4cc15233e3d6 req-3fdcbfd3-85d0-4d06-90ef-8dd6a90ebfb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082544 Oct 28 17:34:23.814013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 730/1521] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:23.829841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:23.838231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:23.858352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.861028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.861947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:23.865053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:23.877926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:23.881102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:24.277800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:24.297258 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-976c7c64-fbf8-4760-87a9-149a894181f8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.481423 Oct 28 17:34:24.297849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 731/1522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:23 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:24.336007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:24.343056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:24.374208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:24.378519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:24.380982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:24.382199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:24.384403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:24.385079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:24.752754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:24.765308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b07bafb8-55af-445d-9589-96c1ddfe13d8 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1510 microversion: 2.1 time: 0.444101 Oct 28 17:34:24.767338 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 732/1523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:24 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:25.324615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:25.325489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:25.341157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:25.341888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:25.342498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:25.348382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:25.349075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:25.349663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:25.664051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:25.701020 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b65057f-7687-45d8-b087-fd60b9041ef5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.379324 Oct 28 17:34:25.717097 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 733/1524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:25 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:25.783850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] validate_networks() for [('f31be05a-e5f0-421d-873b-8a293965faf2', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:34:25.792541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:25.793270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:25.802065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:25.802748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:25.804972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:25.805811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:25.806374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:25.807024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:26.246659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:26.269237 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b903ded-d799-4aa2-a342-403649b6974b tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1510 microversion: 2.1 time: 0.480748 Oct 28 17:34:26.270174 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 734/1525] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:25 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:26.274933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:26.293698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:26.294485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:26.295814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:26.323238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] Creating event network-changed:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h2-860864-13 Oct 28 17:34:26.330256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-04ca581f-7932-4a3e-bea3-d27ab0089cbf req-f7b621e6-f46b-442a-81bf-8c57fc82c318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058863 Oct 28 17:34:26.334154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 735/1526] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:26.659288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aae48805-4194-424f-bab8-b30df2e0371e tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-601454346", "id": 1087240956, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:26.738459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aae48805-4194-424f-bab8-b30df2e0371e tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.400120 Oct 28 17:34:26.741963 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 736/1527] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:34:26 2022] POST /compute/v2.1/flavors => generated 430 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:26.846455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Calling method '.version_select at 0x7f75240db430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:27.013979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:27.014806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Neutron security group b809dc81-c674-4eec-8f10-9a932dfae9a7 not found {{(pid=120568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:27.015568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] HTTP exception thrown: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.015568 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Request method failure captured: Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-security-groups/b809dc81-c674-4eec-8f10-9a932dfae9a7 HTTP/1.1 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBKiwSFjoXzRVV_7ky3o7VuLi0Gdfs25Z_2eWvm4nlzBxLmZi2W-Mo81dyUWQaIJMP9JJ_oTyXuceAU7Q34xBKhe3cdIBGvKpHDPln-HbWOBoqgjX7R69k3vC8eg0PkY2gwi2Gj-8cgAtORJzCRm3383DnNdqvp0n9qU_8gCUUlPfBo Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ceb552e32f8540639f341b62678bc852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ceb552e32f8540639f341b62678bc852"}]}] Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 46c8ee5ce6b142c7911373c320df446d Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b809dc81-c674-4eec-8f10-9a932dfae9a7'} Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:27.018035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Returning 404 to user: Security group b809dc81-c674-4eec-8f10-9a932dfae9a7 does not exist Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-08d60a2e-fb92-4a8d-97d0-0f400a06cbec'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:27.023191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0466f341-a14c-46a0-a9e7-8a3bd55846b1 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b809dc81-c674-4eec-8f10-9a932dfae9a7" status: 404 len: 194 microversion: 2.1 time: 0.275060 Oct 28 17:34:27.026622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 737/1528] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:26 2022] DELETE /compute/v2.1/os-security-groups/b809dc81-c674-4eec-8f10-9a932dfae9a7 => generated 194 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:27.033096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:27.033817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:27.052606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.052606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.052606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.053306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.053753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.054183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.376820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:34:27.377339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:34:27.377751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:34:27.378162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:34:27.378571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:34:27.398387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.398915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.401354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.402154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.402617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.415952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.477730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Getting quotas for project 752dac7c550f4373a66e681d9d7bef55. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:34:27.478802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:27.490786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Getting quotas for user fa1e1df5315948d3894f8ecbd3c264c0 and project 752dac7c550f4373a66e681d9d7bef55. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:34:27.490999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2467e37c-5361-428a-9bbd-631e87deb450 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.464099 Oct 28 17:34:27.495821 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 738/1529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:27 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:27.501581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a556da49-0c4a-4789-abb2-fe587e90c46b tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ca026d9800b74bdbbfaaef65ebb6bbe7"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:27.507991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:34:27.511744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:34:27.671594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9552b1c6-ebea-45f7-81fd-691c69ca4766 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.010870 Oct 28 17:34:27.680224 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 792/1530] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:34:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 9020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:34:27.685376 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c552e1d5-ab26-4882-a63c-7e145b1a66d7 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003932 Oct 28 17:34:27.685904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 793/1531] 10.222.0.48 () {58 vars in 1164 bytes} [Fri Oct 28 17:34:27 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 17:34:27.712179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:27.713216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:27.732653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.736400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.737870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.738812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:27.739505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:27.740119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:27.762429 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a556da49-0c4a-4789-abb2-fe587e90c46b tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1087240956/action" status: 200 len: 97 microversion: 2.1 time: 0.265384 Oct 28 17:34:27.771006 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 739/1532] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:34:27 2022] POST /compute/v2.1/flavors/1087240956/action => generated 97 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:34:27.787166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f738eed9-6571-49fd-9b2a-4771ee78b973 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:27.788362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f738eed9-6571-49fd-9b2a-4771ee78b973 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:28.196502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f738eed9-6571-49fd-9b2a-4771ee78b973 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:28.206583 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f738eed9-6571-49fd-9b2a-4771ee78b973 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1216 microversion: 2.1 time: 0.432696 Oct 28 17:34:28.209623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 740/1533] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:27 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1216 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:28.224413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-787b0269-9cda-40f5-af2c-102e560ef997 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Calling method '.version_select at 0x7f752427e790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:28.290034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:28.303796 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf911ffb-c04b-4601-9041-cc1ccf9cc15d tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1468 microversion: 2.1 time: 0.602211 Oct 28 17:34:28.330768 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 794/1534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:27 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1468 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:28.588671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-787b0269-9cda-40f5-af2c-102e560ef997 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.377787 Oct 28 17:34:28.590900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 741/1535] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:34:28 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:28.597617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39ffc3c-934f-4954-ad63-80e87d894535", "name": "network-vif-deleted", "tag": "40cbd656-1193-4f0a-b24c-138f9c359e38"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:28.611044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:28.611970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:28.612748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:28.629425 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] Creating event network-vif-deleted:40cbd656-1193-4f0a-b24c-138f9c359e38 for instance b39ffc3c-934f-4954-ad63-80e87d894535 on n-h2-860864-13 Oct 28 17:34:28.658116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a7a5143d-6543-4b6b-9aad-8bb662582c6c req-7e696f3b-279b-46af-8d72-5dbcb5a1c6c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061820 Oct 28 17:34:28.659248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 742/1536] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:28.674726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4de2a39-2696-411a-80a3-491b0a249e1a", "name": "network-vif-deleted", "tag": "492d00c5-8f6b-4628-a083-b49ec5c12a4c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:28.701625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:28.705155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:28.706801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:28.775490 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] Creating event network-vif-deleted:492d00c5-8f6b-4628-a083-b49ec5c12a4c for instance e4de2a39-2696-411a-80a3-491b0a249e1a on n-h2-860864-13 Oct 28 17:34:28.784441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5d47f39-f796-4269-8dcd-d82cbdd03c29 tempest-FlavorsAccessTestJSON-674596941 tempest-FlavorsAccessTestJSON-674596941-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:28.787893 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-898a7555-f1e8-40c1-a90c-f45e8fe9d1e0 req-ae772952-f96e-4596-9ec5-c9b93145a322 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126152 Oct 28 17:34:28.791154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 743/1537] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:28.799310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:28.800370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:28.807960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:28.808681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:28.809196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:28.810398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:28.810757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:28.811296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:28.911360 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5d47f39-f796-4269-8dcd-d82cbdd03c29 tempest-FlavorsAccessTestJSON-674596941 tempest-FlavorsAccessTestJSON-674596941-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.577854 Oct 28 17:34:28.912779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 795/1538] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:28 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:28.919826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Calling method '.version_select at 0x7f75241c18b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.198942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:29.219733 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01f776f0-25ce-49a5-b9bf-17b5533d4e67 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.426561 Oct 28 17:34:29.243557 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 744/1539] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:28 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:29.248533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbfe919e-b06e-4c79-b746-517d6440795b tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ca026d9800b74bdbbfaaef65ebb6bbe7"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:29.342164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:29.344893 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 28 17:34:29.344893 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Request method failure captured: Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/634f4add-ab9c-4310-a08c-e82b92dae881 HTTP/1.1 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKiwSFjoXzRVV_7ky3o7VuLi0Gdfs25Z_2eWvm4nlzBxLmZi2W-Mo81dyUWQaIJMP9JJ_oTyXuceAU7Q34xBKhe3cdIBGvKpHDPln-HbWOBoqgjX7R69k3vC8eg0PkY2gwi2Gj-8cgAtORJzCRm3383DnNdqvp0n9qU_8gCUUlPfBo Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ceb552e32f8540639f341b62678bc852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ceb552e32f8540639f341b62678bc852"}]}] Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 46c8ee5ce6b142c7911373c320df446d Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: exception: Insufficient rights for removing default security group. Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '634f4add-ab9c-4310-a08c-e82b92dae881'} Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:29.347034 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-7d2adf8b-c388-41f6-a6ef-63c36265cbe8'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa1ad6ed-2340-40ef-9b5b-5f71cbcf76ce tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/634f4add-ab9c-4310-a08c-e82b92dae881" status: 400 len: 182 microversion: 2.1 time: 0.434757 Oct 28 17:34:29.353619 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 796/1540] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:28 2022] DELETE /compute/v2.1/os-security-groups/634f4add-ab9c-4310-a08c-e82b92dae881 => generated 182 bytes in 437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:34:29.370183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.370926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:29.380222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:29.380632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:29.381236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:29.381962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:29.382428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:29.382858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:29.418297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbfe919e-b06e-4c79-b746-517d6440795b tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1087240956/action" status: 200 len: 21 microversion: 2.1 time: 0.173476 Oct 28 17:34:29.423734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 745/1541] 10.222.0.48 () {60 vars in 1200 bytes} [Fri Oct 28 17:34:29 2022] POST /compute/v2.1/flavors/1087240956/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:34:29.434038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.434662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:29.452264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:29.452805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:29.453845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:29.455137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:29.455660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:29.456105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:29.508608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:29.520029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9a26b01-2fde-4d3c-bdbf-0d1fd40bf76e tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1212 microversion: 2.1 time: 0.168362 Oct 28 17:34:29.533264 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 797/1542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:29.539056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Calling method '.version_select at 0x7f752420ec10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.546683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:29.548719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:29.549784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:29.552465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lazy-loading 'fault' on Instance uuid e4de2a39-2696-411a-80a3-491b0a249e1a {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:29.591035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:29.592442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Neutron security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:29.594741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] HTTP exception thrown: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.594741 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Request method failure captured: Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-security-groups/3f14ddf5-4cdf-455e-83d1-7823d9abf944 HTTP/1.1 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKiwSFjoXzRVV_7ky3o7VuLi0Gdfs25Z_2eWvm4nlzBxLmZi2W-Mo81dyUWQaIJMP9JJ_oTyXuceAU7Q34xBKhe3cdIBGvKpHDPln-HbWOBoqgjX7R69k3vC8eg0PkY2gwi2Gj-8cgAtORJzCRm3383DnNdqvp0n9qU_8gCUUlPfBo Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ceb552e32f8540639f341b62678bc852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ceb552e32f8540639f341b62678bc852"}]}] Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 46c8ee5ce6b142c7911373c320df446d Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3f14ddf5-4cdf-455e-83d1-7823d9abf944'} Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:29.603343 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] Oct 28 17:34:29.609335 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.613914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Returning 404 to user: Security group 3f14ddf5-4cdf-455e-83d1-7823d9abf944 does not exist Oct 28 17:34:29.613914 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-12e426fd-c423-43ec-8876-b6fc8461bbf2'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:29.615509 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35c9c8e1-a56d-4243-a53a-9aeb757a2321 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/3f14ddf5-4cdf-455e-83d1-7823d9abf944" status: 404 len: 194 microversion: 2.1 time: 0.080669 Oct 28 17:34:29.629419 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 798/1543] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/os-security-groups/3f14ddf5-4cdf-455e-83d1-7823d9abf944 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:29.640730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d6ad271-1ae0-491d-b6b8-8c1ce1f8e3d5 tempest-FlavorsAccessTestJSON-674596941 tempest-FlavorsAccessTestJSON-674596941-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.726139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f174f0096144acb1eecea234b820ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c45164b59c3403e83844ab0698c594e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:29.729823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d6ad271-1ae0-491d-b6b8-8c1ce1f8e3d5 tempest-FlavorsAccessTestJSON-674596941 tempest-FlavorsAccessTestJSON-674596941-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086018 Oct 28 17:34:29.736772 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 799/1544] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:29.752128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f98d695f-f6f4-428f-98c3-c68db3835f78 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 200 len: 1307 microversion: 2.1 time: 0.323233 Oct 28 17:34:29.754854 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 746/1545] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:29.762825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Action: 'update', calling method: .version_select at 0x7f7524336040>, body: {"security_group": {"name": "tempest-sg-911921938", "description": "tempest-description-1257788354"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:29.778171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39fdd87c-a26d-41b8-ace2-b83392845a95 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.793787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:29.794400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Neutron security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:34:29.794935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] HTTP exception thrown: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.794935 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Request method failure captured: Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-security-groups/62db9f19-c69a-4a8f-8ab8-6625486b4b77 HTTP/1.1 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 101 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKiwSFjoXzRVV_7ky3o7VuLi0Gdfs25Z_2eWvm4nlzBxLmZi2W-Mo81dyUWQaIJMP9JJ_oTyXuceAU7Q34xBKhe3cdIBGvKpHDPln-HbWOBoqgjX7R69k3vC8eg0PkY2gwi2Gj-8cgAtORJzCRm3383DnNdqvp0n9qU_8gCUUlPfBo Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ceb552e32f8540639f341b62678bc852"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ceb552e32f8540639f341b62678bc852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ceb552e32f8540639f341b62678bc852"}]}] Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ceb552e32f8540639f341b62678bc852 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673 Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 46c8ee5ce6b142c7911373c320df446d Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1631099673-project Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: {"security_group": {"name": "tempest-sg-911921938", "description": "tempest-description-1257788354"}} Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '62db9f19-c69a-4a8f-8ab8-6625486b4b77', 'body': {'security_group': {'name': 'tempest-sg-911921938', 'description': 'tempest-description-1257788354'}}} Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:29.797639 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] Returning 404 to user: Security group 62db9f19-c69a-4a8f-8ab8-6625486b4b77 does not exist Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d8bda4d7-1e5e-41f7-bf7f-dea321a648d6'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:29.802044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2707ffd-dfd7-4709-bd4e-27800262ee17 tempest-SecurityGroupsNegativeTestJSON-1631099673 tempest-SecurityGroupsNegativeTestJSON-1631099673-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/62db9f19-c69a-4a8f-8ab8-6625486b4b77" status: 404 len: 194 microversion: 2.1 time: 0.060991 Oct 28 17:34:29.819823 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 800/1546] 10.222.0.48 () {60 vars in 1290 bytes} [Fri Oct 28 17:34:29 2022] PUT /compute/v2.1/os-security-groups/62db9f19-c69a-4a8f-8ab8-6625486b4b77 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:29.836077 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39fdd87c-a26d-41b8-ace2-b83392845a95 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1087240956" status: 202 len: 0 microversion: 2.1 time: 0.074407 Oct 28 17:34:29.843686 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 747/1547] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:34:29 2022] DELETE /compute/v2.1/flavors/1087240956 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:29.854555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-471eebcb-5c67-44ca-bec6-9659e32225b5 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:29.897902 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-471eebcb-5c67-44ca-bec6-9659e32225b5 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051166 Oct 28 17:34:29.910042 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 801/1548] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:29.924016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4731af23-458e-42b1-9301-3ce71be05709 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1424453244", "id": 1377602873, "os-flavor-access:is_public": "False"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:29.957345 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4731af23-458e-42b1-9301-3ce71be05709 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.037677 Oct 28 17:34:29.969819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 748/1549] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:34:29 2022] POST /compute/v2.1/flavors => generated 431 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:29.973533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88579823-b0d0-4eba-a935-da0b860546be tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.012968 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88579823-b0d0-4eba-a935-da0b860546be tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1377602873/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.043167 Oct 28 17:34:30.020266 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 802/1550] 10.222.0.48 () {58 vars in 1209 bytes} [Fri Oct 28 17:34:29 2022] GET /compute/v2.1/flavors/1377602873/os-flavor-access => generated 21 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:34:30.027152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5d77abf-73da-4773-af63-dfc4d7c839f4 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.057045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:30.088221 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5d77abf-73da-4773-af63-dfc4d7c839f4 tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1377602873" status: 202 len: 0 microversion: 2.1 time: 0.066165 Oct 28 17:34:30.095727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 749/1551] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:34:30 2022] DELETE /compute/v2.1/flavors/1377602873 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:30.101228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3cf030d-be21-4947-a409-8f8cc76d545d tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.150572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3cf030d-be21-4947-a409-8f8cc76d545d tempest-FlavorsAccessTestJSON-1087721251 tempest-FlavorsAccessTestJSON-1087721251-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054143 Oct 28 17:34:30.152198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 803/1552] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:30.248345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.250002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.292559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.300003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.300948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.303899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.305497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.307472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.563123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.564532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.578823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.580080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.583590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.585511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.586198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.586805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.621404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:30.638495 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b356439-b08e-4414-b9f4-2e1c3ec6757a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.395718 Oct 28 17:34:30.641457 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 750/1553] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:30.668303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.675486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.692767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.693477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.697504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.698555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.700195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.701606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.705578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:30.716936 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc17d819-0f0e-4985-bb40-114038215cda tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1268 microversion: 2.1 time: 0.161586 Oct 28 17:34:30.718556 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 804/1554] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:30.754667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-541035bb-d446-46bd-aed2-99dcffb78cf4 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101990 Oct 28 17:34:30.755896 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 751/1555] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:30.768233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.769070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.780442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.780698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.781371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: e4de2a39-2696-411a-80a3-491b0a249e1a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.782012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.782650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.783626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.784552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.785199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.790405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.791183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.794991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.800650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.801219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.801884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.827816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:30.836525 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] HTTP exception thrown: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Request method failure captured: Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a HTTP/1.1 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJoY2Mde6nKDK4ZcSbrxtyAmyJiBkyyA4p-XYpZNofZbfI2EZrKUFJHsWIQDW-uyB-4bdtXp9ezHZ6k3ckvbxzjUxSjSQ31pArCtoaSnCMj-E_9Ary96EoSr1woCqqn4VP6NZVGRvUG7UWHHR8aMhl8jIdxgkaZW2_EyRroEnbuQGU Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5c45164b59c3403e83844ab0698c594e Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c45164b59c3403e83844ab0698c594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c45164b59c3403e83844ab0698c594e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5c45164b59c3403e83844ab0698c594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5c45164b59c3403e83844ab0698c594e"}]}] Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5c45164b59c3403e83844ab0698c594e Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MultipleCreateTestJSON-1227143054-project Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 46f174f0096144acb1eecea234b820ef Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MultipleCreateTestJSON-1227143054-project Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e4de2a39-2696-411a-80a3-491b0a249e1a'} Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:30.840849 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. Oct 28 17:34:30.846474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.847972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Returning 404 to user: Instance e4de2a39-2696-411a-80a3-491b0a249e1a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:30.849716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c9a3d7a-6f77-4a7d-83de-f7ccccec253c tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a" status: 404 len: 111 microversion: 2.1 time: 0.073065 Oct 28 17:34:30.850738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 752/1556] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/servers/e4de2a39-2696-411a-80a3-491b0a249e1a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:30.862821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:30.864471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] [instance: b39ffc3c-934f-4954-ad63-80e87d894535] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:30.885997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.886751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.888738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.899960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:30.901597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:30.902886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:30.944189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] HTTP exception thrown: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Request method failure captured: Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 HTTP/1.1 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJoY2Mde6nKDK4ZcSbrxtyAmyJiBkyyA4p-XYpZNofZbfI2EZrKUFJHsWIQDW-uyB-4bdtXp9ezHZ6k3ckvbxzjUxSjSQ31pArCtoaSnCMj-E_9Ary96EoSr1woCqqn4VP6NZVGRvUG7UWHHR8aMhl8jIdxgkaZW2_EyRroEnbuQGU Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5c45164b59c3403e83844ab0698c594e Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c45164b59c3403e83844ab0698c594e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5c45164b59c3403e83844ab0698c594e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5c45164b59c3403e83844ab0698c594e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5c45164b59c3403e83844ab0698c594e"}]}] Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5c45164b59c3403e83844ab0698c594e Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1227143054 Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MultipleCreateTestJSON-1227143054-project Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 46f174f0096144acb1eecea234b820ef Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MultipleCreateTestJSON-1227143054-project Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b39ffc3c-934f-4954-ad63-80e87d894535'} Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:30.957307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:30.965055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] Returning 404 to user: Instance b39ffc3c-934f-4954-ad63-80e87d894535 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:30.968051 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3cb1538f-7efd-44bf-b732-f4a6736d9c80 tempest-MultipleCreateTestJSON-1227143054 tempest-MultipleCreateTestJSON-1227143054-project] 10.222.0.48 "GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535" status: 404 len: 111 microversion: 2.1 time: 0.112317 Oct 28 17:34:30.977871 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 753/1557] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:30 2022] GET /compute/v2.1/servers/b39ffc3c-934f-4954-ad63-80e87d894535 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:31.068577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lazy-loading 'services' on Instance uuid 05ddc7a9-f843-484c-8f6e-edf06a0343a7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:31.399023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d63fd3f-2c42-4f35-b261-ff5f69a5d99d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments/849efccc-c2a9-4714-b1d9-840d128fd424" status: 202 len: 0 microversion: 2.1 time: 0.635823 Oct 28 17:34:31.404778 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 805/1558] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:34:30 2022] DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments/849efccc-c2a9-4714-b1d9-840d128fd424 => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:31.670502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:31.672176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:31.690903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:31.691816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:31.692440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:31.693345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:31.693965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:31.694554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:31.744157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:31.745335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:31.762771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:31.771658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:31.772125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:31.773078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:31.773817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:31.782728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:31.994411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:32.006579 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b585b82-72a4-4fe0-b533-26d59d9a2fb3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1274 microversion: 2.1 time: 0.267893 Oct 28 17:34:32.007350 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 806/1559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:31 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:32.465994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:32.482469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f86b39b-d412-4aec-8fa6-a09fdcc49db4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.817060 Oct 28 17:34:32.496945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 754/1560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:31 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:33.033697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:33.034314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:33.041554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:33.056919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:33.058356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:33.060002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:33.061311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:33.061748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:33.393957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:33.412466 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc20a4ad-8e12-4ac7-88c7-cefbef01042c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1274 microversion: 2.1 time: 0.382859 Oct 28 17:34:33.431994 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 807/1561] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:33 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:33.510741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:33.512640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:33.557317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:33.560627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:33.562022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:33.566570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:33.568421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:33.569086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:34.438163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:34.438767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:34.462822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:34.471167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:34.471663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:34.472482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:34.472952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:34.481617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:35.311852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:35.321058 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-528e1d2c-17ff-4ace-80d0-69d6f530c642 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.814586 Oct 28 17:34:35.322696 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 755/1562] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:33 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:35.676032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:35.699254 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e7b5f32-ba58-4a46-a28c-f0f0e59926a5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 1.259414 Oct 28 17:34:35.703662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 808/1563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:34 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:36.346938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:36.348318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:36.370623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:36.370858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:36.371218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:36.399219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:36.416200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:36.417097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:36.729445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:36.730499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:36.762096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:36.763002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:36.765063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:36.767004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:36.767517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:36.774846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:37.441325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:37.499713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:37.502989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:37.513841 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c84b1684-07b8-42c6-aa75-e02cc36e0a79 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.172365 Oct 28 17:34:37.540776 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 756/1564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:36 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:37.746506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:37.764099 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a38be7e3-a2be-4a83-8e33-5654ef99b5d3 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 1.040973 Oct 28 17:34:37.765388 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 809/1565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:36 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:38.545451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:38.548127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:38.577128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:38.589934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:38.592337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:38.595675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:38.597549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:38.599558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:38.600272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:38.642295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:38.798874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:38.801295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:38.842662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:38.846972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:38.849373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:38.852284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:38.857582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:38.858517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:39.274062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:39.295625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efc854ac-ea4b-417b-af3c-93479c97ffe0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.754104 Oct 28 17:34:39.325476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 757/1566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:38 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:39.337174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b884c-6998-4aab-8718-ef0ca5723870", "tag": "acd372da-029f-48b2-9c1f-6ad96d16c20e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:39.381592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:39.382483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:39.384103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:39.790461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:39.816215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bd73b5a-b1e1-481e-8198-2d1b971931cf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 1.028036 Oct 28 17:34:39.823389 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 810/1567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:38 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:39.832403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] Creating event network-changed:acd372da-029f-48b2-9c1f-6ad96d16c20e for instance 348b884c-6998-4aab-8718-ef0ca5723870 on n-h1-860864-13 Oct 28 17:34:39.848195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ae1d5cef-7ac3-45c9-be3d-4a9a16b836f2 req-26691557-f5e0-4e40-9673-30c0813c3a48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521073 Oct 28 17:34:39.859434 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 758/1568] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:40.326065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:40.326674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:40.342763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.343421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.344831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:40.379749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.384098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.384838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:40.716433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:40.728301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93470b57-2209-4f51-9c01-5fb04101dc29 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.405930 Oct 28 17:34:40.747232 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 811/1569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:40 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:40.858563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:40.859600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:40.872245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.874109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.877101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:40.878074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.879616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.881560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:40.945260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Calling method '.version_select at 0x7f7524103040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:40.950036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.952131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.954033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:40.955247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:40.957483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:40.959296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:41.060233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbc40d9b-f21d-44d9-9cf1-8265257a4c41 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.467060 Oct 28 17:34:41.061924 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 759/1570] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:34:40 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:41.300303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.308588 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-705d9d22-e9de-4edb-9f39-54a8b5ce6b48 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.461011 Oct 28 17:34:41.310686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 812/1571] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:40 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:41.448944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c379f12b-1d52-4835-b556-34af547fa20d tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Calling method '.version_select at 0x7f752411ac10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.452524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c379f12b-1d52-4835-b556-34af547fa20d tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c379f12b-1d52-4835-b556-34af547fa20d tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.456325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c379f12b-1d52-4835-b556-34af547fa20d tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c379f12b-1d52-4835-b556-34af547fa20d tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.388000 Oct 28 17:34:41.465971 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 760/1572] 10.222.0.48 () {58 vars in 1128 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:41.467264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ac5aedb-3035-4903-8bbb-80381e7cce62 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Calling method '.version_select at 0x7f752442bb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.470120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ac5aedb-3035-4903-8bbb-80381e7cce62 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ac5aedb-3035-4903-8bbb-80381e7cce62 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hosts/n-d-860864-13/reboot HTTP/1.1 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13'} Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.472083 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ac5aedb-3035-4903-8bbb-80381e7cce62 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ac5aedb-3035-4903-8bbb-80381e7cce62 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-860864-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.010001 Oct 28 17:34:41.476531 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 813/1573] 10.222.0.48 () {58 vars in 1191 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/n-d-860864-13/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:41.485532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14233931-f97e-430b-8b3a-47664b1ab3cf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Calling method '.version_select at 0x7f7524213040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.521136 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-14233931-f97e-430b-8b3a-47664b1ab3cf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14233931-f97e-430b-8b3a-47664b1ab3cf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'nonexistent_hostname'} Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.523298 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.528816 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.539748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14233931-f97e-430b-8b3a-47664b1ab3cf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.539748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14233931-f97e-430b-8b3a-47664b1ab3cf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051698 Oct 28 17:34:41.539748 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 761/1574] 10.222.0.48 () {58 vars in 1212 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:34:41.566147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2163da9-c3d6-4546-910f-9e1967e90fb9 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Calling method '.version_select at 0x7f75244ea9d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.566147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2163da9-c3d6-4546-910f-9e1967e90fb9 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2163da9-c3d6-4546-910f-9e1967e90fb9 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hosts/n-d-860864-13 HTTP/1.1 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13'} Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.568047 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2163da9-c3d6-4546-910f-9e1967e90fb9 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2163da9-c3d6-4546-910f-9e1967e90fb9 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-860864-13" status: 403 len: 109 microversion: 2.1 time: 0.027611 Oct 28 17:34:41.578887 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 814/1575] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/n-d-860864-13 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:41.584868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a733370-026b-4594-ae2e-7aee15111baf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Calling method '.version_select at 0x7f7524034e50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.607709 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-5a733370-026b-4594-ae2e-7aee15111baf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a733370-026b-4594-ae2e-7aee15111baf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'nonexistent_hostname'} Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.609186 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.616035 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.620748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a733370-026b-4594-ae2e-7aee15111baf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.621929 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a733370-026b-4594-ae2e-7aee15111baf tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045630 Oct 28 17:34:41.622914 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 762/1576] 10.222.0.48 () {58 vars in 1191 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:34:41.634040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7b0619e-8eff-48a0-a637-99064d9792de tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Calling method '.version_select at 0x7f7524467a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.635851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7b0619e-8eff-48a0-a637-99064d9792de tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7b0619e-8eff-48a0-a637-99064d9792de tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hosts/n-d-860864-13/shutdown HTTP/1.1 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13'} Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.637422 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7b0619e-8eff-48a0-a637-99064d9792de tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.642808 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7b0619e-8eff-48a0-a637-99064d9792de tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-860864-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009983 Oct 28 17:34:41.644944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 815/1577] 10.222.0.48 () {58 vars in 1197 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/n-d-860864-13/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:41.650307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01eda99a-cec3-4c7b-85ed-b574d0c35b92 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Calling method '.version_select at 0x7f7524034790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.723290 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-01eda99a-cec3-4c7b-85ed-b574d0c35b92 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01eda99a-cec3-4c7b-85ed-b574d0c35b92 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'nonexistent_hostname'} Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.730334 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01eda99a-cec3-4c7b-85ed-b574d0c35b92 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.735848 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01eda99a-cec3-4c7b-85ed-b574d0c35b92 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.087802 Oct 28 17:34:41.739102 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 763/1578] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:34:41.750337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e2ffe90-99d5-4679-a8d6-1f159fd15b63 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Calling method '.version_select at 0x7f752442b4c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.752847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e2ffe90-99d5-4679-a8d6-1f159fd15b63 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e2ffe90-99d5-4679-a8d6-1f159fd15b63 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hosts/n-d-860864-13/startup HTTP/1.1 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13'} Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.755725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 17:34:41.760578 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.763221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e2ffe90-99d5-4679-a8d6-1f159fd15b63 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.765845 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e2ffe90-99d5-4679-a8d6-1f159fd15b63 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-860864-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.018958 Oct 28 17:34:41.768207 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 816/1579] 10.222.0.48 () {58 vars in 1194 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/n-d-860864-13/startup => generated 110 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:41.770655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.773593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:41.777677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de85c577-f81d-4f07-ab03-9e92d9aec6d1 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Calling method '.version_select at 0x7f75244eaa60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:41.805404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:41.807048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:41.808729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:41.808888 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-de85c577-f81d-4f07-ab03-9e92d9aec6d1 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.810260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de85c577-f81d-4f07-ab03-9e92d9aec6d1 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'nonexistent_hostname'} Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.810885 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:41.816122 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.819159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de85c577-f81d-4f07-ab03-9e92d9aec6d1 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.819866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:41.821824 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de85c577-f81d-4f07-ab03-9e92d9aec6d1 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.046601 Oct 28 17:34:41.822154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:41.824786 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 817/1580] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:34:41.839883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f97e7e26-476d-4df5-8019-32aed29b601a tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Action: 'update', calling method: .version_select at 0x7f7524118d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f97e7e26-476d-4df5-8019-32aed29b601a tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-hosts/n-d-860864-13 HTTP/1.1 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 51 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: {"status": "enable", "maintenance_mode": "invalid"} Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:34:41.856622 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f97e7e26-476d-4df5-8019-32aed29b601a tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f97e7e26-476d-4df5-8019-32aed29b601a tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-860864-13" status: 400 len: 199 microversion: 2.1 time: 0.027621 Oct 28 17:34:41.867191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 818/1581] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:34:41 2022] PUT /compute/v2.1/os-hosts/n-d-860864-13 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:34:41.877713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a69927c-9cda-4c30-a13a-9ae9d670cc55 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Action: 'update', calling method: .version_select at 0x7f7524467ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a69927c-9cda-4c30-a13a-9ae9d670cc55 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-hosts/n-d-860864-13 HTTP/1.1 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 51 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: {"status": "invalid", "maintenance_mode": "enable"} Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:34:41.888706 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a69927c-9cda-4c30-a13a-9ae9d670cc55 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.893926 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a69927c-9cda-4c30-a13a-9ae9d670cc55 tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-860864-13" status: 400 len: 189 microversion: 2.1 time: 0.020772 Oct 28 17:34:41.895221 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 819/1582] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:34:41 2022] PUT /compute/v2.1/os-hosts/n-d-860864-13 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:34:41.908376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a9b42af-92ec-4266-90fe-a41c5907f835 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Action: 'update', calling method: .version_select at 0x7f7524467dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:41.918924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3a9b42af-92ec-4266-90fe-a41c5907f835 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ba8619bb6e724ceb903bbee323e0d865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bdef902dba44fb884f31afeee81d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a9b42af-92ec-4266-90fe-a41c5907f835 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Request method failure captured: Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-hosts/n-d-860864-13 HTTP/1.1 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 50 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKuU0JDa2jMJ1g_5-im46-iDQbOi0HjBGxStEurdWjmk_75AeHylQoBuL3Hny3z_eyyHOHThTvOlW38YZwvcfVz2zn8zyR1seFoC2iBWWrn-mK5EnR9GPBSp3WiyvBDyGzv3LHhn1Ov0ezQzfibjq3GDNR_QTtCwGdzZJwGPlIcui0 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6bdef902dba44fb884f31afeee81d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6bdef902dba44fb884f31afeee81d1f"}]}] Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c6bdef902dba44fb884f31afeee81d1f Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1118658502 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ba8619bb6e724ceb903bbee323e0d865 Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1118658502-project Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 17:34:41.924473 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 17:34:41.930171 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.932603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a9b42af-92ec-4266-90fe-a41c5907f835 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.932603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a9b42af-92ec-4266-90fe-a41c5907f835 tempest-HostsAdminNegativeTestJSON-1118658502 tempest-HostsAdminNegativeTestJSON-1118658502-project] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-860864-13" status: 403 len: 111 microversion: 2.1 time: 0.031039 Oct 28 17:34:41.935072 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 820/1583] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:34:41 2022] PUT /compute/v2.1/os-hosts/n-d-860864-13 => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:34:41.946407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98ff4ba7-2724-4d34-bbbd-214757eaca2c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Action: 'update', calling method: .version_select at 0x7f7524377ee0>, body: {"status": null, "maintenance_mode": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98ff4ba7-2724-4d34-bbbd-214757eaca2c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-hosts/n-d-860864-13 HTTP/1.1 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 42 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: {"status": null, "maintenance_mode": null} Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'n-d-860864-13', 'body': {'status': None, 'maintenance_mode': None}} Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi None Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:34:41.958918 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98ff4ba7-2724-4d34-bbbd-214757eaca2c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:41.964224 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98ff4ba7-2724-4d34-bbbd-214757eaca2c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-860864-13" status: 400 len: 127 microversion: 2.1 time: 0.022041 Oct 28 17:34:41.966428 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 821/1584] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Oct 28 17:34:41 2022] PUT /compute/v2.1/os-hosts/n-d-860864-13 => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:34:41.980469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Action: 'update', calling method: .version_select at 0x7f7524388f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:41.988866 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.hosts [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Enabling host nonexistent_hostname. Oct 28 17:34:42.002233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:42.008983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Request method failure captured: Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 50 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBKw__tr2tba_YCaRmk6jJv7Zz41dmV-mG1wmZ2ouip-zjfKLa_SHUi_HIPLrIb_aE0T0LrTtj1X0zVP6UqboK0XJ4mOecoVghl03x7QHyXxpD7sOb-HbsR60yjmE5CIeDAxDaRRfYBLjXBSu9fsHlFTjCqkoPZziJPtiBc2t7N7wz8 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5f54a8c28caf4f438c05d28a605a9e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5f54a8c28caf4f438c05d28a605a9e38"}]}] Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5f54a8c28caf4f438c05d28a605a9e38 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-675943433 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 09437bcdd5794c6592a6d509c7367ab7 Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-675943433-project-admin Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:42.016381 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0fb5f53b-ddc8-49f0-901c-b19b3af7599c tempest-HostsAdminNegativeTestJSON-675943433 tempest-HostsAdminNegativeTestJSON-675943433-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044672 Oct 28 17:34:42.021039 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 822/1585] 10.222.0.48 () {60 vars in 1211 bytes} [Fri Oct 28 17:34:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:34:42.341657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:42.343072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:42.370606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:42.376402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:42.376942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:42.379691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:42.380172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:42.380608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:42.842915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:42.858661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fecc971c-279f-424d-9d59-26548402097f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.098169 Oct 28 17:34:42.860001 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 764/1586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:41 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:42.978076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:42.987560 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22255c7b-2ca3-45ba-a3ff-8f80a4a4044c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.652843 Oct 28 17:34:43.011408 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 823/1587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:42 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:43.888319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:43.889138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:43.903618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:43.905508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:43.908624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:43.910611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:43.911268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:43.913023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:43.956843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:43.959326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:43.979967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:43.980593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:43.980881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:43.981597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:43.982053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:43.982477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.079688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae251c68-4383-4147-9695-1b6297d72d3e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127394 Oct 28 17:34:44.086674 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 824/1588] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:34:43 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:34:44.094048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:44.095270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:44.102186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.102922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.103619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.104507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.105127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.105716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.325906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:44.336590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60d8a85f-8114-4cf3-bd8a-3ab98394b4bc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.454385 Oct 28 17:34:44.343465 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 765/1589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:43 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:44.536598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:44.539134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:44.559027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.565739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:44.570565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.575882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a194debb-6683-4ccb-a5e6-44619e3c6778 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.487606 Oct 28 17:34:44.578225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.579186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.580256 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 825/1590] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:44 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:44.580923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.581557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.651716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-511cebd5-00c1-4925-9895-a4a1cd76031d tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119708 Oct 28 17:34:44.652489 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 766/1591] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:34:44 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:34:44.751076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:44.751612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:44.763985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.764762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.765961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.767564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:44.768192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:44.768787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:44.811529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:34:45.024330 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb281ebb-6990-469c-93aa-d1eddd3dc680 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 204 len: 0 microversion: 2.1 time: 0.278527 Oct 28 17:34:45.034345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:45.035022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:45.035662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 826/1592] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:34:44 2022] DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:34:45.049621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.050134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.050587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:45.053987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.054469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.054912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:45.368754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:45.369605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:45.379213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.379743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.380184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:45.380902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.387095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.388074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:45.430410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:45.451283 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1849081f-b44e-46ba-9864-2c5225eb65e1 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1682 microversion: 2.1 time: 0.410501 Oct 28 17:34:45.451929 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 767/1593] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:45 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1682 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:45.606640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:45.607812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:45.623141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.624953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.625692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:45.629038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:45.629729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:45.630628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:46.065385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:46.087568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d02ba18-af4d-4ca5-9514-a062e2ff8e3e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.724467 Oct 28 17:34:46.088816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 827/1594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:45 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:46.202768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:46.212003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b0502b8-7697-4d4a-874a-6faf836a7c45 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.612102 Oct 28 17:34:46.215780 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 768/1595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:45 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:46.480176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:46.481427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:46.492470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:46.493308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:46.494471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:46.495932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:46.498352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:46.501085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:46.869132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:46.892282 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac08f8f7-615c-487a-a8d1-5615924de41e tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1682 microversion: 2.1 time: 0.416043 Oct 28 17:34:46.897956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 828/1596] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:46 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:47.116822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:47.117440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:47.135406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:47.135895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:47.138204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:47.141875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:47.144697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:47.145133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:47.242794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:47.244664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:47.252876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:47.253713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:47.254397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:47.255424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:47.256117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:47.256912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:47.288096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:48.001547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:48.019739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a7526f5d-b915-411b-a6ea-35abe3a15aef tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.907751 Oct 28 17:34:48.026104 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 769/1597] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:47 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:48.042739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:48.052059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:48.067693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:48.072065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:48.080654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:48.084672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:48.084982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:48.090542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:48.151665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:48.163135 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86de9d8d-7104-4e84-a8aa-cb4fb1c27863 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.924026 Oct 28 17:34:48.163751 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 829/1598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:47 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:48.489014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348b884c-6998-4aab-8718-ef0ca5723870", "name": "network-vif-plugged", "status": "completed", "tag": "acd372da-029f-48b2-9c1f-6ad96d16c20e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:48.511623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:48.512109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:48.512540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:48.561553 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] Creating event network-vif-plugged:acd372da-029f-48b2-9c1f-6ad96d16c20e for instance 348b884c-6998-4aab-8718-ef0ca5723870 on n-h1-860864-13 Oct 28 17:34:48.573242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5aadfb6a-5508-4a8f-8100-bf548db2454d req-11e174b3-8047-442e-bac5-88638ebbe523 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087801 Oct 28 17:34:48.573871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 830/1599] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:49.054126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:49.054385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:49.075900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:49.081146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:49.083566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:49.084141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:49.084904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:49.085380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:49.085837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:49.095949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1dbd972-957b-408e-9389-695b8e12f7c9 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1682 microversion: 2.1 time: 1.059841 Oct 28 17:34:49.105861 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 770/1600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:48 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1682 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:49.190787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:49.191470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:49.201982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:49.202569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:49.203050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:49.203819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:49.204264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:49.229235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:50.106357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:50.114769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9799315-c7ce-43eb-8b56-a151b7058602 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 0.928688 Oct 28 17:34:50.123775 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 771/1601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:49 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:50.135030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ddc7a9-f843-484c-8f6e-edf06a0343a7", "name": "network-vif-deleted", "tag": "0442ef4e-ba83-4e6c-9702-ac9a43e96e32"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:50.178136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:50.181521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:50.182626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:50.184281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:50.199812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] Creating event network-vif-deleted:0442ef4e-ba83-4e6c-9702-ac9a43e96e32 for instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 on n-h1-860864-13 Oct 28 17:34:50.204268 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-438b2cb7-4b84-4e17-b887-e21dbd20160a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.146014 Oct 28 17:34:50.205068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 831/1602] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:49 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:50.207094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1e74d284-5474-401b-b424-680edfedc892 req-eee111df-40fd-41f1-bb46-c1ee9577b65b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080950 Oct 28 17:34:50.208151 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 772/1603] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:50.229208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:50.239140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:50.251027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:50.251699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:50.252237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:50.253051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:50.253606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:50.254147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:50.325524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:50.326247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:50.326885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:50.328243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lazy-loading 'fault' on Instance uuid 05ddc7a9-f843-484c-8f6e-edf06a0343a7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:34:50.533577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8817c763274745478f78228177c8d690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4744fa0a3c14442b1252b4349209b6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:50.547539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aac4f896-a5f0-434e-bf21-c6748d372eaf tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 200 len: 1331 microversion: 2.1 time: 0.320933 Oct 28 17:34:50.548432 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 832/1604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:50 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:51.009145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:51.146337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:51.147301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:51.159053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.162072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.163566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.165539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.168602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.169294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.261956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Calling method '.version_select at 0x7f7524034940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:51.274467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.276649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.277368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.326376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.327525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.327986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.381040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.383556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.384308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.400447 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ec11cfa8-e639-4608-8600-f709c069ff2f tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.491998 Oct 28 17:34:51.423424 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 773/1605] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:51.443701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:51.444970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:51.480766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.483229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.487326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:51.488913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:51.499158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:51.499782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.481438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:52.493822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:52.511991 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d32f1d3-78f7-4368-b745-7ac194f23ace tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 1.087145 Oct 28 17:34:52.513396 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-efbf88d5-acaa-41e3-9a04-f751857e1f46 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1316 microversion: 2.1 time: 1.371051 Oct 28 17:34:52.514236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 833/1606] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:51 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1316 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:52.517197 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 774/1607] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:51 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:52.526190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:52.532370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Calling method '.version_select at 0x7f752448f430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:52.535014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:52.540669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.541934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.545039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.554670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.555574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.561106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.562348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.563163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.563837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.573375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.574229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.576198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.602155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] HTTP exception thrown: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Request method failure captured: Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 HTTP/1.1 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBHrpAG7IkGPtm0XnDM7aSpxKUOpNNvxODcHmlg-QpC7PlGHH4LnQB7Z7EvA7U_pC0pJP5hZa5TmiuAx0JGl2wZDsy7gcba-LZ2vxKaK4kf7LEw5HRBoGZpKbrxEPafGMo6l3UKoXcvqxyYh4eLhAoaHa9KWjxdVUGeEr-sBD2yBvy4 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4744fa0a3c14442b1252b4349209b6d"}]}] Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8817c763274745478f78228177c8d690 Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '05ddc7a9-f843-484c-8f6e-edf06a0343a7'} Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:52.606457 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:34:52.612207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:34:52.614431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Returning 404 to user: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:52.614572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.614971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.615441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.621749 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-08efc01a-ac2a-4c89-9b49-e203b9c1e16c tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 404 len: 111 microversion: 2.1 time: 0.101995 Oct 28 17:34:52.622554 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 775/1608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:52 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:34:52.631949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3617430f-3805-454f-ae17-c6cfba7d99e3 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '.version_select at 0x7f75242fe4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:52.634040 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-660cd55f-3932-472c-9585-9475ec3de6e8 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-860864-13/servers" status: 200 len: 276 microversion: 2.1 time: 0.115485 Oct 28 17:34:52.635914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 834/1609] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Oct 28 17:34:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-13/servers => generated 276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:52.647930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Calling method '.version_select at 0x7f75243b98b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:52.650374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.652899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.653569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.677269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.678105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.678724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.687425 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3617430f-3805-454f-ae17-c6cfba7d99e3 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227439975" status: 202 len: 0 microversion: 2.1 time: 0.058851 Oct 28 17:34:52.688265 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 776/1610] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:34:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227439975 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:52.724026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.725102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.727959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.739406 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ecf57b2-560d-49b6-9184-a2f3c14db426 tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.095174 Oct 28 17:34:52.740661 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 835/1611] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:34:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:34:52.753034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Calling method '.version_select at 0x7f7524213430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:52.755208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.755929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.756420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.805354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:52.805951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:52.806471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:52.813722 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-823f7408-3975-4da4-9bf9-77346cbaa03d tempest-HypervisorAdminUnderV252Test-629466219 tempest-HypervisorAdminUnderV252Test-629466219-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h2-860864-13/search" status: 200 len: 105 microversion: 2.1 time: 0.065853 Oct 28 17:34:52.817759 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 777/1612] 10.222.0.48 () {58 vars in 1212 bytes} [Fri Oct 28 17:34:52 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-13/search => generated 105 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:53.544399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:53.545433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:53.546388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:53.546535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:53.564799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:53.566563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:53.567121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:53.567471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:53.568172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:53.569089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:53.569692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:53.569919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:53.570537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:53.572128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:53.573271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:53.574558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:54.152151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:54.155640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:54.193948 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3a6549e-2db4-4339-a9c8-157f71c3f9b4 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1503 microversion: 2.1 time: 0.657274 Oct 28 17:34:54.194189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00a128d8-b4f8-4757-bcd1-2bf1378b6299 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1719 microversion: 2.1 time: 0.653121 Oct 28 17:34:54.195148 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 778/1613] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:53 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1719 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:54.217754 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 836/1614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:53 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1503 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:54.251391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1434768698"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:54.252817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:54.267232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-911967752", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0cbf4b98-e322-48fb-b131-dac3c084f709"}], "block_device_mapping_v2": [{"uuid": "1024bd73-cbd8-4c45-a7e5-41a73bdfad8d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:54.269988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:54.270792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:54.271643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:54.276243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:54.278292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:54.278844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:54.428525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] validate_networks() for [('0cbf4b98-e322-48fb-b131-dac3c084f709', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:34:55.285087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Adding security group 8a809c51-30da-4c47-8e10-78b0469236a3 to port acd372da-029f-48b2-9c1f-6ad96d16c20e Oct 28 17:34:56.840856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:34:56.841431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:34:56.842165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:34:56.843463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:34:56.844844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:34:56.889960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:56.896138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:56.897067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:56.898983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:56.900184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:56.901189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:56.984192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:34:56.993875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Getting quotas for user 5121cf58427a48738ec1c70fbf5e922d and project 1d985c16d5e341f3a78075917a2a4e9b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:34:57.089856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05b148ea-f0eb-432e-8288-49f39cdbb821 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action" status: 202 len: 0 microversion: 2.1 time: 2.850547 Oct 28 17:34:57.090479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 779/1615] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:34:54 2022] POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action => generated 0 bytes in 2852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:57.096342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:57.097063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:57.111749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:57.115100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:57.115962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:57.119449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:57.120157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:57.122860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:57.154496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:34:57.157857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1024bd73-cbd8-4c45-a7e5-41a73bdfad8d',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:34:57.442262 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a43a8c48-72be-4dd3-a681-3efa2ae85c75 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.179186 Oct 28 17:34:57.449736 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 837/1616] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 17:34:57.463575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75244678b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:57.472296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:57.510554 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b585bcb9-aa6e-499c-b72b-2bfa2b999b95 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1709 microversion: 2.1 time: 0.418778 Oct 28 17:34:57.517072 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 780/1617] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:57 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1709 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:57.533486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b884c-6998-4aab-8718-ef0ca5723870", "tag": "acd372da-029f-48b2-9c1f-6ad96d16c20e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:57.558621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:57.559301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:57.559884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:57.592798 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] Creating event network-changed:acd372da-029f-48b2-9c1f-6ad96d16c20e for instance 348b884c-6998-4aab-8718-ef0ca5723870 on n-h1-860864-13 Oct 28 17:34:57.607655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-aa5d35bc-ab30-48f7-bbf7-5245a5c051c5 req-8bc8235d-e298-41fe-ac86-2b0d2761ef7a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087479 Oct 28 17:34:57.624989 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 781/1618] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:34:57.648124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:57.648848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:57.933406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:57.957048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:57.965201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:57.971737 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-edc78630-925d-46fc-b9b0-946e8247e12f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1103 microversion: 2.25 time: 0.336488 Oct 28 17:34:57.972365 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 782/1619] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:34:57 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1103 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:34:57.994140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5eae8d56-4c85-40fd-931e-11c6d561824f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '.version_select at 0x7f75242f5160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:58.003124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eae8d56-4c85-40fd-931e-11c6d561824f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.005532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eae8d56-4c85-40fd-931e-11c6d561824f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.005953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eae8d56-4c85-40fd-931e-11c6d561824f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.035003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5eae8d56-4c85-40fd-931e-11c6d561824f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2344 microversion: 2.1 time: 0.060841 Oct 28 17:34:58.037512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 783/1620] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:34:57 2022] GET /compute/v2.1/os-migrations => generated 2344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:58.042150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use.", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:34:58.043188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.043188 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3 HTTP/1.1 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: exception: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8a809c51-30da-4c47-8e10-78b0469236a3'} Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:34:58.046870 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 400 to user: Security Group 8a809c51-30da-4c47-8e10-78b0469236a3 in use. Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-5a324474-c216-48b6-94d8-dfd00e134674'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-750286cf-8eeb-456a-8768-10eca07f4130 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3" status: 400 len: 185 microversion: 2.1 time: 0.598692 Oct 28 17:34:58.051755 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 838/1621] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:34:57 2022] DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3 => generated 185 bytes in 600 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:34:58.071198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:58.075197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:58.076624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:58.085040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:58.092179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.094586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.096727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.097945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.099691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.101829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.123065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.124418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.125033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.129880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.130775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.131507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.178858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:34:58.355545 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b6442e3-62ae-4f2c-be8d-3fe7a2137e3a tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action" status: 202 len: 0 microversion: 2.1 time: 0.296473 Oct 28 17:34:58.356846 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 784/1622] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:34:58 2022] POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:34:58.399654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:58.400365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:58.419431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.420238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.422166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.423405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:58.424127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:58.424812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:58.933481 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87c99622-ef20-4630-a533-a61b8e8610a6 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1862 microversion: 2.1 time: 0.871171 Oct 28 17:34:58.934401 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 839/1623] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:58 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1862 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:34:59.126572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:34:59.138071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-685bb143-01e0-42e1-9983-f255980f01b7 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1574 microversion: 2.1 time: 0.755556 Oct 28 17:34:59.142365 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 785/1624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:58 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1574 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:34:59.159788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:34:59.160988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:34:59.175223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:59.178674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:59.179478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:59.180947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:34:59.181647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:34:59.182938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:34:59.461564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1164365367", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:34:59.612275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:35:01.015844 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3e5515a-5f05-4c88-b95c-06371dc7b740 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1862 microversion: 2.1 time: 1.870631 Oct 28 17:35:01.020043 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 786/1625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:34:59 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1862 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:01.043208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:01.045284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:01.067675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:01.078359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:01.081167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:01.082669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:01.087656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:01.091643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:01.093347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:01.565447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:01.584623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:01.586382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:01.588463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-36baf611-8b06-4827-af65-e281917217da tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1250 microversion: 2.25 time: 0.566339 Oct 28 17:35:01.611404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 787/1626] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:01 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1250 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:01.612013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:01.619879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:01.634914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:01.635975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:01.639837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:01.640987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:01.646105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:01.647159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:03.620051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:03.637454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bfff0076-5d9f-431d-afd3-c2b4d7dfceb2 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1574 microversion: 2.1 time: 2.032050 Oct 28 17:35:03.680926 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 788/1627] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:01 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1574 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:03.696374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:03.709173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:03.742222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:03.743092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:03.743810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:03.745175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:03.745861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:03.746516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:03.917510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:35:03.918196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:35:03.918678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:35:03.919080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:35:03.919532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:35:03.956377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:03.956865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:03.957303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:03.957677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lazy-loading 'services' on Instance uuid 9296eac6-dd58-4654-adce-1d025ea51036 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:35:03.968530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:03.969733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:03.970180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:04.067580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:04.069648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11b894a0-1a90-47cc-ac8a-f56052cb290e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments/4c471f57-6f56-4913-bb5a-3d75f3b15d62" status: 202 len: 0 microversion: 2.1 time: 0.386547 Oct 28 17:35:04.072558 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 789/1628] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:35:03 2022] DELETE /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments/4c471f57-6f56-4913-bb5a-3d75f3b15d62 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:04.087878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:04.090879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:04.108087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:04.108815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:04.109731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:04.110346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:04.112979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:04.113558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:04.114977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:04.152156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:35:04.156717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:35:04.259341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d72d2523-0188-44e9-87cb-9c0de3daec0f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.323628 Oct 28 17:35:04.275771 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 840/1629] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 5340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:35:04.673188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-962774140", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:04.812278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:35:05.727719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:05.752804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:05.773742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:05.786361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18039afa-f038-434a-a4c9-5b27e694b300 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 1.700989 Oct 28 17:35:05.799155 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 790/1630] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:04 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:05.825631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:05.834237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:05.867274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:05.867978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:05.868427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:05.871877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:05.872424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:05.874818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:05.969680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2fb6134-e102-4f34-bd46-35f7d77b41d7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165588 Oct 28 17:35:05.978024 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 791/1631] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:05 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:05.989563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:05.990258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:06.006470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.007121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.008517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.009265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.009784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.010214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.142331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:35:06.146365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:35:06.147238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:35:06.147965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:35:06.148680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:35:06.171326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.173619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.176460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.177751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.180009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.180899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.237701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:06.251089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:06.290721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:35:06.298366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:35:06.336566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:06.353225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58ca5377-7c5a-431a-ad8b-7e14b6d7bdac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1267 microversion: 2.1 time: 0.375907 Oct 28 17:35:06.369547 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 792/1632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:05 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1267 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:06.429253 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4694508f-3629-4dac-a68d-1bec4fa8f1d0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.151985 Oct 28 17:35:06.439901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 841/1633] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:35:06.446505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:06.451514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:06.491097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.492810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.493273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.496264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:06.497035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:06.498704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c227255a-b089-4598-9fa9-718d05060db5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: .version_select at 0x7f752438d5e0>, body: {"keypair": {"name": "tempest-keypair-1118882013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM94FoWcXsHexvmN12ZbM5Yd0A1rJ3ilIcMGyKTgZ/+TGdpdVfDah4agij2jIRH0WTfGHfZmO1BvoCz70EHld5DA6OmvvvgmoA4xXoJ354y4NKcihLUzzLjmrj9+bbgbug=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:06.499548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:06.549709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c227255a-b089-4598-9fa9-718d05060db5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:06.562968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c227255a-b089-4598-9fa9-718d05060db5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:06.668225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c227255a-b089-4598-9fa9-718d05060db5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296570 Oct 28 17:35:06.677087 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 793/1634] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:35:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:06.685710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b736ba0e-21ab-4bb3-b24c-3922a3c00d7c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:06.688330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b736ba0e-21ab-4bb3-b24c-3922a3c00d7c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:07.578345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:07.595288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b736ba0e-21ab-4bb3-b24c-3922a3c00d7c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:07.605092 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b736ba0e-21ab-4bb3-b24c-3922a3c00d7c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1212 microversion: 2.1 time: 0.931160 Oct 28 17:35:07.606277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dda66177-1953-4715-97a3-8a0a6f1a914c tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1572 microversion: 2.1 time: 1.148507 Oct 28 17:35:07.610831 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 842/1635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:06 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1572 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:07.624088 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 794/1636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:06 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1212 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:07.632486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:07.633545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:07.635655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:07.638855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:07.664117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.664910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.665998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.666693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:07.668246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.668653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.669360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:07.670079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.671074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.671907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:07.672578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.682395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:07.762999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3325310-4f2f-4ef1-b938-0889ae971d1b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137130 Oct 28 17:35:07.770184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 795/1637] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:07 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:07.776642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:07.777702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:07.788936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.792011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.792847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:07.794141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:07.794916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:07.795855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.070235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:09.085544 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0ffcd321-a9cf-4934-8533-61680be4c8b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 1.314012 Oct 28 17:35:09.086998 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 796/1638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:07 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:09.103027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1528704795"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:09.104981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:09.113516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.114510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.115604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.116917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.118299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.119146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.183275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:09.201043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:09.220155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:09.223476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb710d05-32d4-4f2c-bb90-2bf8ea552f6a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 1.601031 Oct 28 17:35:09.224098 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 843/1639] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:07 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:09.238842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:09.241022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:09.252392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.252892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.253333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.254050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.259829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.260548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.512672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:09.530645 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ecd2767-cbe3-4d4a-b68f-7a38b1444e22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1270 microversion: 2.1 time: 0.299781 Oct 28 17:35:09.531518 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 844/1640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:09 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1270 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:09.540160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:09.547913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:09.555996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.556919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.557536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.559175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:09.559971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:09.560561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:09.662348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-59328492-2f10-4a41-b7c1-2d24dbcb56a2 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129401 Oct 28 17:35:09.667788 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 845/1641] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:09 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:09.729601 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Adding security group 97bff969-9cf2-458d-a84d-54905535c6b6 to port acd372da-029f-48b2-9c1f-6ad96d16c20e Oct 28 17:35:10.122299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:10.125378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:10.148964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:10.158160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:10.159647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:10.160287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:10.164371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:10.167477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:10.169559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:10.722153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:10.735037 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61f48fd4-3ee7-4f38-9324-20a65bb0d5da tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.622519 Oct 28 17:35:10.737359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 846/1642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:10 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:10.748785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:10.751950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:10.767250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:10.767784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:10.768230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:10.771883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:10.773824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:10.774521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.290409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89f037c1-cbb8-40b2-ad51-373b6f213adf tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action" status: 202 len: 0 microversion: 2.1 time: 2.201692 Oct 28 17:35:11.291039 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 797/1643] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:35:09 2022] POST /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870/action => generated 0 bytes in 2203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:11.296154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7311730b-292e-404f-9ed7-6c15524129da", "tag": "a11a6f1e-0195-4cdd-bde7-a9e50b452172"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:11.318351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.319842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.319842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.341475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] Creating event network-changed:a11a6f1e-0195-4cdd-bde7-a9e50b452172 for instance 7311730b-292e-404f-9ed7-6c15524129da on n-h2-860864-13 Oct 28 17:35:11.364341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:11.365657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-083e6ea9-37c6-48b6-820d-a0899b8a3a8b req-61d3272f-e8d8-45a7-9572-a7b9cca67180 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073352 Oct 28 17:35:11.372195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 798/1644] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:11.384126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:11.386682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:11.387880 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-671750ee-f3a7-4930-951e-0dabb2b50d2f tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 0.649524 Oct 28 17:35:11.388622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:11.392496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:11.412639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.414313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.416512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.418817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.419261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 847/1645] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:10 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:11.424291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.425147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.430400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:11.443428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:11.462546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.463745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.469747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.470800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.471467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.472146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.552399 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f4091f4-1d5d-4262-9ff2-ddb1dea221d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131949 Oct 28 17:35:11.553319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 848/1646] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:11 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:11.558015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1478932a-8fb6-494a-8945-1d5767134fbc", "tag": "c36a3b56-03c2-4f2d-b992-5e15782a5124"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:11.581576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:11.582063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:11.582495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:11.586620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:11.609085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] Creating event network-changed:c36a3b56-03c2-4f2d-b992-5e15782a5124 for instance 1478932a-8fb6-494a-8945-1d5767134fbc on n-h2-860864-13 Oct 28 17:35:11.625774 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-cc953910-176a-44ee-a571-ef9f35153a51 req-6f960177-95c4-4b34-b387-aa5ece849c9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070988 Oct 28 17:35:11.626685 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 849/1647] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:11.632003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75243039d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:12.064925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:12.077377 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45ae71ec-4ccb-44c0-a5b0-4f70f5ba24e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.701298 Oct 28 17:35:12.081801 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 799/1648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:11 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:12.097028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:12.098915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:12.120289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use.", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:12.120989 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.120989 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6 HTTP/1.1 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: exception: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '97bff969-9cf2-458d-a84d-54905535c6b6'} Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:12.123894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] Oct 28 17:35:12.129291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:12.132463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.132463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.132463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.132463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.132851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.135242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.135417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 400 to user: Security Group 97bff969-9cf2-458d-a84d-54905535c6b6 in use. Oct 28 17:35:12.135417 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-c6abc8a3-6815-45eb-b90d-0a435058570a'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:12.135417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90a08bc5-f33d-4a58-86c8-b770a7922431 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6" status: 400 len: 185 microversion: 2.1 time: 0.506721 Oct 28 17:35:12.135417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 850/1649] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:11 2022] DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6 => generated 185 bytes in 508 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:35:12.145066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:12.161374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:12.178755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.179578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.184996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.186565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.188263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.190161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.271005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:35:12.453590 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d5f0082-5b1b-4dca-a8a3-0892ecd5539d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 204 len: 0 microversion: 2.1 time: 0.313842 Oct 28 17:35:12.454396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 851/1650] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:35:12 2022] DELETE /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:35:12.466104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9dab7a7-c8a0-4d43-a714-b643ebae010b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Action: 'create', calling method: .version_select at 0x7f7524d36160>, body: {"keypair": {"name": "tempest-keypair-1383743115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4jgJgSkXGtWh8VYMSCOr/DUF40YHMYEkoth8bylIfTWMzJzHXiDyzppPlbSkiMq4Dh1lpJmpCZzGRZ9t4FbcdbhDz4L/lOVEIof+suzLLIaPeX5q44ic/QSe3FcaFL/g=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:12.520847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f9dab7a7-c8a0-4d43-a714-b643ebae010b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Getting quotas for project 8fdae183be19441db9cd63cc277740cf. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:12.536480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f9dab7a7-c8a0-4d43-a714-b643ebae010b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Getting quotas for user b564af2dfb0847d8b01822a2d218ad5b and project 8fdae183be19441db9cd63cc277740cf. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:12.592645 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9dab7a7-c8a0-4d43-a714-b643ebae010b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.137199 Oct 28 17:35:12.600434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 852/1651] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:35:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:35:12.600434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:12.600434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:12.623310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.623842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.624285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.625012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.625472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.625907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.638364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:12.647683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bcbe0657-531d-440a-b4e7-982659ead22e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.564542 Oct 28 17:35:12.648474 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 800/1652] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:12 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:12.668332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:12.668958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:12.680514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.681008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.681440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:12.694029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:12.694527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:12.695174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.069446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:13.080488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f42a3586-5acd-4243-b5b0-7927f7a2050f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1647 microversion: 2.1 time: 0.431063 Oct 28 17:35:13.080999 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 801/1653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:12 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1647 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:13.095464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:13.102488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:13.110007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:13.112273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:13.124539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:13.127963 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-700c6605-5d48-4185-b929-4582250b63d4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 0.532700 Oct 28 17:35:13.130370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 853/1654] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:12 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:13.138484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.141744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:13.144501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.145122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.146737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.148040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.148521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:13.149120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.170959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.181080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.182643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.184269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.187101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.191970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.219406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:13.273828 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da0789ef-400e-4efc-8c20-2524700da12a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190355 Oct 28 17:35:13.291092 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 802/1655] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:13 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:13.437807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b884c-6998-4aab-8718-ef0ca5723870", "tag": "acd372da-029f-48b2-9c1f-6ad96d16c20e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:13.454527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.455005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.455458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.496343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] Creating event network-changed:acd372da-029f-48b2-9c1f-6ad96d16c20e for instance 348b884c-6998-4aab-8718-ef0ca5723870 on n-h1-860864-13 Oct 28 17:35:13.507241 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1ccb2754-5818-46d9-9897-513f950119bc req-a14d1e5f-a5a7-49e6-83d0-0b9dfdbffe6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077606 Oct 28 17:35:13.511635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 803/1656] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:35:13.530523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-166257001", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "433988cf-7d9a-4f57-bc43-869692e1a0af"}], "security_groups": [{"name": "tempest-securitygroup--1237994490"}], "key_name": "tempest-keypair-1118882013", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:13.616067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:13.629802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4954db6a-71ef-4081-93cd-f4caf12d5e65 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.498001 Oct 28 17:35:13.633976 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 854/1657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:13 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:13.677486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:13.678119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:13.690955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.691487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.694186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.696996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:13.700682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:13.701809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:13.782767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] validate_networks() for [('433988cf-7d9a-4f57-bc43-869692e1a0af', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:35:14.388554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:14.402456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-42c5b857-1b64-4550-996f-c6155e727053 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.729579 Oct 28 17:35:14.415401 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 855/1658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:13 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:35:14.415401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:14.432559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:14.433325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:14.434022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:14.447664 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] Creating event network-changed:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h2-860864-13 Oct 28 17:35:14.457268 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d0a48731-2c8e-4680-8a15-d1a24d81475d req-e9b9f646-4e65-4c80-b485-2af3eb02c731 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052512 Oct 28 17:35:14.458360 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 856/1659] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:14.465166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:14.465883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:14.473931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:14.474428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:14.475649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:14.476487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:14.476967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:14.477404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.330545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:15.338925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1709eb91-2c44-4895-9ce1-0e4aad9627be tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1647 microversion: 2.1 time: 0.879342 Oct 28 17:35:15.366103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 857/1660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:14 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1647 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:15.375730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:15.376733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:15.385326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.386111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.387231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.388409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.389590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.391034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.873993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:15.890026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:35:15.891193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:35:15.891996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:35:15.892577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:35:15.893174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:35:15.915830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:15.922033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:15.934604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.935270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28637875-35c2-46ee-befd-0c73fcad4c53 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 0.564041 Oct 28 17:35:15.936235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.937743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.938507 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 858/1661] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:15 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:15.938873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.939691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.940291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.960334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:15.963340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:15.972904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:15.976591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.979915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.982636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:15.984097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:15.984836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:15.988494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:15.988675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.047193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:35:16.056127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:35:16.066002 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-94554b3e-67cf-4f24-a695-3fa35e3d96fb tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126139 Oct 28 17:35:16.066710 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 859/1662] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:35:15 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:35:16.083061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.083934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.099312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.100152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.100764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.101641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.102264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.102847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.197740 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3269e9fa-8509-441d-b20b-c9df7a391d8b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.666415 Oct 28 17:35:16.198881 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 804/1663] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:35:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:35:16.206248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:16.213391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.213922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.234117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.234639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.235032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.235784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.239234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.243782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.350420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] HTTP exception thrown: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Request method failure captured: Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 HTTP/1.1 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBHrpAG7IkGPtm0XnDM7aSpxKUOpNNvxODcHmlg-QpC7PlGHH4LnQB7Z7EvA7U_pC0pJP5hZa5TmiuAx0JGl2wZDsy7gcba-LZ2vxKaK4kf7LEw5HRBoGZpKbrxEPafGMo6l3UKoXcvqxyYh4eLhAoaHa9KWjxdVUGeEr-sBD2yBvy4 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4744fa0a3c14442b1252b4349209b6d"}]}] Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8817c763274745478f78228177c8d690 Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '05ddc7a9-f843-484c-8f6e-edf06a0343a7'} Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:16.358476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.363359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.382030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Returning 404 to user: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:16.386829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90e61006-f768-4ba5-ab82-df9118b6318f tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 404 len: 111 microversion: 2.1 time: 0.182055 Oct 28 17:35:16.390934 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 805/1664] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:35:16 2022] DELETE /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:16.436127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.436782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.472183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.472668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.473108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.473818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.474273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.474689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.477869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:16.491167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dfde156d-76d1-44db-a19b-dad20c7778bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.422954 Oct 28 17:35:16.494422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 860/1665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:16 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:16.521186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4fe7b7b-463a-4d24-b2fc-08fe584ac6c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.522184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4fe7b7b-463a-4d24-b2fc-08fe584ac6c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.785253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:16.795972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc36740f-48b8-450e-ad17-84404338708a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.401694 Oct 28 17:35:16.799178 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 806/1666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:16 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:16.810980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.814021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.831316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.832974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.838433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.842346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.843056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.844649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.853103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4fe7b7b-463a-4d24-b2fc-08fe584ac6c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:16.863472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4fe7b7b-463a-4d24-b2fc-08fe584ac6c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1238 microversion: 2.1 time: 0.367553 Oct 28 17:35:16.867814 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 861/1667] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:16 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1238 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:16.879558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:16.890407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] [instance: 05ddc7a9-f843-484c-8f6e-edf06a0343a7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:16.905438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.906456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.907083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.907800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lazy-loading 'fault' on Instance uuid 348b884c-6998-4aab-8718-ef0ca5723870 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:35:16.908278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.910362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.911919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.915801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:16.916416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:16.916969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:16.959965 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] HTTP exception thrown: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Request method failure captured: Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 HTTP/1.1 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBHrpAG7IkGPtm0XnDM7aSpxKUOpNNvxODcHmlg-QpC7PlGHH4LnQB7Z7EvA7U_pC0pJP5hZa5TmiuAx0JGl2wZDsy7gcba-LZ2vxKaK4kf7LEw5HRBoGZpKbrxEPafGMo6l3UKoXcvqxyYh4eLhAoaHa9KWjxdVUGeEr-sBD2yBvy4 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4744fa0a3c14442b1252b4349209b6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4744fa0a3c14442b1252b4349209b6d"}]}] Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c4744fa0a3c14442b1252b4349209b6d Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-297454895 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8817c763274745478f78228177c8d690 Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-297454895-project Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '05ddc7a9-f843-484c-8f6e-edf06a0343a7'} Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:16.962117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. Oct 28 17:35:16.967342 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:16.972072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] Returning 404 to user: Instance 05ddc7a9-f843-484c-8f6e-edf06a0343a7 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:16.973161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc2471b0-78dd-4034-b643-47b3cd15c190 tempest-AttachSCSIVolumeTestJSON-297454895 tempest-AttachSCSIVolumeTestJSON-297454895-project] 10.222.0.48 "GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7" status: 404 len: 111 microversion: 2.1 time: 0.102716 Oct 28 17:35:16.974062 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 862/1668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:16 2022] GET /compute/v2.1/servers/05ddc7a9-f843-484c-8f6e-edf06a0343a7 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:16.989624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348b884c-6998-4aab-8718-ef0ca5723870", "name": "network-vif-deleted", "tag": "acd372da-029f-48b2-9c1f-6ad96d16c20e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:17.000614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:17.014167 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b73f5fe-278d-4c43-9658-73cc67c8b7c5 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 200 len: 1306 microversion: 2.1 time: 0.211971 Oct 28 17:35:17.021869 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 807/1669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:16 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:17.031975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:17.032854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:17.043218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.043941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.044603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.054720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.055253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.056258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.065037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.066794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.067731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.082097 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] Creating event network-vif-deleted:acd372da-029f-48b2-9c1f-6ad96d16c20e for instance 348b884c-6998-4aab-8718-ef0ca5723870 on n-h1-860864-13 Oct 28 17:35:17.093466 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5a7b8760-736c-42b9-94f7-514a03a576d6 req-bf70a4eb-4a12-4767-834c-c56fbf9ffcc9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117830 Oct 28 17:35:17.094798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 863/1670] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:17.314398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:17.327484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:17.330241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:17.331716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1bd388c-33b2-43d3-a329-d7176f446121 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 0.308437 Oct 28 17:35:17.332540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 808/1671] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:17 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:17.524914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:17.525614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:17.541059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.541758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.542493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.543439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.551588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.552257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.721397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:17.734257 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-59313716-9d2b-4473-a2b6-d9dd05123d1a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.215027 Oct 28 17:35:17.747393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 864/1672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:17 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:17.824356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:17.825166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:17.844512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1408458309", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f2136570-2b81-4b06-9df8-86baeb1c6d18"}, {"port": "febf6791-5bbd-479e-a66a-5cba708bfaf7", "tag": "port-1"}, {"port": "9b1c9f97-9495-48eb-b03c-cb90f9eb86dc", "tag": "port-2"}, {"uuid": "f6dfd061-060d-4dd5-a747-6ff2ff3d2ca2", "tag": "net-1"}, {"uuid": "f6dfd061-060d-4dd5-a747-6ff2ff3d2ca2"}, {"uuid": "8bbb3554-3ca3-4fd9-8481-c89c57ce32cd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8bbb3554-3ca3-4fd9-8481-c89c57ce32cd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b6e1ef8a-2079-42da-bf59-11ddfcfc3a11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5f05c95e-3062-4573-a6d6-24240cb734cd", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a170b94f-fc39-432b-bbc8-e081f47b24bd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1781945649"}], "key_name": "tempest-keypair-1383743115", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:17.844943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.845694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.846855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:17.848634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:17.849726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:17.850377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.122140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] validate_networks() for [('f2136570-2b81-4b06-9df8-86baeb1c6d18', None, None, None, None, None), (None, None, 'febf6791-5bbd-479e-a66a-5cba708bfaf7', None, None, None), (None, None, '9b1c9f97-9495-48eb-b03c-cb90f9eb86dc', None, None, None), ('f6dfd061-060d-4dd5-a747-6ff2ff3d2ca2', None, None, None, None, None), ('f6dfd061-060d-4dd5-a747-6ff2ff3d2ca2', None, None, None, None, None), ('8bbb3554-3ca3-4fd9-8481-c89c57ce32cd', '10.2.2.100', None, None, None, None), ('8bbb3554-3ca3-4fd9-8481-c89c57ce32cd', '10.2.2.200', None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:35:18.125569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:18.137315 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-77c468c7-50fa-4f37-833e-143204fe6e81 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.317261 Oct 28 17:35:18.138644 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 809/1673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:17 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:18.152900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:18.157185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:18.166198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.167632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.168343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.170987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.171930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.173164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.353428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:18.362480 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd15a33b-fd19-4ed9-85c4-fb0a2757d9e8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1290 microversion: 2.1 time: 0.222029 Oct 28 17:35:18.367119 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 810/1674] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:18 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1290 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:18.377790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:18.380460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:18.394968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.395582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.397404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.398413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.400597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.401270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.454748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 HTTP/1.1 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '348b884c-6998-4aab-8718-ef0ca5723870'} Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:18.463828 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88c0fff5-7178-4df0-af51-12bc1b92db04 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 404 len: 111 microversion: 2.1 time: 0.096959 Oct 28 17:35:18.470132 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 811/1675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:18 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:18.483432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:18.487962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:18.520558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.523185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.523716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.525956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:18.529924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:18.531341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:18.969248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:18.978040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:18.980048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:18.982557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6221964c-f909-4448-b3fd-3a4e0b4b8884 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1292 microversion: 2.25 time: 0.510122 Oct 28 17:35:18.983987 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 812/1676] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:18 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1292 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:18.990146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f4537b8-ace6-49bb-b43c-c9c1f888b37f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524034790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:19.521217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f4537b8-ace6-49bb-b43c-c9c1f888b37f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3" status: 202 len: 0 microversion: 2.1 time: 0.535956 Oct 28 17:35:19.521824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 813/1677] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:18 2022] DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:19.527234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:19.527880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:19.542718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:19.550440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:19.551024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:19.551819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:19.552284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:19.552987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:19.866026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:19.876736 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac16b061-ec95-4ff3-be20-608fe34b2731 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.353871 Oct 28 17:35:19.890066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 814/1678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:19 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:19.899965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:19.901129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:19.908770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:19.909593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:19.910334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:19.911462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:19.913324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:19.914037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:20.433841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:20.445064 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9de2b4c-ca43-4ec6-ba37-564ec5fceb2c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.553276 Oct 28 17:35:20.449111 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 815/1679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:19 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:20.458309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:20.462555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:20.473705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:20.476651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:20.477380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:20.489589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:20.492111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:20.492880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:20.675726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:20.695063 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f60afc20-afde-4fec-984a-be08f82d23ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1296 microversion: 2.1 time: 0.234820 Oct 28 17:35:20.708113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 816/1680] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:20 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1296 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:20.720045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5aeac5c0-b8de-4b7c-a7aa-5f9fce8f59a9 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752423e5e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:21.676613 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5aeac5c0-b8de-4b7c-a7aa-5f9fce8f59a9 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6" status: 202 len: 0 microversion: 2.1 time: 0.966739 Oct 28 17:35:21.680978 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 817/1681] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:20 2022] DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6 => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:21.686699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1478932a-8fb6-494a-8945-1d5767134fbc", "name": "network-vif-plugged", "status": "completed", "tag": "c36a3b56-03c2-4f2d-b992-5e15782a5124"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:21.723889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:21.724669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:21.725269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:21.742474 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] Creating event network-vif-plugged:c36a3b56-03c2-4f2d-b992-5e15782a5124 for instance 1478932a-8fb6-494a-8945-1d5767134fbc on n-h2-860864-13 Oct 28 17:35:21.749998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b96b727d-0c05-4192-90bd-b33589de5a2a req-a7e0d2d6-ae64-4da8-94b7-3dafe68f4472 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067538 Oct 28 17:35:21.751252 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 818/1682] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:21.757598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:21.773288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:21.783401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:21.784900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:21.785672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:21.787217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:21.788118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:21.788773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:22.300019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:22.326393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:22.328045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:22.336403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65e7e7c5-8498-4ddb-8c9b-a6f8ed441f73 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 0.583830 Oct 28 17:35:22.351390 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 819/1683] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:21 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:22.361107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:22.364183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:22.388121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:22.388678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:22.389124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:22.389855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:22.391086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:22.391544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:22.792572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:22.802647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e9ea8a1-4a26-49bd-8cb9-e17c2711d875 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.452331 Oct 28 17:35:22.804218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 820/1684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:22 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:22.811089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:22.812573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:22.840163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:22.842195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:22.843913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:22.844823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:22.847183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:22.847725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:23.170450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:23.184947 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba07e216-5814-4b74-8b5b-63ef2426c2bc tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1315 microversion: 2.1 time: 0.379223 Oct 28 17:35:23.186312 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 821/1685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:22 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:23.195994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59cdf4a2-c456-4ba6-b80a-42ac7b103305 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'create', calling method: .version_select at 0x7f752434a550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2040762110", "description": "tempest-description-184149896"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:23.851945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:35:23.852752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:35:23.853375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:35:23.854451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:35:23.855263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:35:23.871459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=25 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:23.878774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:23.880108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:23.881297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:23.883841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:23.885073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59cdf4a2-c456-4ba6-b80a-42ac7b103305 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.697666 Oct 28 17:35:23.886210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:23.886662 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 822/1686] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:35:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:23.887183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:23.893377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:23.895214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:23.909581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:23.910458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:23.915918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:23.917747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:23.921089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:23.922014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:23.933773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Getting quotas for project 8fdae183be19441db9cd63cc277740cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:23.944609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Getting quotas for user b564af2dfb0847d8b01822a2d218ad5b and project 8fdae183be19441db9cd63cc277740cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:24.212969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:35:24.219053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b6e1ef8a-2079-42da-bf59-11ddfcfc3a11',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5f05c95e-3062-4573-a6d6-24240cb734cd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a170b94f-fc39-432b-bbc8-e081f47b24bd',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:35:24.229639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:24.240862 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c376a810-ebb8-4c4f-99e9-4119378b6576 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1364 microversion: 2.1 time: 0.352121 Oct 28 17:35:24.242132 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 823/1687] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:23 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:24.246986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:24.268819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:24.272077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:24.273861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:24.299680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] Creating event network-changed:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:35:24.316919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-76900188-9fc4-49dd-bbaa-4b1b959278a0 req-fa6a1490-4b28-467f-af63-125206b7d502 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073141 Oct 28 17:35:24.318217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 824/1688] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:24.334777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:24.336336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:24.338413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:24.352960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:24.353301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:24.357235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:24.358444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:24.360064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:24.363771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:24.656853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:24.662968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:24.666347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:24.667843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:24.668966 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e9db9f4-9a28-4994-9cf7-01bad39c92cb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 0.349366 Oct 28 17:35:24.670071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 825/1689] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:24 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:24.691756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:24.692870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:24.700632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:24.701346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:24.702059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:24.703150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:24.703838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:24.704454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:24.759463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86213056-6998-416a-9590-8001fdbe99eb tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.920048 Oct 28 17:35:24.760893 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 865/1690] 10.222.0.48 () {62 vars in 1189 bytes} [Fri Oct 28 17:35:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 6922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 17:35:24.765611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51f98620-c14c-41b1-be0e-967ad9aa2d9d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Action: 'update', calling method: .version_select at 0x7f7524467ee0>, body: {"security_group": {"name": "tempest-sg-hth-474280168", "description": "tempest-description-hth-566514770"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:25.083106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:25.090991 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7585e56d-2256-484d-b887-e35dea0972e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.410394 Oct 28 17:35:25.092113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 826/1691] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:24 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:25.103665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "name": "network-vif-plugged", "status": "completed", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:25.123665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:25.124429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:25.125406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:25.146642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] Creating event network-vif-plugged:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h2-860864-13 Oct 28 17:35:25.157551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-52c034f5-feae-44ef-9e4e-cfa1b4c2495e req-a683a7d2-f8a0-495f-8aa4-67bc5fb077ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060694 Oct 28 17:35:25.158453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 827/1692] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:25.166648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:25.167721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:25.175582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:25.176673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:25.177769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:25.181614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:25.183394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:25.184153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:25.228592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51f98620-c14c-41b1-be0e-967ad9aa2d9d tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508" status: 200 len: 216 microversion: 2.1 time: 0.466509 Oct 28 17:35:25.237774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 866/1693] 10.222.0.48 () {60 vars in 1290 bytes} [Fri Oct 28 17:35:24 2022] PUT /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508 => generated 216 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:25.241692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:25.242297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:25.408317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:25.420207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:25.423153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:25.429291 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8620451c-d469-46c5-937a-e0f0ef791202 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1286 microversion: 2.42 time: 0.194224 Oct 28 17:35:25.430098 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 867/1694] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:25 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1286 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:25.453233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03c9a738-5d89-49fa-b9d6-1fa64b869ed1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75243c2670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:25.572464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:25.584952 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a10c978b-50b2-48a1-b27b-42e66b02c8fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1502 microversion: 2.1 time: 0.424351 Oct 28 17:35:25.585747 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 828/1695] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:25 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:25.588313 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03c9a738-5d89-49fa-b9d6-1fa64b869ed1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508" status: 200 len: 216 microversion: 2.1 time: 0.156908 Oct 28 17:35:25.598631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 868/1696] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:35:25 2022] GET /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508 => generated 216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:25.606959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02061597-39ee-43bc-b0fb-ac841dbfece0 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752450d820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:25.615034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:25.636718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:25.647870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:25.648371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:25.648798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:25.649505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:25.650537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:25.650967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:25.960996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:26.039260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:26.099275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:26.112709 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bee1481d-8e2c-47de-8c22-c76eb61940ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1364 microversion: 2.1 time: 0.523705 Oct 28 17:35:26.128427 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 829/1697] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:25 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1364 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:26.137568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.138619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.145411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.146008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.146516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.147298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.147846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.148333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.211689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:35:26.296149 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02061597-39ee-43bc-b0fb-ac841dbfece0 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508" status: 202 len: 0 microversion: 2.1 time: 0.692696 Oct 28 17:35:26.301287 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 869/1698] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:25 2022] DELETE /compute/v2.1/os-security-groups/cbd6c29a-7d75-4ef5-aa85-8ba8b2332508 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:26.306820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.308104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.336903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.338604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.339971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.345751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.347968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.348960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.384330 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-122c3c9a-719c-490d-9f91-8620252c04af tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 204 len: 0 microversion: 2.1 time: 0.251461 Oct 28 17:35:26.384962 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 830/1699] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:35:26 2022] DELETE /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:35:26.393371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.398583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.409856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.410354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.410982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.411739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.412196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.412625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.787186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:26.801312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:26.803091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:26.805442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f21494e9-bed8-4c47-a536-cec383bac400 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 0.502421 Oct 28 17:35:26.806027 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 870/1700] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:26 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:26.813025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.813722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.819814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.821050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.821507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.822211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.822718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.823142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.838790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 HTTP/1.1 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '348b884c-6998-4aab-8718-ef0ca5723870'} Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:26.840561 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:26.847070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:26.848424 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b25d556-6c4a-42ad-b9da-9e83bb559cce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 404 len: 111 microversion: 2.1 time: 0.037430 Oct 28 17:35:26.848835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 871/1701] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:35:26 2022] DELETE /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:26.853185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.854136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.860728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:26.861031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.861537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.861980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.862694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.863154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.863618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.870402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-495f8cbe-3d4f-4c73-b6c0-f8c8be6b680d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1312 microversion: 2.1 time: 0.481496 Oct 28 17:35:26.872047 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 831/1702] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:26 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:26.878027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:26.878627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:26.884676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.885280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.885714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:26.886448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:26.887123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:26.887955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.031949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:27.050304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:27.051719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:27.052892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4c73174-e717-4669-9fd6-27596fe84abc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1576 microversion: 2.42 time: 0.178916 Oct 28 17:35:27.059278 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 832/1703] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:26 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:27.064485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.073726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 348b884c-6998-4aab-8718-ef0ca5723870] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:27.094099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.095049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.096261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.099458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.100600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.101871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.126979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 HTTP/1.1 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '348b884c-6998-4aab-8718-ef0ca5723870'} Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.129036 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Instance 348b884c-6998-4aab-8718-ef0ca5723870 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5dfdb0b5-99bc-46a8-a03c-4cf9ec413b06 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870" status: 404 len: 111 microversion: 2.1 time: 0.069793 Oct 28 17:35:27.135883 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 833/1704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:27 2022] GET /compute/v2.1/servers/348b884c-6998-4aab-8718-ef0ca5723870 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.139980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75242fe550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.201255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG neutronclient.v2_0.client [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist", "detail": ""}} {{(pid=120568) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.204333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 97bff969-9cf2-458d-a84d-54905535c6b6 not found {{(pid=120568) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.205479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.205479 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6 HTTP/1.1 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: exception: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '97bff969-9cf2-458d-a84d-54905535c6b6'} Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.211362 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 97bff969-9cf2-458d-a84d-54905535c6b6 does not exist Oct 28 17:35:27.217140 n-d-860864-13 devstack@n-api.service[120568]: Neutron server returns request_ids: ['req-919805c3-a6a6-483e-afc5-1efad6dcc198'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.225029 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e262277d-b190-4c00-a8c8-08728e1cdbad tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6" status: 404 len: 194 microversion: 2.1 time: 0.083731 Oct 28 17:35:27.225029 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 834/1705] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/97bff969-9cf2-458d-a84d-54905535c6b6 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.235487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.243905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:27.281034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.288752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.288752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.291835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.291984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:27.294620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.295840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.302899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43b5682c-5ec2-44f5-88c6-efa47b4fede6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1508 microversion: 2.1 time: 0.453183 Oct 28 17:35:27.303445 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 872/1706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:26 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:27.312262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752450d310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.402043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.402641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 8a809c51-30da-4c47-8e10-78b0469236a3 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.406119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.406119 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3 HTTP/1.1 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8a809c51-30da-4c47-8e10-78b0469236a3'} Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.406627 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 8a809c51-30da-4c47-8e10-78b0469236a3 does not exist Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-28867b6c-2ebe-4ab1-b73f-dd49dd799c26'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64577ff8-aa18-455f-b2a7-0276f2b1042f tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3" status: 404 len: 194 microversion: 2.1 time: 0.103836 Oct 28 17:35:27.412848 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 873/1707] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/8a809c51-30da-4c47-8e10-78b0469236a3 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.423814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524467310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.483247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.483872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.484383 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.484383 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 HTTP/1.1 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92'} Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.486956 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 does not exist Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-d1c6e9b0-9c16-4106-af76-f8b69ee81f1d'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35728b3b-e848-4045-b923-7e147600d930 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92" status: 404 len: 194 microversion: 2.1 time: 0.075101 Oct 28 17:35:27.491312 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 874/1708] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/7a8b20bf-e23d-42f6-bfb0-1ecd4f5a5e92 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:35:27.502713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752450d820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.573839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.574440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 3f279483-4cdd-4e26-aa39-882d9944e327 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.574957 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.574957 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327 HTTP/1.1 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3f279483-4cdd-4e26-aa39-882d9944e327'} Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.577326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 3f279483-4cdd-4e26-aa39-882d9944e327 does not exist Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-23d1c103-5732-478c-8b0a-cd270acbfbc3'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.581698 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06f0b406-9fde-4fc7-81d5-56927414cfe1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327" status: 404 len: 194 microversion: 2.1 time: 0.085310 Oct 28 17:35:27.590828 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 875/1709] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/3f279483-4cdd-4e26-aa39-882d9944e327 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.590828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f7524b89160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.632004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:27.638582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.639202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group f9599329-9ca0-4e95-a036-3e544ecffc40 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.639753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.639753 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40 HTTP/1.1 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f9599329-9ca0-4e95-a036-3e544ecffc40'} Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.642982 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group f9599329-9ca0-4e95-a036-3e544ecffc40 does not exist Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-ac13eeeb-e692-4d4c-8299-1d72fb0efcae'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.647649 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b013cc4d-232c-4dce-be6e-4e36c4f8aba1 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40" status: 404 len: 194 microversion: 2.1 time: 0.060038 Oct 28 17:35:27.650515 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 876/1710] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/f9599329-9ca0-4e95-a036-3e544ecffc40 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.656282 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f492d24f-ba1c-475d-b50d-2c0678c72c9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1364 microversion: 2.1 time: 0.431577 Oct 28 17:35:27.657069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 835/1711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:27 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:27.658346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75244d13a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.726246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:35:27.726839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.security_group_api [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Neutron security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 not found {{(pid=120567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 17:35:27.727811 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.727811 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 HTTP/1.1 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: exception: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0311392c-3b7f-40d3-8ea7-c46e729bdd19'} Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:35:27.729898 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] Oct 28 17:35:27.735031 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:27.740690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Security group 0311392c-3b7f-40d3-8ea7-c46e729bdd19 does not exist Oct 28 17:35:27.740690 n-d-860864-13 devstack@n-api.service[120567]: Neutron server returns request_ids: ['req-21efcd13-fe97-4975-b30f-fbca3091d25d'] {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:27.740690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d48fa19e-fcca-4061-b4b2-6fbc28e1d5bd tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19" status: 404 len: 194 microversion: 2.1 time: 0.088745 Oct 28 17:35:27.740690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 877/1712] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/os-security-groups/0311392c-3b7f-40d3-8ea7-c46e729bdd19 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:27.746646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.747141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:27.760400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.760917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.761361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.762085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.762542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.762958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.834091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:27.834762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:27.867990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.873802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.874803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.877014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:27.886852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:27.890436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:27.947303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:35:28.229321 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-87387a49-8841-47db-8047-5289f840f129 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 204 len: 0 microversion: 2.1 time: 0.486223 Oct 28 17:35:28.230254 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 836/1713] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:35:27 2022] DELETE /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:35:28.243862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:28.244889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:28.264209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.265040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.265668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:28.266574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.267188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.267801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:28.596038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:28.607528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:28.616428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:28.626387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6df3c26a-391d-4173-bf14-842b5d955b50 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 0.793069 Oct 28 17:35:28.642310 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 878/1714] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:27 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:35:28.662574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:28.664227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:28.678468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.685941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.688608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:28.690858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.693623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.695632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:28.847421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:28.860171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc6cb3ec-fc61-42f3-82b1-62fe1ec2c94b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1461 microversion: 2.1 time: 0.628338 Oct 28 17:35:28.862536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 837/1715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:28 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1461 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:28.878834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:28.882373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:28.897628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.899520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.900071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:28.904947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:28.907497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:28.908194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.355359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:29.367821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:29.369289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:29.370485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-091fbc3a-87a8-4a04-a0f7-a5f4b8ee014a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1594 microversion: 2.42 time: 0.727087 Oct 28 17:35:29.376932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 879/1716] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:28 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1594 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:29.389567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:29.390612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:29.410542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:29.422306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:29.424445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.425242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:29.425710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:29.426145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.432564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:29.811922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:29.824012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c27087ee-398d-42dd-8881-56a7de887d53 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 200 len: 1508 microversion: 2.1 time: 0.443058 Oct 28 17:35:29.824641 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 880/1717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:29 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:29.832517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-plugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:29.864269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:29.865455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:29.865911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.896065 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] Creating event network-vif-plugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:35:29.916447 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-58ff9db7-a82a-4f4c-abe0-8f9ffd10bf1d req-cfad7235-acb2-4281-8080-301f96ffc58c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086186 Oct 28 17:35:29.919028 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 881/1718] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:29.932569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:29.936727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:29.964367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:29.970616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:29.974567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:29.976138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.978040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:29.985683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:29.986799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:29.991639 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9100f405-c2c7-4a46-963d-98e1fda8a8ce tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1646 microversion: 2.1 time: 1.127601 Oct 28 17:35:29.994041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 838/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:28 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1646 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:30.127038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:30.127806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:30.140772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:30.142097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:30.143404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:30.145134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:30.146349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:30.148318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:30.695302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:30.707665 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7a0a0c2-9fb2-4726-89b7-bac3e8b3165e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1364 microversion: 2.1 time: 0.785551 Oct 28 17:35:30.715954 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 882/1720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:29 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1364 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:30.728951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:30.729583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:30.761242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:30.762410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:30.763075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:30.764072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:30.765382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:30.766029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:31.558395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:31.578023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:31.583399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:31.588844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed80d4ab-7749-49a3-8fa5-ff59cae99c67 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 0.871083 Oct 28 17:35:31.604287 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 883/1721] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:30 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:31.644297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:31.645240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:31.657981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:31.658480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:31.658922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:31.659665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:31.660124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:31.660547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:31.854646 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6940b959-90b0-4477-8053-99314d688ca4 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1614 microversion: 2.1 time: 1.842731 Oct 28 17:35:31.855829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 839/1722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:29 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1614 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:31.920908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:31.925758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:31.965239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:31.968656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:31.970837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:31.973890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:31.980096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:31.982967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.071927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc HTTP/1.1 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1478932a-8fb6-494a-8945-1d5767134fbc'} Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:32.082728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:35:32.095483 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:35:32.099541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:32.102741 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3604b996-8374-46f1-9f85-5a2b1d651087 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 404 len: 111 microversion: 2.1 time: 0.244435 Oct 28 17:35:32.104354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 840/1723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:31 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:32.113960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1478932a-8fb6-494a-8945-1d5767134fbc", "name": "network-vif-deleted", "tag": "c36a3b56-03c2-4f2d-b992-5e15782a5124"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:32.139556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.140731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.141698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.208972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] Creating event network-vif-deleted:c36a3b56-03c2-4f2d-b992-5e15782a5124 for instance 1478932a-8fb6-494a-8945-1d5767134fbc on n-h2-860864-13 Oct 28 17:35:32.222941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-32aad4b7-f7ad-444c-809d-c01bc844ed22 req-6d6127e9-004a-45e0-97f3-83b2cefb603c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113210 Oct 28 17:35:32.226386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 841/1724] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:32.260731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:32.262318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:32.284775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.291567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.292977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.295039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.299483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.300481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.401429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:32.426613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:32.430979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:32.436663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65547836-cc42-4aae-a205-30daceca5944 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1662 microversion: 2.42 time: 0.819421 Oct 28 17:35:32.440231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 884/1725] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:31 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1662 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:32.445222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:32.450607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:32.463713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.467137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.467823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.469471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.470706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.485250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.709681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1e1df5315948d3894f8ecbd3c264c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752dac7c550f4373a66e681d9d7bef55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:32.732712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:32.737247 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40ca2d9e-2018-42a3-9dea-6dfab13833a6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 200 len: 1299 microversion: 2.1 time: 0.505770 Oct 28 17:35:32.738475 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 842/1726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:32 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 1299 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:32.769399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:32.770409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:32.792338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.792821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.796393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.798809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:32.799315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:32.802576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:32.904512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e8870f26a16449bdb0f1c6ae54695bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd169f155a6401ab55275d29c23fb1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:32.905885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] flavor_id is None. Assuming migration. {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 17:35:32.907278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 17:35:33.056753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:33.072235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa6ab109-6c12-4d52-ba98-cf90a9ed32a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1364 microversion: 2.1 time: 0.629047 Oct 28 17:35:33.093128 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 885/1727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:32 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1364 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:33.104475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7311730b-292e-404f-9ed7-6c15524129da", "name": "network-vif-plugged", "status": "completed", "tag": "a11a6f1e-0195-4cdd-bde7-a9e50b452172"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:33.119241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:33.120036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:33.121358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:33.163298 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] Creating event network-vif-plugged:a11a6f1e-0195-4cdd-bde7-a9e50b452172 for instance 7311730b-292e-404f-9ed7-6c15524129da on n-h2-860864-13 Oct 28 17:35:33.178795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e9c0e309-a54c-471b-afb0-3858db514377 req-1e4a60ae-87cf-42fe-b010-a34f472c615d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083577 Oct 28 17:35:33.180740 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 886/1728] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:33.196874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4", "name": "network-vif-deleted", "tag": "67f2f158-76a4-406b-a4b6-9f09938b15aa"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:33.209621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:33.225667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:33.226863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:33.228115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:33.262646 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] Creating event network-vif-deleted:67f2f158-76a4-406b-a4b6-9f09938b15aa for instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 on n-h1-860864-13 Oct 28 17:35:33.273572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1c3f208f-af98-41c4-8a08-5730f9eb36e7 req-cbea11db-bb76-4e16-bcbf-bdb5d762b0b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091395 Oct 28 17:35:33.278081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 887/1729] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:33.305199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-104953374", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:33.458646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:35:33.485196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0a5ddad-2e27-4616-97f0-20b76b6f6bb8 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.735610 Oct 28 17:35:33.488972 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 843/1730] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:35:32 2022] POST /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:33.509234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:33.516235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:33.539986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:33.541024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:33.543171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:33.546217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:33.548768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:33.550842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:33.916408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:34.508132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:34.533683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:34.540467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:34.546507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d78a651-6f86-4feb-ac67-e644a1ce3bda tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1280 microversion: 2.25 time: 1.052623 Oct 28 17:35:34.548356 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 844/1731] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:33 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1280 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:34.565845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:34.566771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:34.578457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:34.579345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:34.580148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:34.581718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:34.582438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:34.583815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.334702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:35.344601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:35.345961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:35.359469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10d5294b-d15d-4439-bcbb-b0ec83c8408b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1756 microversion: 2.42 time: 0.796236 Oct 28 17:35:35.363510 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 845/1732] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:34 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1756 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:35.380859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:35.381771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:35.390778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.391623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.392249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.393133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.393782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.394401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.407105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:35:35.407642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:35:35.408182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:35:35.408774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:35:35.409228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:35:35.414680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=7 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:35.444457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.445342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.446272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.447421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.448134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.448886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.471301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:35:35.488135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:35:35.516286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:35:35.519131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:35:35.609199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ca7e70f-c0b5-40ea-b23f-ebe9d6474839 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.322731 Oct 28 17:35:35.617294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 888/1733] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:35:35.625114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:35.626262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] [instance: 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:35.634213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.635190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.636103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.637698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.638090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.638717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.660930 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] HTTP exception thrown: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Request method failure captured: Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 HTTP/1.1 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJtxa05HRtWu5i1cgl_xxjKwmEpopPzs_RwTPjqlCszVTC8EsHiSxKH4WxPNkR7ev3j7OwHLJ3ztExmBsxKZ7oZVIYQrZyhl5LhRLGiAFjm0q_ZtVFhIbja68jEZGZ1ERco1vFzWMoCp7OnBUa_UZFOwwuFtRP4dO1BbvzY_cpUkeQ Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_752dac7c550f4373a66e681d9d7bef55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/752dac7c550f4373a66e681d9d7bef55"}]}] Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 752dac7c550f4373a66e681d9d7bef55 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-243208238 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fa1e1df5315948d3894f8ecbd3c264c0 Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-SecurityGroupsTestJSON-243208238-project Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4'} Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:35:35.663111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. Oct 28 17:35:35.672117 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:35:35.676059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Returning 404 to user: Instance 21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:35:35.677266 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5218a47d-5c90-4354-95a1-932c122448d6 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4" status: 404 len: 111 microversion: 2.1 time: 0.058516 Oct 28 17:35:35.678685 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 889/1734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:35 2022] GET /compute/v2.1/servers/21d95d38-61e5-4fe9-8b9c-34c90e2bc6a4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:35:35.684867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:35.686019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:35.693726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.698240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.699160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.700336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:35.701472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:35.702220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:35.947406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:35.974456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5dfffeff-35a2-4858-a8de-277c6f600637 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1470 microversion: 2.1 time: 0.609469 Oct 28 17:35:35.975066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 846/1735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:35 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:35.992503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:35.993227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:36.017706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.019958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.022315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:36.024236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.025734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.027062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:36.278141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:36.296644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41be8d8b-1765-43f9-a15e-1e38c9a9b23a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1552 microversion: 2.1 time: 0.615712 Oct 28 17:35:36.301958 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 890/1736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:35 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1552 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:36.319766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80d5bf27-98cb-475a-8adc-35a7a71d6d89 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:36.320802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-80d5bf27-98cb-475a-8adc-35a7a71d6d89 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:36.449874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:36.459304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:36.461259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:36.462666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb7007b5-62ae-437c-b61c-b63db3d40576 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1477 microversion: 2.25 time: 0.486652 Oct 28 17:35:36.463928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 847/1737] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:35 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:36.474555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eddcdcae-de16-4875-8add-2953188f1d27 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f752434ae50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:36.521143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-80d5bf27-98cb-475a-8adc-35a7a71d6d89 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:36.536857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80d5bf27-98cb-475a-8adc-35a7a71d6d89 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1214 microversion: 2.1 time: 0.229724 Oct 28 17:35:36.542367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 891/1738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:36 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:36.564708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:36.578754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:36.595431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.596571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.597474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:36.598634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.599170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.600204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:36.941382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7c39b0fa-aae2-467b-86dd-630f9b67c5c0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.395205 Oct 28 17:35:36.942368 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 892/1739] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:35:36 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/os-interface => generated 285 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:36.947785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:36.948608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:36.970032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.970875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.973651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:36.974406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:36.978206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:36.978713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:37.934458 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eddcdcae-de16-4875-8add-2953188f1d27 tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3308f6ff-bcf3-48b6-bbfa-38cdc8af41c7" status: 202 len: 0 microversion: 2.1 time: 1.469124 Oct 28 17:35:37.936948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 848/1740] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:36 2022] DELETE /compute/v2.1/os-security-groups/3308f6ff-bcf3-48b6-bbfa-38cdc8af41c7 => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:38.001198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:38.018579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:38.021518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:38.024824 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5cbf30fa-2880-47b8-8151-a723d48e72d9 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1803 microversion: 2.42 time: 1.081083 Oct 28 17:35:38.040346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 893/1741] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:36 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1803 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:38.053279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:38.058969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:38.072051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.074851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.076573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.080901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.081686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.082322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.433108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:38.444145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30f3e7ef-511a-493d-8d99-ffbea27d8918 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1470 microversion: 2.1 time: 0.401809 Oct 28 17:35:38.447927 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 894/1742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:38 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:38.455999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:38.458820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:38.475622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.477218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.478245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.479210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.482939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.485295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.579153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:38.579880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:38.589517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.590182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.591478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.593034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:38.593907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:38.594602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:38.764325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:38.774151 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-04264f40-947d-47cd-a54f-3dbebc87fda3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1272 microversion: 2.1 time: 0.324889 Oct 28 17:35:38.774748 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 895/1743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:38 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:38.791168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a572012-6411-46ff-9339-fe24ce8eb87b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] Calling method '.version_select at 0x7f75245b2940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:38.921265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 7311730b-292e-404f-9ed7-6c15524129da {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:35:38.973681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20616681-77f5-4cab-8d6f-289fae209b49 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1971 microversion: 2.25 time: 1.035130 Oct 28 17:35:38.975239 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 849/1744] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:37 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1971 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:39.005533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:39.006253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:39.015091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.017479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.019786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:39.021411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.022293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.024246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:39.503727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 7311730b-292e-404f-9ed7-6c15524129da {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:35:39.513827 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a572012-6411-46ff-9339-fe24ce8eb87b tempest-SecurityGroupsTestJSON-243208238 tempest-SecurityGroupsTestJSON-243208238-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/4a30b8ac-4954-4170-b48e-65e018efc8bb" status: 202 len: 0 microversion: 2.1 time: 0.737921 Oct 28 17:35:39.517553 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 896/1745] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:35:38 2022] DELETE /compute/v2.1/os-security-groups/4a30b8ac-4954-4170-b48e-65e018efc8bb => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:35:39.522674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:39.523609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:39.536471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.538965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.539695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:39.541530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.543413 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d407c56-90d2-4674-99bc-a0cf29d3b763 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1971 microversion: 2.25 time: 0.541641 Oct 28 17:35:39.545010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 850/1746] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:38 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1971 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:39.550960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:39.552517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:39.556497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.557090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:39.579258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.580294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.581605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:39.583679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:39.584446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:39.585122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:40.741166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:40.765888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:40.769738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:40.781696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:40.791728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7eba3d79-3560-4b4c-82cf-7d25ac9feab8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 1.245126 Oct 28 17:35:40.795322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 851/1747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:39 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:40.803516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d291092a-9e38-41a2-8c43-248786d91e6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1850 microversion: 2.42 time: 1.274766 Oct 28 17:35:40.806239 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 897/1748] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:39 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1850 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:40.814498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:40.829690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:40.835092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:40.838781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:40.839284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:40.851398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:40.853264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:40.855933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:40.857627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:40.864677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:40.871292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:40.873020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:40.874179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:40.878745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:40.881710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:40.953632 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55e334fe-52d7-4560-9072-e302726485f3 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.154397 Oct 28 17:35:40.959863 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 852/1749] 10.222.0.48 () {60 vars in 1217 bytes} [Fri Oct 28 17:35:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:35:41.123297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d94f8c0-e6cb-4c9b-a5cc-19785075cbc8 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.136109 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d94f8c0-e6cb-4c9b-a5cc-19785075cbc8 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.175109 Oct 28 17:35:41.141527 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 853/1750] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.156124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "c672d2c1-310f-453c-871d-9c962f2a558e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:41.189503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.190023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.193166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:41.219559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] Creating event network-changed:c672d2c1-310f-453c-871d-9c962f2a558e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:41.230345 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-06604029-9896-4ddf-a965-d7b99d10f451 req-f11e601e-da59-412c-b401-3f636e62dede service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086544 Oct 28 17:35:41.230967 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 854/1751] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.261408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:41.289167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.289653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.290088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:41.312542 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] Creating event network-changed:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:35:41.319285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-afc92372-f592-425d-8520-c94e80265b8f req-5527b46c-e0ee-4884-9bf7-605a46b421e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082075 Oct 28 17:35:41.320217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 855/1752] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.341832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": "auto"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:41.346292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:41.354720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.355589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.356255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:41.357157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.357847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.358436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:41.426127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'flavor' on Instance uuid 7311730b-292e-404f-9ed7-6c15524129da {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:35:41.428143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:41.447998 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e8fad11-d851-4fbd-abb0-e5d61604a637 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.640459 Oct 28 17:35:41.448587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 898/1753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:40 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:41.454290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:35:41.462486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03432e9c-2e00-4ca2-a586-fef3719b1b92 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.521299 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03432e9c-2e00-4ca2-a586-fef3719b1b92 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.062312 Oct 28 17:35:41.522956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 899/1754] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:41.540392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0199990-38be-466a-81bb-0a61622df8f6 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.581844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0199990-38be-466a-81bb-0a61622df8f6 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037235 Oct 28 17:35:41.583823 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 900/1755] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.603478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89e07877-b700-47dc-bbd2-ede6d95c8e8d tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.631838 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89e07877-b700-47dc-bbd2-ede6d95c8e8d tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036921 Oct 28 17:35:41.633336 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 901/1756] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.645535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1e8a723e-0504-4ec0-9116-398e7a4e7bb5 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.755641 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1e8a723e-0504-4ec0-9116-398e7a4e7bb5 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.114032 Oct 28 17:35:41.758864 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 902/1757] 10.222.0.48 () {58 vars in 1165 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:35:41.774987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-696c602b-388c-48d9-81c5-6e50a0de044d tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.817815 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-696c602b-388c-48d9-81c5-6e50a0de044d tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046488 Oct 28 17:35:41.820864 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 903/1758] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:41.837787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:41.838618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:41.847660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.848447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.849049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:41.849942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:41.850557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:41.851142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:42.646400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:42.657851 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4054d91-cecf-4969-b60e-be7ec7bf4335 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.835055 Oct 28 17:35:42.675874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 904/1759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:41 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:42.685165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08f2c097-89f3-42a1-9227-f5699deccd47 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:42.743636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08f2c097-89f3-42a1-9227-f5699deccd47 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.066402 Oct 28 17:35:42.744633 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 905/1760] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Oct 28 17:35:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:42.759691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:42.763516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:42.777508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:42.778648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:42.781142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:42.784247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:42.785116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:42.785871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:43.214525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:43.231971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:43.237783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:43.242982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4e6391b-1ba3-47e8-a81c-bd550546013c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1871 microversion: 2.42 time: 0.492486 Oct 28 17:35:43.243631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 906/1761] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:42 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1871 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:43.251333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:43.255508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:43.271491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:43.274903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:43.275821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:43.276742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:43.278733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:43.280724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:43.511560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:43.525159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28cca310-776c-4c0d-b1fc-f4601ff70039 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.278303 Oct 28 17:35:43.525793 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 907/1762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:43 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:43.560418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-84504aa9-9b7b-4f77-a376-070521c9f310 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:43.589913 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-84504aa9-9b7b-4f77-a376-070521c9f310 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.042644 Oct 28 17:35:43.593855 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 908/1763] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:35:43 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:43.605256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f709c72-edbb-454c-878f-70e65daddd12 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:43.621581 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f709c72-edbb-454c-878f-70e65daddd12 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020135 Oct 28 17:35:43.631289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 909/1764] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:35:43.642770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5938f4c-6f0e-4958-aa91-73464a11a9cf tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:43.737221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5938f4c-6f0e-4958-aa91-73464a11a9cf tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.099428 Oct 28 17:35:43.738144 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 910/1765] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:35:43 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:43.752255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:43.755444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:43.769682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:43.774026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:43.774858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:43.777634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:43.778853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:43.779717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:43.830407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:44.165662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:44.180188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45907ad2-c13b-43f9-bd16-fb18083f0107 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.439897 Oct 28 17:35:44.182315 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 911/1766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:43 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:44.194853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36350b53-78ee-4743-b835-5ae8d0a54809 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:44.215044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36350b53-78ee-4743-b835-5ae8d0a54809 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030008 Oct 28 17:35:44.219114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 912/1767] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:44.225984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "febf6791-5bbd-479e-a66a-5cba708bfaf7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:44.237457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:44.238058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:44.238565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:44.250411 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] Creating event network-changed:febf6791-5bbd-479e-a66a-5cba708bfaf7 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:44.258296 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d00624b0-9ec5-4d27-925c-fdfb110327c2 req-7cb4c206-29d4-4764-965f-88e97f019de3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Oct 28 17:35:44.259309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 913/1768] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:44.272233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37f5bfb2-3e24-417e-ba50-5388cb5e192b tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:44.304390 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37f5bfb2-3e24-417e-ba50-5388cb5e192b tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043674 Oct 28 17:35:44.326076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 914/1769] 10.222.0.48 () {58 vars in 1144 bytes} [Fri Oct 28 17:35:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:44.331146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:44.331915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:44.353537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:44.353977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:44.366963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:44.368037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:44.368531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:44.368971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:45.318501 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4520899c-9fde-48f1-8dd4-c5101c36d9b8 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da/action" status: 202 len: 0 microversion: 2.25 time: 3.995079 Oct 28 17:35:45.323531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 856/1770] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:35:41 2022] POST /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da/action => generated 0 bytes in 4001 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:35:45.339623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca776bbf-d008-4fa3-a065-30a2ccb3f874 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:45.352217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca776bbf-d008-4fa3-a065-30a2ccb3f874 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026805 Oct 28 17:35:45.353561 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 857/1771] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:45.360671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:45.362044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:45.370660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:45.373631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:45.374592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:45.375954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:45.377099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:45.378016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:45.401690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:45.416051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:45.429863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:45.431271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d6df127-d75d-4b59-83a2-84cb1126b9cc tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1871 microversion: 2.42 time: 1.103893 Oct 28 17:35:45.443430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 915/1772] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:44 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1871 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:45.444947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:45.445572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:45.470720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:45.482020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:45.489547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:45.492838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:45.494267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:45.495235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:45.500725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:45.983492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:46.000969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-529c0f3e-a4ee-4e14-b1f0-48690eaa4927 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.645913 Oct 28 17:35:46.001564 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 858/1773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:45 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:46.017023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.017952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:46.031714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:46.036722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:46.037482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:46.038453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:46.039102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:46.040012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:46.052807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:46.067346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd7fa005-5a40-4ecd-ba7f-3221813f7371 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.626376 Oct 28 17:35:46.068024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 916/1774] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:45 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:46.080249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-844c45f9-eb68-4086-97da-774759de67e0 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.119172 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-844c45f9-eb68-4086-97da-774759de67e0 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.049460 Oct 28 17:35:46.129067 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 917/1775] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:46.146890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c14a13ad-797b-4b12-8449-fe31c0b1b8ec tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.168314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c14a13ad-797b-4b12-8449-fe31c0b1b8ec tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.038054 Oct 28 17:35:46.170214 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 918/1776] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:46.191226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1198dbe2-8023-4705-85a9-a606c20fb85b tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.211925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1198dbe2-8023-4705-85a9-a606c20fb85b tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024446 Oct 28 17:35:46.220389 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 919/1777] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:46.225182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cec2ba28-d437-432b-9ee5-6f808a7788b4 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.267890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cec2ba28-d437-432b-9ee5-6f808a7788b4 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.046320 Oct 28 17:35:46.277011 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 920/1778] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:46.282007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2ced1a8-f7d4-4396-9900-4bbc2c78e032 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.303679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2ced1a8-f7d4-4396-9900-4bbc2c78e032 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025434 Oct 28 17:35:46.304462 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 921/1779] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:46.322060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb6b040-ddd8-4c9e-80f3-6dfafd27faeb", "tag": "4cad71a6-3dba-4061-b3b7-c7f753097fdc"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:46.332703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:46.333180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:46.333614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:46.345480 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] Creating event network-changed:4cad71a6-3dba-4061-b3b7-c7f753097fdc for instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb on n-h2-860864-13 Oct 28 17:35:46.350444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0be6241c-1397-41df-abec-d5968634f49b req-66829c6c-9141-442b-8033-cf35caa11656 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032008 Oct 28 17:35:46.351346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 922/1780] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:46.359225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cf81eac-ccd4-404e-a123-18fc05a39514 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.376609 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cf81eac-ccd4-404e-a123-18fc05a39514 tempest-FlavorsV2TestJSON-324053286 tempest-FlavorsV2TestJSON-324053286-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024025 Oct 28 17:35:46.378684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 923/1781] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:46.462515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:46.464018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:46.480844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:46.484539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:46.490125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:46.491286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:46.493248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:46.499545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:46.540670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:46.650693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:46.672037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:46.677750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:46.679269 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-857a4ed2-a217-4745-a0b9-ff8363623c55 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.676531 Oct 28 17:35:46.680109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 859/1782] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:47.026859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:47.027504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:47.052658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:47.053201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.053826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.054311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:47.055117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.057447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.059644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:47.071230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:47.072810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:47.074242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99cd4ed3-7e9a-4f1a-8916-abe3446fb47b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.615525 Oct 28 17:35:47.074458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:47.082541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 924/1783] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:46 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:35:47.104062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:47.104678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:47.143829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.144405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.144850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:47.145624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.146125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.146645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:47.817329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:47.828229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:47.831287 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d3466b4-24f6-47a6-b4a5-5ad5c3e2e590 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.807993 Oct 28 17:35:47.833054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 860/1784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:47 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:35:47.849383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:47.850064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:47.859586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-265fc7e2-b9b6-4173-9e8d-7a785a34ae7f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.766481 Oct 28 17:35:47.861805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 925/1785] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:47 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:47.891189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.892802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.896704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:47.903771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:47.906225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:47.912189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:48.114651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:48.115786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:48.138929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:48.140280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:48.142872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:48.144855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:48.146137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:48.150516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:48.804711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.820893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.824012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.828351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.836995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d76ce163-b861-44f7-8939-78cd31d1a8ca tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.729215 Oct 28 17:35:48.838998 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 926/1786] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:48 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:48.842549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.849003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:48.850341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-afa79b14-cbbb-421d-865f-a45d464bc07c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 1.016360 Oct 28 17:35:48.852450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-692762990", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3a6a8a69-8887-4595-92d7-f0a0dfb49ff9"}], "block_device_mapping_v2": [{"uuid": "315bcf01-5f81-4af0-ab46-d049e9f35364", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:48.853152 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 861/1787] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:47 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:48.864165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "9b1c9f97-9495-48eb-b03c-cb90f9eb86dc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:48.889972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:48.892777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:48.894128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:48.924039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] Creating event network-changed:9b1c9f97-9495-48eb-b03c-cb90f9eb86dc for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:48.937072 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5f00b82a-1f00-497f-88b2-7b5c7fa0beee req-bcc1a7f8-9730-4c54-a2f5-a42b466b4afd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080073 Oct 28 17:35:48.940415 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 862/1788] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:48.964013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:48.970691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:48.992407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:48.993181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:48.995255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:48.997623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:48.998312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:49.003462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:49.322016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:49.332899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-225f918f-0bb7-45fe-841b-62df5ab9ba7c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.391023 Oct 28 17:35:49.352060 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 863/1789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:48 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:49.362676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:49.365374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:49.383303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:49.383816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:49.386720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:49.392042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:49.392793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:49.393412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:49.784370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:49.794055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c74bb67c-1e96-4a32-ab04-1e48a886a6e3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.440350 Oct 28 17:35:49.797773 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 864/1790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:49 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:49.866419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:49.867961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:49.882039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:49.882634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:49.884384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:49.887112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:49.889428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:49.891147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:50.386590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:50.405745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:50.407601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:50.415530 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b34b2186-dfba-4366-a07b-ff607fc5a5b3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.553579 Oct 28 17:35:50.416954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 865/1791] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:49 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:35:50.428732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:50.433174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:50.465960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:50.467992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:50.468986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:50.470011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:50.470711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:50.472299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:50.900047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:51.075698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:51.086567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:51.088955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:51.091826 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76d843b6-e969-4198-a6bb-9fee436b9c77 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.673281 Oct 28 17:35:51.111882 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 866/1792] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:50 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:51.119825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:51.123048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:51.131274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:51.132296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:51.133127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:51.134140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:51.136020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:51.136852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:51.719169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:51.750298 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82b38585-ca5d-4ffd-a13e-0a2e02212fcf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.635405 Oct 28 17:35:51.750913 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 867/1793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:51 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:51.767115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:51.768525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:51.780631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:51.785745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:51.786698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:51.787333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:51.788487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:51.789142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:51.789760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:52.397381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:52.420148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80d9224e-f6f1-4caa-93d5-d69f1cb273c1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.661233 Oct 28 17:35:52.437298 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 868/1794] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:51 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:52.453048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "4ccc5446-0359-471c-9f28-c5d8f7b673d3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:52.476411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:52.479421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:52.480082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:52.504909 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] Creating event network-changed:4ccc5446-0359-471c-9f28-c5d8f7b673d3 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:52.511617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d637a6e1-1f31-4696-ac03-7bddc8402ae5 req-d41b4948-3a7c-4a0c-b633-8aa2b073653a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072836 Oct 28 17:35:52.513034 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 869/1795] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:52.523287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:52.524448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:52.545757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:52.549994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:52.551517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:52.552979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:52.553994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:52.557678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:52.924162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:52.935989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:52.937997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:52.939609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d59e38c-f854-4461-a2d9-4547b52b1597 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.425112 Oct 28 17:35:52.958440 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 870/1796] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:52 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:52.974528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:52.975831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:52.996053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:52.996801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:52.999716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.002382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.005061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.008359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.235205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:53.247768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:53.249835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:53.251582 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-35749d2d-29e0-4051-a975-ab71fb40d855 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.292915 Oct 28 17:35:53.252640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 871/1797] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:52 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:53.257493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb6b040-ddd8-4c9e-80f3-6dfafd27faeb", "name": "network-vif-plugged", "status": "completed", "tag": "4cad71a6-3dba-4061-b3b7-c7f753097fdc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:53.268486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.269312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.270221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.283668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] Creating event network-vif-plugged:4cad71a6-3dba-4061-b3b7-c7f753097fdc for instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb on n-h2-860864-13 Oct 28 17:35:53.290735 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-31d5574d-1e10-4d78-9ab5-f4f17590063e req-969fd80b-ca1f-49bf-9bb6-1fbfbd6f1476 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Oct 28 17:35:53.292411 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 872/1798] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:53.300559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:53.301793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:53.311315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.312114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.312916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.313975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.314654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.317805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.512623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:53.520813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-585e184b-d492-41ec-8439-5db6c444fe6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1314 microversion: 2.1 time: 0.226246 Oct 28 17:35:53.523672 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 873/1799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:53 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:53.540052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:53.545848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:53.557985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.560472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.561144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:53.564302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:53.564971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:53.565748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:54.301407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:54.314274 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d02bf32f-a6d6-4a68-8ff6-618f4084812b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.790247 Oct 28 17:35:54.316057 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 874/1800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:53 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:54.327623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:54.330710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:54.360394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:54.361303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:54.361994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:54.362975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:54.365184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:54.367048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:54.894255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:54.918651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:54.920991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:54.926863 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f000678-0e4a-4317-9964-7e89bf88f8bd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.609090 Oct 28 17:35:54.939410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 875/1801] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:54 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:54.939410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:54.939410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:54.947249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:54.953083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:54.953819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:54.954775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:54.955345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:54.959275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.364692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:55.381154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:55.384047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:55.388106 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf391522-cae7-491f-9669-288427c8d8ff tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.457026 Oct 28 17:35:55.397491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 876/1802] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:54 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:55.403428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:55.404311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:55.418233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:55.419165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:55.419866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.421513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:55.421982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:55.422414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.746102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:55.756112 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73fa475a-cb33-4ca0-8863-f48ff343d080 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1501 microversion: 2.1 time: 0.356971 Oct 28 17:35:55.778487 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 877/1803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:55 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1501 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:55.787172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "6bc07bb1-bae8-41c1-9ed6-2df11a20cdde"}, {"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "328f2b9e-4a6a-4b29-9cf3-5a19c18f834e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:55.809368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:55.810011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:55.810452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.832759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Creating event network-changed:6bc07bb1-bae8-41c1-9ed6-2df11a20cdde for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:55.833267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] Creating event network-changed:328f2b9e-4a6a-4b29-9cf3-5a19c18f834e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:55.854570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f5656a8c-c8dd-427b-a2df-3ca21b1295ad req-7b66e879-2257-481c-8475-90251bc3472b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070297 Oct 28 17:35:55.855954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 878/1804] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:55.863106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:55.869713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:55.885868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:55.886651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:55.889030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.896433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:55.897817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:55.898428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:55.960304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:56.261153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:56.273433 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aac73714-00cc-4ba8-973e-e590c895602f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.415828 Oct 28 17:35:56.276682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 879/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:55 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:56.290972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:56.292126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:56.309870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:56.310721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:56.311399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:56.315615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:56.316425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:56.317100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:56.803180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:56.836763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:56.841067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:56.844900 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b82c3f03-0936-4547-b644-95c84deacc07 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.565154 Oct 28 17:35:56.845539 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 880/1806] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:56 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:56.858982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:56.861729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:56.875208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:56.876007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:56.876636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:56.877840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:56.878503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:56.879245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:57.232780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:57.248487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:57.250167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:57.251513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86ef77df-3965-42f5-ac38-50fef41494b7 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.403670 Oct 28 17:35:57.254973 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 881/1807] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:56 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:57.306877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:57.307787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:57.316350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:57.317265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:57.317942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:57.318867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:57.319579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:57.320358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:57.681079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:57.696413 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98058e4e-a60a-4a90-9190-2fe2be58ca73 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.395491 Oct 28 17:35:57.708106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 882/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:57 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:57.870579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:57.872119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:57.883187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:57.884970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:57.888379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:57.889267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:57.889942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:57.890739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:58.575833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:58.594927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:58.596613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:58.597821 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d1cd0a3-9e49-4fce-8e60-5200cbec0a4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 0.731451 Oct 28 17:35:58.611785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 883/1809] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:57 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:35:58.617044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "452a2cfa-f5b7-4060-afce-a8c1024694ff"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:35:58.636756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:58.638052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:58.638681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:58.661356 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] Creating event network-changed:452a2cfa-f5b7-4060-afce-a8c1024694ff for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:35:58.681434 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8968c0ae-263e-4ee7-bfe7-d84db7483b8e req-4adc78fa-df68-44c9-a287-eed6e2caf1c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067956 Oct 28 17:35:58.682248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 884/1810] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:35:58.690285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:58.691647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:58.712542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:58.713035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:58.713471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:58.714193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:58.714644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:58.715115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:58.813924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=36 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:58.907452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:35:59.175210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:59.202393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:59.205265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:59.208293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d654bf5d-927f-4da4-8cf2-7d9cb56a5178 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.523152 Oct 28 17:35:59.209354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 885/1811] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:58 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:35:59.214567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:59.215568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:59.236636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:59.237288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:59.237838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:59.239281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:59.240129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:59.240731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:59.685985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:35:59.698257 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6b234c0-4f5b-46f2-8d80-d78009dd126f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1475 microversion: 2.1 time: 0.486310 Oct 28 17:35:59.710249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 886/1812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:35:59 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1475 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:35:59.716375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:35:59.716991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:35:59.745017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:59.745518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:59.745991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:59.747497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:35:59.747951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:35:59.748380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:35:59.948502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] validate_networks() for [('3a6a8a69-8887-4595-92d7-f0a0dfb49ff9', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:01.460690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:01.471725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:01.487430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:01.489065 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e258893-396e-4689-b56d-968978711568 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 1.783749 Oct 28 17:36:01.496030 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 887/1813] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:35:59 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:01.502456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:01.512505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:01.540026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:01.546562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:01.548722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:01.549730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:01.552267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:01.552910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:02.036132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:02.036716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:02.037205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:02.037612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:02.038062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:02.068743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:02.069193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:02.069638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:02.070951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:02.071492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:02.071852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:02.151541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:02.173270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Getting quotas for user b5dbc2c295144accbd4d508afb066b03 and project 4745f00281fc4cce985160599bcae8ca. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:02.367077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:02.369756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='315bcf01-5f81-4af0-ab46-d049e9f35364',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:02.648036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee00a9e2-e38b-4bce-8f42-3152dd0cc58c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.802676 Oct 28 17:36:02.650389 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 927/1814] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:35:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 13811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:36:02.663456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:02.664665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:02.703587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:02.704485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:02.706824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:02.707814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:02.708667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:02.709296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:03.329753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:03.346223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:03.350596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:03.357459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3ecdf3e-336f-4055-a563-03b50493d6bd tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 1.858651 Oct 28 17:36:03.371472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 888/1815] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:01 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:03.371472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:03.373026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:03.389379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:03.392805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:03.393724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:03.397280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:03.398856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:03.399244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:03.401939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:03.413765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea601cd4-5dd5-4776-a78f-905a1addd74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1474 microversion: 2.1 time: 0.761892 Oct 28 17:36:03.417050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 928/1816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:02 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1474 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:03.429042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78f6c725-e8b8-4b98-b1ef-cee3a8478612 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:03.429495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78f6c725-e8b8-4b98-b1ef-cee3a8478612 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:03.599653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78f6c725-e8b8-4b98-b1ef-cee3a8478612 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:03.628310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78f6c725-e8b8-4b98-b1ef-cee3a8478612 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1052 microversion: 2.1 time: 0.209723 Oct 28 17:36:03.629648 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 929/1817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:03 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1052 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:03.668424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf6d646e-be2a-4bb1-939e-efb416e6ece0"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:03.672813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:03.687086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:03.687878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:03.689947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:03.690907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:03.691475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:03.691982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:04.303322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-988d649c-5fd9-44e5-8995-1ad15d33b01d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671404 Oct 28 17:36:04.315280 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 930/1818] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:36:03 2022] POST /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:04.329127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "name": "network-vif-unplugged", "status": "completed", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:04.366382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:04.367418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:04.368558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:04.405545 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Creating event network-vif-unplugged:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h1-860864-13 Oct 28 17:36:04.432312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:36:04.482756 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c2c34e20-2c79-48a6-872e-25a3f8b36b80 req-9be783f7-c4ad-4068-9dcd-6d3b5727695a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165281 Oct 28 17:36:04.495743 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 931/1819] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:04.508753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:04.509623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:04.517257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:04.517832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:04.518280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:04.519055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:04.519541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:04.520251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:04.540841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:04.560836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:04.566193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:04.567513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-619a9fd6-3db5-488e-93ff-c0f607f90a05 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1892 microversion: 2.42 time: 1.205036 Oct 28 17:36:04.572865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 889/1820] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:03 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1892 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:04.587346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:04.588234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:04.605061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:04.605607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:04.606040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:04.614454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:04.614970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:04.615444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:05.197684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:05.215881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:05.217828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:05.221578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb51156f-7fa9-4e21-ba37-5bd22812a3df tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.723774 Oct 28 17:36:05.234281 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 932/1821] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:04 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:05.239397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:05.254251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:05.265891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:05.266668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:05.268206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:05.269035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:05.275970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:05.276543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:05.506784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:05.523847 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b18478f-2581-4f0f-8bd5-fa7419b03e5f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1168 microversion: 2.1 time: 0.288226 Oct 28 17:36:05.526080 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 933/1822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:05 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1168 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:05.528296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:05.550979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac9bfd0a-cc63-430a-962f-fad09007360d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1474 microversion: 2.1 time: 0.976952 Oct 28 17:36:05.567933 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 890/1823] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:04 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1474 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:05.596044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:05.597209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:05.609860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:05.611071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:05.613097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:05.613961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:05.616180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:05.616740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.196590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd9b12aa-afdf-4f58-87c7-31f9b282390a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Action: 'create', calling method: .version_select at 0x7f75242d0ee0>, body: {"keypair": {"name": "tempest-keypair-832636418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRD2NQhypekl8E1qgY6/v3GPNpXkrLtdswOY2Sx5f0toWMDek4b2wkIpksuCjuxZ1us/Jual+AahS+l7fIwRzB2MC8R4u3RU1UD1w4UGOybUnH6xs2KhHjU2yV3G7VLzg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:06.235754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:06.242036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cd9b12aa-afdf-4f58-87c7-31f9b282390a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for project 703e2e549f2148b4bf70f354e2c967b7. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:06.254381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:06.260905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:06.263688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cd9b12aa-afdf-4f58-87c7-31f9b282390a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for user e3c3ac5d935b485c846a5e2d0f090404 and project 703e2e549f2148b4bf70f354e2c967b7. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:06.268883 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a805520-6584-4ee7-b8ed-33f4dc719302 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.679657 Oct 28 17:36:06.272262 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 934/1824] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:05 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:06.285520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:06.287194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:06.301322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.304078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.307759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.309376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.310773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.312691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.320312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd9b12aa-afdf-4f58-87c7-31f9b282390a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.409351 Oct 28 17:36:06.321916 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 891/1825] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:36:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:06.556616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:06.557431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:06.575292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.576258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.577621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.578533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.580013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.584516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.867764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:06.889570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f675ae3d-d5b7-4b30-98e5-ff311832bbdc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1168 microversion: 2.1 time: 0.340961 Oct 28 17:36:06.890177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 892/1826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:06 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1168 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:06.913023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:06.914931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:06.932601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.933713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.934160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.937299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:06.940432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:06.940985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:06.981746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:06.998135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:07.002576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:07.004699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c6ba913-bb02-4f40-b20c-ecb752e1dd26 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.730297 Oct 28 17:36:07.008306 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 935/1827] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:06 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:07.023452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:07.052883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:07.053672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:07.054744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:07.080615 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Creating event network-changed:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h1-860864-13 Oct 28 17:36:07.104786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:36:07.140389 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-973823b3-486c-4a97-8ad0-0719a494ecfc req-be3febf1-f3c3-4d4b-98c7-b7e7a0eed954 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129616 Oct 28 17:36:07.142208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 936/1828] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:07.299818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:07.300821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:07.320462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:07.321359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:07.322091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:07.323087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:07.323862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:07.327508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:07.543444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:07.564897 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81bc4805-ea2d-4ea6-b2fa-39f8f438f826 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1474 microversion: 2.1 time: 0.658506 Oct 28 17:36:07.579397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 893/1829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:06 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1474 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:07.920777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:07.921875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:07.945123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:07.946279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:07.948316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:07.950640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:07.951735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:07.952548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.012743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.036663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.042225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.046255 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b7977a1-c9b7-461f-930d-82be369df96b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 1.750989 Oct 28 17:36:09.051683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 937/1830] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:07 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:09.056831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:09.060092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:09.074148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:09.077188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:09.077997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.078982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:09.083333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:09.084116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.140153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.151270 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af15cd72-7655-4e5c-b920-f96c9af03bca tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 1.237591 Oct 28 17:36:09.166010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 894/1831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:07 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:09.174085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:09.183859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:09.199541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:09.200222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:09.200826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.201708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:09.203930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:09.204624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.654913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.664856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1585c208-7838-4dcd-8c09-c53944bdf668 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1472 microversion: 2.1 time: 0.501412 Oct 28 17:36:09.665816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 895/1832] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:09 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:09.678314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7311730b-292e-404f-9ed7-6c15524129da", "name": "network-vif-unplugged", "status": "completed", "tag": "a11a6f1e-0195-4cdd-bde7-a9e50b452172"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:09.706946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:09.707846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:09.708486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:09.734155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] Creating event network-vif-unplugged:a11a6f1e-0195-4cdd-bde7-a9e50b452172 for instance 7311730b-292e-404f-9ed7-6c15524129da on n-h2-860864-13 Oct 28 17:36:09.741819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0dace623-91ac-41d7-81d9-13647dcdb191 req-d02e4deb-08c0-43f0-86f3-a1451b08d8f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074689 Oct 28 17:36:09.747236 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 896/1833] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:09.750631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.770659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.775230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:09.780600 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a595b1fa-b17f-4443-af72-a82301c85fb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.724825 Oct 28 17:36:09.784237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 938/1834] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:09 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:10.080017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:10.081688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:10.096327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.097256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.099580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.101440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.103000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.104525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.211607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] Calling method '.version_select at 0x7f7524691700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:10.327319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c25797b2-876a-4783-8e08-ab52f5604621 could not be found", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:36:10.329603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] HTTP exception thrown: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] Request method failure captured: Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-floating-ips/c25797b2-876a-4783-8e08-ab52f5604621 HTTP/1.1 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBMJ9HRHa0xslnQMyF1FW5JSXN1Oe6cGOsMMD4fW_YbVKI70p3jFrLAPhJFZfvt1cMEBrWbHl5uVEKX3NG7RE6j1mnRpOjvUgV_K2tc22VSYU5fEYC91WK2EMSYpnW14-YDSEmmYX-Sl9DRs8NRk2Ek9V8MJTYMngSpuAQmw6XwFTCQ Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f61eade806f44830b00d59e951ce550b Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1066053752 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f61eade806f44830b00d59e951ce550b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f61eade806f44830b00d59e951ce550b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f61eade806f44830b00d59e951ce550b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f61eade806f44830b00d59e951ce550b"}]}] Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1066053752 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f61eade806f44830b00d59e951ce550b Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1066053752 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 54f4ab6e6c274fc8807e8d965f570fe3 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: exception: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c25797b2-876a-4783-8e08-ab52f5604621'} Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:36:10.331705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c25797b2-876a-4783-8e08-ab52f5604621 could not be found Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-48cc47cb-835a-4577-80b5-a774811b21ec'] Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621. Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621 Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621 Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] Returning 404 to user: Floating IP not found for ID c25797b2-876a-4783-8e08-ab52f5604621 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6b8b42f-0a64-425a-86fa-5ea0bff0b047 tempest-FloatingIPDetailsNegativeTestJSON-1066053752 tempest-FloatingIPDetailsNegativeTestJSON-1066053752-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/c25797b2-876a-4783-8e08-ab52f5604621" status: 404 len: 111 microversion: 2.1 time: 0.223193 Oct 28 17:36:10.337289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 939/1835] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:36:10 2022] GET /compute/v2.1/os-floating-ips/c25797b2-876a-4783-8e08-ab52f5604621 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:36:10.347961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:10.350747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:10.365231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.365736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.368038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.368845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.370630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.372590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.702243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:10.712967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:10.724832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:10.726626 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a70ea25-b246-4b22-9459-5d20d7c9166f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.652000 Oct 28 17:36:10.727724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 897/1836] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:10 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:10.733247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:10.742688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:10.755261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.755960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.756928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.757899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.758589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.764660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.791205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:10.866508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:10.883718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8514dca0-b581-4522-b429-5eef09020530 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 0.540345 Oct 28 17:36:10.884704 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 940/1837] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:10 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:10.896720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:10.897346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:10.911475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.912202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.912666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:10.913428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:10.913893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:10.914323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:11.305246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:11.316520 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-21db9c04-1891-477e-a3d8-a373a3dd0e1d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1472 microversion: 2.1 time: 0.587571 Oct 28 17:36:11.320887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 898/1838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:10 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:11.442531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:11.465664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:11.475233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:11.479882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b81cbff7-9440-47a1-aa66-ce94de50b0f1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.591479 Oct 28 17:36:11.480530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 941/1839] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:10 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:11.761998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:11.767109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:11.785858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:11.791831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:11.793170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:11.794159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:11.794807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:11.795756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:11.912432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:11.913363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:11.925002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:11.929160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:11.929846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:11.931736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:11.934492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:11.936670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:12.096845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:12.484439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:12.498273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:12.500110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:12.501291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8922b769-d910-4265-a790-0fccd12d34f7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.748128 Oct 28 17:36:12.501860 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 899/1840] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:11 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:12.513596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7311730b-292e-404f-9ed7-6c15524129da", "tag": "a11a6f1e-0195-4cdd-bde7-a9e50b452172"}, {"name": "network-changed", "server_uuid": "d67cc7c9-686a-4b98-86b0-a647fc64ca50", "tag": "61cb3323-cfb9-4288-95d9-c547008bfe90"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:12.527483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:12.547721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:12.548207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:12.548646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:12.560220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6c22db72-b12b-4d3e-9a01-15d77f5414e8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 0.651560 Oct 28 17:36:12.565127 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 942/1841] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:11 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:12.578561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:12.579812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:12.584610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Creating event network-changed:a11a6f1e-0195-4cdd-bde7-a9e50b452172 for instance 7311730b-292e-404f-9ed7-6c15524129da on n-h2-860864-13 Oct 28 17:36:12.585062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] Creating event network-changed:61cb3323-cfb9-4288-95d9-c547008bfe90 for instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 on n-h2-860864-13 Oct 28 17:36:12.593866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:12.594325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:12.594764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:12.597626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:12.598131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:12.598561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:12.600052 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f38b075c-2b5a-4f8e-b368-321815dc0771 req-5c2c7988-b0b3-48a6-90a8-208869785982 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096958 Oct 28 17:36:12.604293 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 900/1842] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:12.620840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:12.621552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:12.644039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:12.644539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:12.644982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:12.657012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:12.658289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:12.658757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.180137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:13.198790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:13.200288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:13.201483 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d245a41-2fc3-4c2f-9442-2a6a90bd651e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.595495 Oct 28 17:36:13.212093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:13.212262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 901/1843] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:12 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:13.228402 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab071d57-1581-4b0e-a548-0f693aa0b157 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1469 microversion: 2.1 time: 0.661703 Oct 28 17:36:13.232718 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 943/1844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:12 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1469 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:13.259595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:13.260130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:13.275280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.275810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.276246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.277419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.278087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.278978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.429920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1ab4fd73-1fb8-4904-8768-55e25857efed tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7/action" status: 204 len: 0 microversion: 2.1 time: 0.166618 Oct 28 17:36:13.435711 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 902/1845] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:36:13 2022] POST /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7/action => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:36:13.440240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:13.441107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:13.448320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.461298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.463119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.465055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.468270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.468895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.532792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:13.533678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:13.548860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.549360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.549798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.550514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:13.550968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:13.551406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:13.604308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:14.040433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:14.052065 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f11a7216-f7ae-4023-acfb-7d4a47b54eaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1469 microversion: 2.1 time: 0.615807 Oct 28 17:36:14.055838 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 944/1846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:13 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:14.073483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:14.075879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:14.091095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:14.094371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:14.095176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:14.097156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:14.099602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:14.100229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:14.159172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:14.288164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:14.314114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:14.319175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:14.320732 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-742b2b23-566e-496b-af6c-d25f31698c57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.792531 Oct 28 17:36:14.323765 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 903/1847] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:13 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:14.335965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:14.336585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:14.352457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:14.353282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:14.353912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:14.372125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:14.372859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:14.373695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:15.108561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:15.124426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:15.126128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:15.127987 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e61c72de-8e19-441a-9f01-50bb46761f34 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.802807 Oct 28 17:36:15.143495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 904/1848] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:14 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:15.143859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:15.151454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2075253530", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "20c6c5e3-5365-4d1e-aecd-e31ca8366965"}], "security_groups": [{"name": "tempest-securitygroup--862874141"}], "key_name": "tempest-keypair-832636418", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:15.152235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-62ea1400-ef11-47bd-afe4-86acd16ab23d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 1.090477 Oct 28 17:36:15.152235 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 945/1849] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:14 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:15.176402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:15.176402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:15.193855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:15.194746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:15.195219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:15.195996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:15.196448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:15.196869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:15.452431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] validate_networks() for [('20c6c5e3-5365-4d1e-aecd-e31ca8366965', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:15.720794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:15.729916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6317b8e5-7388-4090-8d3e-9987306db14a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1469 microversion: 2.1 time: 0.560461 Oct 28 17:36:15.731297 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 946/1850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:15 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1469 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:15.737080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:15.737906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:15.745111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:15.746019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:15.746807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:15.747772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:15.749072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:15.749690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:16.294584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:16.412897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:16.438039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:16.443256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:16.446200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e9abfe4-dade-46ae-9840-6ca646466eb1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.713125 Oct 28 17:36:16.450169 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 947/1851] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:15 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:16.457964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:16.458938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:16.478442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:16.483257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:16.484065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:16.485086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:16.485794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:16.489912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:16.689701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for project 703e2e549f2148b4bf70f354e2c967b7. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:16.700271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for user e3c3ac5d935b485c846a5e2d0f090404 and project 703e2e549f2148b4bf70f354e2c967b7. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:16.728590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:16.731713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:16.732197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:16.732646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:16.733151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:16.758084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:16.758585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:16.759028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:16.759797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:16.760251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:16.760682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:16.803925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for project 703e2e549f2148b4bf70f354e2c967b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:16.816629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:16.817933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Getting quotas for user e3c3ac5d935b485c846a5e2d0f090404 and project 703e2e549f2148b4bf70f354e2c967b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:16.854077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:16.856644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:16.961974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d61d1569-bbec-4cbe-b1e3-a3095a8b8592 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.828940 Oct 28 17:36:16.969361 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 905/1852] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:36:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:36:16.978415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:16.983465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:16.997519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:16.998310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:16.998942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.000000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.000638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.001240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.001706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.014666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.020001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.021631 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a64c7edb-e5ac-4169-bc17-3d1f7895b7fa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.570116 Oct 28 17:36:17.040341 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 948/1853] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:16 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:17.054612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "name": "network-vif-plugged", "status": "completed", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:17.090847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.091750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.092395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.110232 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Creating event network-vif-plugged:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h1-860864-13 Oct 28 17:36:17.118184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:36:17.131577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5cf2bdbd-fb89-4dcd-a7ca-cdd7c1caf968 req-2a47e900-e33e-486f-b12b-0ed163af950b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089668 Oct 28 17:36:17.132707 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 949/1854] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:17.141234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:17.142233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:17.150337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.151111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.152556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.153458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.154090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.154750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.453978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.463998 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab370512-9dc8-4a04-a123-2adeefd3e357 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1469 microversion: 2.1 time: 0.329171 Oct 28 17:36:17.469886 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 950/1855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:17 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:17.483891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb9cf940-4e8c-46cd-aba1-27ee23aa7ae6 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:17.484504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb9cf940-4e8c-46cd-aba1-27ee23aa7ae6 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:17.642007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb9cf940-4e8c-46cd-aba1-27ee23aa7ae6 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.657300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb9cf940-4e8c-46cd-aba1-27ee23aa7ae6 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1269 microversion: 2.1 time: 0.185858 Oct 28 17:36:17.659883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:17.664527 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 951/1856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:17 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:17.668817 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91ec8176-1266-40fd-b03d-8760f92f5ea7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 0.698026 Oct 28 17:36:17.671230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:17.676084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:17.690084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.690586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.691036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:17.691420 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 906/1857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:16 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:17.704539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:17.705549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:17.706625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.026086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.051525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.055798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.056276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:18.057002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:18.062807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b9aa7ec-3a28-44f7-a73f-f64f8f3fa05b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.394481 Oct 28 17:36:18.079396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 952/1858] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:17 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.080328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.407753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.419672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.421354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.424702 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79f185e2-b958-45b1-ae6c-ec11e6bdb05e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.372957 Oct 28 17:36:18.426395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 907/1859] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:18 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:18.493044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:18.493583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:18.503550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.506739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.507360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.508292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.509138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.509736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.693593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:18.698873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:18.710218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.712353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.721121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.723855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.725237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.725880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.782238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.795548 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d7b23ba-738d-453a-a68a-4e90f451d17d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1461 microversion: 2.1 time: 0.306877 Oct 28 17:36:18.796397 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 953/1860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:18 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1461 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:18.801267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:18.802245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:18.809912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.810718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.811638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.812605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.813871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.814946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.872607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:18.886431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d7f30d9-e729-40eb-a9ab-1c73d691647a tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1321 microversion: 2.1 time: 0.198630 Oct 28 17:36:18.887214 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 908/1861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:18 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:18.922268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:18.922876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:18.962161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.962980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.963679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:18.966275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:18.969096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:18.971297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.029139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.072223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb22525a-6ad2-482a-86a0-6195f171c6df tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1210 microversion: 2.1 time: 0.273037 Oct 28 17:36:19.073625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 954/1862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:18 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:19.100735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:19.104184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:19.134423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.135096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.135862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.137597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.138175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.138771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.371786 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d83ac83-de1e-46f1-b86a-d6285c48762c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1614 microversion: 2.1 time: 0.467276 Oct 28 17:36:19.373035 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 909/1863] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:18 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1614 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:19.405701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f909c4e-3a39-477b-a8fe-543b5c068cd0 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '.version_select at 0x7f75241925e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:19.413673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f909c4e-3a39-477b-a8fe-543b5c068cd0 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.416020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f909c4e-3a39-477b-a8fe-543b5c068cd0 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.416745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f909c4e-3a39-477b-a8fe-543b5c068cd0 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.435361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f909c4e-3a39-477b-a8fe-543b5c068cd0 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 3127 microversion: 2.1 time: 0.034252 Oct 28 17:36:19.436960 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 910/1864] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:36:19 2022] GET /compute/v2.1/os-migrations => generated 3127 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:19.471348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.483310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.488365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:19.488545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.489394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:19.489620 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-717ad944-5e30-4a72-b123-c0b5f3b3d646 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.397224 Oct 28 17:36:19.491082 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 955/1865] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:19 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:19.540425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.540425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.540667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.541604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.544756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.545408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.641272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1811117110", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:19.729050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:19.901030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.918389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.922281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:19.927117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c797a289-8878-444b-bd0d-aef15a425d9b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.458701 Oct 28 17:36:19.928939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 911/1866] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:19 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:19.936594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:19.938040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:19.946319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.947082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.950008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:19.950927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:19.951674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:19.952262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.100980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.110470 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a0779f2-7bb8-4007-8746-598835da2dfa tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1327 microversion: 2.1 time: 0.180241 Oct 28 17:36:20.111402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 912/1867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:19 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:20.121442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:20.122499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:20.125909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:20.126698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:20.127469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:20.141357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.142185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.143273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.144880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.146195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.146690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.171925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:20.184850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:20.185482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:20.186309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:20.194436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.196511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.197228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.198380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.199260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.199890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.211819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:20.215120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:20.279130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1228b59-a45b-41ad-96c8-cbe8ba796fe7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641740 Oct 28 17:36:20.286139 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 956/1868] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:36:20.291279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a516dda2-2c2e-4943-a874-45f3b58808e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:20.292711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a516dda2-2c2e-4943-a874-45f3b58808e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:20.398574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a516dda2-2c2e-4943-a874-45f3b58808e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.412117 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a516dda2-2c2e-4943-a874-45f3b58808e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1213 microversion: 2.1 time: 0.124478 Oct 28 17:36:20.412716 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 957/1869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:20 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:20.460662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.470314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28f9493b-334d-4970-8cd4-6601679fd4e4 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.290242 Oct 28 17:36:20.484121 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 913/1870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:20 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:20.522887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:20.523535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:20.536935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.538199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.538636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.539794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.540254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.540746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.786498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.800509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.802349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:20.804329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-836b5538-f2ee-4457-b825-d60f2d792fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.285339 Oct 28 17:36:20.806001 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 958/1871] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:20 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:20.962865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:20.963262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:20.970653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.971732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.972548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:20.973345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:20.973899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:20.974754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.139287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:21.140693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:21.149135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:21.150871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.151979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.152700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.153672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.154364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.155291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.161500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:21.163791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:21.166215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a89fc7bf-8f39-4b76-b429-3ca2ee81f250 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.211575 Oct 28 17:36:21.167889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 914/1872] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:20 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:21.322266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:21.332666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ec57023-e7a0-4dec-bc6d-9b89e3d66ae4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.199982 Oct 28 17:36:21.333586 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 959/1873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:21 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:21.437681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:21.438745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:21.447963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.449558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.450264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.451430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.452117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.452940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.498125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:21.498972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:21.514162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.515666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.516447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.521022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.523486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.524345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.636427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:21.650472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65114ead-c11c-4530-8020-e0f9dd22bd09 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1265 microversion: 2.1 time: 0.218556 Oct 28 17:36:21.663992 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 915/1874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:21 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:21.834969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:21.836210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:21.864809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.867022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.870651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.872470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:21.874899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:21.876378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:21.885505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:22.487107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.503956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9aefdec1-5890-4616-8669-556c44319800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 1.010844 Oct 28 17:36:22.505871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 960/1875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:21 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:22.527783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.538525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:22.539602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:22.543508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:22.549413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:22.550231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:22.550368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.551063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:22.552057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:22.552834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:22.553650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:22.560999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.563595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c9ab1c1-dcf4-4608-9b6a-3faf17c16ddf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.734055 Oct 28 17:36:22.578866 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 916/1876] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:21 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:22.763634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.773876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.774955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:22.776292 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e8455f4-9376-455e-baf9-f7e57ee11630 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.243673 Oct 28 17:36:22.777452 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 961/1877] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:22 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:22.801582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:22.802252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:22.809411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:22.810118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:22.810554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:22.811270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:22.811756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:22.812176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:22.820224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-776648194", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:22.919231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:23.052077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:23.066366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82180379-2a8c-491e-95c9-09bdb7a94666 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.277283 Oct 28 17:36:23.068676 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 962/1878] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:22 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:23.074301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:23.074908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:23.094232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.094983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.095669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.096573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.097015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.097660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.204066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:23.221376 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ac70031-d2f5-4b38-8ea0-f80a8ae6aceb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1271 microversion: 2.1 time: 0.148219 Oct 28 17:36:23.222236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 963/1879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:23 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:23.240223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24fe800-9c27-4eb4-ac68-eb8a422cb304", "tag": "fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:23.257310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.257795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.258225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.275487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] Creating event network-changed:fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35 for instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 on n-h2-860864-13 Oct 28 17:36:23.280765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:23.281384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:23.282061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:23.283137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:23.284053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:23.284654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0c61b4f3-ba33-4b78-b21d-c5420913508d req-e2eb4115-a24a-4f07-9bb4-ea83cf50b36a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053786 Oct 28 17:36:23.285362 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 964/1880] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:23.294426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.295068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.295640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.296375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.296832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.297259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.315018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Getting quotas for project 378bcb819bd14593866269c06c978f53. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:23.320055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Getting quotas for user 3106807274604bfe86b924a6d4aa70b1 and project 378bcb819bd14593866269c06c978f53. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:23.333059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:23.335405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:23.406114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7311e6c-b70e-4108-8d65-0dbddb0469e8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822061 Oct 28 17:36:23.413143 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 917/1881] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:36:23.420459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77094713-026e-4fc3-b2e6-d0d17d58e44e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:23.421262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-77094713-026e-4fc3-b2e6-d0d17d58e44e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:23.490680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77094713-026e-4fc3-b2e6-d0d17d58e44e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:23.499191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77094713-026e-4fc3-b2e6-d0d17d58e44e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1216 microversion: 2.1 time: 0.084166 Oct 28 17:36:23.499802 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 965/1882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:23 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:23.532544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:23.534192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:23.559257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.559786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.560225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.560946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.561571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.562798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.626798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:23.627439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:23.635110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.642419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.642915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.643702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.644175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.644613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.886930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:23.900230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c86772dd-bbb7-4059-9cc8-c195deb496c0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.374106 Oct 28 17:36:23.901729 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 918/1883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:23 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:23.907862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:23.909033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:23.920548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.921663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.923108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:23.924315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:23.925044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:23.926317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.008633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.013185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:24.039928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.044788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.046018 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71c13118-9c35-49f1-844a-52b4333a8824 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.423276 Oct 28 17:36:24.052066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 966/1884] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:23 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:24.091579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.092454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.105632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.106414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.107329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.108253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.110691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.111481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.340140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.354277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.358737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.360719 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9aec67f0-5686-44ba-9f6d-22fe793426e5 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.457633 Oct 28 17:36:24.361733 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 919/1885] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:23 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:24.367104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.367922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.376749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.377529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.378201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.379180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.379942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.380643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.430810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:36:24.460864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.473269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2e60ff6-dff2-427a-8274-e175a4f97aab tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.386796 Oct 28 17:36:24.488673 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 967/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:24 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:24.498949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.500342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.511743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.512558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.513006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.513753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.514210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.514634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.564903 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-027d2e8c-cb31-474c-bb2b-a9cfce649f28 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 204 len: 0 microversion: 2.1 time: 0.201648 Oct 28 17:36:24.565494 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 920/1887] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:36:24 2022] DELETE /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:36:24.573908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.574909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.581041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.581794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.582401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.583258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.583893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.584501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.677736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.687666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91e74efa-9181-419a-b741-da04c999fe68 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1268 microversion: 2.1 time: 0.118078 Oct 28 17:36:24.688961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 921/1888] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:24 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1268 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:24.693975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.695349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.702117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.702864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.704220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.705686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.706324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.707053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.727123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.738559 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3498079c-c9c7-4172-856c-0ce0251afd6b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.247801 Oct 28 17:36:24.739547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 968/1889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:24 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:24.864529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:24.875147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee47bff1-5bf4-452c-b7a2-2a846ce3d97c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1553 microversion: 2.1 time: 0.184837 Oct 28 17:36:24.876054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 922/1890] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:24 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:24.925510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:24.926113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:24.932439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.932964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.933396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:24.934093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:24.934536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:24.934951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.069525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.077891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e8d1ba5f-051b-4323-a0f8-dbd95a2e302d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.156539 Oct 28 17:36:25.083083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.083338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.090315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.090789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.091218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.091928 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 969/1891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:24 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:25.092084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.092939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.093367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.287291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.297157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.298605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.299786 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65077477-97a9-431f-80e0-3a8adbb421df tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.221667 Oct 28 17:36:25.300351 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 923/1892] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:25.392406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.393084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.400292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.400747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.401245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.402054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.402607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.403035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.429810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:25.441951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.442540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.443004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.464873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] Creating event network-changed:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h1-860864-13 Oct 28 17:36:25.470503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-dcccb275-27cd-491b-80b3-d90acb40c960 req-c59a6e70-46a8-4a50-8136-150bee7851c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044607 Oct 28 17:36:25.471106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 924/1893] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:25.498061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.498738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.504901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.505388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.505825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.506528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.506982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.507430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.538593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.549418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.550891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.552105 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c6215b4-5897-494a-a87b-c0e81c988e1e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.164008 Oct 28 17:36:25.552671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 970/1894] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:25.653849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.662430 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3c09d0b-e249-4571-a9dc-08f9602c634e tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.169007 Oct 28 17:36:25.662834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 925/1895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:25.716210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.717051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.724404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.724862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.725370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.727034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.727708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.728132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.762039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.762652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.768605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.769089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.769522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.770449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.770897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.771523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.795938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.804557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3fc622fc-5350-46e5-9221-e359cba6e4e5 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1268 microversion: 2.1 time: 0.092959 Oct 28 17:36:25.805176 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 971/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:25.898132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:25.899041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:25.905508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.905995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.906435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.907134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:25.907690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:25.908320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:25.917614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:25.925760 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f53176bc-2911-46bc-82a3-b62e21408317 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.167540 Oct 28 17:36:25.926342 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 926/1897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:26.045102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.053378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b23a387-ba4e-4cc8-8fe4-c0b4352ad355 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1553 microversion: 2.1 time: 0.159143 Oct 28 17:36:26.054018 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 972/1898] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:25 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:26.101349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.101957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.108583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.109072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.109506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.110215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.110669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.111093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.246712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.254496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67622e7a-a875-4e29-85cc-ddba07d8f229 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.157064 Oct 28 17:36:26.255078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 927/1899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:26.327135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.327695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.333664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.334144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.334578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.335260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.335733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.336153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.520226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.529958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.531419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.532558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-089098c5-a844-4a16-a839-fc4439dff077 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.209860 Oct 28 17:36:26.533108 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 973/1900] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:26.578918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.579461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.586031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.586509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.586937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.587652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.588101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.588578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.686572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.688401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.695997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.696735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.697168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.698715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.699305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.699872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.739504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.753195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.754658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.755877 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5cab1887-e821-4a3b-9e7a-bedd3edb813e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.180995 Oct 28 17:36:26.756441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 928/1901] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:26.827937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.828534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.834393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.834810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.835241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.835958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.836402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.836819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.840831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.848742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf0bb29a-db1c-4824-8254-2f9f5e7cf6ff tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.167021 Oct 28 17:36:26.849308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 974/1902] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:26.899829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:26.908108 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3338afdb-bed7-4042-b3e5-83d3eebc059b tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1268 microversion: 2.1 time: 0.083985 Oct 28 17:36:26.908679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 929/1903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1268 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:26.948990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:26.949611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:26.955734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.956216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.956648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:26.957343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:26.957794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:26.958211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.077479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.078343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.085264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.085692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.086122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.086814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.086924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.087259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.087703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.097618 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a80c71a4-9a24-4dea-bb60-9d175c014e6e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.152913 Oct 28 17:36:27.108571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 975/1904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:26 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:27.238817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.247714 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d698107f-c621-4568-aeb5-3571971b1671 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1553 microversion: 2.1 time: 0.174841 Oct 28 17:36:27.248286 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 930/1905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:27.277988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.278598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.284670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.285148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.285580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.286260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.286712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.287133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.413977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.422193 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b8a6c80-7c3b-4cb8-b712-d15013c4009f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.148196 Oct 28 17:36:27.422992 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 976/1906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:27.560005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.560606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.566565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.567039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.567498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.568177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.568622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.569036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.754408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.764265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.765701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.766846 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b684f45-7f65-4bf8-815b-38060f945c4a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.211389 Oct 28 17:36:27.767433 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 931/1907] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:27.782300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.782899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.789363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.789835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.790267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.790955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.791425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.792884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.872544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.873148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.879031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.879550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.879979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.880689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.881132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.881549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.896693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:27.940268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.949341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.950791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:27.952008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-46532c74-c90a-4cda-a7c1-4ba9ed055a22 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.173546 Oct 28 17:36:27.952603 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 977/1908] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:27.959069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:27.959694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:27.966550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.967036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.967494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:27.968438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:27.968893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:27.969315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.038930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:28.047280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34ebbaa2-50d0-4569-9563-16c6bcd92050 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1268 microversion: 2.1 time: 0.093392 Oct 28 17:36:28.047900 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 978/1909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1268 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:28.053917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:28.062555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-08830f5d-fce7-485d-a527-19587eb3347c tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.194509 Oct 28 17:36:28.063214 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 932/1910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:27 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:28.121717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:28.122320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:28.128251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.128728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.129159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.129848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.130295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.130711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.263859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:28.271699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:28.271880 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9eb3c4ef-005a-482e-bc42-0b99f2524290 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.153999 Oct 28 17:36:28.272521 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 979/1911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:28 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:28.272707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:28.282131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.282752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.283296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.284120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.284700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.285246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.423032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:28.431283 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-939e66c8-822b-4498-9a8a-27b65c391c43 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1553 microversion: 2.1 time: 0.163779 Oct 28 17:36:28.431882 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 933/1912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:28 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:28.446649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:28.447765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:28.454505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.454990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.455436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.456134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.456589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.457009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.589205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:28.597417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f465986f-7cd4-42f4-82d1-432e88408e6a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.155709 Oct 28 17:36:28.597991 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 980/1913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:28 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:28.792674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:28.793257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:28.800478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.801162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.801741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.802579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.803201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.803790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.978163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:28.978955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:28.986194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.986753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.987257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.988060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:28.988590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:28.989109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:28.993849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.003357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.004839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.006024 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-990db8cf-fe1c-4ed2-a414-4fbef2167ffd tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.217910 Oct 28 17:36:29.006585 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 934/1914] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:28 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:29.070071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:29.070669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:29.076874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.077352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.077779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.078467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.078917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.079339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.130983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.140378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.141974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.143306 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9966fbb4-8978-41c8-b09c-800f426a86ba tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.169147 Oct 28 17:36:29.153395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 981/1915] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:28 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:29.153484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.153579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:29.153579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:29.160529 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdbe1b50-b265-4a1d-91b2-5627d8813dbd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1268 microversion: 2.1 time: 0.094291 Oct 28 17:36:29.161685 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 935/1916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:29 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:29.161840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.162328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.162761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.163501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.163956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.164367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.295609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:29.296325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:29.302321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.302886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.303407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.304183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.304710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.305209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.312498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.320276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e67eec3-c88a-4d11-a598-b38809c225ca tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.174790 Oct 28 17:36:29.321033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 982/1917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:29 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:29.442600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.454405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:29.455344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:29.465666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28ae6d4c-bb5b-4e4c-a45d-39bc292e1f8a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.172797 Oct 28 17:36:29.466661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.467140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.468158 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 936/1918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:29 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:29.482728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.483619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.484209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.485289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.506373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:29.622047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:29.622844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:29.629388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.629871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.630472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.630990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:29.631729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:29.631897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:29.826149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.836145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d156d06d-1c2f-49b5-98b5-0ce6580e971b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1553 microversion: 2.1 time: 0.385422 Oct 28 17:36:29.838245 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 983/1919] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:29 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:29.891049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:29.899903 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc9eca5b-c22a-43a5-92c4-afbd6cb5ef73 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.283874 Oct 28 17:36:29.900731 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 937/1920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:29 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:30.032566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:30.034397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:30.044355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.045503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.046292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.047323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.047931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.048616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.160197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:30.171339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:30.172261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:30.183563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.184309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.187445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.189142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.190720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.192878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.468466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.482968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.484837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.488169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5ac8caed-8248-4956-b7ee-c411416818ae tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.321235 Oct 28 17:36:30.491531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 938/1921] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:30 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:30.504138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:30.507813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:30.518824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.528797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.538455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.539254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.539894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.540330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.562732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.578801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.580236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.581525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8cb31d61-c8f1-4650-ba95-cd05c43d8b3d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.553056 Oct 28 17:36:30.594766 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 984/1922] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:30 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:30.594766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb6b040-ddd8-4c9e-80f3-6dfafd27faeb", "name": "network-vif-deleted", "tag": "4cad71a6-3dba-4061-b3b7-c7f753097fdc"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:30.606127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.606127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.606127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.615679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] Creating event network-vif-deleted:4cad71a6-3dba-4061-b3b7-c7f753097fdc for instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb on n-h2-860864-13 Oct 28 17:36:30.623667 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-271d7324-1da8-4b4b-9295-e4dfb1d3a1c3 req-3d829eb6-9f4e-4331-b034-0e7bf81e818a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038615 Oct 28 17:36:30.624710 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 985/1923] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:30.630716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:30.631525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:30.639836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.641527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.642895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.645723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.648338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.648810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.656082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:30.671007 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e74d83ed-b4fa-48fa-b49d-2e934a7ec80d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1274 microversion: 2.1 time: 0.173145 Oct 28 17:36:30.675905 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 939/1924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:30 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:30.684622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:30.685592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:30.696503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.697100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.697583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.698933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:30.699344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:30.699944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:30.981658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.002865 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a11bfc44-5e04-4083-83c3-0258d171f8f9 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.374404 Oct 28 17:36:31.004103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 986/1925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:30 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:31.018285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fe800-9c27-4eb4-ac68-eb8a422cb304", "name": "network-vif-plugged", "status": "completed", "tag": "fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:31.042302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.044846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.045338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.045770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.052250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20c4395b-374e-4c04-9237-4125c7f6ae5d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.375263 Oct 28 17:36:31.053141 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 940/1926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:30 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:31.058382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:31.059227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:31.069725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.071871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.072555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.074070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.075011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] Creating event network-vif-plugged:fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35 for instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 on n-h2-860864-13 Oct 28 17:36:31.075405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.076055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.087214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-05fb3ea8-1c2e-4b43-8daa-d3dddad31144 req-9e39399f-cc11-4420-aed2-1d245c129d08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080227 Oct 28 17:36:31.087903 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 987/1927] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:31.132435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:31.133963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:31.154429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.154935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.155926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.157241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.157871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.158616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.324599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.342877 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0bcab9d8-e722-4788-8c23-c10ff8158caa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1345 microversion: 2.1 time: 0.288172 Oct 28 17:36:31.354512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 941/1928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:31 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1345 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:31.520890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:31.521609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:31.564054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.568540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:31.571533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.573494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d6ed2f0-5edb-4e59-a359-eeddf20eca38 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.471036 Oct 28 17:36:31.574064 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 988/1929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:31 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:31.574793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.575944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.578530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.579097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.580035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.614807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:31.615704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:31.626981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.627617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.628616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.634217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.634592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.636017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.882007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.890683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.892498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.893667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40c95317-1d21-4f23-86ff-fb5cab5d9b1c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.377383 Oct 28 17:36:31.911778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 942/1930] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:31 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:31.917479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:31.918281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:31.925837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.926535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.927127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.927936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:31.928539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:31.929128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:31.932166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.942356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.944161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:31.945567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-799affd9-adf8-4b28-a1e6-b14933b30719 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.335445 Oct 28 17:36:31.946503 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 989/1931] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:31 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:32.030827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.031866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.039762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.040435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.041040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.042211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.043184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.043688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.109467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:32.128780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76839172-1150-446c-ad07-3a2cd5b0276c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.215583 Oct 28 17:36:32.129543 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 943/1932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:31 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:32.152877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.154144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.164309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.164962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.165735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.168036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.168676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.169291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.237799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:32.248003 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38828266-23f5-4a22-b4ab-919a8677d1fd tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1394 microversion: 2.1 time: 0.220922 Oct 28 17:36:32.249232 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 990/1933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1394 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:32.338816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:32.353022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-44d06072-e231-4094-b35e-fd6689d1d83a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.204326 Oct 28 17:36:32.354141 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 944/1934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:32.375141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.375832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.382229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.382944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.383739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.384479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.384930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.385435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.415991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:32.425567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.426243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.426809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.447288 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] Creating event network-changed:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:36:32.461403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-32cc7f95-e682-4d40-be92-9dfbecc68934 req-6875b60f-11e8-4d00-bda2-e50ff0ac44b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048921 Oct 28 17:36:32.462327 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 945/1935] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:32.475097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:32.484590 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a65f0cce-a2da-4cf4-a09c-e585b18e0721 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1345 microversion: 2.1 time: 0.113520 Oct 28 17:36:32.485170 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 991/1936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:32.598666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.599420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.606913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.607423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.608505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.609571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.610045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.610481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.762216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:32.770805 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad472616-1e3f-4318-8a01-aa15e37c7ba8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.176114 Oct 28 17:36:32.771799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 946/1937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:32.918779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.919497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.932013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.933040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.933620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.934348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.935022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.943726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.972499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:32.973617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:32.991950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.992441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.993034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:32.993905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:32.994370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:32.995357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.304845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:33.305987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.309891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.317189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.318854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.320121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.320462 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cba6e024-ce9a-4df9-8063-912415b42079 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1487 microversion: 2.25 time: 0.406127 Oct 28 17:36:33.321846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.323726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db4bb599-f0d0-40d6-9588-48404e263f75 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.354930 Oct 28 17:36:33.333370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 992/1938] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1487 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:33.348449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67cc7c9-686a-4b98-86b0-a647fc64ca50", "name": "network-vif-plugged", "status": "completed", "tag": "61cb3323-cfb9-4288-95d9-c547008bfe90"}, {"server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "name": "network-vif-plugged", "status": "completed", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:33.356090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 947/1939] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:32 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:33.366339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.367223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.379215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.379731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.380161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.381379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:33.384186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.385128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.388487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.389881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.390495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.391067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.395848 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Creating event network-vif-plugged:61cb3323-cfb9-4288-95d9-c547008bfe90 for instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 on n-h2-860864-13 Oct 28 17:36:33.396471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] Creating event network-vif-plugged:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h1-860864-13 Oct 28 17:36:33.409036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1996c9c2-a4e1-4605-af65-a5043cdf6a59 req-cdeefd55-fbfa-4493-90e0-560b9852d464 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074381 Oct 28 17:36:33.410388 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 993/1940] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:33.419428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.421175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.430366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.431116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.431802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.433683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.434296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.434872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.495629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:33.627302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.638703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db2f51b8-4d7d-4b83-a5af-df844c0339b6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.280981 Oct 28 17:36:33.639299 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 948/1941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:33.645364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.652988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.656142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.662780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-870c0891-2e86-426b-8314-0a8cac690485 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1574 microversion: 2.1 time: 0.249301 Oct 28 17:36:33.672951 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 994/1942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:33.672951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.672951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.673590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.674139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.675408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.675408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.679718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.679849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.679926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.679992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.679992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.679992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.679992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.679992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.802890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.820061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f229f93b-f575-4148-b18d-49878818f056 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1345 microversion: 2.1 time: 0.155295 Oct 28 17:36:33.830019 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 995/1943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:33.832849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.833347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.845453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.846396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.846534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.847203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.847825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.848867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.962322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fbb2e3c2-3bf6-4ac8-bc36-c9083ada95bb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133801 Oct 28 17:36:33.963462 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 996/1944] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:33.969118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:33.970060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:33.972001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:33.972629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:33.979117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.980360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6853025e-9adb-44e0-a7a6-bb1776661fb8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.339080 Oct 28 17:36:33.980638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.981134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.981836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:33.982283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:33.982729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:33.999077 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 949/1945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:34.124845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.132556 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f291bdc9-d365-46bd-a44d-6fcf668196c8 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.167218 Oct 28 17:36:34.133393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 997/1946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:33 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:34.349256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.350549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:34.366532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.367124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:34.375477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.375609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.375972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.376109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.376412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.376975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.377136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.378117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.378547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.379947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.381121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.381755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.646549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.651856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.658075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.659552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.660751 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a85ac027-9f42-4fcf-a748-b06b7cc0d619 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1477 microversion: 2.25 time: 0.316321 Oct 28 17:36:34.662477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.663980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.666113 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d37d4a9-b3a8-4873-a94a-96b771c96a87 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.312601 Oct 28 17:36:34.675460 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 998/1947] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:34.675460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.675460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:34.675849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 950/1948] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.687204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.690330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d255e9df-a3b6-4c61-942b-93eb0146d103 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '.version_select at 0x7f75287df670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.693972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d255e9df-a3b6-4c61-942b-93eb0146d103 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.694459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d255e9df-a3b6-4c61-942b-93eb0146d103 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.694900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d255e9df-a3b6-4c61-942b-93eb0146d103 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.707069 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d255e9df-a3b6-4c61-942b-93eb0146d103 tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 3656 microversion: 2.25 time: 0.022305 Oct 28 17:36:34.719590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 951/1949] 10.222.0.48 () {60 vars in 1184 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/os-migrations => generated 3656 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:34.724489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.725098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:34.747967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.748896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.748896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.752810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.753330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.753772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.885700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:34.897931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a2a5c7b-98a6-4541-8510-991c96b2d03c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.229627 Oct 28 17:36:34.901516 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 999/1950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:34.909696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:34.914294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:34.928771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.929523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.933343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:34.934407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:34.935020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:34.935616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.021409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.031575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cbcbc20-48e5-473e-9a86-e96a1aabf74c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1345 microversion: 2.1 time: 0.128295 Oct 28 17:36:35.043864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] Lazy-loading 'services' on Instance uuid 7311730b-292e-404f-9ed7-6c15524129da {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:35.043985 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1000/1951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:35.054731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.055351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.062235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.063133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.063242 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fdebd2f-9d0f-48bc-a723-edfd0b0fa1fe tempest-LiveAutoBlockMigrationV225Test-316575101 tempest-LiveAutoBlockMigrationV225Test-316575101-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1971 microversion: 2.25 time: 0.342187 Oct 28 17:36:35.063361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.064007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.064470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.064894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.076589 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 952/1952] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:34 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1971 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:35.087679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.089619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.114058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.114806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.115892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.117734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.118343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.120218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.268511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.279602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6663330f-462e-45b3-923a-717aba6f0753 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1313 microversion: 2.1 time: 0.234423 Oct 28 17:36:35.292348 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1001/1953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:35.303004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c24fe800-9c27-4eb4-ac68-eb8a422cb304", "tag": "fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:35.314559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.315213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.315809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.328529 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] Creating event network-changed:fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35 for instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 on n-h2-860864-13 Oct 28 17:36:35.334006 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-480221a0-3a48-4160-b2fa-e92fade0b54e req-b7a412f7-2d8a-40c2-a4f4-89d8eec513a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039770 Oct 28 17:36:35.335104 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1002/1954] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:35.336581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.343340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.344103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.345400 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da03ce4a-fbd8-40a4-860a-39df4a4a270b tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1574 microversion: 2.1 time: 0.267143 Oct 28 17:36:35.346329 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 953/1955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1574 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:35.351392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.352156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.352251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.352897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.353498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.354456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.355038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.355637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.361711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:35.380074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.380728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.381872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.383054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.383706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.384875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.388303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:36:35.501494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2133385a-5ab2-4fc3-bacb-3fcda33c52a1 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 204 len: 0 microversion: 2.25 time: 0.163934 Oct 28 17:36:35.505147 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1003/1956] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:36:35 2022] DELETE /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:36:35.514946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.516078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.529872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.530672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.531209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.532184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.532746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.533270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.605057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.615383 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98d00e50-4a90-423d-a577-472048dda6b9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.267825 Oct 28 17:36:35.631475 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 954/1957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:35.694051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.694762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.702211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.702774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.703292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.704130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.704645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.705138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.718928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.732841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.738891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.740188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4dd6a607-3d4b-4bc7-b5c1-369b9cef28e9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1483 microversion: 2.25 time: 0.233549 Oct 28 17:36:35.741007 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1004/1958] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1483 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:35.927208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:35.927832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:35.936287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.940115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.950792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.951188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.952094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:35.952578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:35.953003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:35.954634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.956154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:35.957341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3caf5b55-761e-446c-8129-bc701f6e0fc4 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.267202 Oct 28 17:36:35.957897 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 955/1959] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:36.062735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:36.064660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:36.082458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.085116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.086064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.087342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.089779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.090798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.144157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.145487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.146240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.146797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid efb6b040-ddd8-4c9e-80f3-6dfafd27faeb {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:36.154816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:36.163062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8c3a05d-adb6-4e5c-9ac4-dcdabd4b0a09 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.239557 Oct 28 17:36:36.164040 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1005/1960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:35 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:36.202670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:36.211503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01faf55a-eeb6-412b-b4bd-66b6463de028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1350 microversion: 2.1 time: 0.155281 Oct 28 17:36:36.212325 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 956/1961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:36 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:36.305582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:36.306530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:36.313296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.313796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.314231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.314938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.315524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.316171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.457945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:36.466626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74b7eeff-e181-4803-a53e-dc5a540efed9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1462 microversion: 2.1 time: 0.164954 Oct 28 17:36:36.468004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1006/1962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:36 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1462 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:36.491259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:36.494343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:36.502800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.503558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.504190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.504907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.505390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.505820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.638324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:36.638931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:36.644113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:36.647737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.648228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.648725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.649428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.658786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.659188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.700623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:36.706917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 17:36:36.718619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:36.718833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:36.719300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:36.727911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:36.728647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:36.932793 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b972320-ccf2-4577-b8ab-129732347948 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.442887 Oct 28 17:36:36.934735 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 957/1963] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:36:36 2022] POST /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:36:36.946611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:36.951653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:36.953470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:36.956140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0c9440f-1aac-4277-b91d-796008beb80a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1198 microversion: 2.1 time: 0.321904 Oct 28 17:36:36.963970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.964931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.966541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.967790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:36.968554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:36.969204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:36.975871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1007/1964] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:36 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1198 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:36.985212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:36.985973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:37.009485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.010046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.011145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:37.011912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.012360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.013193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:37.163829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:37.177906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:37.184265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:37.189903 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d1cff6f-7281-42c4-940e-692b06a7fd37 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1441 microversion: 2.25 time: 0.253386 Oct 28 17:36:37.211969 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 958/1965] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:36 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1441 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:37.233960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:37.234588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:37.248032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.248541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.248986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:37.249714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.250160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.250580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:37.905042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:37.924809 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcbd7979-623e-4794-a818-adc8f5853f94 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1471 microversion: 2.1 time: 0.944401 Oct 28 17:36:37.925662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1008/1966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:36 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1471 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:37.931065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:37.941543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:37.961682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.962366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.962953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:37.964752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:37.965435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:37.966143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.075902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.088310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.090816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.092791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13cfe49d-357e-498e-b3cd-f43e5a1f73f6 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.879512 Oct 28 17:36:38.093986 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 959/1967] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:37 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:38.099230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.100283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.107561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.108270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.108885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.110003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.111354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.112080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.160190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.160920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.161490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.162075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid efb6b040-ddd8-4c9e-80f3-6dfafd27faeb {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:38.188466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.214628 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8efe1a83-f878-4fa2-b926-c826f3fe1fda tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.284311 Oct 28 17:36:38.215272 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1009/1968] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:37 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:38.221428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7311730b-292e-404f-9ed7-6c15524129da", "name": "network-vif-deleted", "tag": "a11a6f1e-0195-4cdd-bde7-a9e50b452172"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:38.235019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.236110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.236586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.241541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.270427 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] Creating event network-vif-deleted:a11a6f1e-0195-4cdd-bde7-a9e50b452172 for instance 7311730b-292e-404f-9ed7-6c15524129da on n-h1-860864-13 Oct 28 17:36:38.274214 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70877009-462a-471e-9ff2-9b1473056531 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 200 len: 1350 microversion: 2.1 time: 0.178754 Oct 28 17:36:38.282795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2d6773ac-3ef9-4e3c-a7fb-ef39e31f49ee req-a1451243-620b-4240-b967-837901d678f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065752 Oct 28 17:36:38.283821 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1010/1969] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:38.288849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 960/1970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 1350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:38.294686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.295297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.308740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.309432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.309894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.310102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.310608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.311581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.312315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.312867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.317706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.318393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.318971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.319860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.320452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.321009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.489176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.504303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.506336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.512452 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b32a44bf-85af-4ba0-b08c-41acaedb345a tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1265 microversion: 2.25 time: 0.222335 Oct 28 17:36:38.523837 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 961/1971] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:38.602455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:38.614839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a884055-452f-4e9e-a567-60ce7ef24d93 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1381 microversion: 2.1 time: 0.328977 Oct 28 17:36:38.617209 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1011/1972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1381 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:38.641148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.641756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.648576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.649534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.650382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.652235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.653108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.653981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.806475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1f4712b-ba5b-4802-887e-266ed4238c33 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1534 microversion: 2.1 time: 0.169007 Oct 28 17:36:38.807410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 962/1973] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1534 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:38.829364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.829976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.836459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.836944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.837377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.838187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.838764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.839303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.953355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:38.954147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:38.960843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.961554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.962588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.963438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:38.964387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:38.964502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:38.990959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8f83ee9-916d-4271-aeba-c3f3435256cd tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1534 microversion: 2.1 time: 0.165279 Oct 28 17:36:39.000121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1012/1974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1534 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:39.014863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.018701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.019339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.019942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.020949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.021569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.022222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.049092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa3b5942-e002-4b45-80cc-23869d6076cf tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038681 Oct 28 17:36:39.058013 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1013/1975] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:39.063514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-13", "block_migration": false, "disk_over_commit": false}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:39.066604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.073895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.074383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.074994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.076085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.077086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.077662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.106017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lazy-loading 'flavor' on Instance uuid d67cc7c9-686a-4b98-86b0-a647fc64ca50 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:39.121040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Going to try to live migrate instance to n-h1-860864-13 {{(pid=120567) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 17:36:39.224726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.233794 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6dc37222-5f60-45b1-a5b3-1c41cf5af0cd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1471 microversion: 2.1 time: 0.286871 Oct 28 17:36:39.234753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 963/1976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:38 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:39.240095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.240859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.247753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.249243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.249828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.250708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.251297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.251904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.497850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.500156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:39.509225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.512037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.513235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97517fd0-9881-4f69-a0eb-1bbb565a570d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.277408 Oct 28 17:36:39.513799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 964/1977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:39.519115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.519928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.528370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.529037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.529624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.530485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.531087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.531686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.686381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.696715 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9df784d6-321e-4d30-9a08-912abf202ed8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.181719 Oct 28 17:36:39.698215 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 965/1978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:39.703791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.705457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.712016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.712548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.713052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.713762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.714289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.714840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.731604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb HTTP/1.1 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'efb6b040-ddd8-4c9e-80f3-6dfafd27faeb'} Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:39.733263 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:39.736951 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3969a26d-4135-4224-8533-74e831610e18 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 404 len: 111 microversion: 2.1 time: 0.035418 Oct 28 17:36:39.738305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 966/1979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:36:39.747780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.749080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.755415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.755958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.756480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.757726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.758349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.758783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.876245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.890860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.894478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:39.897429 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-33a3e89f-3842-4bf7-a871-223a03075363 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1265 microversion: 2.25 time: 0.153695 Oct 28 17:36:39.899727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 967/1980] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:39.936560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:39.939554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:39.956402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.957386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.958137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.959167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:39.959871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:39.960593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:39.981746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb/os-volume_attachments HTTP/1.1 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': 'efb6b040-ddd8-4c9e-80f3-6dfafd27faeb'} Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:36:39.991911 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:36:39.995070 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:39.998023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:39.999214 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39d0ab59-9eed-4be9-94d6-cb4a0909d286 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067138 Oct 28 17:36:40.000240 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 968/1981] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:36:39 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:36:40.189812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-958979876", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:40.266756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:40.759483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:40.761400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:40.762143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:40.762745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:40.763404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:40.774100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:40.774528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:40.775048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:40.777110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:40.777635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:40.778125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:40.798065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:40.804116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:40.818470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:40.820944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:40.877563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0545e669-8a09-4980-8e14-6c98ef735f7a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691703 Oct 28 17:36:40.882938 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 969/1982] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:36:40.893923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:40.894484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:40.902787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:40.903427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:40.903969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:40.904726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:40.905289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:40.905802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.025237 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f3ea8fa-ebf7-4971-90bb-ebfba868703f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50/action" status: 202 len: 0 microversion: 2.1 time: 1.965602 Oct 28 17:36:41.027615 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1014/1983] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:36:39 2022] POST /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50/action => generated 0 bytes in 1969 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:36:41.033730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:41.035441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:41.098009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.108633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.115065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.117110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.120576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.125676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.395556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.406289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85ace9a5-88b4-4d8b-80b0-b8d49b88254a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1471 microversion: 2.1 time: 0.522086 Oct 28 17:36:41.406886 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 970/1984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:40 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1471 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:41.428661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:41.429285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:41.438407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.439331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.440011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.440933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.441743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.442369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.469635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.482997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.490914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.492680 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93a454d4-3357-4cea-b933-a7655360275d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.463208 Oct 28 17:36:41.500575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1015/1985] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:41 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:41.512364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1261077a-b267-442b-9c8a-8b2e6051e4fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:41.518371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1261077a-b267-442b-9c8a-8b2e6051e4fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:41.692380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1261077a-b267-442b-9c8a-8b2e6051e4fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.701995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1261077a-b267-442b-9c8a-8b2e6051e4fb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673" status: 200 len: 1214 microversion: 2.1 time: 0.199933 Oct 28 17:36:41.702590 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1016/1986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:41 2022] GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:41.712202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:41.716105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:41.731006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.733576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.739669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.740134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.742121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.742602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.743780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-698d09b6-db9b-4b76-bb38-7550eee4aef7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.322992 Oct 28 17:36:41.744928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 971/1987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:41 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:41.762073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.769020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:41.771668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:41.807040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.807720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.808297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.809016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.809467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.809883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.888931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.904332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.906226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:41.909631 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a72f5d25-bc44-436a-b16b-0e27cde9f549 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1265 microversion: 2.25 time: 0.203358 Oct 28 17:36:41.912995 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1017/1988] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:41 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:41.938953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-plugged", "status": "completed", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:41.974288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:41.974931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:41.978562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:41.998036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] Creating event network-vif-plugged:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:36:42.007126 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-25e1fc0f-0520-4743-8f64-0910d8ad6989 req-bbff1a6b-4654-4527-bbd4-df0998087d77 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079830 Oct 28 17:36:42.013465 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1018/1989] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:42.027095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:42.028850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:42.042773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.045665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.046132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.048485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.048965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.051655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.063398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:42.123888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:36:42.143946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.144814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.145554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.153835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:42.162507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f060ce11-bd6a-4ec5-a3ac-1e35e43e3aa6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.416280 Oct 28 17:36:42.173573 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 972/1990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:41 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:42.238997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'flavor' on Instance uuid b23e126f-ca33-47c4-8b76-65e51758e673 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:42.313476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'system_metadata' on Instance uuid b23e126f-ca33-47c4-8b76-65e51758e673 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:42.383280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'metadata' on Instance uuid b23e126f-ca33-47c4-8b76-65e51758e673 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:42.432921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:42.435682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:42.446379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.446884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.447456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.448194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.448651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.449082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.689010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:42.698033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6383d58f-b2ae-4653-af1f-cc832ee0cab7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.268900 Oct 28 17:36:42.698611 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 973/1991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:42 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:42.703684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:42.705087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:42.718366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.718850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.719278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.720041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.720568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.720996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.830891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.scheduler.client.report [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Deleted allocations for instance b23e126f-ca33-47c4-8b76-65e51758e673 Oct 28 17:36:42.853817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-91b50dd1-49e0-42e3-9dca-5c252d5a8832 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673" status: 204 len: 0 microversion: 2.1 time: 0.836262 Oct 28 17:36:42.856371 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1019/1992] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:36:42 2022] DELETE /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:36:42.866595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:42.867220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:42.876700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.877246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.877687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:42.878456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:42.878913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:42.879439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.084886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.101121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.102857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.108458 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ee3a64c-a60a-49ac-97b0-2ac7c0226634 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.408293 Oct 28 17:36:43.109587 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 974/1993] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:42 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:43.111338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.126005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5afe2e5d-2780-4019-a744-18c52129310a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1316 microversion: 2.1 time: 0.267691 Oct 28 17:36:43.132167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.135641 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1020/1994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:42 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:43.138856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.149604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.150745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.151475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.152197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.156233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.157208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.157814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.158167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.158533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.158642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.159082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.159827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.160522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.173104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.220439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 HTTP/1.1 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b23e126f-ca33-47c4-8b76-65e51758e673'} Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:43.222230 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:43.225617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:43.226006 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30d86f05-eb36-4090-8e05-d214fb581519 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673" status: 404 len: 111 microversion: 2.1 time: 0.089151 Oct 28 17:36:43.238310 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1021/1995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:36:43.238310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.238310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.241320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.241885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.242713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.243637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.244217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.245354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.354015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.365610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.368156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.369261 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6630bfd7-bcb9-4469-863d-e2815e468f4e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 200 len: 1265 microversion: 2.25 time: 0.140070 Oct 28 17:36:43.388978 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1022/1996] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:43.395164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.396417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.404617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.405141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.405584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.406337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.419680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.420516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.470183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.479116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c420eff5-615a-49c5-8224-e71a36747934 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.367809 Oct 28 17:36:43.490546 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 975/1997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:43.490546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-368831387", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:43.553634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:36:43.640100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.655068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72d64b62-0b7a-4f14-a0a8-2abecf94f4d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.262387 Oct 28 17:36:43.656102 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1023/1998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:43.679354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.680056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.689572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.690209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.690666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.691541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.692109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.692812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.954010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:43.963075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28bde591-d282-4b69-8d79-a48122bc64c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.290082 Oct 28 17:36:43.964404 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1024/1999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:43.980487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:43.981171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:43.987813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.988306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.988746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:43.990139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:43.990601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:43.991053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.219212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.231535 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a553d4e-38e8-471f-8bef-2b5ce4e874b1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.265959 Oct 28 17:36:44.232274 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1025/2000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:43 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:44.236126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:36:44.236714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:36:44.237360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:36:44.237916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:36:44.238297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.238635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:36:44.239097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.248116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.248742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.249401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.250206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.250945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.251561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.260703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.261751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.262349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.263271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.263903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.264519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.289735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:44.296412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:44.310967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:36:44.313674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:36:44.325493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:44.379518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c657acc3-452c-41cd-9623-db8f8fcd1cfa tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898201 Oct 28 17:36:44.380498 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 976/2001] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:36:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:36:44.386609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.387825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.399563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.400310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.400895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.401761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.402423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.402998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.457382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.467697 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-132ee13a-9863-4612-808d-ec814f6d7106 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.233943 Oct 28 17:36:44.468758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1026/2002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:44.482660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.483270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.491008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.491522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.492012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.492715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.493218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.493638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.706186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.718459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.720812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.722370 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2587ea2e-d0f6-49b5-b48f-81c704611b4c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.340555 Oct 28 17:36:44.723687 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 977/2003] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:44.730396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6609ddce-01ac-49d3-9cc0-28172f51fa07 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.731241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6609ddce-01ac-49d3-9cc0-28172f51fa07 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.764528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.774377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c27c603-5ea4-48e4-9987-a5ea4f1f83d7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1466 microversion: 2.1 time: 0.304564 Oct 28 17:36:44.775321 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1027/2004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:44.779830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.780432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 7311730b-292e-404f-9ed7-6c15524129da] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.786476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.786960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.787414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.788271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.788703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.789174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.813550 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] HTTP exception thrown: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Request method failure captured: Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da HTTP/1.1 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBE-PBSFusHnD8SgO6aXkkA-j6br-mPakaitolTHWgXJ9MCSY_sW2nW5udfeeFuCpUv_pUL4QtwOYSfcUhkTow5qa53oa_GZGXgMgOg-V-JOr44VdE5iJg2_B-o-HIR2EmchrTA5dRAgOdXx2AQ-OKho4ihAS7tTq3xhz4y1xFsuAk4 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1d985c16d5e341f3a78075917a2a4e9b"}]}] Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5121cf58427a48738ec1c70fbf5e922d Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7311730b-292e-404f-9ed7-6c15524129da'} Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. Oct 28 17:36:44.815111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. Oct 28 17:36:44.819291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:36:44.825938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Returning 404 to user: Instance 7311730b-292e-404f-9ed7-6c15524129da could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:44.827024 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3168f65f-8466-4de9-9cd4-e778ba7c4c8b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da" status: 404 len: 111 microversion: 2.25 time: 0.050625 Oct 28 17:36:44.836090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6609ddce-01ac-49d3-9cc0-28172f51fa07 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:44.844331 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6609ddce-01ac-49d3-9cc0-28172f51fa07 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1214 microversion: 2.1 time: 0.119211 Oct 28 17:36:44.845453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 978/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:44.847702 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1028/2006] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/7311730b-292e-404f-9ed7-6c15524129da => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:36:44.852760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:44.853935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.861668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1100946087"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:44.864457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:44.873205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.873997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.874640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.875594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.876252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.876879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.883845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.884460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.885418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:44.886126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:44.886577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:44.887001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.170805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:45.184953 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfb61060-65d9-4db4-8dd4-3f6c75da4818 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.336083 Oct 28 17:36:45.185727 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1029/2007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:44 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:45.192077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1455371409", "metadata": {"image_type": "test"}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:45.198385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:45.221406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.222049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.222198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.223471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.224295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.225367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.232235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb1552f7-44a4-4e6e-b108-bd2ce4e1e660 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.380356 Oct 28 17:36:45.239833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 979/2008] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:36:44 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 17:36:45.261091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:45.262148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:45.269556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.270130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.270627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.271419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.271952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.272438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.285216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Getting quotas for project 378bcb819bd14593866269c06c978f53. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:36:45.291517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Getting quotas for user 3106807274604bfe86b924a6d4aa70b1 and project 378bcb819bd14593866269c06c978f53. Resources: dict_keys(['metadata_items']) {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:36:45.544261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:45.554803 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7cfc505e-1dba-4eea-a3a2-8fdcef9b7f59 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.300352 Oct 28 17:36:45.575209 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 980/2009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:45 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:45.596650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d418f6af-f69a-4bfa-b7c2-61d3d962dfc3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "POST /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f/action" status: 202 len: 0 microversion: 2.1 time: 0.409910 Oct 28 17:36:45.597295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1030/2010] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:36:45 2022] POST /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:36:45.609427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5fbf02f9-5016-4d10-bab9-9f7c0aa3899a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75286798b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:45.700904 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5fbf02f9-5016-4d10-bab9-9f7c0aa3899a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.095124 Oct 28 17:36:45.702082 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 981/2011] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:45 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:45.754832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:45.755634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:45.762754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.763510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.763951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.764772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.765230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.765656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.799611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:45.870455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:45.872375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:45.879002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.879957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.880656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:45.881569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:45.882230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:45.882857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:46.006061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.015618 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f3b3683-6c79-4bb9-82b6-f571b7bcf418 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1266 microversion: 2.1 time: 0.149458 Oct 28 17:36:46.016578 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 982/2012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:45 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:46.045074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.054850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.056343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.058134 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-819b85a3-207b-4bf1-ba84-d94a80fe083f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.307655 Oct 28 17:36:46.068995 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1031/2013] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:45 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:46.226418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:46.227027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:46.245521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:46.246006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:46.246440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:46.247137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:46.247609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:46.248030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:46.482756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.497783 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8942e10-5404-4f31-ba30-57cd467de1d5 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.284057 Oct 28 17:36:46.498917 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 983/2014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:46 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:46.578860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:46.579616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:46.587505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:46.588852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:46.589367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:46.590149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:46.590782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:46.591210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:46.717747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-230ca515-6317-42fe-b044-5122cc61cbb9 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528679e50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:46.777690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:46.782760 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-230ca515-6317-42fe-b044-5122cc61cbb9 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.069157 Oct 28 17:36:46.783779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 984/2015] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:46 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:46.788540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53edc475-661f-4edd-bc1b-8ee1abc429c4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.213534 Oct 28 17:36:46.789391 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1032/2016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:46 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:47.038717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:47.039220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:47.048867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.049678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.050474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.051447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.052112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.052741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.089579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:47.090640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:47.104227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.105076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.105849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.107225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.109201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.113509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.178444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:47.181203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:47.199637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-edcf830a-3eca-4893-bf35-ab708191f9ed tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1272 microversion: 2.1 time: 0.164569 Oct 28 17:36:47.216073 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 985/2017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:47 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:47.429981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:47.442720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:47.444467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:47.445665 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9dbd1bf8-755f-48b5-bfd2-1c301114707c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.365119 Oct 28 17:36:47.456382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1033/2018] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:47 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:47.522490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:47.525775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:47.537364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.538584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.539267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.540360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.542431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.543110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.724035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:47.747163 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ac16ca4-ce22-42e0-b80a-200cce96d062 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.228552 Oct 28 17:36:47.747833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 986/2019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:47 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:47.800098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb67a8ca-15f6-4546-bbb5-f23e700086fb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75240659d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:47.816128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:47.817254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:47.827120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.827986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.829025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.829999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:47.830638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:47.831246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:47.870011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb67a8ca-15f6-4546-bbb5-f23e700086fb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.069740 Oct 28 17:36:47.873611 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1034/2020] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:47 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:48.016020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:48.025201 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-09e89c5b-c04c-4c8d-8fa4-c8ee643f56fa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.216335 Oct 28 17:36:48.040531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 987/2021] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:47 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:48.226092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:48.226701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:48.234402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.235212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.235911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.244370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.245223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.246178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.306882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48e8b72-0a15-4b2d-86fd-752efa288371", "tag": "fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:48.332568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.333068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.333509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.350462 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] Creating event network-changed:fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2 for instance c48e8b72-0a15-4b2d-86fd-752efa288371 on n-h2-860864-13 Oct 28 17:36:48.381726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-87ca456b-384c-46d1-b312-9f6e8f48cc28 req-0f000691-a1a0-4987-9255-a888fd20d679 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078462 Oct 28 17:36:48.392576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 988/2022] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:48.473306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:48.474255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:48.483790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.485498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.486150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.487105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.487802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.488431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.502927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:48.513823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-022b8029-9a4a-4ea2-928e-f9c8a7a738ee tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.290923 Oct 28 17:36:48.514898 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1035/2023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:48 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:48.745160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:48.757265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:48.758713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:48.759999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5557949-d466-4564-8920-a1400464daf3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.292616 Oct 28 17:36:48.760576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 989/2024] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:48 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:48.771553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:48.772168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:48.783131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.783675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.784116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.784823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:48.785269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:48.785689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:48.888714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6718726b-73ca-496a-bbd7-3a32c5631bfe tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752434adc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:48.950253 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6718726b-73ca-496a-bbd7-3a32c5631bfe tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.065976 Oct 28 17:36:48.958758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 990/2025] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:48 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:48.991514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:49.000394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a380368-e5e8-470c-aac5-20f13b2f4100 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.232725 Oct 28 17:36:49.001377 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1036/2026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:48 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:49.054303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:49.055238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:49.062366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.062931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.063468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:49.064265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.064778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.065523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:49.207692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:49.216813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61458da5-529e-4875-8e5d-11696ecd3e84 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.166447 Oct 28 17:36:49.217720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 991/2027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:49 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:49.541761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:49.542983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:49.548864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:49.551252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.551834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.552617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:49.553356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.553815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.554313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:49.791966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:49.793320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:49.802713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.803781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.804578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:49.805596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:49.806863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:49.807578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.022685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.033006 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6662b75-6e64-4501-8f3d-ea42cab44328 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.495122 Oct 28 17:36:50.043995 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1037/2028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:49 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:50.053393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54068517-a406-43a9-8f6e-5aa811987c7c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524065ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:50.062653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.073938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.075422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.076699 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a7eb0ba-f589-405a-9c76-f059ebcda72b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.290475 Oct 28 17:36:50.087142 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 992/2029] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:49 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:50.101857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:50.102465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:50.108302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54068517-a406-43a9-8f6e-5aa811987c7c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.062958 Oct 28 17:36:50.109334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:50.109558 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1038/2030] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:50 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:50.109878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:50.110268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.110969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:50.111487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:50.111857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.242805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:50.246332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:50.256564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:50.257360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:50.258199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.263843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.267696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:50.268513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:50.271135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.280560 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1951ea0-0a87-4ba4-8f2b-b8107c25342f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.191557 Oct 28 17:36:50.281495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 993/2031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:50 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:50.451881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:50.463705 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39e7bb27-00f0-493a-adc2-7f0dc674e55c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.224188 Oct 28 17:36:50.465204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1039/2032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:50 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:50.837214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "6bc07bb1-bae8-41c1-9ed6-2df11a20cdde"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:50.849448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:50.850194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:50.850697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:50.866293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] Creating event network-vif-plugged:6bc07bb1-bae8-41c1-9ed6-2df11a20cdde for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:50.872438 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0d4c531c-639d-4180-877f-bdf5a6222a20 req-bcd8eb11-0c23-4db4-8109-30f505a655a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039555 Oct 28 17:36:50.873495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 994/2033] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:51.060012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.061244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:51.068071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.068718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.069219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.070128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.070833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.071608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.112993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.116297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:51.129195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.133178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.136741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.137675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.138311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.138909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.335901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.347936 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b65426ce-907c-465b-992e-03b872592737 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.293558 Oct 28 17:36:51.356015 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1040/2034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:51.373165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ceb0a176-d03e-4b1a-b4f8-482191801e92 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524065ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.433577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ceb0a176-d03e-4b1a-b4f8-482191801e92 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.065035 Oct 28 17:36:51.435704 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1041/2035] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:51.443919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.448457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:51.452430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.461772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.464015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.464460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.465380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.465674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.466109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.483414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.486342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.489752 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b6437d6-465c-46d9-91ea-0a98f4e16d6b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.387820 Oct 28 17:36:51.495178 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 995/2036] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:36:51.503260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.504116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:51.513177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.515109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.516466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.518130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.518764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.519350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.698401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:51.769317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.780321 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c9966239-6d30-4304-bd88-1d85ae957809 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.343445 Oct 28 17:36:51.781422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1042/2037] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:51.790183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:51.794063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:51.806763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.807556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.808002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.808728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:51.809292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:51.809599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:51.824224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:51.846029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:36:51.850162 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f36649e-5198-4f77-808d-8ee6322e9e0d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.353596 Oct 28 17:36:51.853135 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 996/2038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:51.989564 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-117911b2-59f2-4442-bcae-d2bde17399bb tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 204 len: 0 microversion: 2.25 time: 0.206547 Oct 28 17:36:51.998078 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1043/2039] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:36:51 2022] DELETE /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:36:52.003896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.005031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:52.012157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.014454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.015133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.016591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.016757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.017379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.198427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.208731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.210547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.221549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5071be10-65d8-4019-b30b-1daa1468a726 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1733 microversion: 2.25 time: 0.221946 Oct 28 17:36:52.226193 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 997/2040] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:51 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:52.381406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.383009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:52.392731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.393357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.393907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.394732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.395398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.395834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.451964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c49f3a31-b2a4-42ae-b516-c9d16626d5ae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528679940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.513809 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c49f3a31-b2a4-42ae-b516-c9d16626d5ae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.068041 Oct 28 17:36:52.516124 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 998/2041] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:52 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:52.528099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.529499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:52.539496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.541002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.541654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.542798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.543571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.544420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.571254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.580023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75904235-e03a-48b5-890d-3dc5305cf6ac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.204360 Oct 28 17:36:52.580600 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1044/2042] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:52 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:52.760670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.782781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.784444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:52.785612 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3288540-ae68-492e-b901-6c381b6c33b1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.268377 Oct 28 17:36:52.786230 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 999/2043] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:52 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:52.806055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.807917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:52.813543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:52.815653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.816151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.816584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.817293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.817749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.818172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.876412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:52.877137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:52.889859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.890483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.891022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:52.892700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:52.893304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:52.893830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.024335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.033219 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-866eac61-ec55-4566-a025-00b4816e3bc6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.230978 Oct 28 17:36:53.043820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1045/2044] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:52 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:53.056836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "febf6791-5bbd-479e-a66a-5cba708bfaf7"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "9b1c9f97-9495-48eb-b03c-cb90f9eb86dc"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "328f2b9e-4a6a-4b29-9cf3-5a19c18f834e"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "c672d2c1-310f-453c-871d-9c962f2a558e"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "452a2cfa-f5b7-4060-afce-a8c1024694ff"}, {"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-plugged", "status": "completed", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:53.071604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.072650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.073080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.081625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.088231 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:febf6791-5bbd-479e-a66a-5cba708bfaf7 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:53.088741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:9b1c9f97-9495-48eb-b03c-cb90f9eb86dc for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:53.089245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:328f2b9e-4a6a-4b29-9cf3-5a19c18f834e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:53.089742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:c672d2c1-310f-453c-871d-9c962f2a558e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:53.090226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:452a2cfa-f5b7-4060-afce-a8c1024694ff for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:53.090722 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] Creating event network-vif-plugged:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:36:53.095426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9da894e1-9b10-4aa4-a763-8e11b4bbae2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.222926 Oct 28 17:36:53.096142 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1000/2045] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:52 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:53.100343 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e9a752f6-5b54-4769-80a7-89705f670edd req-7a921925-804c-4ac0-b366-87ea1268369d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.047303 Oct 28 17:36:53.101100 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1046/2046] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:53.249381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:53.250042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:53.256117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.256607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.257040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.257737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.258185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.258609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.435923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.446287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.448586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.450046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bd77966-5bf0-4977-9451-6958a50f6518 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1733 microversion: 2.25 time: 0.204791 Oct 28 17:36:53.451772 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1001/2047] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:53 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:53.532526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf45114f-d363-4aa7-8ab6-ba90feca2afd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f751fac3940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:53.591332 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf45114f-d363-4aa7-8ab6-ba90feca2afd tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.064968 Oct 28 17:36:53.591936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1047/2048] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:53 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:53.601908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:53.602593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:53.609324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.609803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.610235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.610924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.611961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.611961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.744829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:53.752578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6b5a5e5-833f-4268-80f5-973543417ac7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.154367 Oct 28 17:36:53.753076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1002/2049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:53 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:53.813621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:53.814362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:53.822336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.823183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.823698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:53.824461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:53.824919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:53.825469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.024709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.035172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.036820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.037995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca75c00f-be2c-46b3-9809-7b7fed99f6c7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.228575 Oct 28 17:36:54.051904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1048/2050] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:53 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:54.063264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:54.064060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:54.070920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.071445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.072594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.073369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.073857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.074284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.118492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:54.119640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:54.130375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.130871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.131394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.135977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.139631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.140099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.277822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:54.305215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.319640 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc096895-090f-4d8e-9730-45d85760251d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.261958 Oct 28 17:36:54.320587 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1003/2051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:54 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:54.331781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083311cd-7d34-4577-8b4f-d2135b33a8f5", "name": "network-vif-deleted", "tag": "af0fa9d9-6e41-4e74-9737-2f5a352eebbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:54.364098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.366869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.367323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.389246 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] Creating event network-vif-deleted:af0fa9d9-6e41-4e74-9737-2f5a352eebbc for instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 on n-h1-860864-13 Oct 28 17:36:54.398743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-215eff7e-fe8f-4ab5-8635-2fcf53a10d8b req-c831223a-1060-47e8-8de8-f082c567e9aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074609 Oct 28 17:36:54.399931 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1004/2052] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:54.474303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.483733 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-174c4dfc-be44-43c4-ba0d-40c18fca3c68 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.369456 Oct 28 17:36:54.484103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:54.485251 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1049/2053] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:54 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:54.487189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:54.493857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.494644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.495232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.496101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.496734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.497338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.536439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.537022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.537645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.538448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lazy-loading 'fault' on Instance uuid 083311cd-7d34-4577-8b4f-d2135b33a8f5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:36:54.596596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.607109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-999bacee-99a1-4e8f-b4c6-a7152368f011 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752865e040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:54.608527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.610132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.611312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45efbb3b-3e31-48c1-9974-ba23d39950f9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 200 len: 1376 microversion: 2.25 time: 0.137943 Oct 28 17:36:54.616002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1005/2054] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:54 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 1376 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:54.672709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-999bacee-99a1-4e8f-b4c6-a7152368f011 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.068736 Oct 28 17:36:54.676584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1050/2055] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:54 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:54.776216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:54.776822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:54.794571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.795389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.795538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.796541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:54.797215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:54.797712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:54.813991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:54.846612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:54.956423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:54.965187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d0b6992-1182-4d52-a240-9d71dee06a64 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.193437 Oct 28 17:36:54.966032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1006/2056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:54 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:55.067769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.070156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:55.081120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.082265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.083979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.085336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.086049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.087088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.129356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-plugged", "status": "completed", "tag": "4ccc5446-0359-471c-9f28-c5d8f7b673d3"}, {"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-plugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:55.145711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.146563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.147249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.164657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Creating event network-vif-plugged:4ccc5446-0359-471c-9f28-c5d8f7b673d3 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:36:55.166122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] Creating event network-vif-plugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:36:55.174584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a0b69706-540d-4647-af93-fd77d03f2499 req-8da2570e-0ad7-46c8-9880-4bb6f2507af5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049525 Oct 28 17:36:55.175680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1007/2057] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:36:55.348669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.349370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:55.359417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:55.373223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:36:55.383202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:55.385557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:55.388109 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a313855b-4fb3-4552-b9b7-bf95105e0248 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.325574 Oct 28 17:36:55.388371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.388870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.389305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.390017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.390811 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1051/2058] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:55.391798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.392230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.510927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.511625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:55.522051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.526411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.527070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.528888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.529502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.531240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.607620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:55.617049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42d19eb8-9591-4fcd-853e-bc0a433e7ff9 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.272046 Oct 28 17:36:55.617672 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1008/2059] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:55.641245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.641853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 083311cd-7d34-4577-8b4f-d2135b33a8f5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:55.658978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.659787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.660425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.661320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:55.661942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:55.662547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:55.693024 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] HTTP exception thrown: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Request method failure captured: Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 HTTP/1.1 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBE-PBSFusHnD8SgO6aXkkA-j6br-mPakaitolTHWgXJ9MCSY_sW2nW5udfeeFuCpUv_pUL4QtwOYSfcUhkTow5qa53oa_GZGXgMgOg-V-JOr44VdE5iJg2_B-o-HIR2EmchrTA5dRAgOdXx2AQ-OKho4ihAS7tTq3xhz4y1xFsuAk4 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1d985c16d5e341f3a78075917a2a4e9b"}]}] Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5121cf58427a48738ec1c70fbf5e922d Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '083311cd-7d34-4577-8b4f-d2135b33a8f5'} Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. Oct 28 17:36:55.698689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. Oct 28 17:36:55.702123 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:36:55.706943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Returning 404 to user: Instance 083311cd-7d34-4577-8b4f-d2135b33a8f5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:36:55.709774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-afd5df42-5872-4e2c-af5c-3d55d2f5e09c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5" status: 404 len: 111 microversion: 2.25 time: 0.074398 Oct 28 17:36:55.711525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1009/2060] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/servers/083311cd-7d34-4577-8b4f-d2135b33a8f5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:36:55.722959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1a58784-cf4c-436d-b6eb-8cfdf63c8df7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528683700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.838982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1a58784-cf4c-436d-b6eb-8cfdf63c8df7 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1422 microversion: 2.1 time: 0.125997 Oct 28 17:36:55.839606 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1010/2061] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:55.855241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6457c36-eb80-4371-b9ee-e35b34b51faa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '.version_select at 0x7f752866fdc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.874056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:55.882840 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25c0aecc-f78c-4444-9f76-fa0626315d5f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.377718 Oct 28 17:36:55.883970 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1052/2062] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:55.906349 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6457c36-eb80-4371-b9ee-e35b34b51faa tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338595218" status: 204 len: 0 microversion: 2.25 time: 0.065621 Oct 28 17:36:55.911588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1011/2063] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338595218 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:36:55.996034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:55.996996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:56.003830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.004866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.005669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.006619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.007278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.007936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.294239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:56.302871 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3232eca3-64f3-410d-bac8-f575d6fb2477 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.313990 Oct 28 17:36:56.316931 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1053/2064] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:55 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:56.421647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:56.422819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:56.437440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.437892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.438505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.439217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.439839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.440936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.643546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:56.644175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:56.661141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.661828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.670414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.676595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:56.679085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:56.679720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:56.769601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:56.791756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:56.793399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:56.794618 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae5bfc5c-59f9-4fdd-aeaf-d81e1d3135a2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.380406 Oct 28 17:36:56.795510 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1012/2065] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:56 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:56.860624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64f514fc-9a72-4b13-b67c-0c95b0b22493 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528600700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:57.066552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:57.086130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83c838b4-866b-4b52-9449-d19f1247238b tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.443605 Oct 28 17:36:57.094492 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1054/2066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:56 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:36:57.104759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:57.105864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:57.128850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.133348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.136489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.137860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.143950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.144774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.434369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:57.442639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-953ce2a3-67b1-4fc2-9a9f-33ab92e15653 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.346530 Oct 28 17:36:57.448074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1055/2067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:57 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:57.460057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:57.460568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:57.479154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.479682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.480122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.482713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.482713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.482713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.531592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:36:57.669009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d279122a-2be6-49c7-83cd-d4edf75b4a0b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 204 len: 0 microversion: 2.25 time: 0.219892 Oct 28 17:36:57.669613 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1056/2068] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:36:57 2022] DELETE /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:36:57.677003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:57.677771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:57.688117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.688117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.688117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.688117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.688522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.689133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.880195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:57.892939 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-164fc804-a6d2-4773-b5da-108e07aa0e9f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1314 microversion: 2.1 time: 0.221825 Oct 28 17:36:57.894136 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1057/2069] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:57 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:57.900853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48e8b72-0a15-4b2d-86fd-752efa288371", "name": "network-vif-plugged", "status": "completed", "tag": "fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:36:57.915132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.916013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.916592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.933697 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] Creating event network-vif-plugged:fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2 for instance c48e8b72-0a15-4b2d-86fd-752efa288371 on n-h2-860864-13 Oct 28 17:36:57.939706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0593660d-505a-4ade-ba71-8bebd6ac967a req-cae9fe8d-602a-42a2-8f04-d8b9acffacbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043528 Oct 28 17:36:57.941016 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1058/2070] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:36:57.953095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:57.955080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:57.968749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.969810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.970476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:57.972449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:57.974522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:57.976117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:58.416532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:58.429138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:58.430674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:58.432715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9734f466-02f3-416d-98c7-f6586ec2074c tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1549 microversion: 2.25 time: 0.488819 Oct 28 17:36:58.433619 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1059/2071] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:57 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1549 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:58.450941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:58.453813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:58.472047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:58.474790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:58.475744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:58.476515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:58.479280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:58.479775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:59.057876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:59.074125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:59.086050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:59.089087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e05bf6ae-e483-4bb9-9a71-dd15bfdfcf4d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1880 microversion: 2.42 time: 0.654184 Oct 28 17:36:59.110224 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1060/2072] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:36:58 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1880 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:36:59.125272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:59.132333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:59.149429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:59.150629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:59.153923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:59.158161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:59.159223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:59.163750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:59.927362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:36:59.943721 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68534a42-1e4a-4f30-bf18-85fae431afbd tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.822937 Oct 28 17:36:59.946331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1061/2073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:59 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:36:59.959620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:36:59.959620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:36:59.966069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:59.966069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:59.966069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:36:59.966069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:36:59.966731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:36:59.967540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:00.255973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:00.278857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-81f1ebc3-0d1b-49e8-a2a2-2f671722f3d9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.330776 Oct 28 17:37:00.287446 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1062/2074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:36:59 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:00.309189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:00.309948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:00.340327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:00.341076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:00.341550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:00.342599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:00.343912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:00.344389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:00.636320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:00.648497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e193b795-2b5b-4898-984d-cfe66dcd5164 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1502 microversion: 2.1 time: 0.359399 Oct 28 17:37:00.649558 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1063/2075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:00 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:00.678269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67cc7c9-686a-4b98-86b0-a647fc64ca50", "name": "network-vif-unplugged", "status": "completed", "tag": "61cb3323-cfb9-4288-95d9-c547008bfe90"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:00.715790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:00.716283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:00.716718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:00.767087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] Creating event network-vif-unplugged:61cb3323-cfb9-4288-95d9-c547008bfe90 for instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 on n-h2-860864-13 Oct 28 17:37:00.797902 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-61cbf65b-41e8-4198-aa93-695f5164f602 req-5d87fa5c-86e4-4c5e-a946-70bb5a864ef1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137650 Oct 28 17:37:00.802998 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1064/2076] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:00.832695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:00.835994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:00.864295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:00.864721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:00.865343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:00.866103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:00.867874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:00.868944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.053132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.068970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.070820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.072832 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5a14105-0b87-45e7-87b9-a5003d6bfdb2 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 200 len: 1332 microversion: 2.25 time: 0.266238 Oct 28 17:37:01.074155 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1065/2077] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:00 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 1332 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:01.079929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:01.080828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:01.088684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.089483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.090163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.091095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.092237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.092874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.395939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.413931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.415774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.417208 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98d6d4cd-7c2d-456d-8abe-c2d0420ced6c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2837 microversion: 2.42 time: 0.341807 Oct 28 17:37:01.435432 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1066/2078] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:01 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2837 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:01.435647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:01.436069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:01.460891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.461535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.463219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.464078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.464632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.465138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.523996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:01.584173 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a83e7a8-af31-4965-ae43-088b25eb1865 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371/action" status: 202 len: 0 microversion: 2.1 time: 0.162063 Oct 28 17:37:01.588501 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1067/2079] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:01 2022] POST /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:37:01.597483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:01.598280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:01.617138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.617381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.617881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.622399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.622953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.623699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.915814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:01.934325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-093a77bc-5d48-4dc7-8d15-3d55f36146a1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.344303 Oct 28 17:37:01.951396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1068/2080] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:01 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:01.951396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:01.951396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:01.957733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.958248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.958699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:01.961469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:01.962017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:01.962464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.198663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:02.213272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9ed6f2a-235e-4ddd-b092-26bfd607ebb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.276465 Oct 28 17:37:02.214846 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1069/2081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:01 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:02.221290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:02.221787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:02.232697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.233417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.234116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.234854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.235313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.235814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.510391 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-307d81df-520b-4ff9-ba31-4ee93efee3a3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.294364 Oct 28 17:37:02.512451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1070/2082] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:37:02 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f/os-interface => generated 1832 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:02.528482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:02.529136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:02.539478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.542524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.543057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.543923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.544403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.546091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.908669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:02.925685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9d36cec-fb9c-4c08-9f55-d1443df50d82 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1487 microversion: 2.1 time: 0.411985 Oct 28 17:37:02.928185 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1071/2083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:02 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1487 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:02.940035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:02.940654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: 94a4d850-3cbd-494b-93a8-e2002c08f162] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:02.969818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.970612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.971338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:02.979965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:02.980597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:02.982466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.026596 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] HTTP exception thrown: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Request method failure captured: Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 HTTP/1.1 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBE-PBSFusHnD8SgO6aXkkA-j6br-mPakaitolTHWgXJ9MCSY_sW2nW5udfeeFuCpUv_pUL4QtwOYSfcUhkTow5qa53oa_GZGXgMgOg-V-JOr44VdE5iJg2_B-o-HIR2EmchrTA5dRAgOdXx2AQ-OKho4ihAS7tTq3xhz4y1xFsuAk4 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1d985c16d5e341f3a78075917a2a4e9b"}]}] Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5121cf58427a48738ec1c70fbf5e922d Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '94a4d850-3cbd-494b-93a8-e2002c08f162'} Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. Oct 28 17:37:03.028711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Returning 404 to user: Instance 94a4d850-3cbd-494b-93a8-e2002c08f162 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:03.032124 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-292e7f29-3b8c-4193-a488-e82e0c7f91a4 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162" status: 404 len: 111 microversion: 2.25 time: 0.100034 Oct 28 17:37:03.033846 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1072/2084] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:02 2022] GET /compute/v2.1/servers/94a4d850-3cbd-494b-93a8-e2002c08f162 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:37:03.038884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67cc7c9-686a-4b98-86b0-a647fc64ca50", "tag": "61cb3323-cfb9-4288-95d9-c547008bfe90"}, {"server_uuid": "94a4d850-3cbd-494b-93a8-e2002c08f162", "name": "network-vif-deleted", "tag": "956f60b5-83cb-4886-a78c-9ee51eab73e8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:03.062061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.062561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.063162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.103984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Creating event network-changed:61cb3323-cfb9-4288-95d9-c547008bfe90 for instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 on n-h2-860864-13 Oct 28 17:37:03.104886 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] Creating event network-vif-deleted:956f60b5-83cb-4886-a78c-9ee51eab73e8 for instance 94a4d850-3cbd-494b-93a8-e2002c08f162 on n-h1-860864-13 Oct 28 17:37:03.118926 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-185372f0-24c1-4185-9e0e-da2e3ef500db req-67bfb115-e8f4-425d-bbcf-837bbee1930e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084796 Oct 28 17:37:03.119946 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1073/2085] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:03.129326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:03.129982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:03.142187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.142776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.143068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.144355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.145246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.145795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.210883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:03.435012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-694d81e9-44a2-4e9e-b50f-698606b758e3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 204 len: 0 microversion: 2.1 time: 0.312874 Oct 28 17:37:03.439403 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1074/2086] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:03 2022] DELETE /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:03.453027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:03.454788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:03.470375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.473213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.473686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.474588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.478270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.478270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.848344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:03.861668 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-962a03e9-17de-49a5-b46f-ee7d085504d0 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.423018 Oct 28 17:37:03.863805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1075/2087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:03 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:03.889669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:03.890170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:03.898622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.899121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.899642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.900677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:03.901144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:03.901571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:03.936927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:04.097270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-517f0091-c5f3-4c0c-b9b7-4b66329c938e tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 204 len: 0 microversion: 2.25 time: 0.221603 Oct 28 17:37:04.099306 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1076/2088] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:37:03 2022] DELETE /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:37:04.118803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:04.120584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:04.136900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:04.137775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:04.139927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:04.143300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:04.147796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:04.148891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:04.703325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:04.713561 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23785805-9877-4f26-8034-498048d8eba1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.612852 Oct 28 17:37:04.716577 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1077/2089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:04 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:04.728469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:04.731082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:04.747874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:04.755305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:04.756528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:04.757196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:04.757885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:04.758570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:05.142568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:05.155311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba4b9ecc-7627-4056-bc11-13bd32803e3f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1493 microversion: 2.1 time: 0.433616 Oct 28 17:37:05.173092 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1078/2090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:04 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1493 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:05.180041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:05.180041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:05.194209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:05.199189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:05.200692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:05.203399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:05.204135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:05.205993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:06.175114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:06.203888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:06.205475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:06.206718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-816fa627-3207-43a3-bea7-228732b6807b tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1565 microversion: 2.25 time: 1.045041 Oct 28 17:37:06.232338 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1079/2091] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:05 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1565 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:06.232338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "tag": "c672d2c1-310f-453c-871d-9c962f2a558e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:06.263783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:06.264287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:06.264742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:06.314857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] Creating event network-changed:c672d2c1-310f-453c-871d-9c962f2a558e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:37:06.348145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3c3ea646-9630-44c9-a791-4fcd22b7d294 req-fc252611-72da-4673-a147-31dcf6061e66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106427 Oct 28 17:37:06.350663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1080/2092] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:06.380571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:06.381841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:06.402574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:06.408783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:06.413182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:06.416095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:06.418088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:06.421285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:06.437313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:06.775640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=21 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:06.963712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:06.983305 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a671760-267c-4c32-86cc-279577dad800 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.628502 Oct 28 17:37:06.983850 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1081/2093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:06 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:06.996044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:06.996305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:07.032572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.033115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.033562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.037237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.037715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.038160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.390114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:07.395578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:07.407805 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5580ca7-915e-4a71-b790-c31d61ac4c3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.422264 Oct 28 17:37:07.408943 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1082/2094] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:06 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:07.432847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:07.433856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:07.456573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.457440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.458095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.460951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.461945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.467339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.609489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.611465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.612500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.613737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid c48e8b72-0a15-4b2d-86fd-752efa288371 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:37:07.770025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:07.797428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4a23fe85-7c0d-40ee-b2e4-a36052a4c71d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 200 len: 1304 microversion: 2.1 time: 0.379895 Oct 28 17:37:07.800273 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1083/2095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:07 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 1304 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:07.814048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:07.814662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:07.842721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.843405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.845769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.846733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:07.847481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:07.865852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:07.993865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.010466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.015314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.016860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lazy-loading 'fault' on Instance uuid ff8abcba-e8d9-4d0d-920b-29e60391d599 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:37:08.154826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:08.164981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:08.166870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5121cf58427a48738ec1c70fbf5e922d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d985c16d5e341f3a78075917a2a4e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:08.179150 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db0cda0a-33e6-4c04-bcf1-b43f3e038fa6 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 200 len: 1352 microversion: 2.25 time: 0.374183 Oct 28 17:37:08.184928 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1084/2096] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:07 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 1352 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:08.200756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8abcba-e8d9-4d0d-920b-29e60391d599", "name": "network-vif-deleted", "tag": "90bb83c2-c8ff-43a5-ad60-21f4062a8587"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:08.257254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.257685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.258123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.285769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] Creating event network-vif-deleted:90bb83c2-c8ff-43a5-ad60-21f4062a8587 for instance ff8abcba-e8d9-4d0d-920b-29e60391d599 on n-h1-860864-13 Oct 28 17:37:08.294933 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8e1f753c-8b3f-402c-b510-d85ac763a2b3 req-42b78222-b40b-442c-a7e9-4a571a1bedfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108706 Oct 28 17:37:08.295816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1085/2097] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:08.314465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:08.315427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:08.318607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:08.347235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.347778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.348223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.349465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.349903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.355244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.645930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:08.654760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c79d5a1e-23b7-40c2-9976-22922a6e08f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.357589 Oct 28 17:37:08.655362 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1086/2098] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:08 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:08.668412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48e8b72-0a15-4b2d-86fd-752efa288371", "name": "network-vif-deleted", "tag": "fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:08.704274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.706807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.707507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.747780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] Creating event network-vif-deleted:fb2c8e89-3fe4-4f5e-b2ba-55ff87b377f2 for instance c48e8b72-0a15-4b2d-86fd-752efa288371 on n-h2-860864-13 Oct 28 17:37:08.761755 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6723ecb2-bf7d-476d-a564-df6f841bea4a req-96721f8e-f45e-490d-bf11-8cd7dfad7ccd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104981 Oct 28 17:37:08.766597 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1087/2099] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:08.779601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:08.780236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:08.796523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.799471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.800393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:08.801127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:08.802772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:08.806461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:09.115104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:09.127378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d97226c9-c09f-4242-98e5-92d4bf5f7603 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.358472 Oct 28 17:37:09.128354 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1088/2100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:08 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:09.133710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:09.150669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:09.161002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:09.161674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:09.162124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:09.162839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:09.163296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:09.163755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:09.198807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 HTTP/1.1 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c48e8b72-0a15-4b2d-86fd-752efa288371'} Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:09.204183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.207332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:09.209314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6396f0b-d667-4292-93da-e380822833d8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 404 len: 111 microversion: 2.1 time: 0.079719 Oct 28 17:37:09.228114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1089/2101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:09 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:37:09.259660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:09.260448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] [instance: ff8abcba-e8d9-4d0d-920b-29e60391d599] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:09.275985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:09.276615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:09.278714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:09.280361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:09.280835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:09.281304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:09.327186 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] HTTP exception thrown: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Request method failure captured: Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 HTTP/1.1 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBE-PBSFusHnD8SgO6aXkkA-j6br-mPakaitolTHWgXJ9MCSY_sW2nW5udfeeFuCpUv_pUL4QtwOYSfcUhkTow5qa53oa_GZGXgMgOg-V-JOr44VdE5iJg2_B-o-HIR2EmchrTA5dRAgOdXx2AQ-OKho4ihAS7tTq3xhz4y1xFsuAk4 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1d985c16d5e341f3a78075917a2a4e9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1d985c16d5e341f3a78075917a2a4e9b"}]}] Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1d985c16d5e341f3a78075917a2a4e9b Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100 Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5121cf58427a48738ec1c70fbf5e922d Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2093045100-project Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ff8abcba-e8d9-4d0d-920b-29e60391d599'} Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. Oct 28 17:37:09.328852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] Returning 404 to user: Instance ff8abcba-e8d9-4d0d-920b-29e60391d599 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:09.332168 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfb7252a-9db8-46ef-af19-6d7ecafabbf9 tempest-LiveAutoBlockMigrationV225Test-2093045100 tempest-LiveAutoBlockMigrationV225Test-2093045100-project] 10.222.0.48 "GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599" status: 404 len: 111 microversion: 2.25 time: 0.101031 Oct 28 17:37:09.335987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1090/2102] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:09 2022] GET /compute/v2.1/servers/ff8abcba-e8d9-4d0d-920b-29e60391d599 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:37:09.365757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-8865713", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:10.838506 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64f514fc-9a72-4b13-b67c-0c95b0b22493 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1431 microversion: 2.1 time: 13.982579 Oct 28 17:37:10.849972 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1013/2103] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:36:56 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1431 bytes in 13995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:10.858988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:10.859854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:10.869305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:10.870462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:37:10.871466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:10.873474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:10.874902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:10.876207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:10.876648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:11.249010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:11.258154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aeb3a459-76bd-468c-9850-ca88f964f40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.407057 Oct 28 17:37:11.260061 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1014/2104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:10 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:11.270739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:11.273253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:11.286783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:11.289353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:11.290587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:11.292364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:11.294308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:11.295641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:11.898886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:11.912331 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2829bfd9-14ee-4296-8123-295e62eb822e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.650183 Oct 28 17:37:11.931475 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1015/2105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:11 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:11.939619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-754b8554-280d-4ca5-809f-ebddc120fe8f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752863c280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.021232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-754b8554-280d-4ca5-809f-ebddc120fe8f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 200 len: 1431 microversion: 2.1 time: 0.088512 Oct 28 17:37:12.032665 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1016/2106] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:11 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 1431 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:12.038549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.039223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:12.049348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.049971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.050413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.051140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.052408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.052816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.403292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:37:12.404568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:37:12.405246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:37:12.405950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:37:12.406511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:37:12.418055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.418817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.419427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.420330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.420936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.421691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.424754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:12.445067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:37:12.447609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d47ee50e-5071-4808-b804-712b95640ec2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1466 microversion: 2.1 time: 0.411538 Oct 28 17:37:12.453277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:37:12.466368 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1017/2107] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:12.469705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:37:12.480650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:37:12.481257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.483299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:12.503203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.505430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.505960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.508162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.509260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.511071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.571634 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3144d03a-b10c-4051-95cf-0b240b369c48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.233313 Oct 28 17:37:12.579582 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1091/2108] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:37:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:37:12.584763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f22651ae-2f77-4023-9ab5-1f96e3333c17 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f751faf7040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.641335 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f22651ae-2f77-4023-9ab5-1f96e3333c17 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6" status: 200 len: 784 microversion: 2.1 time: 0.060384 Oct 28 17:37:12.642161 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1092/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/images/4f7274c7-779f-4acb-8077-345620e4cdc6 => generated 784 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:12.647891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe77d321-6ad6-498e-8eb3-816f70789b55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.648674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe77d321-6ad6-498e-8eb3-816f70789b55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:12.742700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe77d321-6ad6-498e-8eb3-816f70789b55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:12.752489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe77d321-6ad6-498e-8eb3-816f70789b55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1212 microversion: 2.1 time: 0.108964 Oct 28 17:37:12.756919 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1093/2110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1212 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:12.768655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ff1be96-8be7-457e-a396-ad4904cd53a6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.795136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ff1be96-8be7-457e-a396-ad4904cd53a6 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036014 Oct 28 17:37:12.795763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1094/2111] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:12.825519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-539c0cf1-de85-45a7-9b56-12ee80a40a59 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752469c940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.895804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:12.909608 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f3d56b7-8603-418b-a7dc-2e277225fbf7 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1391 microversion: 2.1 time: 0.441583 Oct 28 17:37:12.910463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1018/2112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:12.938521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:12.939399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:12.954103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.954643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.955490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:12.956376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:12.957079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:12.957636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:13.299095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:13.313230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48ed6d0e-c3dc-4ae6-9f44-4abd70c5a527 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1476 microversion: 2.1 time: 0.377331 Oct 28 17:37:13.316095 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1019/2113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:12 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:13.557942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-539c0cf1-de85-45a7-9b56-12ee80a40a59 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "DELETE /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 204 len: 0 microversion: 2.1 time: 0.747350 Oct 28 17:37:13.567829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-314031de-abe4-4c18-9879-f60f9312bf45 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528600af0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:13.568028 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1095/2114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:12 2022] DELETE /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:13.600430 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-314031de-abe4-4c18-9879-f60f9312bf45 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] HTTP exception thrown: Image not found. Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-314031de-abe4-4c18-9879-f60f9312bf45 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Request method failure captured: Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 HTTP/1.1 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBMWIlK93YZxMafWoaXr4LHkM7mE3QT7ubHb_-6lx4z3KIWlDzVxxYLwZPehb61dG09RkLlNNc-_-WzoKzo-q23-1gzOXwUuUBa5BZQ3GR49JZ9zMavb_Dqxn3anyzybiCTEY_zL2_ilatKAA8rpXAAr05lzfFzJWBc7MA-IcX3o1c4 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_378bcb819bd14593866269c06c978f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/378bcb819bd14593866269c06c978f53"}]}] Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 3106807274604bfe86b924a6d4aa70b1 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0'} Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:37:13.604631 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 could not be found. Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-314031de-abe4-4c18-9879-f60f9312bf45 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-314031de-abe4-4c18-9879-f60f9312bf45 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 404 len: 62 microversion: 2.1 time: 0.042716 Oct 28 17:37:13.608595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1020/2115] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:13 2022] GET /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:37:13.618711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1083180463"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:13.621797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:13.628412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:13.628907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:13.629340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:13.634429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:13.635125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:13.635748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:13.792634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:13.793684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:13.820303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:13.823915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:13.826512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:13.835150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:13.838782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:13.839533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:13.972290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:13.981880 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00e2f0a7-0c5b-484c-8fbd-78cb776ed3a5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1264 microversion: 2.1 time: 0.200307 Oct 28 17:37:13.998379 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1021/2116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:13 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.019879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.020543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:14.039387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.041131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.041778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.043563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.044342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.044981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.134993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c96afa8-d699-4fca-bead-412656281486 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "POST /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f/action" status: 202 len: 0 microversion: 2.1 time: 0.519922 Oct 28 17:37:14.142496 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1096/2117] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:13 2022] POST /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:37:14.148300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.152236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:14.173615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.174110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.174542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.175244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.175923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.177134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.329963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:14.344629 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-abb9647f-e9b3-441f-9c8d-4281f715573a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.340469 Oct 28 17:37:14.346150 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1022/2118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:13 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.351669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d093224c-7a69-466b-853d-81c8aa42d6d8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752429d550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.384753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:14.402456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b67f7f5-00e9-4a49-8f2e-b6d900f4ab51 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1381 microversion: 2.1 time: 0.258164 Oct 28 17:37:14.403459 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1097/2119] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:14 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1381 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.416513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.417165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:14.424227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.424766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.425203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.425995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.426452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.426876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.452688 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d093224c-7a69-466b-853d-81c8aa42d6d8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.103718 Oct 28 17:37:14.455402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1023/2120] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:14 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.463605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1926290171"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:14.468839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:14.476598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.478117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.478572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.480524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.481149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.481928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.701085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:14.716679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-84d967fd-fbaa-458d-8eff-86205b17959c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1475 microversion: 2.1 time: 0.309937 Oct 28 17:37:14.718716 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1098/2121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:14 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.731555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffff8660-8a76-40f7-aa25-0e33af6d0582 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '.version_select at 0x7f75248cbee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.741856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffff8660-8a76-40f7-aa25-0e33af6d0582 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.746472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffff8660-8a76-40f7-aa25-0e33af6d0582 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.746989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffff8660-8a76-40f7-aa25-0e33af6d0582 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.765194 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffff8660-8a76-40f7-aa25-0e33af6d0582 tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2366 microversion: 2.1 time: 0.043900 Oct 28 17:37:14.766359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1099/2122] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:37:14 2022] GET /compute/v2.1/os-migrations => generated 2366 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:14.785338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:14.786199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:14.795500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.799410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.800097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.801021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:14.801658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:14.802412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:14.883463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b368f7f3-ded2-435f-9b7a-432fc43cf138 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.426457 Oct 28 17:37:14.887652 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1024/2123] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:14 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 17:37:15.006840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:15.007849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:15.019333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.020227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.020877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.021799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.022435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.023249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.103176 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30f318a9-63a7-4a04-8c3f-81ccfec7a30f tempest-LiveMigrationTest-403666865 tempest-LiveMigrationTest-403666865-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1534 microversion: 2.1 time: 0.322605 Oct 28 17:37:15.104463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1100/2124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:14 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1534 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:15.127890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:15.148573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:15.150133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:15.156287 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67c04cb3-5650-4302-a3ce-c6323599c10f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1270 microversion: 2.1 time: 0.153264 Oct 28 17:37:15.157113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1025/2125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:15 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:15.169725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.170316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.170758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.184378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.185304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.185940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.228942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:15.281249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-unplugged", "status": "completed", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:15.299135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.299547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.304441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.341647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] Creating event network-vif-unplugged:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:37:15.354129 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8d19f4ec-a0d6-4d6e-87ef-fe2e856044fe req-855d4e7d-f8da-4486-8f02-9c695f879ddb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077325 Oct 28 17:37:15.380566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1026/2126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:15.436377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ecd9fdf-354a-4216-b2ef-37849cf23efc tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 204 len: 0 microversion: 2.1 time: 0.291946 Oct 28 17:37:15.440435 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1101/2127] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:15 2022] DELETE /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:15.469277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:15.471355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:15.478719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddffc4f0-9422-45ff-86b4-c3f09929edf2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f751faf7820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:15.496088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.496576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.497398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.498153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.498600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.499228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.589762 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddffc4f0-9422-45ff-86b4-c3f09929edf2 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.117271 Oct 28 17:37:15.590830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1102/2128] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:15 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:15.747398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:15.748214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:15.760522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.765017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.767943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.768877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.770013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.771470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.807118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:15.815490 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5209b78-9915-4f3b-933d-1b875136be0a tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1387 microversion: 2.1 time: 0.369248 Oct 28 17:37:15.832551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1027/2129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:15 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1387 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:15.904600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "name": "network-vif-unplugged", "status": "completed", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:15.918717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:15.919315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:15.919892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:15.942934 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Creating event network-vif-unplugged:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h2-860864-13 Oct 28 17:37:15.955009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:37:15.980401 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-06450a2d-171b-47eb-99b7-169975fcf69e req-2a6a78aa-a3ff-4050-8679-eda9328aefe4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090997 Oct 28 17:37:15.980773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:15.982009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1028/2130] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:15.989371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45ed8ad2-7e36-4ba2-a47c-5c4db2ec268a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1475 microversion: 2.1 time: 0.250887 Oct 28 17:37:15.989961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1103/2131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:15 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:16.192415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:16.193334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:16.201768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:16.202412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:16.203030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:16.204077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:16.204539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:16.204964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:16.505171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:16.514618 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe8604bc-4e91-434a-8b5e-e6cb57a034c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.326910 Oct 28 17:37:16.515214 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1029/2132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:16 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:16.608434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-174f1cd9-7959-4ae5-85a1-d6dba14dc324 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f751fac6550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:16.725071 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-174f1cd9-7959-4ae5-85a1-d6dba14dc324 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.122611 Oct 28 17:37:16.732560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1104/2133] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:16 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:16.842622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:16.843240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:16.864871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:16.865438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:16.866068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:16.869956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:16.870614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:16.871042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.016175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:17.017659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:17.031763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:17.032587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:17.034698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.035728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:17.036413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:17.037057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.370432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:17.380826 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbdeb65d-ff76-43d8-a9bf-a42274f0bc41 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1387 microversion: 2.1 time: 0.542264 Oct 28 17:37:17.381812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1030/2134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:16 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1387 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:17.414940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:17.418015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:17.428043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed10bd03-1c46-450e-80ad-e202e635f2ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1475 microversion: 2.1 time: 0.416164 Oct 28 17:37:17.434013 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1105/2135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:17 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1475 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:17.537778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:17.538490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:17.564786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:17.565456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:17.566203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.567278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:17.568078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:17.568664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.661566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbbdee1b-247b-4d3b-808f-0848600dcf6c", "tag": "0e6eb9b0-25d6-41ad-930a-84e9821eee05"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:17.679531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:17.684053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:17.684773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:17.717075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] Creating event network-changed:0e6eb9b0-25d6-41ad-930a-84e9821eee05 for instance dbbdee1b-247b-4d3b-808f-0848600dcf6c on n-h2-860864-13 Oct 28 17:37:17.724133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-23360a17-27a4-4053-b664-7b7f51300470 req-aced47e9-e1fe-43a0-8b08-63552760ccc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072279 Oct 28 17:37:17.725390 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1106/2136] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:17.749462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6b043a0-dc7e-488c-a7c5-94ab1d77f641 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752869a310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:17.802745 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6b043a0-dc7e-488c-a7c5-94ab1d77f641 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.059924 Oct 28 17:37:17.812671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1107/2137] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:17 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:17.979030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:17.991120 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d7d2cc4-e711-46b3-a8ad-99d3236cf46e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.456096 Oct 28 17:37:17.992760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1031/2138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:17 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:18.028350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}, {"server_uuid": "d67cc7c9-686a-4b98-86b0-a647fc64ca50", "name": "network-vif-deleted", "tag": "61cb3323-cfb9-4288-95d9-c547008bfe90"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:18.060081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.061275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.065972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.082885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Creating event network-changed:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h2-860864-13 Oct 28 17:37:18.083532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Creating event network-vif-deleted:61cb3323-cfb9-4288-95d9-c547008bfe90 for instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 on n-h1-860864-13 Oct 28 17:37:18.090496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:37:18.103529 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-705ec84d-2e18-4c4e-8fb9-64a22020c9e1 req-01080994-a403-4073-a8eb-0aca9f5c6c90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084564 Oct 28 17:37:18.104156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1108/2139] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:18.406604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:18.408067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:18.417167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.418029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.418724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.419702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.420574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.421211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.453976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:18.455417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:18.462781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.463572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.464188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.465146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.466296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.467149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.547831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:18.557594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c74cbd06-ff6a-4387-9f9a-a4241c0fe56d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1183 microversion: 2.1 time: 0.155509 Oct 28 17:37:18.578253 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1032/2140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:18 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:18.700877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:18.709517 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6463c72-5acb-4382-aa7a-2e68091b488b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.260031 Oct 28 17:37:18.711089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1109/2141] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:18 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:18.823292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17cbbd51-d9b9-4b21-bd25-8e850f1ae64d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75241f9430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:18.857446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-unplugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:18.874597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:18.875530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:18.876432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:18.894366 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17cbbd51-d9b9-4b21-bd25-8e850f1ae64d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.077893 Oct 28 17:37:18.902945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1033/2142] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:18 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:18.905773 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] Creating event network-vif-unplugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:37:18.912469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7ebdad3e-087f-43d6-82a5-c9def7dc66e6 req-f552ed5d-89ad-47aa-bd6c-54b0c0f3fa4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062052 Oct 28 17:37:18.913533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1110/2143] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:19.021196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:19.021808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:19.029105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.029730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.030171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.031064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.031554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.031985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.040383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:19.245407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:19.254641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-07da5a29-3c8b-4e10-a964-44c523e19c32 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.237538 Oct 28 17:37:19.271402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1034/2144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:19 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:19.588710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:19.590144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:19.611027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.611596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.612046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.612783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.613246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.613681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.716546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:19.727684 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffa396b9-0ee0-470f-b212-3e239e7e1b57 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1183 microversion: 2.1 time: 0.147155 Oct 28 17:37:19.728868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1111/2145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:19 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:19.736299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:19.736909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:19.752388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.752925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.753536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.754422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:19.755028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:19.755627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:19.910933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a78517c6-1af8-457e-81af-5a99cd372c50 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75246540d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:19.915325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:19.925426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0311cef2-33b7-4350-ae9b-a0d904ce1874 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.192861 Oct 28 17:37:19.926753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1035/2146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:19 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:19.971995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a78517c6-1af8-457e-81af-5a99cd372c50 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.065710 Oct 28 17:37:19.982368 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1112/2147] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:19 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:20.281057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:20.284359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:20.300234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.301177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.301792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.302671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.303272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.303872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.504395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:20.516933 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b5ab393-65f8-4b2b-b04b-52801f40d49e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.242553 Oct 28 17:37:20.527460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1036/2148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:20 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:20.756116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:20.757368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:20.771359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.771775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.772380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.773980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.775073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.775886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.924060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:20.936031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff4058da-1279-4455-aa16-475c83cfcb07 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1183 microversion: 2.1 time: 0.186970 Oct 28 17:37:20.937182 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1113/2149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:20 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:20.959096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:20.960293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:20.972028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.974077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.976230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.977177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:20.978601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:20.979932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:20.988972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16e8fde8-7257-4971-b2c8-50e12da93704 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75240651f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:21.057822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16e8fde8-7257-4971-b2c8-50e12da93704 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.073503 Oct 28 17:37:21.058415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1114/2150] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:20 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:21.266502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:21.279946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2844de70-04ef-42d3-ae82-4dbd0424b085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.330661 Oct 28 17:37:21.292751 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1037/2151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:20 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:21.506583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-plugged", "status": "completed", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:21.528447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:21.529403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:21.530106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:21.544003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:21.545022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:21.548600 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] Creating event network-vif-plugged:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:37:21.552200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:21.553056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:21.553672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:21.554675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:21.556061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:21.556227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d3954f86-8a6f-4c6b-9b54-f51230f8dc0c req-16c13784-981d-48a8-b35b-4728c35e1c99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053205 Oct 28 17:37:21.556804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:21.557517 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1115/2152] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:21.749270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:21.758883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6624ac5f-fb43-43cb-bd4b-e89597166207 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.220749 Oct 28 17:37:21.774284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1038/2153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:21 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:21.973847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:21.976743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:21.985869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:21.986572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:21.987176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:21.988667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:21.989274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:21.989846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:22.075107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f963cb67-f77e-45b5-9c70-e100a4b6afd1 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528619670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:22.076646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:22.092318 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2aca7405-2f3d-451f-8537-406186f0da53 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1183 microversion: 2.1 time: 0.128121 Oct 28 17:37:22.095912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1116/2154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:21 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:22.156510 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f963cb67-f77e-45b5-9c70-e100a4b6afd1 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.086594 Oct 28 17:37:22.157594 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1039/2155] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:22 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:22.308449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:22.309560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:22.317429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:22.318240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:22.318890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:22.319957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:22.321817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:22.322693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:22.436049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:22.565121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:22.594160 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-761b3b69-1881-4fbd-92b5-b3bfcd4e51b0 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.290325 Oct 28 17:37:22.595223 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1117/2156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:22 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:22.782819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:22.783473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:22.808284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:22.809026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:22.809552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:22.811680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:22.812272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:22.813647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.119736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:23.120951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:23.126498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:23.129827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.130507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.131128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.132038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.132835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.133782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.180799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.181524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.182117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.182752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lazy-loading 'fault' on Instance uuid d67cc7c9-686a-4b98-86b0-a647fc64ca50 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:37:23.372014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:23.382341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-47093063-6633-485d-8120-8c729f272e1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.604236 Oct 28 17:37:23.383059 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1040/2157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:22 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:23.388493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b59c8117-1b7f-42b0-92e3-7c912e7ff638 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752862b8b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:23.416807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:23.424872 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38b68ef9-c6ac-4b9d-9640-870605e1f633 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 200 len: 1142 microversion: 2.1 time: 0.309840 Oct 28 17:37:23.435422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1118/2158] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:23 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 1142 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:23.437299 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b59c8117-1b7f-42b0-92e3-7c912e7ff638 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.052159 Oct 28 17:37:23.437886 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1041/2159] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:23 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:23.576487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-plugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:23.587242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.587740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.588438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.604931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] Creating event network-vif-plugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:37:23.610787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1f450790-e1cf-423f-b4b3-74a5481b3196 req-a79c7e3c-07d8-403f-bec9-824743fb7625 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037805 Oct 28 17:37:23.611885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1119/2160] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:23.629845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:23.630559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:23.643189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.643717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.644158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.644879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:23.648461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:23.651444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:23.833372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:23.852616 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6020b07b-c51d-4ece-9bf9-dd655421737a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.225317 Oct 28 17:37:23.853892 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1042/2161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:23 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:24.408094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:24.410603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:24.419628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.420361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.420996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:24.421981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.422742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.423317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:24.451249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:24.452059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: d67cc7c9-686a-4b98-86b0-a647fc64ca50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:24.465452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.467525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.467989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:24.468709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.470223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.470851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:24.497725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] HTTP exception thrown: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Request method failure captured: Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 HTTP/1.1 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFj_Egm693cvD569-zyyCf6WcP0smS8jIyuQcpseP0o9uScXHgU7AFxL-gX_F9aP8U_ov4Nee-MzKH1Lt2tjlubdeC6LVhY94Fy-1INDvRo3bEXBDn6ALmGoJ-XuYJVwCyDGmRm5DY_ZsBFcnU75V9pmWbyyYBONIFd8JgNI2sx82I Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4745f00281fc4cce985160599bcae8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4745f00281fc4cce985160599bcae8ca"}]}] Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-LiveMigrationTest-106709088 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b5dbc2c295144accbd4d508afb066b03 Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'd67cc7c9-686a-4b98-86b0-a647fc64ca50'} Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:24.504472 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. Oct 28 17:37:24.509022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:24.511237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Returning 404 to user: Instance d67cc7c9-686a-4b98-86b0-a647fc64ca50 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:24.515079 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12840285-1c17-4343-8da8-1270ee015f69 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50" status: 404 len: 111 microversion: 2.1 time: 0.068196 Oct 28 17:37:24.516148 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1043/2162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:24 2022] GET /compute/v2.1/servers/d67cc7c9-686a-4b98-86b0-a647fc64ca50 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:37:24.538962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc347fc2-f351-40d3-8a0c-0afc8a3c951f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528619160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:24.606072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:24.611621 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc347fc2-f351-40d3-8a0c-0afc8a3c951f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.092705 Oct 28 17:37:24.612822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1044/2163] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:24 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:24.616701 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6daa0599-f0c6-4419-937a-bdcce4404ec2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.213874 Oct 28 17:37:24.617340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1120/2164] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:24 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:24.876912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:24.877528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:24.890672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.892013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.892474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:24.893211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:24.893669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:24.894107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:25.179339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:25.190206 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13067708-cf24-4e55-a0ff-96d4c67f1d25 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1473 microversion: 2.1 time: 0.317536 Oct 28 17:37:25.192615 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1045/2165] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:24 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:25.628729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8bdea9fa-16ae-4692-b27b-f99fb704b281 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752424fb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:25.650510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:25.651231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:25.679297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:25.680817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:25.682794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:25.685724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:25.689674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:25.690503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:25.746920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8bdea9fa-16ae-4692-b27b-f99fb704b281 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.122044 Oct 28 17:37:25.749960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1121/2166] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:25 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:26.220999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:26.221633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:26.230041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:26.230537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:26.230974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:26.231720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:26.232179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:26.253921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:26.424429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:26.435918 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8645e013-b691-4343-a03c-090b222b6bdf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.795515 Oct 28 17:37:26.442241 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1046/2167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:25 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:26.764843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4dfcd822-c3ff-4c23-8884-46c172347cef tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528619160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:26.857934 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4dfcd822-c3ff-4c23-8884-46c172347cef tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.097223 Oct 28 17:37:26.864112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1047/2168] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:26 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:26.893051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:26.907808 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4da3f31f-4b87-4eae-a7ff-72b94ce87729 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1470 microversion: 2.1 time: 0.688071 Oct 28 17:37:26.910774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1122/2169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:26 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1470 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:26.952752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:26.955777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:26.964189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:26.964999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:26.965680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:26.966656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:26.967683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:26.968438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:27.147448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e258fd66-1a1c-43d6-ad60-bc2f83bc3b52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f/action" status: 204 len: 0 microversion: 2.1 time: 0.205590 Oct 28 17:37:27.150599 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1048/2170] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:26 2022] POST /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f/action => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:37:27.162533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:27.163190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:27.185051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:27.185576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:27.186039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:27.186765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:27.187222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:27.195112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:27.470947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:27.471767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:27.486482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:27.487002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:27.487494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:27.493775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:27.495554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:27.496113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:27.502195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:27.512419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d810642-1db4-4de4-9517-42c7ae5f9e52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1470 microversion: 2.1 time: 0.355977 Oct 28 17:37:27.529277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1123/2171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:27 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:27.816564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:27.828480 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fe1dd61-f570-439e-ad3e-25041b2cd80a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.363601 Oct 28 17:37:27.847747 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1049/2172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:27 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:27.875164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64a14f8a-f752-410d-b6d5-e5888edd9543 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524572ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:27.980686 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64a14f8a-f752-410d-b6d5-e5888edd9543 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.109813 Oct 28 17:37:27.991823 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1124/2173] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:27 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:28.538650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:28.540248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:28.556441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:28.557182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:28.561120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:28.564192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:28.567411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:28.568266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:28.860897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:28.862723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:28.892162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:28.909350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:28.911845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:28.914596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:28.916192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:28.917656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:28.961672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:28.992277 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9828af89-91bf-435e-b4a8-d55cbd43b3f8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1470 microversion: 2.1 time: 0.452517 Oct 28 17:37:29.016303 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1050/2174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:28 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:29.031304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e649d1f-c080-49f3-8b37-a7becac24e60 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752862a040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:29.136969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e649d1f-c080-49f3-8b37-a7becac24e60 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.119204 Oct 28 17:37:29.137608 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1051/2175] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:29 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:29.452801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:29.464353 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af421622-f422-49f0-ba91-9fe75b89778f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.613727 Oct 28 17:37:29.467834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1125/2176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:28 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:30.027443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:30.029510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:30.049236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.053287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.054209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.055791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.058592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.059284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.156749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6fb064e-73e8-4726-86e3-4c51b0ae047f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524c629d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:30.271994 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6fb064e-73e8-4726-86e3-4c51b0ae047f tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.121133 Oct 28 17:37:30.284488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1126/2177] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:30 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:30.333109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:30.333613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:30.369588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.370221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.376769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.378622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.380235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.381470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.386302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:30.400723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0bb61e0-1a9e-4d78-949b-65103dd08142 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1470 microversion: 2.1 time: 0.380344 Oct 28 17:37:30.406626 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1052/2178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:30 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:30.457066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:30.493950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:30.494752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:30.509544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.511752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.512457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.513933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.516703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.517378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.669516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2dd708e4-b389-4645-aec5-439536b45820 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 204 len: 0 microversion: 2.1 time: 0.343003 Oct 28 17:37:30.674087 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1127/2179] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:30 2022] DELETE /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:30.688789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:30.689846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:30.710988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.714390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.715348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.716605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:30.721625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:30.723160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:30.893447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:30.903953 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f18fa8b7-9979-4e75-a7ff-e440fc39afc5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.415306 Oct 28 17:37:30.908116 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1053/2180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:30 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:30.959789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:30.970123 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-adebe86f-6616-4adf-bbc7-56b7eefd68f6 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1669 microversion: 2.1 time: 0.294528 Oct 28 17:37:30.971290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1128/2181] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:30 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:31.291218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1927db49-8a44-4432-b17a-6f8bd6e2f1c4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752862a3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:31.402774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1927db49-8a44-4432-b17a-6f8bd6e2f1c4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.115901 Oct 28 17:37:31.411911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1054/2182] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:31 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:31.434800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:31.435651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:31.455820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.458609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.461231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:31.462327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.465125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.465759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:31.506095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:31.740108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:31.750487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44a02dca-0779-400c-83cb-052a076a9b0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1462 microversion: 2.1 time: 0.324844 Oct 28 17:37:31.751620 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1129/2183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:31 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:31.786299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:31.787254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:31.805532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.807099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.807607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:31.809614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.810156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.810610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:31.942053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:31.942778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:31.970623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.972009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.973985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:31.978380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:31.980224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:31.982749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:32.296548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:32.330707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d15efb29-0e74-4e99-b43f-f8c38e6bb74c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1462 microversion: 2.1 time: 0.556987 Oct 28 17:37:32.333823 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1055/2184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:31 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1462 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:32.345738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:32.348612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:32.362758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:32.365585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:32.366896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:32.370391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:32.371125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:32.371802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:32.406630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:32.434478 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6203e9ab-12d7-42e8-ba31-3940c334f910 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.497411 Oct 28 17:37:32.434478 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1130/2185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:31 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:32.448966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:32.464332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "name": "network-vif-plugged", "status": "completed", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:32.491047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:32.491584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:32.494583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:32.549227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] Creating event network-vif-plugged:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h2-860864-13 Oct 28 17:37:32.566202 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-23bdff29-6206-4c1f-8d90-c6a021174e36 req-59cd037e-e36f-4d99-981f-44766fb39e6d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129071 Oct 28 17:37:32.567458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1131/2186] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:32.589417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da041202-2e82-4bec-9258-f7b801189743 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'create', calling method: .version_select at 0x7f7524137ee0>, body: {"keypair": {"name": "tempest-keypair-196641540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvCnU+1bc/1wuGAARSsUUdk6oviCEHnZRcKS15tq/E18I52Fe1ekYgEZ7x09U1pVbqMNC7q02uDWdbT1ct5hQIcYA52oyUyPZkP7cLqu7BExUAlT1t4Yk8EXlcEiwsegw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:32.609115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:32.636387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-da041202-2e82-4bec-9258-f7b801189743 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:37:32.643126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-da041202-2e82-4bec-9258-f7b801189743 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:37:32.717064 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da041202-2e82-4bec-9258-f7b801189743 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146534 Oct 28 17:37:32.719305 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1132/2187] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:37:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:32.725716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c16bd973-0301-4214-a8a8-48c902133e81 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75248e3700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:32.786629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:32.812165 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dccbe7b9-0bbf-4798-90cb-02b134a4800c tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1669 microversion: 2.1 time: 0.462473 Oct 28 17:37:32.813029 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1056/2188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:32 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:32.818895 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c16bd973-0301-4214-a8a8-48c902133e81 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.098198 Oct 28 17:37:32.831777 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1133/2189] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:32 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:33.465962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:33.466787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:33.505483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:33.505983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:33.510562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:33.511819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:33.512299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:33.512736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:33.834106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c51ef90-58e2-4239-b016-468c9263f4f8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524654160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:34.084098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:34.093615 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-96263166-587b-4cf1-a996-87cb160b937e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.633920 Oct 28 17:37:34.099319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1057/2190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:33 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:34.124342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:34.129567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:34.154189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:34.154698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:34.155138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:34.155922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:34.156848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:34.170158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:34.397628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:34.416890 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7ca6087-d8a2-478c-ac4e-280609aadecf tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 200 len: 1601 microversion: 2.1 time: 0.316530 Oct 28 17:37:34.418869 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1058/2191] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:34 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 1601 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:34.437096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9296eac6-dd58-4654-adce-1d025ea51036", "name": "network-vif-deleted", "tag": "61b622d3-8809-4e93-91f0-94f85c8849bb"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:34.510917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:34.511716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:34.512114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:34.551507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] Creating event network-vif-deleted:61b622d3-8809-4e93-91f0-94f85c8849bb for instance 9296eac6-dd58-4654-adce-1d025ea51036 on n-h1-860864-13 Oct 28 17:37:34.570626 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fc0a505f-79f5-4069-b4c1-9cbebf102c1b req-dd32960e-ac37-459d-b0c8-18d13dde7d64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149501 Oct 28 17:37:34.583744 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1059/2192] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:35.122833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:35.123606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:35.137175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:35.137742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:35.138203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:35.138977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:35.139485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:35.143766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:36.008111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:36.019004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f717d54d-2f7b-468d-8be7-cdcda399420d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 0.901002 Oct 28 17:37:36.025756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1060/2193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:35 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:36.039493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:36.049136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9296eac6-dd58-4654-adce-1d025ea51036] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:36.070232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:36.075221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:36.076389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:36.077763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:36.080163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:36.080787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:36.142033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] HTTP exception thrown: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Request method failure captured: Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 HTTP/1.1 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBFj_Egm693cvD569-zyyCf6WcP0smS8jIyuQcpseP0o9uScXHgU7AFxL-gX_F9aP8U_ov4Nee-MzKH1Lt2tjlubdeC6LVhY94Fy-1INDvRo3bEXBDn6ALmGoJ-XuYJVwCyDGmRm5DY_ZsBFcnU75V9pmWbyyYBONIFd8JgNI2sx82I Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4745f00281fc4cce985160599bcae8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4745f00281fc4cce985160599bcae8ca"}]}] Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-LiveMigrationTest-106709088 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b5dbc2c295144accbd4d508afb066b03 Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '9296eac6-dd58-4654-adce-1d025ea51036'} Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:36.150889 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. Oct 28 17:37:36.155400 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:37:36.158722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Returning 404 to user: Instance 9296eac6-dd58-4654-adce-1d025ea51036 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:36.163619 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-684d672f-84f2-4087-9903-151763793a89 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036" status: 404 len: 111 microversion: 2.1 time: 0.125684 Oct 28 17:37:36.164402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1061/2194] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:36 2022] GET /compute/v2.1/servers/9296eac6-dd58-4654-adce-1d025ea51036 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:37:36.189526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79864a35-1218-4c6b-9733-28a62a83f4e3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '.version_select at 0x7f75286143a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:36.249075 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79864a35-1218-4c6b-9733-28a62a83f4e3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474853975" status: 202 len: 0 microversion: 2.1 time: 0.077631 Oct 28 17:37:36.250293 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1062/2195] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:37:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474853975 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:37:36.555136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbdee1b-247b-4d3b-808f-0848600dcf6c", "name": "network-vif-plugged", "status": "completed", "tag": "0e6eb9b0-25d6-41ad-930a-84e9821eee05"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:36.595927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:36.600778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:36.601832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:36.605910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:36.646948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] Creating event network-vif-plugged:0e6eb9b0-25d6-41ad-930a-84e9821eee05 for instance dbbdee1b-247b-4d3b-808f-0848600dcf6c on n-h2-860864-13 Oct 28 17:37:36.656971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-766cf8c2-54cb-4dd4-90f0-368914db5b7a req-14b272a2-91bf-4dd3-82d2-949c1bc726ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106078 Oct 28 17:37:36.658201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1063/2196] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:37.054047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:37.054668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:37.068774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:37.069617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:37.070085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:37.070787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:37.078075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:37.078784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:38.151090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:38.159297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-25b085ca-235f-4d8c-b8ea-197212be719d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1312 microversion: 2.1 time: 1.110539 Oct 28 17:37:38.166422 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1064/2197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:37 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1312 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:38.171721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a49f3d3-defa-4188-9afb-85d46b6f581e tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '.version_select at 0x7f7528679940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:38.183680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a49f3d3-defa-4188-9afb-85d46b6f581e tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:38.190114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a49f3d3-defa-4188-9afb-85d46b6f581e tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:38.196146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a49f3d3-defa-4188-9afb-85d46b6f581e tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:38.220488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a49f3d3-defa-4188-9afb-85d46b6f581e tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.052028 Oct 28 17:37:38.221833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1065/2198] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 17:37:38 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:38.245436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0206349a-1e9f-42e7-b1a8-3d93b9f3496c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:38.255532 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0206349a-1e9f-42e7-b1a8-3d93b9f3496c tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014113 Oct 28 17:37:38.257555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1066/2199] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:37:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:37:38.274008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d6d7d23-6508-4e77-a356-14fc6ee61718 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2050915921", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:38.311856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d6d7d23-6508-4e77-a356-14fc6ee61718 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.041942 Oct 28 17:37:38.321279 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1067/2200] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Oct 28 17:37:38 2022] POST /compute/v2.1/flavors => generated 499 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:38.327131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60d43d66-9676-4c1c-bd7c-0c4601f88717 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:38.335717 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60d43d66-9676-4c1c-bd7c-0c4601f88717 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012199 Oct 28 17:37:38.337139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1068/2201] 10.222.0.48 () {58 vars in 1182 bytes} [Fri Oct 28 17:37:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:37:38.569102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1465681212", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "e7f23dc1-4951-490a-a228-97dbca4c5ff7"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:42.524929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=11 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:42.683793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:42.706695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=9,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:47.615392 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c51ef90-58e2-4239-b016-468c9263f4f8 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 13.782909 Oct 28 17:37:47.629767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1134/2202] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:33 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 13800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:47.637415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:47.646599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:47.663388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:47.669474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:47.670061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:47.673170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:47.673884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:47.674491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:47.748575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:37:48.148620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:48.158004 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4d24f98-e650-4c55-9598-9ce58602a911 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1500 microversion: 2.1 time: 0.526982 Oct 28 17:37:48.161767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1135/2203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:47 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1500 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:48.169969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:48.172413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:48.186374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.186875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.187316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.199627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.200305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.201000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.205057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=35 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:48.253676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:37:48.253950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:48.254189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:37:48.254668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:37:48.255072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:37:48.255674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:37:48.276991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.279467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.280746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.282250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.284080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.285157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.338620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:37:48.378519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:37:48.399739 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ead4d2a0-ca9d-4a7f-98e3-cc2815e266ed tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 204 len: 0 microversion: 2.1 time: 0.234590 Oct 28 17:37:48.400946 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1136/2204] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:48 2022] DELETE /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:48.412772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:48.414444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:48.423837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.424573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.425359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.426302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.427227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.427829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.436877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:37:48.442517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:37:48.534509 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-577a1d32-0200-4cf7-939a-1f57733f0e16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.970034 Oct 28 17:37:48.541566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1069/2205] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 9972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:37:48.548234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:48.548847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:48.559393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.559899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.560335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.561043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.561941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.562506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.638612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'flavor' on Instance uuid dbbdee1b-247b-4d3b-808f-0848600dcf6c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:37:48.758957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:48.773344 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-133ca75e-6311-4c89-8b02-7507604b0ed3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.369693 Oct 28 17:37:48.777344 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1137/2206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:48.787261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:48.788298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:48.798049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.800582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.801497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:48.803068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:48.804307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:48.805164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:49.085929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:49.099084 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68e58168-6f5b-41a5-a03d-40eefee4bb30 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1485 microversion: 2.1 time: 0.319757 Oct 28 17:37:49.104688 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1138/2207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:48 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1485 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:49.110339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5cdccdab-a5f7-4e74-84e6-387497fc0e08 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:49.111165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5cdccdab-a5f7-4e74-84e6-387497fc0e08 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:49.189592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cdccdab-a5f7-4e74-84e6-387497fc0e08 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:49.204338 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5cdccdab-a5f7-4e74-84e6-387497fc0e08 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1279 microversion: 2.1 time: 0.097480 Oct 28 17:37:49.205785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1139/2208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:49 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:49.216552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2ce08ee-3148-418d-ae9a-9e413af86c2d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524bec160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:49.284254 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd67abc7-d39e-4d7e-a8f5-7983a8a1d471 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c/action" status: 202 len: 0 microversion: 2.1 time: 0.745841 Oct 28 17:37:49.287354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1070/2209] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:48 2022] POST /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:37:49.297418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1316534453"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:49.303125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:49.321587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:49.326433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:49.327108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:49.328095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:49.329126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:49.329745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:49.398358 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2ce08ee-3148-418d-ae9a-9e413af86c2d tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.190152 Oct 28 17:37:49.399166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1140/2210] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:49 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:49.416737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:49.417754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:49.426934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:49.429030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:49.429513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:49.430906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:49.431838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:49.432316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:49.711245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:49.729416 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4621edbb-d9b1-48fd-92b2-dad0822a3bd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.320361 Oct 28 17:37:49.747427 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1141/2211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:49 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:50.130284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:50.132458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:50.147421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.152504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.155516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.157732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.158515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.160421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.334906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10df9afd-07e4-44ef-a89b-a6c7030b42e0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 1.045852 Oct 28 17:37:50.335742 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1071/2212] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:37:49 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 17:37:50.346871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:50.348317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:50.369048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.369549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.370006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.370832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.371311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.371953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.491986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:50.502744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-818bd83f-7f4a-4a23-b71d-f9032538d4a8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1331 microversion: 2.1 time: 0.165710 Oct 28 17:37:50.510911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1072/2213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:50 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:50.516149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:50.528350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:50.535137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.535688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.536129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.536840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.537291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.537714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.621802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:50.632019 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3fe0411-ed31-48e5-aeda-b5adf51cd40f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1485 microversion: 2.1 time: 0.507900 Oct 28 17:37:50.632895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1142/2214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:50 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1485 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:50.644156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1224d11-9cfe-4d4e-b2f0-b8df241e5a38 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f751fac6550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:50.717221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1224d11-9cfe-4d4e-b2f0-b8df241e5a38 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.083401 Oct 28 17:37:50.718406 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1143/2215] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:50 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:50.758506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:50.759186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:50.768800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.769292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.778857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:50.780197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:50.780686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:50.783296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.259261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:51.275520 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0858505a-1e11-4920-b47c-2c433eff15c2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.762897 Oct 28 17:37:51.276264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1073/2216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:50 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:51.280830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9415822a-7891-4cd1-96e6-54b21e887316", "name": "network-vif-deleted", "tag": "23cef619-7f5a-482c-9780-5f2a99269678"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:51.303530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.303930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.304361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.329657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] Creating event network-vif-deleted:23cef619-7f5a-482c-9780-5f2a99269678 for instance 9415822a-7891-4cd1-96e6-54b21e887316 on n-h1-860864-13 Oct 28 17:37:51.358827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9c3b1eee-b85f-4d42-bf68-868bed7e2ef4 req-4827c530-2832-40fe-b1cd-0f5b2b2e41aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073662 Oct 28 17:37:51.360538 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1074/2217] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:51.388499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:51.401607 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db0a174d-bf8a-4d38-8023-a77fb3b106c8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.643437 Oct 28 17:37:51.404573 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1144/2218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:50 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:51.527467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:51.533309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:51.543218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.544011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.544503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.545432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.546093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.546733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.660944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:51.661657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:51.672173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.680065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.681184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.687315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.687922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.688466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.721641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:51.732006 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5780897-9232-4a2f-bc18-820bbbe592c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1337 microversion: 2.1 time: 0.209163 Oct 28 17:37:51.732625 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1075/2219] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:51 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1337 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:51.747683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a8bdd02-3d1f-44ee-afe8-f236c35c1126 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f752862d940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:51.766605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:51.767108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:51.767598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:51.768058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lazy-loading 'fault' on Instance uuid 9415822a-7891-4cd1-96e6-54b21e887316 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:37:51.827617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a8bdd02-3d1f-44ee-afe8-f236c35c1126 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.093867 Oct 28 17:37:51.828221 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1076/2220] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:51 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:52.309230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:52.309906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:52.355535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:52.359904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:52.360481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:52.361252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:52.361806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:52.362309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:52.685748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:52.707023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bca49173-245d-4677-aede-5b756ffdf467 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 200 len: 1301 microversion: 2.1 time: 1.047410 Oct 28 17:37:52.711915 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1145/2221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:51 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 1301 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:52.753757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:52.754644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:52.769035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:52.770181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:52.770890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:52.771987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:52.772956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:52.773551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:53.010021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:53.019263 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f51917b-93b5-41cd-b9c3-b2a631f15b41 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.721313 Oct 28 17:37:53.026870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1077/2222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:52 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:53.053455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:53.054729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:53.069845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:53.073971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:53.075344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:53.076318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:53.076959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:53.085386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.051402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:54.061436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0fde6e63-8c94-4424-9317-9bcd0f38f5c3 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 1.347561 Oct 28 17:37:54.066696 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1146/2223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:52 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:54.079093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-962085ce-7319-4639-8c01-faac744505d9 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524b89670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:54.167518 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-962085ce-7319-4639-8c01-faac744505d9 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1427 microversion: 2.1 time: 0.099349 Oct 28 17:37:54.179022 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1147/2224] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:54 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:54.185637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-unplugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:54.216206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.216945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.217596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.232281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] Creating event network-vif-unplugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:37:54.237817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d094806a-35d4-4402-a831-8527e82a715e req-19be734d-0d79-4209-bc71-f2d81279efc1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057514 Oct 28 17:37:54.243870 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1148/2225] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:54.250283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:54.251248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: 9415822a-7891-4cd1-96e6-54b21e887316] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:54.259056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:54.271669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac528b50-c5ba-41fd-8a60-465ac1b473d5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 1.226586 Oct 28 17:37:54.272277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1078/2226] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:53 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:54.283531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.283531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.284017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:54.284125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.290342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.290342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.290342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.300621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.301326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.301786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.307118 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] HTTP exception thrown: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Request method failure captured: Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 HTTP/1.1 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFj_Egm693cvD569-zyyCf6WcP0smS8jIyuQcpseP0o9uScXHgU7AFxL-gX_F9aP8U_ov4Nee-MzKH1Lt2tjlubdeC6LVhY94Fy-1INDvRo3bEXBDn6ALmGoJ-XuYJVwCyDGmRm5DY_ZsBFcnU75V9pmWbyyYBONIFd8JgNI2sx82I Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4745f00281fc4cce985160599bcae8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4745f00281fc4cce985160599bcae8ca"}]}] Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationTest-106709088 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b5dbc2c295144accbd4d508afb066b03 Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationTest-106709088-project Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '9415822a-7891-4cd1-96e6-54b21e887316'} Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:54.309131 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. Oct 28 17:37:54.313491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:54.314080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Returning 404 to user: Instance 9415822a-7891-4cd1-96e6-54b21e887316 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:54.315195 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcb5d980-f7e2-4152-8d67-2afa576173b1 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316" status: 404 len: 111 microversion: 2.1 time: 0.069924 Oct 28 17:37:54.316022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] Creating event network-changed:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:37:54.319359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1149/2227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:54 2022] GET /compute/v2.1/servers/9415822a-7891-4cd1-96e6-54b21e887316 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:37:54.322337 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ded7f082-e9b2-4c4c-a1ea-8f64cc92582a req-93828a1b-1cba-4d76-8b0f-cafe99fca2ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047901 Oct 28 17:37:54.323046 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1079/2228] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:54.326299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:54.327728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:54.334107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.334301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:54.334763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:54.334969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.335809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.337136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.337698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.339116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.341790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.342291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.342731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.343729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.344183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.344608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.388423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:54.493300 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7e216545-56e8-4c12-a389-7ac62b6f1c40 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 204 len: 0 microversion: 2.1 time: 0.167601 Oct 28 17:37:54.494490 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1080/2229] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:54 2022] DELETE /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:54.505055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:54.505753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:54.512688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.513359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.513947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.515179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:54.515662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:54.516131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:54.734429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:54.745792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08439b64-6f4c-4ca5-80e9-6ad09ab1fc2f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1689 microversion: 2.1 time: 0.425034 Oct 28 17:37:54.759393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1150/2230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:54 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1689 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:54.777642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:54.787664 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df4d7c74-e42f-48e1-bf31-3c6ec0a0d091 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.288136 Oct 28 17:37:54.807722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1081/2231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:54 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:55.088180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.089398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:55.096738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.097490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.098103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.098830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.099469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.100056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.184835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a105fd88-246a-45c1-a5de-0b570338a61e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7528600dc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.269375 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a105fd88-246a-45c1-a5de-0b570338a61e tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1436 microversion: 2.1 time: 0.088899 Oct 28 17:37:55.270643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1082/2232] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1436 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:55.285822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f20644b9-bfe3-469d-a309-bde07c63958a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75285bf700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.350313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f20644b9-bfe3-469d-a309-bde07c63958a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 200 len: 1436 microversion: 2.1 time: 0.068742 Oct 28 17:37:55.351416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1083/2233] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 1436 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:55.360865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.363023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:55.378163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.379009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.379755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.380738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.381399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.386003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.452016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:55.461934 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-579fe7cd-48ff-4a62-848d-8d058b974f05 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.378248 Oct 28 17:37:55.465056 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1151/2234] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:55.485080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.485987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:55.495464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.496274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.496900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.497776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.498393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.498967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.761984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:55.772930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b77ad77b-8e52-4288-95a6-ef6294689085 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.414992 Oct 28 17:37:55.772930 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1084/2235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:55.795562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.796344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:55.804848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.807012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.807705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.808663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.809960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.810671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.839186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:55.850754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:55.862491 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-499574e5-bf33-4854-9212-5cbda89955f3 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1466 microversion: 2.1 time: 0.394652 Oct 28 17:37:55.864008 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1152/2236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1466 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:55.872853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:55.874081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:55.882438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.883242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.884809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:55.886138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:55.886781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:55.887522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:56.139904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:56.148716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d09d0fab-9245-40ef-8af5-af5348251f35 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1689 microversion: 2.1 time: 0.360634 Oct 28 17:37:56.164022 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1085/2237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1689 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:56.172596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb3e3a06-4c67-468c-9b04-3bdd9d83e9f4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f75286dd3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:56.176292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:56.203081 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60d89025-45b5-492a-b3e4-dcca9f36210e tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.337071 Oct 28 17:37:56.205209 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1153/2238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:55 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:56.505955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:56.507139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:56.517707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:56.518923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:56.523723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:56.525810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:56.526595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:56.527177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:56.826019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:56.840771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:56.848842 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a794271b-fc62-45fc-866f-d2d0a192c38c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.364420 Oct 28 17:37:56.867509 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1154/2239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:56 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:56.876797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:56.878608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:56.898856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:56.900490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:56.901062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:56.902424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:56.903424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:56.904555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.065595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb3e3a06-4c67-468c-9b04-3bdd9d83e9f4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "DELETE /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec" status: 204 len: 0 microversion: 2.1 time: 0.899746 Oct 28 17:37:57.066702 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1086/2240] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:56 2022] DELETE /compute/v2.1/images/3454c525-0252-4703-b2ac-b0ab1f36f6ec => generated 0 bytes in 902 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:57.077207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.078184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.088702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.089554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.090296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.091732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.092414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.093040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.233796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.256000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.261917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.270718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9b55a1b3-a258-4b1e-8596-3c5d0e956684 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2955 microversion: 2.42 time: 0.394520 Oct 28 17:37:57.272119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1155/2241] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:37:56 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2955 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:57.277991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a680a5a-0834-4e59-8721-ad0066ee3dae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '.version_select at 0x7f7524becdc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.309863 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-8a680a5a-0834-4e59-8721-ad0066ee3dae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] HTTP exception thrown: Image not found. Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a680a5a-0834-4e59-8721-ad0066ee3dae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Request method failure captured: Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 HTTP/1.1 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBMWIlK93YZxMafWoaXr4LHkM7mE3QT7ubHb_-6lx4z3KIWlDzVxxYLwZPehb61dG09RkLlNNc-_-WzoKzo-q23-1gzOXwUuUBa5BZQ3GR49JZ9zMavb_Dqxn3anyzybiCTEY_zL2_ilatKAA8rpXAAr05lzfFzJWBc7MA-IcX3o1c4 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_378bcb819bd14593866269c06c978f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/378bcb819bd14593866269c06c978f53"}]}] Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3106807274604bfe86b924a6d4aa70b1 Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0'} Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 to delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 could not be found. Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.312413 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a680a5a-0834-4e59-8721-ad0066ee3dae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a680a5a-0834-4e59-8721-ad0066ee3dae tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "DELETE /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0" status: 404 len: 62 microversion: 2.1 time: 0.040433 Oct 28 17:37:57.320920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1156/2242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:57 2022] DELETE /compute/v2.1/images/1d827ee4-510e-4ae5-b5f1-f7250fd9e4e0 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:37:57.325268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.329360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.342836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.345567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.346068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.346894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.349114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.349693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.369386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.382576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d15135f-964b-47f4-8413-97c338685a41 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.313949 Oct 28 17:37:57.384267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1087/2243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:57 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:57.393029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.396466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.422538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.423595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.424125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.425202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.425750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.426726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.688525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.698110 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f84c145f-0865-4207-9488-b20579b533ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1689 microversion: 2.1 time: 0.382162 Oct 28 17:37:57.709447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:57.711308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1157/2244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:57 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1689 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:57.723655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.724507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.726383 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39cb4d93-9897-4be7-8583-522cf5e1fa9f tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.339925 Oct 28 17:37:57.730234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1088/2245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:57 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:57.732319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.733119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.733711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.734597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.735210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.735811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.737356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.737856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.745024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.745450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.745969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.746679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.747195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.747728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.807255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:37:57.945820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-124fa43f-4d3c-4e6e-a65c-9ef34d2de66c tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "DELETE /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 204 len: 0 microversion: 2.1 time: 0.213205 Oct 28 17:37:57.947881 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1089/2246] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:37:57 2022] DELETE /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:37:57.963125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:57.965184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:57.981249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.983474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.984884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:57.991948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:57.992673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:57.994026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.035169 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f665b83-3670-4aac-a74d-90c823084d7f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.321929 Oct 28 17:37:58.045653 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1158/2247] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:37:57 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f/os-interface => generated 1832 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:37:58.045653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:58.045653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:58.067902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.069220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.069867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.072366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.083929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.084459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.317747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:58.337484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:58.347632 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7bce0437-9943-428f-92f5-f8b648c2b534 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.396443 Oct 28 17:37:58.349020 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1090/2248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:57 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:58.386308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:58.399839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63fd225b-7805-44ff-8ef1-9f9830889427 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1472 microversion: 2.1 time: 0.362272 Oct 28 17:37:58.401523 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1159/2249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:58 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:58.423677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:58.424765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:58.427631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:58.435706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.436369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.436882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.437677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.438235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.439350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.596998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:58.607507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f66e3212-6804-4812-bae4-fe95279f220f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.196894 Oct 28 17:37:58.608626 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1091/2250] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:58 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:58.726412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:58.727480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:58.734666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.735148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.735798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.736774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.737227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.737648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.754108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:58.754717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:58.767293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.767913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.768359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.769338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:58.769969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:58.770556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:58.981424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:58.992309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb59dd95-3b20-4d25-9339-bc5749b5bfee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1689 microversion: 2.1 time: 0.270128 Oct 28 17:37:59.006304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1160/2251] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:58 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:59.042348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:59.046125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-plugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:37:59.052181 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f31fd6cc-9aa4-4f89-b5d1-802adfba50c3 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.302132 Oct 28 17:37:59.063870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1092/2252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:58 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:37:59.067560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.068409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.069352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.083783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] Creating event network-vif-plugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:37:59.090280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-dc36a18d-a55c-431f-96fb-9bb82e65e1fc req-f0028243-e49e-44ba-a799-e1bb9519da34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050639 Oct 28 17:37:59.090894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1161/2253] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:37:59.375482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:59.376385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:59.382996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.384045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.384728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.385674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.386448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.387247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.424825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:37:59.429144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:59.429862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:59.443880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.460739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.462769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.469305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.470373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.470979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.820484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:37:59.831855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20fc3063-6578-4d39-a3a7-0616e0b5e535 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.464132 Oct 28 17:37:59.833817 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1093/2254] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:59 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:37:59.851768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:37:59.853168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:37:59.860711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.861201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.865078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:37:59.865520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:37:59.866170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:37:59.867947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.023426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:00.036218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2421d51-2bfa-4ef0-a85f-dc5cb28e4225 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1472 microversion: 2.1 time: 0.610585 Oct 28 17:38:00.051400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1162/2255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:59 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1472 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:00.068909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:00.075700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:00.088247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.089098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.089743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.090700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.092299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.094544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.297148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:00.307022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20f3f535-4538-47ff-8552-e901a600e660 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.468013 Oct 28 17:38:00.319936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1094/2256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:37:59 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:00.325672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:00.326369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:00.339975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.340602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.341101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.341891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.342410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.344085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.454116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:00.471833 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aad9fd0e-068a-4a2b-b44c-b906a94d55f7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.429742 Oct 28 17:38:00.472444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1163/2257] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:00 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:00.858212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:00.859152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:00.885363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.886155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.897576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:00.898944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:00.900203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:00.900837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.164540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:01.194325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32e459d3-f430-40ad-a79d-4e9f74bce833 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.866205 Oct 28 17:38:01.195125 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1095/2258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:00 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:01.229131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:01.230725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:01.242383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.243722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.244328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.245203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.245813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.246387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.379268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:01.408973 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-42f43df2-8ecd-4065-b05e-07325ce69813 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.546883 Oct 28 17:38:01.410584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1164/2259] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:00 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:01.425397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-unplugged", "status": "completed", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:01.443467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.447670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.449714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.484537 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] Creating event network-vif-unplugged:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:38:01.513879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2c225748-6a50-4352-b991-b0c57bc37856 req-f3c9ed3b-786a-4943-bca2-fc3d4694265f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098023 Oct 28 17:38:01.514686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1165/2260] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:01.520055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:01.520973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:01.528196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.528953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.529554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.530433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.531032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.531633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.595259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:01.614289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a8aaec5-95db-4b2d-b008-c913176324cb tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1472 microversion: 2.1 time: 0.414592 Oct 28 17:38:01.617781 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1096/2261] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:01 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1472 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:01.644449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:01.645074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:01.652778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.653306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.654530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.655470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:01.656080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:01.662949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:01.882736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:01.891785 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1e156a6-8d7d-4ed9-be19-72d651c26367 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.375642 Oct 28 17:38:01.899787 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1166/2262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:01 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:01.968902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:01.978498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-000768c6-2874-464b-ac1c-d004feb99e61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.358901 Oct 28 17:38:01.980080 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1097/2263] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:01 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:02.223238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:02.224024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:02.241026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.241878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.242576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.243534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.244169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.244760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.438407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:02.439698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:02.450370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.450685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:02.451536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.452151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.457560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.459461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.460192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.466833 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3f1391e-85a9-4643-9795-71efcd79119d tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1499 microversion: 2.1 time: 0.248334 Oct 28 17:38:02.475056 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1167/2264] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:02 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1499 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:02.688620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d72118-dddb-490b-8ecf-d1133fd3511f", "name": "network-vif-deleted", "tag": "498d6408-d69a-431b-a719-c47669d9ae45"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:02.730516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.732496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.736705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.766899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] Creating event network-vif-deleted:498d6408-d69a-431b-a719-c47669d9ae45 for instance 18d72118-dddb-490b-8ecf-d1133fd3511f on n-h2-860864-13 Oct 28 17:38:02.800048 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5b0688ed-074a-4ce9-9ccd-2280aae5b9dc req-219ed181-9139-438e-8567-e04322768423 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241453 Oct 28 17:38:02.800673 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1168/2265] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:02.812153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:02.813098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:02.842820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.846452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.846647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.848728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:02.850005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:02.850462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:02.961521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:02.974449 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1036bcdd-c5b3-4678-abea-331bb785902c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.540310 Oct 28 17:38:03.012008 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1098/2266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:02 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:03.023698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:03.028299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:03.031825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.033782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.034260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.036226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lazy-loading 'fault' on Instance uuid 18d72118-dddb-490b-8ecf-d1133fd3511f {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:38:03.048373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.049233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.050254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.053718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.054478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.055062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.162045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3106807274604bfe86b924a6d4aa70b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '378bcb819bd14593866269c06c978f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:03.174061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-728cf3b7-e45a-4f81-b645-7635a5fbfed4 tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 200 len: 1306 microversion: 2.1 time: 0.368626 Oct 28 17:38:03.187843 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1169/2267] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:02 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 1306 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:03.201711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:03.204449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:03.223774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.224562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.225155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.226017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.226716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.227724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.614607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:03.628827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7257dd28-c534-4ee5-832c-c0444a4bdfc3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.615380 Oct 28 17:38:03.631005 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1099/2268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:03 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:03.641325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:03.643751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:03.657486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.659879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.661790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.662623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.663044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.666922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.688240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:03.704075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2ad347a-a022-4502-8a7b-9fbf8a2a93e6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.513021 Oct 28 17:38:03.734348 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1170/2269] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:03 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:03.805262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.808666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.809114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:03.809614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lazy-loading 'fault' on Instance uuid a8490c85-575e-43e1-80d5-d6d29f94c5fb {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:38:03.904181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbc2c295144accbd4d508afb066b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4745f00281fc4cce985160599bcae8ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:03.913940 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7be74b51-08a2-4714-9f46-9b6faeea0e76 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 200 len: 1301 microversion: 2.1 time: 0.280685 Oct 28 17:38:03.915290 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1100/2270] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:03 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 1301 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:03.962526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-plugged", "status": "completed", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:03.985734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:03.986239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:03.988685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.002692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:04.003308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:04.012360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.013862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.015185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.016138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.016951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.018258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.023619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] Creating event network-vif-plugged:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:38:04.030125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:04.036113 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7348c3b5-8627-472b-93f6-50348ca4266f req-25e6870e-4c2f-4b59-b3bc-34fb7f5c52fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078024 Oct 28 17:38:04.039258 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1171/2271] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:04.204156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:04.204905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] [instance: 18d72118-dddb-490b-8ecf-d1133fd3511f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:04.221621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.223452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.225221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.226263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.228160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.228871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.265475 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] HTTP exception thrown: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Request method failure captured: Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f HTTP/1.1 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBMWIlK93YZxMafWoaXr4LHkM7mE3QT7ubHb_-6lx4z3KIWlDzVxxYLwZPehb61dG09RkLlNNc-_-WzoKzo-q23-1gzOXwUuUBa5BZQ3GR49JZ9zMavb_Dqxn3anyzybiCTEY_zL2_ilatKAA8rpXAAr05lzfFzJWBc7MA-IcX3o1c4 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/378bcb819bd14593866269c06c978f53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_378bcb819bd14593866269c06c978f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/378bcb819bd14593866269c06c978f53"}]}] Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 378bcb819bd14593866269c06c978f53 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-268674623 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3106807274604bfe86b924a6d4aa70b1 Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerTestJSON-268674623-project Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '18d72118-dddb-490b-8ecf-d1133fd3511f'} Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:04.267606 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. Oct 28 17:38:04.271261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:04.273305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] Returning 404 to user: Instance 18d72118-dddb-490b-8ecf-d1133fd3511f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:38:04.274522 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64fe02cf-f8bc-414d-9d8f-e94d7f54762a tempest-ImagesOneServerTestJSON-268674623 tempest-ImagesOneServerTestJSON-268674623-project] 10.222.0.48 "GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f" status: 404 len: 111 microversion: 2.1 time: 0.075368 Oct 28 17:38:04.285643 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1172/2272] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:04 2022] GET /compute/v2.1/servers/18d72118-dddb-490b-8ecf-d1133fd3511f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:38:04.315192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:04.327289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9054b06-c6af-46ca-a1ab-4b1c30f89664 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.327810 Oct 28 17:38:04.328561 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1101/2273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:03 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:04.398296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:04.410888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:04.412634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Searching by: {'deleted': False, 'project_id': '703e2e549f2148b4bf70f354e2c967b7'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:38:04.426385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.428542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.429316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.438053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.439087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.439729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.492089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:38:04.570222 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8b22b44-80e6-46f1-b519-b93f3952bc6d tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.184426 Oct 28 17:38:04.582386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1173/2274] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:38:04 2022] GET /compute/v2.1/servers => generated 334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:04.588343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:04.603221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:04.609740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Searching by: {'deleted': False, 'project_id': '703e2e549f2148b4bf70f354e2c967b7'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:38:04.627922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.628599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.628915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.630122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.630580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.631008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.656074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:04.656684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:04.667056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.667600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.668039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.668762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.669218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.669644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:04.682479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:38:04.775353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:04.785093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:04.787742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:04.792379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:04.793184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.077043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:05.091896 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b89ac958-a6cf-449a-ad77-d455fa8243e4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1379 microversion: 2.1 time: 0.439510 Oct 28 17:38:05.097384 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1174/2275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:04 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1379 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:05.104255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76fabd22-c629-4a78-9e3f-8922dd38e9b4 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.520449 Oct 28 17:38:05.105425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1102/2276] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:38:04 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:05.110298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:05.111151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:05.122721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8490c85-575e-43e1-80d5-d6d29f94c5fb", "name": "network-vif-deleted", "tag": "330285af-8dac-4717-8a98-1b709b53f61e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:05.124463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.127848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.129086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.131496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.137527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.138767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.162776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.163589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.164342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.189224 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] Creating event network-vif-deleted:330285af-8dac-4717-8a98-1b709b53f61e for instance a8490c85-575e-43e1-80d5-d6d29f94c5fb on n-h2-860864-13 Oct 28 17:38:05.201342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2652f776-03b9-494e-b060-9b0ff96e7414 req-37dd5bed-bc9c-4f0a-a0bb-26ca6c658c53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086973 Oct 28 17:38:05.202395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1175/2277] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:05.231960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:05.234053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] [instance: a8490c85-575e-43e1-80d5-d6d29f94c5fb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:05.255805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.256698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.257367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.264218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.265234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.266575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.283345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:05.301432 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] HTTP exception thrown: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Request method failure captured: Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb HTTP/1.1 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBFj_Egm693cvD569-zyyCf6WcP0smS8jIyuQcpseP0o9uScXHgU7AFxL-gX_F9aP8U_ov4Nee-MzKH1Lt2tjlubdeC6LVhY94Fy-1INDvRo3bEXBDn6ALmGoJ-XuYJVwCyDGmRm5DY_ZsBFcnU75V9pmWbyyYBONIFd8JgNI2sx82I Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4745f00281fc4cce985160599bcae8ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4745f00281fc4cce985160599bcae8ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4745f00281fc4cce985160599bcae8ca"}]}] Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-LiveMigrationTest-106709088 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4745f00281fc4cce985160599bcae8ca Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-LiveMigrationTest-106709088 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-LiveMigrationTest-106709088-project Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b5dbc2c295144accbd4d508afb066b03 Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-LiveMigrationTest-106709088-project Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a8490c85-575e-43e1-80d5-d6d29f94c5fb'} Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:05.310832 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] Returning 404 to user: Instance a8490c85-575e-43e1-80d5-d6d29f94c5fb could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3799200-33d6-4da5-a558-794767088651 tempest-LiveMigrationTest-106709088 tempest-LiveMigrationTest-106709088-project] 10.222.0.48 "GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb" status: 404 len: 111 microversion: 2.1 time: 0.106357 Oct 28 17:38:05.314461 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1176/2278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:05 2022] GET /compute/v2.1/servers/a8490c85-575e-43e1-80d5-d6d29f94c5fb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:38:05.318103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-263e3e63-c7bb-49f0-9eef-16b513154118 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:05.344266 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-263e3e63-c7bb-49f0-9eef-16b513154118 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029751 Oct 28 17:38:05.344859 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1177/2279] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:38:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:05.367708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:05.372221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:05.401068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.401571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.402022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.402716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.403176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.403630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.875086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:05.887576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32af85d8-a807-4e4d-add4-73a713ccb0c5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.780781 Oct 28 17:38:05.903132 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1103/2280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:05 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:05.914493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:05.915743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:05.934645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.935144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.935611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.936329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:05.939782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:05.940257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:05.981432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:05.994740 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c14bffea-9061-4b3f-a790-8ffb0e70aee6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.638491 Oct 28 17:38:05.996337 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1178/2281] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:05 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:06.043314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:38:06.121962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:06.123125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:06.147141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.147691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.148256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.149022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.161048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.161717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.282816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e0eb91f-d343-40a5-9e53-13d34f4e3cb5 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 204 len: 0 microversion: 2.1 time: 0.377422 Oct 28 17:38:06.285198 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1104/2282] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:38:05 2022] DELETE /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:38:06.299799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:06.302158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:06.316581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.317216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.318283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.320271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.322394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.323063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.670054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:06.690441 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ae61bd4-ffd8-45d9-b1c3-dfa84a433a0b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1528 microversion: 2.1 time: 0.574502 Oct 28 17:38:06.691280 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1179/2283] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:06 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1528 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:06.703274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:06.719129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:06.719908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:06.727252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0bed9c7a-de52-4ebe-8f8b-95f7e3b10035 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1699 microversion: 2.1 time: 0.436126 Oct 28 17:38:06.729838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.731745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.733136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.735137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.737405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.737997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.742847 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1105/2284] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:06 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1699 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:06.926113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:06.926762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:06.938432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.939086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.948364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:06.949266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:06.949763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:06.950190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.208272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:07.229946 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23627e98-5c21-4f7f-bfb9-e900710c431c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1528 microversion: 2.1 time: 0.516583 Oct 28 17:38:07.230911 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1180/2285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:06 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1528 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:07.242566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:07.243800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:07.255889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.261450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.262095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.263302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.264001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.264619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.340002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:07.353685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6193723b-af91-44f7-8fc6-9920e3f447c9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.431093 Oct 28 17:38:07.380131 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1106/2286] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:06 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:07.401817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34988983-c5f2-495d-8b6e-339fd0fbf428 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:07.464117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34988983-c5f2-495d-8b6e-339fd0fbf428 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/e7f23dc1-4951-490a-a228-97dbca4c5ff7" status: 202 len: 0 microversion: 2.1 time: 0.082592 Oct 28 17:38:07.472113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1107/2287] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:38:07 2022] DELETE /compute/v2.1/flavors/e7f23dc1-4951-490a-a228-97dbca4c5ff7 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:38:07.486448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d30c1df2-e785-4454-9d56-fd604d2c216a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:07.572862 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d30c1df2-e785-4454-9d56-fd604d2c216a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095996 Oct 28 17:38:07.575163 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1108/2288] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:38:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:07.621093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:07.623336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:07.642578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.643957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.644515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.645261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.646566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.647162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.647311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:07.663935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b2ddaf1-143c-4a6d-bd9e-3f98c559a287 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.431385 Oct 28 17:38:07.668844 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1181/2289] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:07 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:07.746971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:07.769883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Old instance type tempest-test_resize_flavor_-2050915921, new instance type m1.heat {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 17:38:07.775489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:07.776121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:07.779293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:07.786533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.799156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.799610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.806532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:07.809001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:07.810023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:07.811149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:07.811670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:07.812273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:07.813241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:07.813889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:08.018865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6a3d3c6-e029-42e6-afa1-899f95b425d6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211/action" status: 202 len: 0 microversion: 2.1 time: 0.426350 Oct 28 17:38:08.021235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1109/2290] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:38:07 2022] POST /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:38:08.043567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:08.044630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:08.065610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.068942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.072968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:08.076545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.077120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.078412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:08.233237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:08.248389 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48a408cd-b866-4dcf-97b2-2d902faee263 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1699 microversion: 2.1 time: 0.477623 Oct 28 17:38:08.250948 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1182/2291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:07 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1699 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:08.408717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:08.409405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:08.423830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.425922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.428058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:08.428970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.431834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.433188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:08.549878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:08.558859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45990acc-cb4b-40ba-9d88-12133a8680cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1537 microversion: 2.1 time: 0.533505 Oct 28 17:38:08.563407 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1110/2292] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:08 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1537 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:08.698277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:08.700821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:08.713291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.718050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.719111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:08.720202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:08.723338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:08.728520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:09.249031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:09.270510 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b745dbb4-5007-4f71-a476-f9fd45a79407 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.871897 Oct 28 17:38:09.294410 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1183/2293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:08 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:09.308422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:09.311571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:09.331619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:09.333327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:09.334657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:09.336703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:09.339053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:09.339725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:09.469072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:09.482767 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2808ffe9-7d29-45c2-9c9c-fc8c9dcdc388 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 0.792992 Oct 28 17:38:09.484461 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1111/2294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:08 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:09.586087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:09.587085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:09.607819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:09.608531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:09.609269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:09.610632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:09.611440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:09.612137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:09.888264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:09.903248 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f5109b30-83ff-4f2c-9693-9c3a5cbcba20 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1699 microversion: 2.1 time: 0.606048 Oct 28 17:38:09.905822 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1184/2295] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:09 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1699 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:10.306744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:10.314481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:10.330696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:10.332391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:10.333603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:10.336578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:10.337846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:10.339851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:10.641575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:10.651709 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b56af689-5052-426e-ace7-8824f60945b9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1537 microversion: 2.1 time: 1.070161 Oct 28 17:38:10.658897 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1112/2296] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:09 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1537 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:10.670854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:10.684708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:10.697947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:10.699078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:10.701243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:10.702449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:10.705065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:10.707263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:11.228678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:11.254635 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d67526bb-026d-4a8d-98f5-0f45caa45b26 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.936471 Oct 28 17:38:11.278539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1185/2297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:10 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:11.287223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:11.303678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:11.316546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:11.317124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:11.324585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:11.328712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:11.329443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:11.330100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.014517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3c3ac5d935b485c846a5e2d0f090404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703e2e549f2148b4bf70f354e2c967b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:12.026501 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38ef1eb0-3113-4b50-a8fe-e310dcb0cd84 tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 200 len: 1632 microversion: 2.1 time: 0.746677 Oct 28 17:38:12.034294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1186/2298] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:11 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 1632 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:12.051484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c24fe800-9c27-4eb4-ac68-eb8a422cb304", "name": "network-vif-deleted", "tag": "fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:12.067416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:12.069752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:12.070367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.096463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] Creating event network-vif-deleted:fa275eba-1ff0-4ff6-bd5c-b7dc05f22e35 for instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 on n-h2-860864-13 Oct 28 17:38:12.100952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:12.117010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7103baa1-e184-48a3-8312-61585dc4b195 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1506 microversion: 2.1 time: 1.451111 Oct 28 17:38:12.119786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-06684fdf-9d66-4ab2-9511-01d6a388ef9f req-e80f86d1-3ce2-4d90-a40e-1529790fcffb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083902 Oct 28 17:38:12.119971 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1113/2299] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:10 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1506 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:12.124400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1187/2300] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:12.129037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:12.129782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:12.139393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:12.142349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:12.142921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.143992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:12.147129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:12.147831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.290591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:12.291705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:12.309490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:12.309977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:12.310418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.311138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:12.323014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:12.323668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:12.788648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:12.798604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-becbea1f-d311-4ce0-b4c6-1acb3ac7de52 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1537 microversion: 2.1 time: 0.676795 Oct 28 17:38:12.799207 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1114/2301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:12 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1537 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:13.062540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:13.063539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] [instance: c24fe800-9c27-4eb4-ac68-eb8a422cb304] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:13.074449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.078277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.078979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:13.079891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.081772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.086010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:13.112278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] HTTP exception thrown: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Request method failure captured: Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 HTTP/1.1 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBMFk9I4F53mFIZbahWd4EHJ9fXN3mEMDsRl3KdPRFEIvU3g9wDzk8ftfZdXNN56kGkOZ9ilbT7VLNfYim8BY07vB_4iTecc25PBap1RRaWUhvRMCGHrRCYO-xF-AkEbc-nuKQUMa1k5TAw6mIEFs5jnfWJWpd7v4kXMfYp4xBAYVmU Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 703e2e549f2148b4bf70f354e2c967b7 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-469062979 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/703e2e549f2148b4bf70f354e2c967b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/703e2e549f2148b4bf70f354e2c967b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_703e2e549f2148b4bf70f354e2c967b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/703e2e549f2148b4bf70f354e2c967b7"}]}] Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-469062979 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 703e2e549f2148b4bf70f354e2c967b7 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-469062979 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-469062979-project Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e3c3ac5d935b485c846a5e2d0f090404 Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-469062979-project Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c24fe800-9c27-4eb4-ac68-eb8a422cb304'} Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:38:13.114678 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. Oct 28 17:38:13.119121 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:38:13.121586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Returning 404 to user: Instance c24fe800-9c27-4eb4-ac68-eb8a422cb304 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:38:13.122786 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28383ba1-2a13-43f5-bf05-52608ab416fb tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304" status: 404 len: 111 microversion: 2.1 time: 0.065239 Oct 28 17:38:13.126922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1115/2302] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:13 2022] GET /compute/v2.1/servers/c24fe800-9c27-4eb4-ac68-eb8a422cb304 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:38:13.139850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab50ccae-f9fd-42bc-bd43-e8d4b2d5e9af tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] Calling method '.version_select at 0x7f751fa71280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:13.182566 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab50ccae-f9fd-42bc-bd43-e8d4b2d5e9af tempest-ServersTestJSON-469062979 tempest-ServersTestJSON-469062979-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832636418" status: 202 len: 0 microversion: 2.1 time: 0.054168 Oct 28 17:38:13.183745 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1116/2303] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832636418 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:38:13.186954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:13.200103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:13.202628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:13.204710 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e580574-b5be-49b2-8d63-a541c21bbaf1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.910664 Oct 28 17:38:13.229325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.230119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.230900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:13.231012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1188/2304] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:12 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:13.231992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.234015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.234972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:13.751864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Action: 'update', calling method: .version_select at 0x7f75243b9430>, body: {"quota_set": {"ram": "5120"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:13.853682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.855345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.855869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:13.857993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:13.859930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:13.860575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.007613 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c9b2333-bd48-402d-859e-9b0bdd5418ba tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e" status: 200 len: 240 microversion: 2.36 time: 0.526682 Oct 28 17:38:14.015669 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1189/2305] 10.222.0.48 () {62 vars in 1303 bytes} [Fri Oct 28 17:38:13 2022] PUT /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e => generated 240 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:38:14.028116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:14.028983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:14.039063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.041290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.043160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.044109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.046444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.047089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.385614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:14.393128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:14.405061 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22c83573-fd3f-4492-99aa-98b9a94ea42a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1527 microversion: 2.1 time: 1.214942 Oct 28 17:38:14.406209 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1117/2306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:13 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1527 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:14.411186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Calling method '.version_select at 0x7f75285b78b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:14.627769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:14.631154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.636753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.637091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.638638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.639119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.639577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.644280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e5d4cc5-c409-4a51-a7ed-2126f445089f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 0.623049 Oct 28 17:38:14.646647 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1190/2307] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:14 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:14.659245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:14.659980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:14.673417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.673917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.677565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.679597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:14.681683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:14.682416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:14.688345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:14.740293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54dafa77-d2b3-4b06-93b1-95ef11b177bc tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e/detail" status: 200 len: 672 microversion: 2.36 time: 0.332755 Oct 28 17:38:14.744370 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1118/2308] 10.222.0.48 () {60 vars in 1304 bytes} [Fri Oct 28 17:38:14 2022] GET /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e/detail => generated 672 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:38:14.994783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:15.011309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Action: 'update', calling method: .version_select at 0x7f752863cdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:15.012658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ccaf61ab-3ba5-4571-8f1d-27ae651ade65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.364374 Oct 28 17:38:15.013266 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1191/2309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:14 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:15.168175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.169800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.170640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.173447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.177540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.178261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.267079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.267773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.268216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.269057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.269741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.270512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.423802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fba51648-2e6f-459e-9886-b840fe816b38 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e?user_id=c4f9232335424f08a772bb3536377835" status: 200 len: 240 microversion: 2.36 time: 0.418009 Oct 28 17:38:15.437448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:15.444780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:15.461060 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1119/2310] 10.222.0.48 () {62 vars in 1384 bytes} [Fri Oct 28 17:38:15 2022] PUT /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e?user_id=c4f9232335424f08a772bb3536377835 => generated 240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:38:15.471510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.473851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.474459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.476556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.478401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46b3f2ee-3e80-4809-876f-2e3eb28476c3 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] Calling method '.version_select at 0x7f751fa7e820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:15.480555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.481223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.620094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46b3f2ee-3e80-4809-876f-2e3eb28476c3 tempest-QuotasAdminTestV236-1360009037 tempest-QuotasAdminTestV236-1360009037-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e?user_id=c4f9232335424f08a772bb3536377835" status: 200 len: 282 microversion: 2.36 time: 0.156828 Oct 28 17:38:15.621175 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1120/2311] 10.222.0.48 () {60 vars in 1364 bytes} [Fri Oct 28 17:38:15 2022] GET /compute/v2.1/os-quota-sets/63811c5b6ded41ef9fc944aed0d49a9e?user_id=c4f9232335424f08a772bb3536377835 => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:38:15.674957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:15.679659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:15.712459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.715188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.715987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:15.727275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:15.730418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:15.731235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:16.174136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:16.186373 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-604b4597-fcb3-48cf-96e2-5f16a19a69b6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1527 microversion: 2.1 time: 0.757963 Oct 28 17:38:16.186978 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1192/2312] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:15 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1527 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:16.212866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbdee1b-247b-4d3b-808f-0848600dcf6c", "name": "network-vif-plugged", "status": "completed", "tag": "0e6eb9b0-25d6-41ad-930a-84e9821eee05"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:16.246561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:16.247046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:16.247505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:16.255181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:16.269045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e828209c-6495-4c46-8632-591b844653c5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 0.600230 Oct 28 17:38:16.269646 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1121/2313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:15 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:16.293119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:16.294556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:16.297642 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] Creating event network-vif-plugged:0e6eb9b0-25d6-41ad-930a-84e9821eee05 for instance dbbdee1b-247b-4d3b-808f-0848600dcf6c on n-h2-860864-13 Oct 28 17:38:16.301080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:16.301781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:16.304626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:16.306305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:16.308615 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-031a77cd-86ba-4232-ade9-a9296ad3415c req-178edff8-632c-41a6-9945-a0172d2f814a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110346 Oct 28 17:38:16.309912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:16.310356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:16.313434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1193/2314] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:16.739995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:16.756409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7bdc6811-c7a2-4f3a-bb95-3af39d1dfe0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.470470 Oct 28 17:38:16.758344 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1122/2315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:16 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:17.221270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:17.222011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:17.245629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:17.246447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:17.248137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:17.249192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:17.249909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:17.252732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:17.296835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:17.297850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:17.313617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:17.314106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:17.327570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:17.328348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:17.328828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:17.329264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:18.393188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:18.417894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0dee818a-ae56-4d3b-a104-e8835f880f14 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.125181 Oct 28 17:38:18.423714 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1123/2316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:17 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:18.438459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:18.439082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:18.466076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:18.466720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:18.467173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:18.468091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:18.468561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:18.468998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:18.937707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:18.950405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-639f4f42-a39d-4d23-a165-95aee8c01720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.742527 Oct 28 17:38:18.968805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1194/2317] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:17 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:19.244221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:19.255939 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1df74fe9-b370-474a-9a96-955d31b26c65 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.830168 Oct 28 17:38:19.263975 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1124/2318] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:18 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:19.451737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:19.452656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:19.486981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:19.488046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:19.493476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:19.494579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:19.497177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:19.497956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:20.006197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:20.031508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:20.124838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:20.129354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:20.135999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:20.138904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:20.144128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:20.161062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:20.798388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:20.815890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4f58017-9015-4869-9145-bda2098523fc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.370018 Oct 28 17:38:20.820537 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1195/2319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:19 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:20.837159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:20.842646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:20.867186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:20.871213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:20.872107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:20.874413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:20.875567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:20.877474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:20.918643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:20.945342 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-375a1edc-29cf-446d-baae-de95628dbb70 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 0.948635 Oct 28 17:38:20.947138 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1125/2320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:19 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:20.970424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:21.563014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:21.576997 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7124d06-578f-496c-abb5-a6443e4b24ae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 0.753716 Oct 28 17:38:21.578215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1196/2321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:20 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:21.846535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:21.847745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:21.860885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:21.862835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:21.870026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:21.871513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:21.875176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:21.875847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:21.979631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:21.980968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:21.997844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:21.998616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:22.001357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:22.002307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:22.005497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:22.006790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:23.558558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:23.576748 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cabe9335-2013-4970-8d4b-d0e1455db8f4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.608056 Oct 28 17:38:23.598129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1197/2322] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:21 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:23.609141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:23.617966 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b86270b-e625-41ec-a623-14bc7f365877 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.776046 Oct 28 17:38:23.625814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:23.626432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:23.643425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1126/2323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:21 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:23.653130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:23.653130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:23.654327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:23.654327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:23.654699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:23.655122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:23.891129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:23.990695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:24.604528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:24.605455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:24.620931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:24.627348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:24.628327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:24.629311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:24.632694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:24.637326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:24.721530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:24.742377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-381a3c13-ee2a-4706-9b97-12b9113eadf9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1684 microversion: 2.1 time: 1.139900 Oct 28 17:38:24.744929 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1198/2324] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:23 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1684 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:24.767492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:24.768347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:24.776352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:24.777116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:24.777718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:24.778804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:24.779434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:24.780004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:25.294307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:25.614484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=20 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:26.094859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:26.107505 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1a992df-d91e-4b11-be00-6267ec014c48 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.344899 Oct 28 17:38:26.108763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1199/2325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:24 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:26.114177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:26.115603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:26.123107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:26.130478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:26.134242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:26.135291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:26.136465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:26.137352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:26.215036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:26.225245 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-093e95f4-15c4-4489-a129-1778151d0b2a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.624673 Oct 28 17:38:26.248391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1127/2326] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:24 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:27.125722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-699930b3-3fcf-4b8b-9dd1-234c6b203532 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Action: 'create', calling method: .version_select at 0x7f752860a5e0>, body: {"keypair": {"name": "tempest-keypair-188870245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1KXxOLxnkRQQ0vX00BQIla0mSJ2o8OmB9fy0foRCl1V+Da9mI79GnpPLJKre917IMkfsnn+84VgjZUBcIpi7BdlZ1kwrAyePyY8pPb4UZyBIse7VJCz6tXrAcmJYnHTQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:27.154197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:27.217724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-699930b3-3fcf-4b8b-9dd1-234c6b203532 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:27.268336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-699930b3-3fcf-4b8b-9dd1-234c6b203532 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for user ce591cb2e15d4fd49fb53d68bd32100b and project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:27.383088 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-699930b3-3fcf-4b8b-9dd1-234c6b203532 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.985582 Oct 28 17:38:27.384226 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1128/2327] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:38:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:38:27.391636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:27.392710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:27.400902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:27.401891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:27.402479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:27.403633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:27.404285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:27.405233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:28.234143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:28.275896 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ea35d1d-173e-4716-a5d7-1c67763443ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 2.165515 Oct 28 17:38:28.285864 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1200/2328] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:26 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:28.300460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:28.302758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:28.318426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:28.319593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:28.320397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:28.323570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:28.326532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:28.328678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:28.831871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:28.859636 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-acdd7256-e752-4090-8003-42c253fe5d33 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.470087 Oct 28 17:38:28.860302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1129/2329] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:27 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:28.930462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:28.943569 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d72c9020-476e-4bc3-b310-e7ca89b8d184 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 0.656321 Oct 28 17:38:28.944202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1201/2330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:28 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:28.959611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:28.960232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:28.980269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:28.981051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:28.981645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:28.982533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:28.983139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:28.989799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:29.157136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-506658157", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:29.264692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:29.690206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:29.710625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1fb37708-358c-4d4a-9d3d-8a2d00c849ca tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.763173 Oct 28 17:38:29.727907 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1202/2331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:28 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:29.769623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:29.770044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:29.770514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:29.771118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:29.771745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:29.788080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:29.790044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:29.795245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:29.796499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:29.797346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:29.797702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:29.840315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:29.848709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:29.882547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:29.888366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:29.888974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:29.892606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:29.902242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:29.903004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:29.903627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:29.904636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:29.905540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:29.908454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:29.987510 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc6757bf-cc9e-47ea-8ae4-e757cf278f8f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108530 Oct 28 17:38:29.997471 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1130/2332] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:30.008622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-unplugged", "status": "completed", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:30.051838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:30.055809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:30.056985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:30.084192 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] Creating event network-vif-unplugged:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:38:30.095184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d1f2c767-a009-43ba-bf7d-be4738c67641 req-5d46ce22-9800-4adc-aa5c-ea5ad81b412c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095878 Oct 28 17:38:30.099674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1131/2333] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:30.119670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:30.120811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:30.127256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:30.127785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:30.128222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:30.128934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:30.129386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:30.129803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:31.009151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:31.045598 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f7414ad-4394-4522-b3ec-ab6cd81467fb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1542 microversion: 2.1 time: 1.158814 Oct 28 17:38:31.046794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1203/2334] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:29 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1542 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:31.055135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b6af119-534e-4b3e-a4b9-5d60d2edefb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:31.057861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b6af119-534e-4b3e-a4b9-5d60d2edefb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:31.453555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:31.469099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc93fbde-efd5-48e2-8980-5bfea483e833 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.367824 Oct 28 17:38:31.480697 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1132/2335] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:30 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:31.916234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b6af119-534e-4b3e-a4b9-5d60d2edefb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:31.936983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b6af119-534e-4b3e-a4b9-5d60d2edefb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1216 microversion: 2.1 time: 0.888601 Oct 28 17:38:31.965149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1204/2336] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:31 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1216 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:32.068618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-unplugged", "status": "completed", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:32.083067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:32.085252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:32.097534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:32.100706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:32.101437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:32.105133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:32.106389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:32.108773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:32.110783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:32.111413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:32.111877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:32.239208 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Creating event network-vif-unplugged:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h1-860864-13 Oct 28 17:38:32.263304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] Instance 82828f5b-aef0-46db-bbef-7b6f74930211 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:38:32.340367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0d69f9bc-9ca9-4dd5-ad3f-1598987208aa req-f59a859e-7485-45d0-aed7-f168a0446e90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.275619 Oct 28 17:38:32.347191 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1133/2337] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:32.514771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:32.519212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:32.548834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:32.549657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:32.551969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:32.553823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:32.558269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:32.561029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.092687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:33.110868 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-906e8347-7524-4a8c-a15a-e7f4b1149ccc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1541 microversion: 2.1 time: 1.039304 Oct 28 17:38:33.116149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1205/2338] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:32 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1541 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:33.131920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:33.142582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:33.169611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.181575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:33.182615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.192289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.192905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:33.193416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.497215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:33.510975 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c827a7c-dacf-461d-aee5-c8ace4d3e303 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1274 microversion: 2.1 time: 0.388465 Oct 28 17:38:33.511583 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1206/2339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:33 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1274 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:33.520108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:33.527255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:33.527986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:33.537732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.538663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:33.539715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.541542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.542823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:33.543900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.564499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-77c32a98-2ee6-494e-928e-d7abcc5eac80 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.065034 Oct 28 17:38:33.583573 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1134/2340] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:32 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:33.931323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:33.945222 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2afaa75c-a351-4d92-807f-69a915598f37 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.428782 Oct 28 17:38:33.946129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1207/2341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:33 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:33.976371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:33.977452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:33.990206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.990937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:33.991970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:33.995859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:33.996732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:34.002898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:34.142226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:34.142949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:34.154611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:34.155428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:34.156092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:34.158600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:34.159759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:34.160620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:34.791243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:34.815821 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af5d33aa-d8a6-4595-b94d-08b78f44e061 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.836436 Oct 28 17:38:34.835872 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1135/2342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:33 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:34.871853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:34.893197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:34.894124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:34.895186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:34.957729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Creating event network-changed:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h1-860864-13 Oct 28 17:38:35.031634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] Instance 82828f5b-aef0-46db-bbef-7b6f74930211 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:38:35.064399 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-41c641a0-3f80-4179-8d94-8e559b86a8ff req-ecbf57cc-eefe-477e-89a8-e001d5371433 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226480 Oct 28 17:38:35.065609 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1136/2343] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:35.085827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:35.089153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:35.103022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.103858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.104536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:35.106140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.112564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.115005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:35.564147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:35.604480 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3648bfa-2547-41df-b39b-c58c0a6fc1f9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1541 microversion: 2.1 time: 1.458189 Oct 28 17:38:35.605550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1208/2344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:34 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1541 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:35.654768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:35.658888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:35.681729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.686493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.690037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:35.691704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.694126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.695668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:35.798355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:35.806788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76b14d7f-403a-440a-8792-8e5fa8e4642f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.739565 Oct 28 17:38:35.811035 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1137/2345] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:35 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:35.824363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:35.825757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:35.835864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.836350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.836797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:35.838016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:35.838493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:35.838886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:36.277017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:36.292724 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52bf2bba-05e3-439e-8aea-a0fe39b61220 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.480630 Oct 28 17:38:36.300266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1138/2346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:35 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:36.312221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1745283620", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1874ad3f-c16c-4a78-a7b7-4f732e3b4411"}], "security_groups": [{"name": "tempest-securitygroup--829006701"}], "key_name": "tempest-keypair-188870245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:36.357527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:36.374108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7413b403-ae5a-4387-920c-0faf5ab252c4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 0.755653 Oct 28 17:38:36.376929 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1209/2347] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:35 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:36.382112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:36.390738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:36.404997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:36.405727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:36.406343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:36.407274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:36.408094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:36.408672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:36.516312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] validate_networks() for [('1874ad3f-c16c-4a78-a7b7-4f732e3b4411', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:36.583707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5069cb5d-db45-4e8e-93ce-dab5ffc2c9a4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.205329 Oct 28 17:38:36.588699 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1210/2348] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:38:36 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:38:36.596518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:36.601538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:36.616763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:36.617497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:36.618173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:36.619569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:36.622467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:36.623102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:36.990399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:37.001507 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d611d1a-f1c3-4eee-8ebd-e1b40d4c4987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1673 microversion: 2.1 time: 0.411511 Oct 28 17:38:37.003177 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1211/2349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:36 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1673 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:37.030139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:37.031149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:37.046680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.049407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.050785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.052402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.053205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.055254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.457821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:37.480228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for user ce591cb2e15d4fd49fb53d68bd32100b and project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:37.518435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:37.518862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:37.531122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:37.539698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:37.540737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:37.541458 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f44f5a3-62ac-4101-9841-c70437cc5775 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1473 microversion: 2.1 time: 0.515513 Oct 28 17:38:37.542246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1212/2350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:37 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:37.543405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:37.556490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:37.559437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:37.566117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.567385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.569788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.570865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.572146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.574404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.574972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.577549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.578223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.579154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.581587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.582232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.656736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:37.675270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Getting quotas for user ce591cb2e15d4fd49fb53d68bd32100b and project 88ffc4eb74fe4929ac359d4d5bf395db. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:37.677776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:37.735418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:37.755405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:37.935950 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb1f9294-f83d-4aec-ad18-58221ab9645b tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.632341 Oct 28 17:38:37.936779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1139/2351] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:37.942138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:37.943285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:37.953528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.954258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.956341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.957239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:37.957852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:37.958429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:37.963147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:38.117464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:38.131208 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66d93218-b92b-47ee-ac24-1ffa6bfedd12 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.585601 Oct 28 17:38:38.135680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1213/2352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:37 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:38.151808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50f55cd-d45e-4efc-9a70-f5e2065e866e", "tag": "73868f29-a1a3-435f-bdf9-58111447d35b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:38.163446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:38.187064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:38.187617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:38.188780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:38.214366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] Creating event network-changed:73868f29-a1a3-435f-bdf9-58111447d35b for instance b50f55cd-d45e-4efc-9a70-f5e2065e866e on n-h2-860864-13 Oct 28 17:38:38.221746 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-844ec2c8-cf41-4c77-820e-662031d2fa31 req-cb16eab4-e214-4c06-9306-fa654727f80c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084557 Oct 28 17:38:38.222852 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1214/2353] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:38.229266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:38.230337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d5e1164-0c95-4fcb-a528-46fe1566b52c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:38.231177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7d5e1164-0c95-4fcb-a528-46fe1566b52c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:38.240495 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bcec297-edb2-48c0-93a0-3abfda7f7529 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 0.302319 Oct 28 17:38:38.251491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1140/2354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:37 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:38.251491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:38.251491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:38.255532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:38.256209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:38.256789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:38.257666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:38.258266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:38.259504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:38.312892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7d5e1164-0c95-4fcb-a528-46fe1566b52c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:38.350983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7d5e1164-0c95-4fcb-a528-46fe1566b52c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1277 microversion: 2.1 time: 0.118281 Oct 28 17:38:38.375992 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1215/2355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:38 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:38.613375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:38.626370 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ad35b54-3d35-466f-a964-33f299190329 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1673 microversion: 2.1 time: 0.383934 Oct 28 17:38:38.631468 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1141/2356] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:38 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1673 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:38.644131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:38.648106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:38.662314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:38.664100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:38.665860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:38.670353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:38.671300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:38.672025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:38.694928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-541fa9e6-f06e-463e-8581-5a1116e28f68 tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] Calling method '.version_select at 0x7f7524481790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:39.034179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:39.048685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8ad10a8-2c9c-45ad-9d24-de3bc0bd49ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1470 microversion: 2.1 time: 0.408020 Oct 28 17:38:39.049579 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1142/2357] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:38 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:39.076141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:39.079176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:39.095673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.096414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.097031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.097897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.100146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.100763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.188222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.188786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.189251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.189846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.190283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.190707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.194533 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-541fa9e6-f06e-463e-8581-5a1116e28f68 tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 6705 microversion: 2.1 time: 0.819998 Oct 28 17:38:39.195127 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1216/2358] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:38:38 2022] GET /compute/v2.1/os-networks => generated 6705 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:39.202610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:39.203472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:39.221505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:39.226949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:39.231814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.232347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.232794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.233525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.233981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.234399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.423042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71eb9946-19f7-4988-a6f2-8e2578c9eabc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211/action" status: 202 len: 0 microversion: 2.1 time: 0.350573 Oct 28 17:38:39.423707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1143/2359] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:38:39 2022] POST /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:38:39.442270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6246e8ed-9cc3-4a36-b132-0604a97d7bff tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] Calling method '.version_select at 0x7f7528797940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:39.667252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:39.678329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c95af8a-8dee-4e26-9598-c0400ea67dd0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.481483 Oct 28 17:38:39.695415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1217/2360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:39 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:39.707150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:39.708890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:39.717619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.718563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.720077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.721012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.721643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.722268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.840000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6246e8ed-9cc3-4a36-b132-0604a97d7bff tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks/f69034d8-b578-4aec-ab1c-b999c04b7776" status: 200 len: 652 microversion: 2.1 time: 0.406995 Oct 28 17:38:39.841220 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1144/2361] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:38:39 2022] GET /compute/v2.1/os-networks/f69034d8-b578-4aec-ab1c-b999c04b7776 => generated 652 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:39.846540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:39.847689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:39.860959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.862991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.869098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.870133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:39.870798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:39.871684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:39.970059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:39.984245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f8951c7-4031-456e-b5ad-8adcf9e92f6a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 0.285208 Oct 28 17:38:39.988667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1218/2362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:39 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:40.000715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:40.002862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:40.031075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:40.042083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.043019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ff447c4-da31-42e2-b774-5530d7ae6a9c tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1329 microversion: 2.1 time: 0.200555 Oct 28 17:38:40.043619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.045532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1145/2363] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:39 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1329 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:40.060575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:40.061531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:40.063772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.067535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.070657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.071132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.074266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.075039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.075724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.092543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.095501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.103890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.455513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:40.467318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db650d96-52b2-4daf-869c-d168322ec55d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1673 microversion: 2.1 time: 0.417836 Oct 28 17:38:40.483503 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1146/2364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:40 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1673 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:40.483503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-426642e7-df27-420f-a9a7-204a01481926 tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] Calling method '.version_select at 0x7f752862d310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:40.637219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:40.662003 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfabd1d2-a016-434a-8069-eebab523ec8b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1469 microversion: 2.1 time: 0.669043 Oct 28 17:38:40.669539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1219/2365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:39 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1469 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:40.712596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:40.713447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:40.723696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.734816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.736283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.736839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:40.737773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:40.740941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:40.789986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-426642e7-df27-420f-a9a7-204a01481926 tempest-NetworksTest-1464788075 tempest-NetworksTest-1464788075-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 7386 microversion: 2.1 time: 0.313601 Oct 28 17:38:40.791089 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1147/2366] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:38:40 2022] GET /compute/v2.1/os-networks => generated 7386 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:41.014562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:41.015252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:41.025187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:41.029853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:41.030680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:41.031647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:41.032265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:41.032867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.052595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:42.076874 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48192ee0-0d8d-487e-84bd-1f984ced145a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 1.366842 Oct 28 17:38:42.077524 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1220/2367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:40 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:42.082556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:42.083171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:42.093698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.094196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.097377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.098434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.099607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.101342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.295542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:42.324449 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad7192b4-d0a2-47e5-ae24-5e2ec6f5872d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1522 microversion: 2.1 time: 1.308592 Oct 28 17:38:42.328119 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1148/2368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:41 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1522 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:42.349411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:42.350039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:42.354700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:42.368849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.369705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.370373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.371436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.372061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.372547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.620845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:42.649469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff229184-4917-486f-8dd0-5fe27fd68e0d tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.570749 Oct 28 17:38:42.670069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:42.676121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1221/2369] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:42 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:42.686329 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-232ebcb6-e29c-4c90-8b8d-d8c6baefd8a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.346100 Oct 28 17:38:42.702929 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1149/2370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:42 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:42.702929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:42.702929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:42.710289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.711030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.711525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.713010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.713854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.714748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.958501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-plugged", "status": "completed", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:42.974253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:42.975081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:42.975766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:42.995936 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Creating event network-vif-plugged:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h1-860864-13 Oct 28 17:38:43.004801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] Instance 82828f5b-aef0-46db-bbef-7b6f74930211 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:38:43.022269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4e8be77e-0cdf-4e01-a7cf-4483ebafa4b3 req-ef830672-ad92-424a-b73c-e969b84357a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343142 Oct 28 17:38:43.023817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1222/2371] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:43.037338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:43.042583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:43.055186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.057511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.058306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.059406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.060293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.061427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.279750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:43.289076 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d35f980-f054-4d4a-8abf-047f91a368bc tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1469 microversion: 2.1 time: 0.600209 Oct 28 17:38:43.304096 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1150/2372] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:42 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1469 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:43.312832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:43.313767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:43.320626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.322133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.322807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.323784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.324450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.325032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.437695 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9a9d554-43e8-45c8-a633-3301afb6fd91 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 200 len: 324 microversion: 2.1 time: 0.410515 Oct 28 17:38:43.443758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1223/2373] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:38:43 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:43.451400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:43.452614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:43.461324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.462694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.463344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.465067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.465987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.467111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.824026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:43.835207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c5092ef-5d5b-4bb1-a57e-9dad0b2fcb5e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.529191 Oct 28 17:38:43.835904 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1151/2374] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:43 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:43.843865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:43.844806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:43.854028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.854812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.855250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.856334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:43.856844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:43.857502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:43.971961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:43.983628 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d020ec6f-e50f-429a-9f88-7a13b09ade9e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1504 microversion: 2.1 time: 0.538078 Oct 28 17:38:43.985611 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1224/2375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:43 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:43.994927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:43.996820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:44.007220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.007981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.008660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.010589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.011303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.011997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.413544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:44.424335 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34f9ac6f-5b55-4b3f-a729-850d738f2d03 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.585503 Oct 28 17:38:44.425275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1152/2376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:43 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:44.430513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:44.432094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:44.439782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.440367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.441045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.442165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.444772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.444772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.498370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:44.507810 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bfd5cccf-8c3f-42b5-ba76-dfb9bd2fb870 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.520633 Oct 28 17:38:44.508429 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1225/2377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:43 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:44.515156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:44.515808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:44.523278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.524055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.524936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.525951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.527073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.527762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.852169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:44.864415 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-beb03a32-877e-4e49-b403-070175c4c91e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1469 microversion: 2.1 time: 0.437859 Oct 28 17:38:44.875463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1153/2378] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:44 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:44.884951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:44.885737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:44.886276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:44.894206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.894341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.895443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.896421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.897031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.897810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.899053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f800669c-a129-4000-a73f-ffba81c69624 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.388623 Oct 28 17:38:44.900244 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1226/2379] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:44 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:44.931292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:44.931292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:44.950400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.951732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.952744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:44.954114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:44.954659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:44.955089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:45.318055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:45.328073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70a9e8a3-c61d-46e5-8df5-2e0e802ac498 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.461215 Oct 28 17:38:45.328891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1154/2380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:44 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:45.333646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:45.334401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:45.341006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:45.342219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:45.342929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:45.343810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:45.344395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:45.345242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:45.380635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:45.398500 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-363334f0-8208-446f-8de4-41b912f535ed tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.474441 Oct 28 17:38:45.399282 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1227/2381] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:44 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:45.424108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:45.424879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:45.432596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:45.433167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:45.433751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:45.434520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:45.435134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:45.435717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.138497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:46.147061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:46.150674 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-adac3bb8-46a0-45c7-b325-12e204349d52 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1504 microversion: 2.1 time: 0.820539 Oct 28 17:38:46.151458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1155/2382] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:45 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1504 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:46.171908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:46.172530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:46.174385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:46.190575 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1769249-e87d-4326-8e3a-550f5da10bc7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.771317 Oct 28 17:38:46.192868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1228/2383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:45 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:46.195114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.195648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.196369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.199045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.200022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.200634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.206128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:46.208022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:46.222739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.223580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.224527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.226067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.251780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.255198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.737695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:46.754196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-02083b53-9871-46d2-9269-7ac42314a629 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.601200 Oct 28 17:38:46.769961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1156/2384] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:46 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:46.777618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:46.781975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbdee1b-247b-4d3b-808f-0848600dcf6c", "name": "network-vif-unplugged", "status": "completed", "tag": "0e6eb9b0-25d6-41ad-930a-84e9821eee05"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:46.790164 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1f4afff-15b5-4a12-9469-26aa8f3fccee tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1535 microversion: 2.1 time: 0.595426 Oct 28 17:38:46.790806 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1229/2385] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:46 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1535 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:46.811622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.812003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.812731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.833880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] Unable to find a host for instance dbbdee1b-247b-4d3b-808f-0848600dcf6c. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:38:46.835811 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3f8d400a-d5ed-4c03-a787-3a467ecdd59a req-2008c723-49b5-4ff1-be32-3fd5b7817af1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060552 Oct 28 17:38:46.836704 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1157/2386] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 17:38:46.842296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:46.843170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:46.850626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.851349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.852874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:46.853808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:46.854463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:46.855359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.031649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84546210-6265-4273-9759-aa689156f9b5", "tag": "6a1c3507-0640-4508-b0c7-16eac274211e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:47.042445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.043139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.043944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.058416 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] Creating event network-changed:6a1c3507-0640-4508-b0c7-16eac274211e for instance 84546210-6265-4273-9759-aa689156f9b5 on n-h1-860864-13 Oct 28 17:38:47.077309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-cb23e7a7-921b-42e4-892f-5caa950402bd req-67c28f7d-9afb-499a-9d77-f79d954dc472 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284776 Oct 28 17:38:47.079096 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1230/2387] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:47.090019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-522432642", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "433988cf-7d9a-4f57-bc43-869692e1a0af"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:47.176786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] validate_networks() for [('433988cf-7d9a-4f57-bc43-869692e1a0af', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:47.237830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:47.251785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b484866-7fd0-46d2-bc99-eacb810d199d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.413679 Oct 28 17:38:47.252800 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1158/2388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:46 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:47.279158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:47.280090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:47.291695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.292504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.293131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.294107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.294730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.295332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.686946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=20 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:47.773400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:47.786268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39d58fd2-111a-48f3-9871-ee0feeb7fd1e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 200 len: 1447 microversion: 2.1 time: 0.512457 Oct 28 17:38:47.786860 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1159/2389] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:47 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 1447 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:47.820553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-unplugged", "status": "completed", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:47.844687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.848796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.849308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.875887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Creating event network-vif-unplugged:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:38:47.886586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] Instance 82828f5b-aef0-46db-bbef-7b6f74930211 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:38:47.919019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-23daef50-fee4-437f-b789-d2a14bc80878 req-9af43ba6-9aed-4969-b420-e9ff9575f704 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105852 Oct 28 17:38:47.920511 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1160/2390] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:47.934560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:47.936282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:47.964639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.965265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.966713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:47.967775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:47.969731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:47.971060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.335471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:48.340441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:48.363004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0e91c4fc-58b7-4dc2-9dc1-4c29a06e9926 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.441086 Oct 28 17:38:48.368220 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1161/2391] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:47 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:48.375038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:48.382018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:48.394841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.395337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.395800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.396530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.396983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.397408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.463129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:38:48.484563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Working on deleting snapshot 5314c228-110a-487a-b208-e8abe27480f0 from shelved instance... Oct 28 17:38:48.555709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:48.556588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:48.557688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:48.558252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:48.558967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:48.592248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.593546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.594316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.596616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.597236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.598537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.623871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:48.631789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:48.654546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:48.657864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:48.773251 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-694f0493-fab6-414b-95c7-66751322f85a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686361 Oct 28 17:38:48.774273 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1231/2392] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:48.793615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:48.795795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:48.812774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.818055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.818522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:48.819304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:48.819929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:48.820269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.152718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:49.178010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c97ea088-eb1d-4b18-9544-c5282c8acb5e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1535 microversion: 2.1 time: 0.389985 Oct 28 17:38:49.182367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1232/2393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:48 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1535 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:49.201931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:49.202965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:49.207787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:49.218339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.219922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.223506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.224371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.224849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.225624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.512886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:49.529511 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f64ffa6f-f193-4b47-8b49-58f17042675e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.345692 Oct 28 17:38:49.531972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1233/2394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:49 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:49.537617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1a62667-cde9-433f-8bf7-e72bca4531f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:49.538791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d1a62667-cde9-433f-8bf7-e72bca4531f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:49.748855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1a62667-cde9-433f-8bf7-e72bca4531f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:49.762521 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1a62667-cde9-433f-8bf7-e72bca4531f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1214 microversion: 2.1 time: 0.229132 Oct 28 17:38:49.783403 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1234/2395] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:49 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:49.785880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50f55cd-d45e-4efc-9a70-f5e2065e866e", "name": "network-vif-plugged", "status": "completed", "tag": "73868f29-a1a3-435f-bdf9-58111447d35b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:49.814457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.815407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.816370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.846113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Doing local delete in cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120568) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 17:38:49.848334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.848997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.850406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.851122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 17:38:49.863079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] deallocate_for_instance() {{(pid=120568) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 17:38:49.866221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] Creating event network-vif-plugged:73868f29-a1a3-435f-bdf9-58111447d35b for instance b50f55cd-d45e-4efc-9a70-f5e2065e866e on n-h2-860864-13 Oct 28 17:38:49.877911 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ab9018e2-7914-4fd8-8326-b3f68b51ab85 req-00236c86-ed2b-40c4-be15-e97f4e700e32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101173 Oct 28 17:38:49.880931 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1235/2396] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:49.899265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:49.902936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:49.910916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.911457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.911906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.912634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:49.913094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:49.913526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:49.961149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:50.762767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:50.776137 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0a04673-275f-4a6d-a167-3cba4eec70d8 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.891537 Oct 28 17:38:50.776958 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1236/2397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:49 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:50.792121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:50.815431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:50.816138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:50.816756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:50.847075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Creating event network-changed:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:38:50.861028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] Instance 82828f5b-aef0-46db-bbef-7b6f74930211 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:38:50.893039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9133daf4-fbcf-4f15-8336-1d4e5164f0d3 req-f806703d-6a1a-4209-922f-e4263adffab6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115056 Oct 28 17:38:50.893766 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1237/2398] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:50.899113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:50.905939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:50.923851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:50.926822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:50.927267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:50.928115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:50.928632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:50.929059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:51.373652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:51.385538 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e434a2b5-5ff9-406c-bc87-9feed040ee3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1535 microversion: 2.1 time: 0.490498 Oct 28 17:38:51.386835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1238/2399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:50 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1535 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:51.396389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:51.397298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:51.405384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:51.406759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:51.407684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:51.408615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:51.409292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:51.409919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:51.914181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:51.928107 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-356de1cf-a37b-4ec4-a7b9-f1c7e765f312 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.539883 Oct 28 17:38:51.929355 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1239/2400] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:51 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:51.936637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:51.940078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:51.955200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:51.955963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:51.956585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:51.957461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:51.958384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:51.959737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.173591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:52.245179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b1f16f7-e4e2-4857-a47e-8157afb4b6af tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1218 microversion: 2.1 time: 0.314330 Oct 28 17:38:52.249701 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1240/2401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:51 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1218 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:52.272772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:52.273390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:52.301122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:52.301879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:52.302474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.304211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:52.308825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:52.309497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.376963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Updating instance_info_cache with network_info: [] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:38:52.736293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b7385cd-6ac8-4079-87f2-4270d05b1202 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 204 len: 0 microversion: 2.1 time: 4.366759 Oct 28 17:38:52.738438 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1162/2402] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:38:48 2022] DELETE /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 0 bytes in 4369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:38:52.753360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbdee1b-247b-4d3b-808f-0848600dcf6c", "name": "network-vif-deleted", "tag": "0e6eb9b0-25d6-41ad-930a-84e9821eee05"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:52.778316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:52.779103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:52.779818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.795545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] Unable to find a host for instance dbbdee1b-247b-4d3b-808f-0848600dcf6c. Dropping event network-vif-deleted {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:38:52.796986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-10a32497-a5ba-4edc-b450-25c0a36984b1 req-6384ef5f-1bbf-45d0-a3e1-4a016390dac5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.056519 Oct 28 17:38:52.798117 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1163/2403] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 17:38:52.803309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:52.804264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:52.830835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:52.831806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:52.832647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.834287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:52.835150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:52.837421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:52.989899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:53.004196 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89cecc50-a56b-44ff-a209-8695029930fe tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.750484 Oct 28 17:38:53.005107 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1241/2404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:52 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:53.011984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:53.013030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:53.036616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.038190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.040737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.045242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.048758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.049576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.106062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c HTTP/1.1 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'dbbdee1b-247b-4d3b-808f-0848600dcf6c'} Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:53.109001 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:38:53.113805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.115693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:38:53.116795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c86b786e-e05d-45b9-b346-9976dfc9ce55 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 404 len: 111 microversion: 2.1 time: 0.110273 Oct 28 17:38:53.117747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1242/2405] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:53 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:38:53.144269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:53.148834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:53.167482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:53.172403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.172909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.173356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.174125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.174595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.175005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.183878 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17048faa-96ae-4364-ba30-c8454167472b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1528 microversion: 2.1 time: 0.383993 Oct 28 17:38:53.186785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1164/2406] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:52 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1528 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:53.211913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:53.213073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:53.223601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.225145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.225832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.227029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.228308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.229813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.573644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:53.582277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9560f89-2e4c-49e0-9cab-d876162dc395 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1316 microversion: 2.1 time: 0.463169 Oct 28 17:38:53.596677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1243/2407] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:53 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:53.606834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:53.608174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:53.616537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.617276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.618008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.619616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:53.620320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:53.621028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:53.655954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:53.671094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23f824ed-24ad-4346-8730-08300c0088a9 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1528 microversion: 2.1 time: 0.459803 Oct 28 17:38:53.686398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1165/2408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:53 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1528 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:53.702164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-430889428", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:53.825500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:53.852325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:53.861318 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76a5d623-df8a-447f-b8e1-922c342e9528 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1266 microversion: 2.1 time: 0.259759 Oct 28 17:38:53.866981 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1244/2409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:53 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:53.875993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf530e8-5512-4925-9ff6-d928a7194827 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:53.887995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fcf530e8-5512-4925-9ff6-d928a7194827 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] HTTP exception thrown: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf530e8-5512-4925-9ff6-d928a7194827 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Request method failure captured: Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/flavors/e7f23dc1-4951-490a-a228-97dbca4c5ff7 HTTP/1.1 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLGrMMJYMlPFXp349YGc4td4Sn33ULJn3hv8O7XXJkuRJfYnkzpeSpybYCdJmbv3YuLSSKag-A008P-Eg9qv9FRS2aFSm7hxa9pCycg2k7IGaM3Gj1dOy7jkhI9_qxOqzDaBhbT2C_YehxiHYEa25tc0448wmjc-g_5PGf3hdQ_0AA Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 3bd169f155a6401ab55275d29c23fb1a Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MigrationsAdminTest-598534258 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3bd169f155a6401ab55275d29c23fb1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3bd169f155a6401ab55275d29c23fb1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3bd169f155a6401ab55275d29c23fb1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3bd169f155a6401ab55275d29c23fb1a"}]}] Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MigrationsAdminTest-598534258 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 3bd169f155a6401ab55275d29c23fb1a Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MigrationsAdminTest-598534258 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MigrationsAdminTest-598534258-project-admin Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e8870f26a16449bdb0f1c6ae54695bf9 Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MigrationsAdminTest-598534258-project-admin Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e7f23dc1-4951-490a-a228-97dbca4c5ff7'} Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.904249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf530e8-5512-4925-9ff6-d928a7194827 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Returning 404 to user: Flavor e7f23dc1-4951-490a-a228-97dbca4c5ff7 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcf530e8-5512-4925-9ff6-d928a7194827 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/e7f23dc1-4951-490a-a228-97dbca4c5ff7" status: 404 len: 109 microversion: 2.1 time: 0.037586 Oct 28 17:38:53.909238 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1245/2410] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:38:53 2022] DELETE /compute/v2.1/flavors/e7f23dc1-4951-490a-a228-97dbca4c5ff7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:38:54.034506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:54.035202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:54.073401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:54.073955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:54.083506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:54.083506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:54.083506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:54.083506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:54.406970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:54.428493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c5220e8-7111-4756-b746-c15b51a18132 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.398201 Oct 28 17:38:54.433118 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1246/2411] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:54 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:38:54.588669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1240619333", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:54.702606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] validate_networks() for [('24b50b8e-95f6-48c0-8a7b-db7ad2a819a1', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:55.066596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:55.067594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:55.068311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:55.069749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:55.070638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:55.094863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:55.096200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:55.096651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:55.097425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:55.097881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:55.098312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:55.145138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:55.159725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:55.179696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:55.183049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:55.258943 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e96014c5-1314-4cca-ba37-a86688053a8c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571052 Oct 28 17:38:55.260648 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1166/2412] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:55.270502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1174445705", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:55.383595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:38:55.797744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:55.798294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:55.798875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:55.799416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:55.800061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:55.813761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:55.816436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:55.820620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:55.822091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:55.823743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:55.824475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:55.845694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Getting quotas for project a553d7c9baa545e5b21faa4ed1c63873. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:55.858167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Getting quotas for user 6b8ab14d2a2a435bb24e42c8d2a12dca and project a553d7c9baa545e5b21faa4ed1c63873. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:55.893932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:55.896352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:55.996426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ef200588-74df-496a-9621-c65e3602e171 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.559801 Oct 28 17:38:56.005756 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1247/2413] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:56.012390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:38:56.012948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:38:56.013446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:38:56.014087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:38:56.014505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:38:56.019149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:56.020598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:56.031333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.031850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.032101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.032278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.032914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.033471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.035389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.036799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.037611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.046847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.047434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.047846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.120724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:38:56.154720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Getting quotas for user e174a38769804247965891c498020315 and project 93d7a495ce6c42f08f2b2dbacaf6c46f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:38:56.204331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:38:56.206531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:38:56.355200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a5db264-7d84-497b-969b-06d56e7dec66 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092703 Oct 28 17:38:56.356996 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1167/2414] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:38:56.408226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84546210-6265-4273-9759-aa689156f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "6a1c3507-0640-4508-b0c7-16eac274211e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:56.457983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.458535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.458968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.497827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] Creating event network-vif-plugged:6a1c3507-0640-4508-b0c7-16eac274211e for instance 84546210-6265-4273-9759-aa689156f9b5 on n-h1-860864-13 Oct 28 17:38:56.514114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4fb5e089-3509-4d15-9b89-acf04649de6f req-4e520380-0e6a-457c-b37b-e2e6d9e22124 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155617 Oct 28 17:38:56.520770 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1168/2415] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:38:56.541472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:56.542188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:56.606454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.610131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.612085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:56.615443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:56.616358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:56.625199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:57.337519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:57.356738 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff1d679e-1017-4d22-9346-a31b4ee8d2ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1464 microversion: 2.1 time: 1.349268 Oct 28 17:38:57.358072 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1248/2416] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:56 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1464 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:57.365639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:57.366515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:57.374584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:57.376269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:57.376986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:57.377694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:57.378623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:57.379851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:57.380443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:57.428845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:57.433121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:38:57.461268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a70f211-0a14-40f8-b736-f9324c50fe80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.939039 Oct 28 17:38:57.465879 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1169/2417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:56 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:57.558471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:57.577341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b1956e6-c0e7-4e96-93b7-f41e680d98b4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1266 microversion: 2.1 time: 0.217298 Oct 28 17:38:57.581133 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1249/2418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:57 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:57.586219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:57.591791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:57.613758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:57.616960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:57.618483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:57.627735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01f0301b-cafa-477b-ad1a-1c002cdf982c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Action: 'create', calling method: .version_select at 0x7f75240b1940>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:38:57.643078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:57.644625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:57.647003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:58.329685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:58.341627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f002534-d0a6-4a7b-946b-c2366dce9412 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1402 microversion: 2.1 time: 0.757983 Oct 28 17:38:58.344195 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1250/2419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:57 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1402 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:58.370273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:58.370897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:58.388514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:58.389219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:58.390418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:58.395678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:58.396439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:58.397053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:58.599468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:58.621479 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3a2c494-5371-4e8f-88e7-b4ca8784a0d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1218 microversion: 2.1 time: 0.275767 Oct 28 17:38:58.629977 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1251/2420] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:58 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:58.674655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:58.676949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:58.691602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:58.692614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:58.693364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:58.696123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:58.698939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:58.699788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:58.909474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:38:58.927218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd7ad229-5da6-4dd6-9643-01eefdd50f56 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1273 microversion: 2.1 time: 0.289251 Oct 28 17:38:58.927909 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1252/2421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:58 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:38:59.154097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:38:59.155325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:38:59.164489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:59.166400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:59.167126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:38:59.168095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:38:59.168719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:38:59.169348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.288552 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83097d77-de57-4216-8002-2ebdaedafdc8 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1617 microversion: 2.1 time: 1.359554 Oct 28 17:39:00.290260 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1253/2422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:38:58 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1617 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:00.296498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:00.297307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:00.324460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:00.325055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:00.325506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.326233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:00.326692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:00.327125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.585246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:00.594734 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57194214-1092-4da2-ab2a-8f4c7fd68ab2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.303180 Oct 28 17:39:00.595824 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1254/2423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:00 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:00.600579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:00.601390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:00.620924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:00.621710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:00.622152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.623758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:00.624841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:00.625278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.657059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:00.917051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:00.934968 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc9806b4-2ef6-4bfe-b2a2-0e58243ae381 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.336750 Oct 28 17:39:00.945120 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1255/2424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:00 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:00.945120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-plugged", "status": "completed", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:00.956806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:00.957598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:00.958332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:00.975780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] Creating event network-vif-plugged:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:39:00.989224 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b0784c83-f631-4ba4-bb53-adac3d9f08b7 req-a0dd834a-c7ad-47f9-8143-bc07961f31b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051282 Oct 28 17:39:01.002716 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1256/2425] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:01.010647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:01.011839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:01.020682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.022214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.022919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.023774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.025069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.025694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.357262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01f0301b-cafa-477b-ad1a-1c002cdf982c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.890129 Oct 28 17:39:01.367108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1170/2426] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:38:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:01.375866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:01.378344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:01.390178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:01.403445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b108c42a-6570-4232-90d7-5007ca8631cd tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1589 microversion: 2.1 time: 0.397796 Oct 28 17:39:01.405508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.406012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.406482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.407064 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1257/2427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:01 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1589 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:01.411703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.412212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.414780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.416990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:01.417489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:01.432559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.433049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.433497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.437263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.437744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.440312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.513840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:01.529875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72016440-013a-46d5-adf8-cfef6aa81040 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1272 microversion: 2.1 time: 0.159817 Oct 28 17:39:01.531282 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1171/2428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:01 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:01.544124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0bd4c1-ca80-4362-8d59-d983ead1c152", "tag": "c4892494-7846-479d-bccf-d582580e9e55"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:01.568081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.569106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.569901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.591788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] Creating event network-changed:c4892494-7846-479d-bccf-d582580e9e55 for instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 on n-h2-860864-13 Oct 28 17:39:01.602846 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e9418c73-2f8a-42c3-8db8-442cc4300f5e req-f8c0b8c7-0499-4a63-9f19-546116297214 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069809 Oct 28 17:39:01.604438 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1172/2429] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:01.619654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: .version_select at 0x7f75240b1d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1200529018", "policies": ["affinity"]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:01.660542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:01.678274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:01.712281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:01.732011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53993d67-990a-443d-b361-4ec69b947f5b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.323611 Oct 28 17:39:01.747413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1258/2430] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:01 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:01.748287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-667f6b88-e025-4fc3-8c3c-8330cc6f892d tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f752463ef70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:01.764300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:01.780594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:01.788074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:01.824884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70f47a59-0fbf-4b4e-986c-7212e693b1a3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.218388 Oct 28 17:39:01.825820 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1173/2431] 10.222.0.48 () {60 vars in 1174 bytes} [Fri Oct 28 17:39:01 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:01.832650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:01.833480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:01.852285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.853604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.854256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:01.855468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:01.856518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:01.857319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:02.012277 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-125b6986-7f83-43fe-ac2d-d52317482550 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184546 Oct 28 17:39:02.013259 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1174/2432] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:39:01 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:02.018155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:02.018837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:02.036362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:02.037000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:02.037913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:02.038651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:02.039711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:02.041064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:02.155464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-667f6b88-e025-4fc3-8c3c-8330cc6f892d tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/33ae3969-2c49-4dd6-b3a1-76aa7d087f8d" status: 200 len: 142 microversion: 2.1 time: 0.417859 Oct 28 17:39:02.156159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1259/2433] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:39:01 2022] GET /compute/v2.1/os-floating-ips/33ae3969-2c49-4dd6-b3a1-76aa7d087f8d => generated 142 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:02.170012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:02.170012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:02.176267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:02.176843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:02.177358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:02.178216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:02.178798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:02.179505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:02.473443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:02.482537 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d616b23-9c2f-4255-9334-74f58bf04fec tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.468174 Oct 28 17:39:02.498873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1175/2434] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:02 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:02.501572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1288075005", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9c1ae1a3-6450-437a-9e2a-84c50544cfb4"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:02.570422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:02.837824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:02.860005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8eb05195-7ec7-4e93-9190-fa050b01f640 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.694990 Oct 28 17:39:02.860622 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1260/2435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:02 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:02.870384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b546ea9-aa56-456e-93e4-fddaf6a9350a tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f75245b2b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:03.372999 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b546ea9-aa56-456e-93e4-fddaf6a9350a tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.507651 Oct 28 17:39:03.377275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1261/2436] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:39:02 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:03.384223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:03.384840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:03.391463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.391618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.392026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.392746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.393205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.393638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.507407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:03.508070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:03.509373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:03.509963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:03.510608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:03.537193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.537779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.538474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.539584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.539822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.540996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.561170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:03.566800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:03.581690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 2 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:03.584718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:03.627404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120568) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 17:39:03.651784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:03.657986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:03.683398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:03.694728 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16d5065a-c352-411a-93a0-59577927d07d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.316212 Oct 28 17:39:03.695682 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1262/2437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:03 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:03.701573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:03.702158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:03.710845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.712201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.712742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.713949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:03.714682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:03.715734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:03.746650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:03.764200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:03.782355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=df39b6c1-c773-4c8e-b8f3-87a561bbde60,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:03.839329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:03.844941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:03.889827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:03.895580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:03.935610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e040bf4-cb64-4f0e-9a93-0d282e398e1c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.439147 Oct 28 17:39:03.936403 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1176/2438] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 17:39:03.945185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-757fe61d-da0a-4b56-9371-44167e205a14 tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f75242df4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:04.032902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:04.043808 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-929b2ba2-deda-47b4-ab85-03e93f493021 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.346648 Oct 28 17:39:04.065075 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1263/2439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:03 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:04.074149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:04.075124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:04.082752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:04.083568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:04.084260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:04.085157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:04.086043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:04.086647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:04.693450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:04.708890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd1e2d6c-3336-4540-bea7-04cc593b2e7b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.642091 Oct 28 17:39:04.732191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1264/2440] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:04 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:04.737279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:04.761201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:04.768341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:04.769100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:04.795244 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] Creating event network-changed:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h2-860864-13 Oct 28 17:39:04.802512 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-702f4526-956f-4797-8748-31ff8d624887 req-73d6f82d-c4c7-4009-9757-4370cfec3f41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068800 Oct 28 17:39:04.803130 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1265/2441] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:04.821900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:04.824722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:04.841800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:04.842313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:04.843610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:04.850409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:04.850909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:04.851352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.086873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:05.100669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b597a98-c58b-409d-9744-91e50e3952db tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.292015 Oct 28 17:39:05.101280 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1266/2442] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:04 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:05.111080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:05.116933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:05.117893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Searching by: {'deleted': False, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:39:05.125882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.126674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.127323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.128278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.129156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.129734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.164785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:39:05.229442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f408d586-cc01-4c1b-9ae4-5122be626070 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.125029 Oct 28 17:39:05.231204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1267/2443] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:39:05 2022] GET /compute/v2.1/servers => generated 1003 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:05.237499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:05.238720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:05.256057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.256976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.260642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.261891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.262684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.263491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.386084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-757fe61d-da0a-4b56-9371-44167e205a14 tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/33ae3969-2c49-4dd6-b3a1-76aa7d087f8d" status: 202 len: 0 microversion: 2.1 time: 1.444756 Oct 28 17:39:05.391405 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1177/2444] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:03 2022] DELETE /compute/v2.1/os-floating-ips/33ae3969-2c49-4dd6-b3a1-76aa7d087f8d => generated 0 bytes in 1450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:39:05.393507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84546210-6265-4273-9759-aa689156f9b5", "tag": "6a1c3507-0640-4508-b0c7-16eac274211e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:05.414630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.416870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.417272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.457203 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] Creating event network-changed:6a1c3507-0640-4508-b0c7-16eac274211e for instance 84546210-6265-4273-9759-aa689156f9b5 on n-h1-860864-13 Oct 28 17:39:05.464210 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3cf2f861-bc0e-45df-a4fa-8d4d9c103e1e req-32d175eb-1c02-4e13-9865-3f27cd1ca002 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075808 Oct 28 17:39:05.465385 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1178/2445] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:05.473302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:05.474337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:05.482906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.483602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.484321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.485178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.485778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.487005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.536983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:05.552345 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-237f9581-dc1b-4df2-a65b-7d5c6c41d012 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1589 microversion: 2.1 time: 0.319861 Oct 28 17:39:05.553549 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1268/2446] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:05 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1589 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:05.571415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:05.572374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:05.579889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.580596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.581179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.582114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.582710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.583443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.784448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:05.787316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:05.797648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c2b1afbf-a748-45a8-a897-b3ccc72285cb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.242676 Oct 28 17:39:05.811397 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1269/2447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:05 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:05.811590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19c39e2c-2649-40f2-bcf6-eb6a9b6912bd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.333068 Oct 28 17:39:05.811590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1179/2448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:05 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:05.811590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52eb4459-9509-4cd2-911a-56e6c6a64c0d tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Action: 'create', calling method: .version_select at 0x7f752448b0d0>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:05.811909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:05.811909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:05.818253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.818749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.819204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.819930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:05.820556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:05.820993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:05.877374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:06.009371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:06.022349 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf0fe4cb-0655-428e-9ad4-50509676a4e9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1215 microversion: 2.1 time: 0.220404 Oct 28 17:39:06.028880 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1270/2449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:05 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:06.034843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:06.042084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:06.053428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.057708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.058293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:06.061706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.062535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.063971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:06.391003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:06.401389 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-adaaf90c-476a-4481-9394-4f76e01749fa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.371097 Oct 28 17:39:06.402446 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1271/2450] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:06 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:06.408350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:06.409244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:06.416113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.417038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.417627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:06.418564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.419034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.419629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:06.920285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:06.928442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-609c58a3-9543-4775-9662-5b2aa9e21ac1 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.524697 Oct 28 17:39:06.929100 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1272/2451] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:06 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:06.934467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:06.935059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:06.940905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.941337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.941908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:06.943059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:06.943528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:06.944242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.162796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:07.172209 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f522168-b332-4070-8fa3-a08522973aba tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.242091 Oct 28 17:39:07.172816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1273/2452] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:06 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:07.177690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:07.178322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:07.184762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.185299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.185725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.186464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.186952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.187504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.400069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:07.408093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55a59eb3-6ab8-4e17-a229-274700a25716 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.234113 Oct 28 17:39:07.408779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1274/2453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:07 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:07.413606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea888bf3-ba23-4e7e-8406-4dccecaaa59f", "tag": "786c57cd-9f00-4eda-aed8-442d85cf0091"}, {"name": "network-changed", "server_uuid": "3607d568-e8b5-4edf-a0bc-602f9a34f065", "tag": "6ec41165-2ef0-403a-abee-e5d36fe29da3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:07.424809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.425289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.425813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.430789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:07.439887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Creating event network-changed:786c57cd-9f00-4eda-aed8-442d85cf0091 for instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f on n-h1-860864-13 Oct 28 17:39:07.440396 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] Creating event network-changed:6ec41165-2ef0-403a-abee-e5d36fe29da3 for instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 on n-h1-860864-13 Oct 28 17:39:07.449696 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1abc67bc-a256-4ea5-9f03-011b3fbb4989 req-9db28f79-869a-4fab-939d-c17a1373bdaf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039523 Oct 28 17:39:07.450333 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1275/2454] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:07.455907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:07.456604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:07.466983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.467509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.467951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.468697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.469143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.469624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.551245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:07.559903 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c956bec8-28d8-4c11-b280-8a5f6133e445 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1271 microversion: 2.1 time: 0.108259 Oct 28 17:39:07.560499 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1276/2455] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:07 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:07.565247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:07.565862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:07.572740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.573482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.573571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.574285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.574741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.575170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.822377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:07.844996 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c43eed10-626d-413d-981f-9b238f02c25c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.283403 Oct 28 17:39:07.846549 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1277/2456] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:07 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:07.883216 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52eb4459-9509-4cd2-911a-56e6c6a64c0d tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.081450 Oct 28 17:39:07.883943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1180/2457] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:39:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:07.902463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddc27f25-ef3f-413e-85ba-ea4444d715ed tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f75248e23a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:07.967347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:07.969224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:07.992555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.993565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.994585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:07.997003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:07.998134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:07.999252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:08.367870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:08.385128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e32f37aa-2191-4687-9da7-12817039563f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.435445 Oct 28 17:39:08.386283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1181/2458] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:07 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:08.394027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0bd4c1-ca80-4362-8d59-d983ead1c152", "name": "network-vif-plugged", "status": "completed", "tag": "c4892494-7846-479d-bccf-d582580e9e55"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:08.406872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:08.407665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:08.408251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:08.425776 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] Creating event network-vif-plugged:c4892494-7846-479d-bccf-d582580e9e55 for instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 on n-h2-860864-13 Oct 28 17:39:08.433022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8ae8041e-4d12-489c-a27f-c98ffb89647c req-3b7a37a2-ee89-45f9-b2b4-e2e04b47d3b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044855 Oct 28 17:39:08.434706 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1182/2459] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:08.440374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:08.441476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:08.450768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:08.451622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:08.452236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:08.453245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:08.453846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:08.455847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:08.761866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:08.769923 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb4820fa-7124-4664-b02a-b7d1a432b191 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.333858 Oct 28 17:39:08.770511 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1183/2460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:08 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:08.775461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:08.776260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:08.788806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:08.789615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:08.791172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:08.791557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:08.792019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:08.792453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.029716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:09.042336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-633f1ce1-41a5-416b-8328-4cc902560cf5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.270406 Oct 28 17:39:09.043264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1184/2461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:08 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:09.048865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.049733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:09.060418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.061161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.061861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.062778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.063454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.064074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.159625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:09.170325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9db1799-4203-4c5b-a31a-a8bf55ecfb03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1271 microversion: 2.1 time: 0.125667 Oct 28 17:39:09.170932 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1185/2462] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:09 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:09.178001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.178620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:09.185722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.186553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.187194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.188155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.188702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.189250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.214430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddc27f25-ef3f-413e-85ba-ea4444d715ed tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d" status: 202 len: 0 microversion: 2.1 time: 1.321397 Oct 28 17:39:09.215975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1278/2463] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:07 2022] DELETE /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d => generated 0 bytes in 1323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:39:09.225894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f752425c160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.329940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5f6f8436-2349-481a-9898-03e0d1b3645d could not be found", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:39:09.330656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] HTTP exception thrown: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Request method failure captured: Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d HTTP/1.1 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOvCsF7oWuYyoFpDg2uijpNAL9f781qtQVsh9Zg36gc88S7JOQ1XW8kmHDUtYlxej_37w6WbO-yV50Lcv9oKHWllCDyNSwHnxxzzF7MlVlKLYz474eV6b_mLdHxNky3tdZeZ5ahYGl8PCzzXSfvSG5gnSIrBIREGB_daM91k5CNy2U Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4120924317164663af26b86d731a85d3 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4120924317164663af26b86d731a85d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4120924317164663af26b86d731a85d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4120924317164663af26b86d731a85d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4120924317164663af26b86d731a85d3"}]}] Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4120924317164663af26b86d731a85d3 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FloatingIPsTestJSON-1688276340-project Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7c861b3ccf8b4db7abbcdc8c04c93fd8 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FloatingIPsTestJSON-1688276340-project Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: exception: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5f6f8436-2349-481a-9898-03e0d1b3645d'} Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5f6f8436-2349-481a-9898-03e0d1b3645d could not be found Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-741727fe-fb72-4f00-87b4-78881dded220'] Oct 28 17:39:09.333203 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d. Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.338073 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.342293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Returning 404 to user: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:09.343450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77bb08bc-4160-43c4-8992-8b8d53e8236c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d" status: 404 len: 111 microversion: 2.1 time: 0.123775 Oct 28 17:39:09.344254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1279/2464] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Oct 28 17:39:09 2022] GET /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:39:09.354504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Calling method '.version_select at 0x7f7524e5f820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.452196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5f6f8436-2349-481a-9898-03e0d1b3645d could not be found", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:39:09.453204 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] HTTP exception thrown: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Request method failure captured: Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d HTTP/1.1 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOvCsF7oWuYyoFpDg2uijpNAL9f781qtQVsh9Zg36gc88S7JOQ1XW8kmHDUtYlxej_37w6WbO-yV50Lcv9oKHWllCDyNSwHnxxzzF7MlVlKLYz474eV6b_mLdHxNky3tdZeZ5ahYGl8PCzzXSfvSG5gnSIrBIREGB_daM91k5CNy2U Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4120924317164663af26b86d731a85d3 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4120924317164663af26b86d731a85d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4120924317164663af26b86d731a85d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4120924317164663af26b86d731a85d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4120924317164663af26b86d731a85d3"}]}] Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4120924317164663af26b86d731a85d3 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1688276340 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FloatingIPsTestJSON-1688276340-project Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7c861b3ccf8b4db7abbcdc8c04c93fd8 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FloatingIPsTestJSON-1688276340-project Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: exception: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5f6f8436-2349-481a-9898-03e0d1b3645d'} Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5f6f8436-2349-481a-9898-03e0d1b3645d could not be found Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-505940cc-fb6a-40f2-915a-a4a3ab6ff84a'] Oct 28 17:39:09.455852 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d. Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d Oct 28 17:39:09.460223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:09.464154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] Returning 404 to user: Floating IP not found for ID 5f6f8436-2349-481a-9898-03e0d1b3645d {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:09.465505 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d31422c6-25dd-4983-98e1-6a478f67c88c tempest-FloatingIPsTestJSON-1688276340 tempest-FloatingIPsTestJSON-1688276340-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d" status: 404 len: 111 microversion: 2.1 time: 0.116565 Oct 28 17:39:09.466261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1280/2465] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:09 2022] DELETE /compute/v2.1/os-floating-ips/5f6f8436-2349-481a-9898-03e0d1b3645d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:39:09.471777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.472644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:09.479059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.479636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.480078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.481424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.481424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.481660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.609675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:09.617559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ecd3760d-7de7-45c0-aba9-fe3567f03071 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.445411 Oct 28 17:39:09.618971 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1186/2466] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:09 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:09.741224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:09.771843 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6cc5398d-587f-4096-a3c7-73fd3b251cbd tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.304034 Oct 28 17:39:09.773803 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1281/2467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:09 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:09.794262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:09.794877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:09.798843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:09.806947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.815575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.817030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:09.817832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:09.818508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:09.819120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.065964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:10.066598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:10.074982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.075531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.075970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.076875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.077330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.077927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.157824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:10.168135 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e58ddfa-ce4d-41db-8973-aa0b82f7fbad tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.379191 Oct 28 17:39:10.168728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1187/2468] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:09 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:10.197019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:10.197564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:10.208155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.211532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.212817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.213869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.214493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.215231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.335700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:10.344957 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fab73366-5572-4e77-9422-33b896d92b83 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1277 microversion: 2.1 time: 0.154617 Oct 28 17:39:10.345546 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1188/2469] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:10 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:10.460662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea888bf3-ba23-4e7e-8406-4dccecaaa59f", "name": "network-vif-plugged", "status": "completed", "tag": "786c57cd-9f00-4eda-aed8-442d85cf0091"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:10.465377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:10.479592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe06cd07-f61a-4f14-972c-c615523ff707 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.417567 Oct 28 17:39:10.479873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.480517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.483439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.483619 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1282/2470] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:10 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:10.495983 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] Creating event network-vif-plugged:786c57cd-9f00-4eda-aed8-442d85cf0091 for instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f on n-h1-860864-13 Oct 28 17:39:10.501183 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-77ab8ff6-9dbb-4ca4-b074-d97d9fc354d2 req-d9abd41c-8c54-4b49-8858-8111f43c12da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044214 Oct 28 17:39:10.501876 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1189/2471] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:39:10.642103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:10.642912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:10.651580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.652181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.652754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.653733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.654483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.654974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.798541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:10.799433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:10.807142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.808031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.808714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:10.809712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:10.810382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:10.811048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:11.431878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:11.440331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3919316b-3b8b-441b-b807-7ffe41a01c4f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1314 microversion: 2.1 time: 0.802124 Oct 28 17:39:11.440917 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1283/2472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:10 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:11.445799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:11.446582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:11.464326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:11.464832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:11.465269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:11.466984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:11.468123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:11.468704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:11.477182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:11.494899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7f0a632-7b0d-4c07-8cc5-0025fa1a7f92 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.700758 Oct 28 17:39:11.497188 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1190/2473] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:10 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:11.509958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:11.511741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:11.519295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:11.520123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:11.520692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:11.521531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:11.522083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:11.522750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.021651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:12.041673 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8b8cbf2-2f1b-4770-85c0-9c1b710b8614 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.599309 Oct 28 17:39:12.043605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1284/2474] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:11 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:12.050226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:12.051652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:12.058693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:12.062519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.063670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.064288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.065442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.067079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.067736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.068737 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d7d85f4-5c47-4a0c-a913-eeabdae73840 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.569221 Oct 28 17:39:12.069335 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1191/2475] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:11 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:12.375319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df39b6c1-c773-4c8e-b8f3-87a561bbde60", "tag": "dd170404-9356-4571-bea2-ffe70c92544f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:12.397225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.397981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.398571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.416729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] Creating event network-changed:dd170404-9356-4571-bea2-ffe70c92544f for instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 on n-h2-860864-13 Oct 28 17:39:12.432275 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7c0cd110-9c32-437d-9052-b503734f9a93 req-1dc67120-66d1-440b-ad58-f65d40236cb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064745 Oct 28 17:39:12.433441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1192/2476] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:12.470162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:12.471425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:12.486331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.487676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.491811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.492839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.493580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.494279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.512096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:12.526482 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44826b66-b77d-405b-b7a4-6c501025a7cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.481244 Oct 28 17:39:12.527676 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1285/2477] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:12 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:12.556278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:12.557429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:12.595066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.596028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.596829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.597742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.599226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.600698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.923233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:12.940059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e3bed79-3215-4ef8-aad3-951d16eef825 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1501 microversion: 2.1 time: 0.476596 Oct 28 17:39:12.947674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1193/2478] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:12 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:12.965563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-plugged", "status": "completed", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:12.986414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:12.987429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:12.988105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:12.998338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:13.006503 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aeb6212d-ec1a-48ee-b729-604503dbd7ca tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1314 microversion: 2.1 time: 0.476600 Oct 28 17:39:13.011245 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1286/2479] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:12 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:13.011990 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] Creating event network-vif-plugged:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h2-860864-13 Oct 28 17:39:13.016411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:13.022914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.023766 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1be9085b-946f-41b0-8361-6cd8b6056cee req-62491d72-fa87-49b6-b751-381839feefcf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065785 Oct 28 17:39:13.026385 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1194/2480] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:13.031686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.032530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.068272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:13.069941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:13.085430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.086202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.087139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.088225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.088901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.089559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.122231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:13.188485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Going to try to stop instance {{(pid=120567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:39:13.248890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-70d5ba25-57ec-4585-a19f-791b90b80a09 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152/action" status: 202 len: 0 microversion: 2.1 time: 0.236192 Oct 28 17:39:13.250010 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1287/2481] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:13 2022] POST /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:39:13.256211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:13.257583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:13.265490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.266211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.266816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.267705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.268314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.268912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.521131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:13.529554 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3151dcb0-e9c2-40db-9645-c6970c29572b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.466894 Oct 28 17:39:13.530515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1195/2482] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:13 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:13.535855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:13.537387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:13.544572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.545471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.546078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.546962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.548374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.548863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.554575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:13.646452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:13.654983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-195283fd-36eb-4ce7-967d-7fad5bb07e3f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.403667 Oct 28 17:39:13.656091 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1288/2483] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:13 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:13.660909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:13.661644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:13.682953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.683594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.684115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.685048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.685654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.686259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:13.876787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:13.893625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f026b7c-d874-4101-ac01-f6ba38179ee5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.361841 Oct 28 17:39:13.894551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1196/2484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:13 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:13.967524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ede4a2a-bcf3-4c92-b308-577bd9e1e996", "tag": "93abd6ef-2a2d-4ed2-adaf-7060c13fe2df"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:13.976171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=42 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:13.997250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:13.997795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:13.998157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.001811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:14.010153 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-951cd1d6-c164-460a-86be-71299643c611 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.352706 Oct 28 17:39:14.011307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1289/2485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:13 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:14.012784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] Creating event network-changed:93abd6ef-2a2d-4ed2-adaf-7060c13fe2df for instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 on n-h2-860864-13 Oct 28 17:39:14.020532 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-737c2f42-65c7-4df8-a2ee-3974f2952a3b req-dc6cb83e-f7c3-4813-8907-550fadc874a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056772 Oct 28 17:39:14.021452 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1197/2486] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:39:14.032737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:14.033637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:14.049962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.050675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.053321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.056243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.057118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.059849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.249445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:14.258245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03cd13ae-73de-4579-b07b-3aedd515892f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1501 microversion: 2.1 time: 0.229295 Oct 28 17:39:14.258875 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1290/2487] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:14 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:14.284083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:14.291901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.292395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.292835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.374943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:39:14.420076 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b1635f8-f1f8-438d-9e3c-cd9b4552b805 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f/action" status: 202 len: 0 microversion: 2.1 time: 0.142179 Oct 28 17:39:14.421058 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1198/2488] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:14 2022] POST /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:39:14.434997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:14.435913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:14.443213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.443740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.444180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.444889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.445345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.445777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.555703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:14.556561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:14.562811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.563309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.563952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.564791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.565473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.566494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.604426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:14.625181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-326585cd-98fb-4275-aa7f-b9318679a51f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.199851 Oct 28 17:39:14.625815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1291/2489] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:14 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:14.687824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:14.689520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:14.696642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.697725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.698237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.699192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.702306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.702845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.788514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:14.803618 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-484355d8-dff5-4456-8af2-d15037b01e3f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.250965 Oct 28 17:39:14.804855 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1199/2490] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:14 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:14.879585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:14.889265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a0dc6e3-609e-4852-8b28-fc398065fcf4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.209827 Oct 28 17:39:14.889968 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1292/2491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:14 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:14.918741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:14.919353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:14.926533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.927099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.927640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:14.928473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:14.929017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:14.929504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.033968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:15.035016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:15.050915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.051426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.052069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.052783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.053238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.053658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.079509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:15.089659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46aed184-fa26-40ad-89c7-4b5e89d1689b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.175456 Oct 28 17:39:15.104640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1200/2492] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:14 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:15.123049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3607d568-e8b5-4edf-a0bc-602f9a34f065", "name": "network-vif-plugged", "status": "completed", "tag": "6ec41165-2ef0-403a-abee-e5d36fe29da3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:15.133488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.135180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.135658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.143891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:15.148337 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] Creating event network-vif-plugged:6ec41165-2ef0-403a-abee-e5d36fe29da3 for instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 on n-h1-860864-13 Oct 28 17:39:15.155476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-74ecb55c-2718-419d-b728-72567151cd4c req-e1b4a8bb-4835-48f0-867e-7d3959bca916 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037633 Oct 28 17:39:15.156912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1201/2493] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:39:15.266735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:15.277740 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c228072f-11d6-4da5-bee8-119b38049d22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.247287 Oct 28 17:39:15.279156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1293/2494] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:15 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:15.651230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:15.652592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:15.659048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.659575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.660008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.660706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.661159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.661584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.820100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:15.831544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:15.832168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:15.835460 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb022a0e-3459-4b2c-9a6d-40723f4426e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.190331 Oct 28 17:39:15.836212 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1202/2495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:15 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:15.839754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.840256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.840699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.841419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.841878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.842306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.865283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:15.912469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:15.913080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:15.919796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.920320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.920829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:15.921545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:15.922002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:15.922431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.423827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:16.431753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f68cbe6-a616-4057-996e-5de12692ee46 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1313 microversion: 2.1 time: 0.604011 Oct 28 17:39:16.432342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1294/2496] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:15 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:16.447681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:16.453198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:16.453820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:16.454532 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da4bb8eb-45be-4b67-9e39-0ba11bfb5026 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.546025 Oct 28 17:39:16.455201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1203/2497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:15 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:16.460257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:16.460951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:16.467556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.468313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.468966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.469877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.470696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.471491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.472508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.473078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.473992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.474504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.475035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.475560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.727323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:16.741010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:16.754266 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db921d12-5813-4842-9492-a77109ea259f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.305097 Oct 28 17:39:16.770461 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1917f2b2-de6e-4161-85bd-264eddff6f8c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1314 microversion: 2.1 time: 0.301106 Oct 28 17:39:16.770461 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1204/2498] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:16 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:16.773511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1295/2499] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:16 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:16.859457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:16.860400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:16.868713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.869521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.869953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:16.870800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:16.871705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:16.872306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.079730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:17.088428 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63974675-0aeb-4131-bdaa-da750c01dc61 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.233376 Oct 28 17:39:17.089549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1205/2500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:16 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:17.459259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:17.460083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:17.467705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.468178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.468618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.469398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.469933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.470364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.478805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:17.479451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:17.485666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.486157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.487041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.487285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.487939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.488366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.681019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:17.689813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-476f147a-c71c-4006-ab4c-2cfd22c25e80 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1462 microversion: 2.1 time: 0.233872 Oct 28 17:39:17.690571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1296/2501] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:17 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1462 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:17.693570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:17.703274 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-687d089e-9a14-4029-b11c-39894334f8b0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.228841 Oct 28 17:39:17.704605 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1206/2502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:17 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:17.715636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:17.715636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:17.721183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.721771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.722212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.722945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.723419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.723849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.782149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:17.782771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:17.789618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.790153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.790635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.791551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.792012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.792445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.930272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e743ddba-b071-46b1-876c-6f49c5911af9 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1615 microversion: 2.1 time: 0.221210 Oct 28 17:39:17.931468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1297/2503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:17 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1615 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:17.941423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:17.942037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:17.949190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.950074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.950678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:17.951423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:17.952034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:17.952616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.019794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:18.031840 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f07193df-42e0-4800-8ddb-c9e2105d2e64 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.253994 Oct 28 17:39:18.050065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1207/2504] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:17 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:18.060161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:18.060715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.070855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.072596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.073248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.074138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.074744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.075388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.116237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e8870f26a16449bdb0f1c6ae54695bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bd169f155a6401ab55275d29c23fb1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:18.116885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] flavor_id is None. Assuming migration. {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 17:39:18.117330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 17:39:18.152387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:18.169910 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02487624-06eb-479e-a772-467dbd29ede0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1500 microversion: 2.1 time: 0.235272 Oct 28 17:39:18.171791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1298/2505] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:17 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:18.190258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:18.191143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.198189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.199032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.199864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.201185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.203546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.204268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.280059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c005449e-7f6e-4a16-8c28-ca4617b8582a tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271/action" status: 202 len: 0 microversion: 2.1 time: 0.228544 Oct 28 17:39:18.280691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1208/2506] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:18 2022] POST /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:39:18.286388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:18.288958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.296825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.297783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.298486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.299254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.299774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.300175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.331876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lazy-loading 'flavor' on Instance uuid 3607d568-e8b5-4edf-a0bc-602f9a34f065 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:39:18.375002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:18.427247 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32df2486-c9c6-488a-9aa6-7a2736854bfd tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "POST /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065/action" status: 200 len: 32 microversion: 2.1 time: 0.145012 Oct 28 17:39:18.428237 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1209/2507] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:18 2022] POST /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:39:18.444484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:18.445490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.457510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.458024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.458462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.459212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.459775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.460205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.647445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:18.662514 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d9a4f0d3-7526-4391-b743-72756a2e862d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.489588 Oct 28 17:39:18.663069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1299/2508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:18 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:18.671934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:18.672551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.690747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.691255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.691728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.692448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.692897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.693323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.904441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:18.921791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bed9c9a9-3ae7-49a8-a58b-bdaced18c489 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1471 microversion: 2.1 time: 0.491879 Oct 28 17:39:18.938238 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1210/2509] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:18 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1471 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:18.942396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:18.943024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:18.954146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.954910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.955823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:18.956699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:18.957307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:18.957995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.069264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:19.081540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07dd7ad8-bb41-4196-9cbe-2f09cf79c077 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.417353 Oct 28 17:39:19.100384 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1300/2510] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:18 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:19.107772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:19.109150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:19.116673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.117391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.118022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.119553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.120242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.120682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.317237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:19.327524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b17d47c1-3720-4013-a26f-45311609e90f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.396388 Oct 28 17:39:19.328689 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1211/2511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:18 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:19.435086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:19.443307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d165770b-21c1-4983-868f-f7dfe4d93260 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.341509 Oct 28 17:39:19.458974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1301/2512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:19 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:19.694028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:19.694902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:19.709511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.710017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.713074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.713074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.713074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.713074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.949581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:19.950903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:19.959212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.960003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.960670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:19.961589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:19.963127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:19.963894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.038100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:20.048019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc19211d-dedc-4038-8f9f-46771d3aff48 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.363945 Oct 28 17:39:20.049177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1212/2513] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:19 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:20.108650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:20.110013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:20.117030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.117595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.118218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.119896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.120477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.120982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.249945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:20.261140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a62b0fbc-7451-48dd-847a-ddf7781ff408 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1471 microversion: 2.1 time: 0.315565 Oct 28 17:39:20.264439 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1302/2514] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:19 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:20.277766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df39b6c1-c773-4c8e-b8f3-87a561bbde60", "name": "network-vif-plugged", "status": "completed", "tag": "dd170404-9356-4571-bea2-ffe70c92544f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:20.306488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.311468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.312008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.334931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] Creating event network-vif-plugged:dd170404-9356-4571-bea2-ffe70c92544f for instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 on n-h2-860864-13 Oct 28 17:39:20.351788 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f22cd854-9a7f-4bfb-a5d4-f9fc0772afef req-fd90fff7-1dab-438c-a681-841d8fe1fabf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084848 Oct 28 17:39:20.356236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1303/2515] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:20.383242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:20.392322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:20.403189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:20.424069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.426514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.427253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.432734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.436371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.437017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.461307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:20.498167 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a09b7616-4e06-49df-804f-5751a01b0283 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.393663 Oct 28 17:39:20.499444 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1213/2516] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:20 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:20.505048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:20.505648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:20.512314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.513065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.513814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:20.514680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:20.515274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:20.515869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.194938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:21.203893 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28db089a-6044-42c8-aa3d-e2e2d98883b1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.846092 Oct 28 17:39:21.219181 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1304/2517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:20 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:21.219181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:21.219181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:21.223816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:21.237559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d55b3d90-c07a-4252-800e-06d5fd8223f8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.736449 Oct 28 17:39:21.241268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.242016 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1214/2518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:20 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:21.242933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.244669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.245892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.246744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.248598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.285885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:21.286748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:21.294753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.295383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.295948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.297193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.297281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.297651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.519894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:21.528828 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a472cef9-b487-48c4-a407-fca2a6ea7417 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.322393 Oct 28 17:39:21.534752 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1305/2519] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:21 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:21.535038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:21.535184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:21.535332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:21.542870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.543752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.544361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.545266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:21.545487 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56a55e0a-44cb-46f9-bbba-3671f661743b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1471 microversion: 2.1 time: 0.263332 Oct 28 17:39:21.545716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:21.546143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:21.546695 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1215/2520] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:21 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:21.820115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:21.829114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15c361ba-945c-437a-b57b-c93478fa4a7e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.298583 Oct 28 17:39:21.830007 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1306/2521] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:21 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:22.229042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:22.229650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:22.236832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.237538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.237966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.238848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.240612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.241227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.265640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:22.266889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:22.274229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.275567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.276166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.277040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.277656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.278853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.576367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:22.582816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:22.586028 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0815bd0-2a94-4760-916d-a16175623761 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.324201 Oct 28 17:39:22.591876 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e07e5b14-a1ed-40e6-90f2-fe87f569a329 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.367451 Oct 28 17:39:22.601130 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1307/2522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:22 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:22.603781 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1216/2523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:22 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:22.611590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:22.612298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:22.613897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:22.614739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:22.618921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.619543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.620336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.621263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.621825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.622035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.622518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.622965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.623506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.624402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:22.625055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:22.625665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:22.945847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:22.958672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6bede98f-9dc7-4e0c-9289-c8c7f4816769 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.353452 Oct 28 17:39:22.960484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:22.976691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1217/2524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:22 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:22.985230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:22.986843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:22.987439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06bc7447-35d6-4c2f-a888-0836a3d4feac tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.384734 Oct 28 17:39:22.988158 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1308/2525] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:22 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.001252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.198826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:23.208236 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f56abbad-17a1-46d4-9415-31b746926713 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.228528 Oct 28 17:39:23.209136 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1218/2526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:22 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:23.620765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:23.621505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:23.622502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:23.624831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:23.640922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.640922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.640922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.640922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.641272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.641533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.642083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.642518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.643972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.644687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:23.645134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:23.645558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:23.996569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:24.003237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:24.015570 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50d61a5a-954e-4766-89ce-2480fa1a3e9e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.404767 Oct 28 17:39:24.020082 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7d76ad8-8f41-4fa3-82bf-dfbcf48b3a6d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.405437 Oct 28 17:39:24.020979 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1309/2527] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:23 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:24.022431 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1219/2528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:23 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:24.031645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:24.035549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:24.036372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:24.038531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:24.050094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.050598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.051040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.051890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.052342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.052934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.054533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.055294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.056763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.057707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.058618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.059619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.691650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:24.697670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:24.704369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15a3a33d-4731-4a99-890b-493d0786b083 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.677758 Oct 28 17:39:24.705215 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1220/2529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:24 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:24.709769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:24.710454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:24.713940 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-156307f1-5ae4-401a-a1ce-c77bc3d3375d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.691851 Oct 28 17:39:24.714638 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1310/2530] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:24 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.723561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.731899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ede4a2a-bcf3-4c92-b308-577bd9e1e996", "name": "network-vif-plugged", "status": "completed", "tag": "93abd6ef-2a2d-4ed2-adaf-7060c13fe2df"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:24.741741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:24.742299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:24.742793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:24.755405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] Creating event network-vif-plugged:93abd6ef-2a2d-4ed2-adaf-7060c13fe2df for instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 on n-h2-860864-13 Oct 28 17:39:24.761094 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-47a8744d-54fe-4ea6-8f6d-b59dad562dd4 req-d60287c7-81b9-42d9-9520-a0a5532fe4cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035510 Oct 28 17:39:24.761749 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1311/2531] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:24.928378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:24.936966 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f16ac62-9ceb-488c-a19d-36a6f8278fab tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.230751 Oct 28 17:39:24.939416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1221/2532] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:24 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:25.050106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.050721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:25.056414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39a9dc67-3b82-4d66-a236-b20cd43ad59e tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Calling method '.version_select at 0x7f752425cee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.058150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.058831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.059269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.060126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.060577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.061010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.106879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39a9dc67-3b82-4d66-a236-b20cd43ad59e tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.168416 Oct 28 17:39:25.107789 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1312/2533] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:39:24 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:39:25.112723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.113445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:25.121010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.121496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.121930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.122748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.123204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.123655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.147734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:25.251468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:25.259296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40c475ff-9463-4f55-b3c8-ea0c5a59a2c3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.213030 Oct 28 17:39:25.259913 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1222/2534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:25 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:25.275826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-967e3af1-316b-422d-a79d-bc58034c2296 tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Action: 'create', calling method: .version_select at 0x7f75240c13a0>, body: {"pool": "non_exist_pool"} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:25.307333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:25.315104 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6c3cdf0-046e-414c-82e9-46555a44e615 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.206103 Oct 28 17:39:25.315901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1313/2535] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:25 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:25.317603 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-967e3af1-316b-422d-a79d-bc58034c2296 tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] HTTP exception thrown: Floating IP pool not found. Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-967e3af1-316b-422d-a79d-bc58034c2296 tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Request method failure captured: Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 26 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPM4KkLKf621IW3vcqhjwBFF2QBOyqrdQtYIyuTOQ6G_JOCuZ8FU-8zcXoZFjcSWKTZwN3VhqRHDLglHR5MkjkVqvCkEZqOQcfoNh3duOt2a_xOhmR_PmLkGJIyY9M-OEIHfArYk-jN6uc3_zHqPAwasqU7-VxKjo35jHVICbKom0o Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 39b7451a929b49d6992411cfd7edcbe9 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39b7451a929b49d6992411cfd7edcbe9"}]}] Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 39b7451a929b49d6992411cfd7edcbe9 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-FloatingIPsNegativeTestJSON-1913049810-project Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6dd787225d024f68bbe41f476acbc4cc Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1913049810-project Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: {"pool": "non_exist_pool"} Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: exception: Floating IP pool not found. Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:25.319305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:25.324439 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 28 17:39:25.324439 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.324439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-967e3af1-316b-422d-a79d-bc58034c2296 tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Returning 404 to user: Floating IP pool not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:25.324439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-967e3af1-316b-422d-a79d-bc58034c2296 tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.049306 Oct 28 17:39:25.324439 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1223/2536] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:39:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:39:25.334280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Calling method '.version_select at 0x7f75242145e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.377319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 91d48cdc-1489-4f88-8377-d138dd3407ef could not be found", "detail": ""}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 17:39:25.378086 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] HTTP exception thrown: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Request method failure captured: Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-floating-ips/91d48cdc-1489-4f88-8377-d138dd3407ef HTTP/1.1 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPM4KkLKf621IW3vcqhjwBFF2QBOyqrdQtYIyuTOQ6G_JOCuZ8FU-8zcXoZFjcSWKTZwN3VhqRHDLglHR5MkjkVqvCkEZqOQcfoNh3duOt2a_xOhmR_PmLkGJIyY9M-OEIHfArYk-jN6uc3_zHqPAwasqU7-VxKjo35jHVICbKom0o Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 39b7451a929b49d6992411cfd7edcbe9 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39b7451a929b49d6992411cfd7edcbe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39b7451a929b49d6992411cfd7edcbe9"}]}] Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 39b7451a929b49d6992411cfd7edcbe9 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1913049810 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FloatingIPsNegativeTestJSON-1913049810-project Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6dd787225d024f68bbe41f476acbc4cc Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1913049810-project Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: exception: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '91d48cdc-1489-4f88-8377-d138dd3407ef'} Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 91d48cdc-1489-4f88-8377-d138dd3407ef could not be found Oct 28 17:39:25.380204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e79e7d0-e624-4f07-b209-bd99152ac107'] Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef. Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] Returning 404 to user: Floating IP not found for ID 91d48cdc-1489-4f88-8377-d138dd3407ef {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c372d286-16c8-4786-8535-446caad5266f tempest-FloatingIPsNegativeTestJSON-1913049810 tempest-FloatingIPsNegativeTestJSON-1913049810-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/91d48cdc-1489-4f88-8377-d138dd3407ef" status: 404 len: 111 microversion: 2.1 time: 0.053314 Oct 28 17:39:25.387794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1314/2537] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:25 2022] DELETE /compute/v2.1/os-floating-ips/91d48cdc-1489-4f88-8377-d138dd3407ef => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:39:25.729527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.738436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:25.739302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:25.740399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:25.750768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.751465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.752053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.752468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.753116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.753715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.754297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.756773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.757233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:25.758079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:25.758549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:25.759576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.025813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:26.034447 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6c385ba9-9075-4c55-81dd-70a910007e3e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.300158 Oct 28 17:39:26.052870 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1315/2538] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:25 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:26.053454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:26.062234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:26.063191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:26.063787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0026d9e5-7d2c-4710-888f-19ed27bff4cb tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.338912 Oct 28 17:39:26.067038 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1224/2539] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:25 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:26.071113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.073494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.074155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.075099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.075816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.076458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.233767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:26.242049 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af668bdf-f0d8-426a-afd8-8a6c60fb4a19 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.187779 Oct 28 17:39:26.242625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1316/2540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:26 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:26.286836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:26.291221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:26.306952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.307628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.308175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.309140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.310643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.311348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.339585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:26.340560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:26.347248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.347855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.348428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.349304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:26.350002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:26.350553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:26.556620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:26.569096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:26.578419 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3df7c6d5-00a1-45b4-a4ef-cadf54264d32 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.299247 Oct 28 17:39:26.579501 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9cfaa2df-c3cf-4fa4-9a78-04fe3865d6c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1319 microversion: 2.1 time: 0.244701 Oct 28 17:39:26.591920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1317/2541] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:26 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:26.598518 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1225/2542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:26 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:27.066842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.067990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.076099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.081515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.081994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.082743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.083207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.083663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.092193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.092808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.100061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.100806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.101447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.102347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.103351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.103977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.130381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:27.333110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:27.335302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:27.345091 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c7c9c22-4185-44f6-8efe-690e82c3179a tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.257001 Oct 28 17:39:27.345743 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1226/2543] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:27.354004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.354835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.361488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.362280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.362904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.363799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.364285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.364746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.368361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2633434b-a694-45c5-8c3e-4263ae075350 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.306973 Oct 28 17:39:27.384901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1318/2544] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:27.537618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:27.548911 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3e12166-89a8-42c2-a725-01692b1d6dc0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.200169 Oct 28 17:39:27.564299 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1227/2545] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:27.605794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.606397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.606825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.607643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.613343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.613844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.614281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.614980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.615631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.616227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.619217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.619991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.620783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.621669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.622283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.622868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.888324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:27.897178 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b396b9e-e279-4866-b9fd-1c294e56aeb8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1469 microversion: 2.1 time: 0.296040 Oct 28 17:39:27.902489 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1319/2546] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:27.927219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:27.928074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:27.932598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:27.938151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.938847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.939661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.940707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:27.941336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:27.941932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:27.947431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34ec6a38-9ded-4ccd-a0d8-1f40e2ea9918 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.345113 Oct 28 17:39:27.948622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1228/2547] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:28.108562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.117423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed75a017-e64b-4877-b3cd-01b273fb33b4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1468 microversion: 2.1 time: 0.196074 Oct 28 17:39:28.119050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1320/2548] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:27 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:28.140777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.145913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.146787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Searching by: {'reservation_id': 'r-n22ph3wr', 'deleted': False, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:39:28.154435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.155148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.155780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.156671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.157317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.157902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.317684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:39:28.376887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.378156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:28.385564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.386290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.386891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.388071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.388699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.389288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.414355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.427157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.428126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.428658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.624520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.625829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79c4818b-026c-4b4e-a032-759ef104ec88 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-n22ph3wr" status: 200 len: 2930 microversion: 2.1 time: 0.488811 Oct 28 17:39:28.626669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1229/2549] 10.222.0.48 () {58 vars in 1197 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-n22ph3wr => generated 2930 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:28.632149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.633031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:28.635261 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-096f38e2-fb15-46c6-9e96-bfe2ae22dfe5 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.263880 Oct 28 17:39:28.641989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.643079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.644080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.645565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.646271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.646941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.648557 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1321/2550] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:28.660018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.660950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:28.669125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.669871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.670457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.671319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.671951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.672536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.891288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.895276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:28.908494 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2562dff-94f0-4bfa-8763-faccf43ddca1 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.280435 Oct 28 17:39:28.909090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1230/2551] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:28.911836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e2d291c-2022-48ae-acca-0f6bfa6fd4a2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.258150 Oct 28 17:39:28.912415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1322/2552] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:28.918623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.949752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.compute.server_groups [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Querying cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) for 2 instances {{(pid=120567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 17:39:28.950481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.951289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.951662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.972626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:28.973204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:28.980584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.981075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.981510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:28.982215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:28.982683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:28.983085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.006644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3dbef225-42be-4651-b00a-38a7d04d429e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/9c1ae1a3-6450-437a-9e2a-84c50544cfb4" status: 200 len: 266 microversion: 2.1 time: 0.092771 Oct 28 17:39:29.007826 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1323/2553] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/os-server-groups/9c1ae1a3-6450-437a-9e2a-84c50544cfb4 => generated 266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:29.018937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:29.019720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:29.028934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.030237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.030961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.032169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.033066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.033728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.166280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:29.176232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e29a96dc-f3d0-482f-a3a9-083998144e1b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.207932 Oct 28 17:39:29.176833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1231/2554] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:28 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:29.223026 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac12a2ad-15df-493d-a211-84834505a149 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 200 len: 1622 microversion: 2.1 time: 0.207447 Oct 28 17:39:29.227432 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1324/2555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:29 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 1622 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:29.245924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:29.246530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:29.252767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.253240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.253672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.254363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.254904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.255334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.403066 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b1dbfd36-ee1c-4b6c-b709-2dc4eda7e9a2 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1621 microversion: 2.1 time: 0.160820 Oct 28 17:39:29.403866 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1232/2556] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:29 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:29.432688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: .version_select at 0x7f752425cee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-753076330", "policies": ["anti-affinity"]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:29.453803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:29.459742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:29.508416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:29.514580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:29.528056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf8db7ce-771f-4667-9b30-25187b1e89ff tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.103144 Oct 28 17:39:29.528670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1325/2557] 10.222.0.48 () {60 vars in 1174 bytes} [Fri Oct 28 17:39:29 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:29.639807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-908365466", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1a903c87-1291-45d5-a302-2707147b8d5d"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:29.660209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:29.660827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:29.668744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.669663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.670437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.671234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.671799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.672324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.696473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:29.921639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:29.930544 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8fc5cf4-0bfe-4f50-b3d2-a2f5650b8bda tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.274598 Oct 28 17:39:29.936204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1326/2558] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:29 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:29.947104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:29.947745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:29.953897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.954377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.954807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:29.955659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:29.956108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:29.957218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.052551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:30.052967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:30.053439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:30.053839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:30.054888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:30.074285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.074767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.075839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.076565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.077017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.077878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.090958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:30.098635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:30.104608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:30.118781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 2 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:30.122109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:30.122288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:30.132031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-044d4857-5a13-4c4e-a958-ce5122bb6197 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.188198 Oct 28 17:39:30.132745 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1327/2559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:29 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:30.152341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:30.152971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:30.164530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.164917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.166034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.167246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.167519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.168010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.185011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:30.193083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:30.235700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:30.242251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:30.262370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=a4b93f32-d36f-4426-a086-6a7f92b2e169,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:30.323246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:30.328350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:30.328906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:30.337396 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-31a8ca82-d610-4557-8609-0865212ae0e3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.203009 Oct 28 17:39:30.338642 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1328/2560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:30 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:30.343691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:30.345041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:30.352990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.353643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.365997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:30.367644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.369264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.369842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.370438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.371723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'server_group_members'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:30.407893 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0998029-d63e-467f-8f3c-29e51481998c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.771903 Oct 28 17:39:30.411182 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1233/2561] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 28 17:39:30.417606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:30.422386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:30.423047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Searching by: {'deleted': False, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:39:30.445990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.446528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.448868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.451622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.452345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.452993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.533793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:30.544540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d39feda-543c-4f77-b5eb-98d3b5ef03b6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.203565 Oct 28 17:39:30.561109 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1329/2562] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:30 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:30.564562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:39:30.634901 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f67f2910-9025-4cc3-906f-73309c425d4a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.222090 Oct 28 17:39:30.636027 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1234/2563] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:39:30 2022] GET /compute/v2.1/servers => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:30.649738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c0cba2b-3ca5-4c15-8d7c-37baeb05c86f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:30.650646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c0cba2b-3ca5-4c15-8d7c-37baeb05c86f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:30.709878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c0cba2b-3ca5-4c15-8d7c-37baeb05c86f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:30.717403 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c0cba2b-3ca5-4c15-8d7c-37baeb05c86f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1218 microversion: 2.1 time: 0.072615 Oct 28 17:39:30.718782 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1330/2564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:30 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:30.953890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:30.954811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:30.962796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.963912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.964676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:30.965663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:30.966408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:30.967074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.166489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:31.167450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:31.175921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.176720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.177227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.178130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.178809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.181128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.219303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:31.229837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf107150-7861-43fb-a395-48393a243c93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.279576 Oct 28 17:39:31.231123 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1235/2565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:30 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:31.364486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:31.365380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:31.377334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.379502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.380522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.382079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.383121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.383438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.386657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:31.399623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3b49f4c-f228-47b0-ad2a-c87e29942f2e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.244684 Oct 28 17:39:31.401296 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1331/2566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:31 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:31.572122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:31.573303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:31.590406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.590891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.591326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.592087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.592543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.592655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:31.592966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.602179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05818f07-db04-4265-ad5b-3427d11fd446 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.242196 Oct 28 17:39:31.604189 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1236/2567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:31 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:31.744929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:31.745629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:31.756357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.760530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.761175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.762662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:31.765210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:31.765877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:31.787108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:31.797920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f531ef7e-0d00-49c3-86b3-0b9242336c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.231045 Oct 28 17:39:31.800341 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1332/2568] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:31 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:31.855433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:31.869094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a2b30e4-425f-40bb-9c34-03896804b26f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1270 microversion: 2.1 time: 0.127590 Oct 28 17:39:31.870266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1237/2569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:31 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:32.258023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:32.259459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:32.267031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.267612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.268116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.269029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.269480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.269895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.303609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:32.427134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:32.427788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:32.448704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.449282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.449903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.450660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.451119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.453231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.506346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:32.521207 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2bb73d6-a0d9-45fe-9cdd-30b07a1b1028 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.267541 Oct 28 17:39:32.521889 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1333/2570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:32 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:32.634986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:32.639110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:32.646644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.647155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.647644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.648374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.649045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.650699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.943319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:32.958588 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-47c29cd7-2092-4ff5-bcb6-c496eab6cf24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.535298 Oct 28 17:39:32.959961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1238/2571] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:32 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:32.968622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:32.969405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:32.980853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.981345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.981805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:32.982521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:32.983115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:32.983583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:33.028401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:33.039639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aaa833d5-44e7-4c04-9293-0e49dde9c0da tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.414826 Oct 28 17:39:33.041024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1334/2572] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:32 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:33.055109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:33.056225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:33.066905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:33.067560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:33.070673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:33.071994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:33.072476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:33.073025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:33.162736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:33.181083 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d79ad8ef-2641-40b1-8494-e1aac6763413 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1276 microversion: 2.1 time: 0.138181 Oct 28 17:39:33.185329 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1335/2573] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:33 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:33.268275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:33.280883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74d5aafd-8df7-4c0b-903f-e42c561cce31 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.319345 Oct 28 17:39:33.282446 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1239/2574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:32 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:33.545745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:33.546354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:33.553591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:33.554340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:33.554777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:33.555708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:33.556829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:33.557404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:33.799661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:33.812195 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f27bb1b1-73fc-4e2c-bb31-b3afced14dd7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.268836 Oct 28 17:39:33.841679 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1336/2575] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:33 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:33.990883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:33.992278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:34.020964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.021851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.023556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.026203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.028507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.030409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.075020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:34.075968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:34.088556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.089414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.090128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.094380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.095194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.096062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.619398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:34.632353 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2cd983c3-353b-460a-8732-db3431dde2c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.567087 Oct 28 17:39:34.633357 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1337/2576] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:34 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:34.652339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:34.653832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:34.654715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:34.663136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.664906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c6149b1-681b-4f94-bddc-9a2251237708 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.685652 Oct 28 17:39:34.667108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.668343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.676091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1240/2577] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:33 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:34.679058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.681751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.682391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.692982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:34.693898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:34.705734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.706229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.706666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:34.707990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:34.709490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:34.709943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.007923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:35.020276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23ffa293-f62f-4307-85cb-c2c410b8d622 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.385079 Oct 28 17:39:35.023791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1338/2578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:34 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:35.039269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:35.039921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:35.054641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.056580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.057147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.058505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.059118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.059692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.487002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:35.499188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f2a9eb7-fc33-47fd-9032-1cd08fdd0089 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.828524 Oct 28 17:39:35.501419 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1241/2579] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:34 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:35.507192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b93f32-d36f-4426-a086-6a7f92b2e169", "tag": "fe025865-d83a-4040-85a4-0bf479488041"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:35.519024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.519873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.521267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.557601 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] Creating event network-changed:fe025865-d83a-4040-85a4-0bf479488041 for instance a4b93f32-d36f-4426-a086-6a7f92b2e169 on n-h1-860864-13 Oct 28 17:39:35.564021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8fe273a9-c70f-4b35-8b7e-b3dc3b857aaa req-49ef86d8-70f0-43da-bca6-c24e24865460 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061078 Oct 28 17:39:35.564867 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1242/2580] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:35.657674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:35.658621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:35.666289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.667200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.667834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.668712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.669347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.669925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.686960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:35.706669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:35.723638 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb90b8c0-9227-463e-8e18-669e9cbb20a2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.698124 Oct 28 17:39:35.736414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1339/2581] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:35 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:35.746364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:35.746986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:35.763486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.763983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.764419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:35.766127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:35.766586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:35.769938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.179993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:36.209999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae10475d-5587-49d9-ad55-d3d5ab69dd1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.556546 Oct 28 17:39:36.211762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1243/2582] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:35 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:36.219008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:36.220007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:36.239629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.240206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.240716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.241501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.242025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.242529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.260912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:36.298095 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c47e75db-e64a-4e39-be5c-3f711f8681bd tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.560461 Oct 28 17:39:36.303541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1340/2583] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:35 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:36.530895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:36.532265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:36.535591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:36.539799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.541094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.541644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.542366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.542855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.543284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.640306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:36.651752 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3eafbbeb-1500-4479-b52d-da8dda5228c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.437915 Oct 28 17:39:36.652353 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1244/2584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:36 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:36.752426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:36.753231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:36.760865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.762000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.762000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.762809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:36.763335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:36.763822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:36.876563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:36.884878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-342fef1d-c344-4a48-a3fe-8aaaa39c603b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.359226 Oct 28 17:39:36.885902 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1341/2585] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:36 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:37.079302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:37.087213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4439ebc5-48b2-4918-9716-a1e4f39fe3e2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.339271 Oct 28 17:39:37.088559 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1245/2586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:36 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:37.132858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a384cbc-9072-45a6-ab25-18e4379db3b4", "tag": "864abb35-1fa2-4b24-aa34-b021625b04a7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:37.145570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.146046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.146472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.158011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] Creating event network-changed:864abb35-1fa2-4b24-aa34-b021625b04a7 for instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 on n-h2-860864-13 Oct 28 17:39:37.162921 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b07bb6c8-3163-4ef9-be46-e9f99a6aaab9 req-b303247d-4afe-40f4-85b9-0386f88dfbe0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033907 Oct 28 17:39:37.163546 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1342/2587] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:39:37.235703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:37.236322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:37.242340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.242832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.243893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.244604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.245084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.245513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.324694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:37.325461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:37.333979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.334497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.334914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.335656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.336109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.336878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.631138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:37.639637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3157a8da-5cfe-4725-831f-f7f54f013659 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.407788 Oct 28 17:39:37.640245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1246/2588] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:37 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:37.675393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:37.676205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:37.682837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.684574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.684574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.684574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.685155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.685638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.686086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:37.708264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-363db423-80fe-4971-9cf8-50dd2666ecfa tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.387804 Oct 28 17:39:37.708860 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1343/2589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:37 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:37.917536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:37.919497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:37.927497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.928420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.931058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:37.932287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:37.933612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:37.934448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.009970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:38.020421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c84ebfb6-c0bc-40f9-88e0-54de9ec1862c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.348846 Oct 28 17:39:38.021252 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1247/2590] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:37 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:38.112420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:38.113505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:38.120301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.120815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.121243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.121944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.122384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.122827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.258705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:38.266562 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b442ef68-37ff-455c-8c76-719d5a7fe4b9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.362125 Oct 28 17:39:38.267233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1344/2591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:37 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:38.356835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:38.364933 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f003f987-cc99-4fac-94a5-d924ec741925 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.256455 Oct 28 17:39:38.379396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1248/2592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:38 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:38.663291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:38.664323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:38.673053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.673538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.673983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.674735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.675184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.675638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.736282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:38.737703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:38.744701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.745341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.745934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:38.746738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:38.747324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:38.747865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.142996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:39.153488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:39.154259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8630b519-ef25-49ba-bab6-5896a07b89ea tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.422254 Oct 28 17:39:39.155414 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1249/2593] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:38 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:39.160553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:39.161374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:39.168450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.169156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.169781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.170641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.171249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.171844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.178623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-991631e5-4cf9-41d7-afc5-d2ccc454852a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.519129 Oct 28 17:39:39.180321 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1345/2594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:38 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:39.291708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:39.292334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:39.299436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.300472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.301065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.302233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.302857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.303281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.409900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:39.419420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8abed70-946f-4f6b-882f-aaf0e6916bfb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.262705 Oct 28 17:39:39.435177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1250/2595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:39 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:39.435177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:39.435177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:39.445300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.445883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.446329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.447043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:39.447760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:39.448193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:39.587072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:39.603890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f7a416c-87a4-43bf-ba1e-90778b88a3b7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.316698 Oct 28 17:39:39.604626 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1346/2596] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:39 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:39.629001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:39.640694 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb35c86a-5962-44d8-bdb2-e292fb944497 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.207612 Oct 28 17:39:39.640694 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1251/2597] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:39 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:39.808956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-386781228", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8e53cf83-ea72-42d2-b2ea-483082deaa8d"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:39.863145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] validate_networks() for [('8e53cf83-ea72-42d2-b2ea-483082deaa8d', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:40.178165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.178775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.185666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:40.187625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.188465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.189004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.189777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.190314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.190805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.251230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:40.252243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:40.252725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:40.253135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:40.253704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:40.264023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.264531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.264976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.265711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.266373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.266805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.285006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:40.290726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for user 7b923545f92c4290b55733dd4cc1c866 and project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:40.304410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:40.307449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:40.339405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:40.349784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-68e7795d-8e40-4c63-a1b1-dcc20b805f16 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.175408 Oct 28 17:39:40.350385 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1252/2598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:40.355547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.356560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.366213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.366986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.367548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.368580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.369270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.369770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.375669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8248ad3f-3c5f-4488-bcba-77a27d4d6f48 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694319 Oct 28 17:39:40.377198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1347/2599] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:39:40.389688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d9a74d1-5145-4e2f-9860-289acf8ade05 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.392055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d9a74d1-5145-4e2f-9860-289acf8ade05 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.394217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=24 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:40.480318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d9a74d1-5145-4e2f-9860-289acf8ade05 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:40.488404 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d9a74d1-5145-4e2f-9860-289acf8ade05 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1224 microversion: 2.1 time: 0.104269 Oct 28 17:39:40.489187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:40.504463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1348/2600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:40.510090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.510707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.517093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.517671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.518181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.518957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.519504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.520158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.557024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:40.565607 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-411f5a14-154a-49c5-a090-315508c5d5e9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.213978 Oct 28 17:39:40.579349 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1253/2601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:40.629910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.630816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.638643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.640202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.640801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.641800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.642288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.642725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.678654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:40.690370 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95d5f01b-e8cc-47ba-8a58-d7ba6efdc402 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.184712 Oct 28 17:39:40.691088 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1349/2602] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:40.696681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:40.697580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:40.703726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.704824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.705588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.706559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:40.707253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:40.707772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:40.886846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:40.895384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a378c46e-f2c1-45b6-9a0d-0bd892ebf349 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.269593 Oct 28 17:39:40.896834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1254/2603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:40.996801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:41.010673 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32e1bc40-755a-4727-855f-2906c7a1ce3b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.317630 Oct 28 17:39:41.023886 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1350/2604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:40 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:41.375120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:41.376811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:41.409055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.410057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.412231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.414510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.415175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.416868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.480605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b93f32-d36f-4426-a086-6a7f92b2e169", "name": "network-vif-plugged", "status": "completed", "tag": "fe025865-d83a-4040-85a4-0bf479488041"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:41.513920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.514558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.515230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.532737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] Creating event network-vif-plugged:fe025865-d83a-4040-85a4-0bf479488041 for instance a4b93f32-d36f-4426-a086-6a7f92b2e169 on n-h1-860864-13 Oct 28 17:39:41.540958 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-28c32fe7-1361-4e6a-8486-8b81097421c4 req-f3918ecb-8a65-4504-9379-6e9851386074 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077481 Oct 28 17:39:41.542876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1351/2605] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:41.550506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:41.551500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:41.576013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.576733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.577200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.577952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.578433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.581803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.704087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:41.714814 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fafbae6-c5be-4e27-b1c8-97774c9b592e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1276 microversion: 2.1 time: 0.170110 Oct 28 17:39:41.715803 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1352/2606] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:41 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:41.720934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:41.722023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:41.730060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.730810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.731422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.732296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.733037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.733462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.738073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:41.750349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:41.759475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0a69730-3a5d-47c4-af0a-07a2403d2a27 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.387663 Oct 28 17:39:41.761705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1255/2607] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:41 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:41.778274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:41.779215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:41.785640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.786311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.786904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:41.787802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:41.788443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:41.788871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.051163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.070273 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f80b5e6-0f3d-4b19-9ca7-f9788d46a31a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.353184 Oct 28 17:39:42.087913 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1353/2608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:41 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:42.098739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:42.099355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:42.105252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.108518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.109565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.110372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.110703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.111153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.111615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.124971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83d1926c-9779-464e-8728-196047da9dad tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.352751 Oct 28 17:39:42.126129 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1256/2609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:41 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:42.143560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:42.144451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:42.156436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.156937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.157377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.158089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.158544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.158964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.463617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.476739 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0fc44c41-af44-4276-97d6-fe43a5ee4716 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.387567 Oct 28 17:39:42.479983 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1354/2610] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:42 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:42.486052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.495200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ea97669-2ad1-4b02-9c6d-70b22a11403e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.367534 Oct 28 17:39:42.511886 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1257/2611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:42 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:42.741497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:42.742037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:42.750702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.751278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.751807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.752605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.753046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.753471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.783129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:42.784144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:42.792140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.792653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.793173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.793931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:42.794548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:42.795041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:42.827797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.837172 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d355df7-0157-4df2-9d8b-4724375c19b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1282 microversion: 2.1 time: 0.099833 Oct 28 17:39:42.837777 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1355/2612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:42 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:42.945925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:42.956368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8adf4112-f3ac-4b5d-b008-3e6c513cdbd7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.177944 Oct 28 17:39:42.957641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1258/2613] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:42 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:43.094848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.095497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.102129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.103281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.103946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.104677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.105137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.105571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.158980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.160203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.168922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.169720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.170338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.171024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.171664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.172254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.340631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:43.349789 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00724c78-754f-4307-9b58-d2b29418dc2e tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.258746 Oct 28 17:39:43.350484 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1356/2614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:43.369272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:43.377569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b47d8227-e805-484d-b1e4-f4dc81999bd8 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.223424 Oct 28 17:39:43.394761 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1259/2615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:43.500997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.501704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.507859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.508964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.509522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.510339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.510910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.511412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.529337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.530725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.544162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.545297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.546067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.548555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.549871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.550802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.558716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:43.718923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:43.727532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7d5d4be-fab6-4fe5-8b41-b38168218ad1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.230528 Oct 28 17:39:43.736845 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1357/2616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:43.775363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:43.783600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a141b37-198b-4b5e-96e2-6b9bc9988d93 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.263540 Oct 28 17:39:43.784925 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1260/2617] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:43.861101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.861711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.869537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.870055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.870488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.871188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.871668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.872090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.981932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:43.983300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:43.995872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.996978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:43.997710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:43.999052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:43.999834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.000562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.059309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:44.067509 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b9070fe-35a4-4f1d-b989-450aa7e25d71 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.210204 Oct 28 17:39:44.068163 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1358/2618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:44.152057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:44.159965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63017d55-3dd0-4aaf-b325-9565e6b18aa8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.182683 Oct 28 17:39:44.160557 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1261/2619] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:43 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:44.373661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:44.374270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:44.380130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.380607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.381033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.381713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.382163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.382563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.402158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:44.402852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:44.409819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.410309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.410747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.411463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.412153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.412795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.606810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:44.609499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:44.617678 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6debdbc-bb09-4253-9911-408a82bcd6f9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.220142 Oct 28 17:39:44.634828 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1262/2620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:44 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:44.634828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7", "tag": "618178d3-3ee6-4ebc-a0c6-3d3be7827c86"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:44.635163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.635591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.636022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.636864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf11e43d-41bd-41ca-ac36-2ee4dd3e4014 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.248193 Oct 28 17:39:44.638055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1359/2621] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:44 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:44.648638 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] Creating event network-changed:618178d3-3ee6-4ebc-a0c6-3d3be7827c86 for instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 on n-h1-860864-13 Oct 28 17:39:44.654224 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fff7dd5f-6ed3-4a22-a6d3-aacc3e3ce20c req-ae8b9101-a379-4e9a-9b04-ed1a4a6cdf65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Oct 28 17:39:44.654863 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1263/2622] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:44.752246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:44.752816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:44.758914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.759693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.760091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.760806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.761266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.761699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.765456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a384cbc-9072-45a6-ab25-18e4379db3b4", "name": "network-vif-plugged", "status": "completed", "tag": "864abb35-1fa2-4b24-aa34-b021625b04a7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:44.776294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.777046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.778402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.795253 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] Creating event network-vif-plugged:864abb35-1fa2-4b24-aa34-b021625b04a7 for instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 on n-h2-860864-13 Oct 28 17:39:44.804067 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3e7577c9-148e-4737-afe4-9c368c94173d req-79a4f4f1-b9dd-4b75-b46c-e87218663b3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042454 Oct 28 17:39:44.805331 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1264/2623] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:44.812791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:44.813734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:44.822240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.823057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.823694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:44.824685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:44.825298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:44.825880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.046446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.054993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7735a9f-5f1f-4290-afbb-9f90209fb588 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.307135 Oct 28 17:39:45.055644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1360/2624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:44 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:45.092106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:45.092734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:45.093794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.099030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.099561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.100000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.100699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.101187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.101613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.101775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b79dee4-2bd5-4b03-86ba-63b3a2012c09 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1511 microversion: 2.1 time: 0.294280 Oct 28 17:39:45.102348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1265/2625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:44 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:45.184567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:45.185199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:45.191334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.191845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.192418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.193113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.193563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.193988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.243918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.251639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1498768-e6a6-4638-8165-93e28712a46f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.164190 Oct 28 17:39:45.252223 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1361/2626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:45 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:45.332364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.340256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf698dcb-1000-4cd7-83e3-6e84568523ca tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.160331 Oct 28 17:39:45.340826 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1266/2627] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:45 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:45.642479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:45.643107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:45.649886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.650360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.650795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.651497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.651946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.652362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.660620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:45.661259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:45.668661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.669139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.669574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.670262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:45.670717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:45.671142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:45.851094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.858034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:45.859347 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfea4568-27f7-450b-9244-8cb980b9cc79 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1318 microversion: 2.1 time: 0.220716 Oct 28 17:39:45.859981 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1362/2628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:45 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:45.865840 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a6e1294-eb89-4eb4-8fd3-097befade300 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.209038 Oct 28 17:39:45.866408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1267/2629] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:45 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:46.078198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.078721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.085228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.085710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.086144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.087338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.087824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.088338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.124836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.125436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.131557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.132045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.132509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.133204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.133653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.134148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.267071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:46.275666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1976bd6-1700-464c-8a18-f4bbb7872dbe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1511 microversion: 2.1 time: 0.201416 Oct 28 17:39:46.276252 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1363/2630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:46.280696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.281309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.287165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.287689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.288127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.288868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.289329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.289759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.302662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:46.311297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8841fe0b-26a2-47c6-9447-9d84cd75e579 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1488 microversion: 2.1 time: 0.190168 Oct 28 17:39:46.311919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1268/2631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1488 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:46.334668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.335036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.341971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.342462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.342898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.343655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.344138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.344597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.374743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:39:46.441328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:46.450873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a07c9e48-99e3-4b34-8eba-685813b197ee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.173627 Oct 28 17:39:46.451685 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1364/2632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:46.456428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.456774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.463032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.463620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.464095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.464863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.465313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.465734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.467754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76093cef-d85b-4d74-998a-d527f267ac3d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 204 len: 0 microversion: 2.1 time: 0.136952 Oct 28 17:39:46.468350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1269/2633] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:39:46 2022] DELETE /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:39:46.476936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.478170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.484112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.484582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.485017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.485713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.486168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.486591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.655573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:46.663231 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-873058c6-8615-44ba-9ec0-3f2cdce8c8e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.210536 Oct 28 17:39:46.663835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1365/2634] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:46.680418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:46.689261 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-677a2398-c583-4655-a6ab-42cc55930ec9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1494 microversion: 2.1 time: 0.216300 Oct 28 17:39:46.690141 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1270/2635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1494 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:46.882320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.882847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.889177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:46.889346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.889715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.889849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:46.890147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.890833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.891281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.891723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.895704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.896190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.896629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:46.897327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:46.897780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:46.898207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.085549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.092909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.094312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c3dcec8-e388-4ec0-8fc6-4bfb20845c3b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.209788 Oct 28 17:39:47.094903 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1271/2636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:47.101015 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25f5bfc4-31bd-47d6-aa9c-9996634d25a9 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1468 microversion: 2.1 time: 0.222721 Oct 28 17:39:47.101575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1366/2637] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:46 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.122986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.123640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.129601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.130146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.130583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.131304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.131783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.132217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.263204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.271187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d54f15b3-9599-4a95-bcfd-bcbcb9150b43 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 200 len: 1468 microversion: 2.1 time: 0.151907 Oct 28 17:39:47.272002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1272/2638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.293683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.298700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.299594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Searching by: {'reservation_id': 'r-tnjhdjgi', 'deleted': False, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:39:47.300556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.301154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.305014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.305488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.305953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.306673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.307120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.307580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.307692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.308133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.308559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.309507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.309955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.310374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.404338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:39:47.441488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.449892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a3d1e07a-df00-4060-8cfa-421d67312227 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1488 microversion: 2.1 time: 0.153040 Oct 28 17:39:47.450470 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1273/2639] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1488 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.473850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:47.476157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.477018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.482346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.482825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.483253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.483962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.484062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.484406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.484529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.484825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.484933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.576740 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11fb4ede-7c07-4991-ae78-893df89948fe tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 200 len: 178 microversion: 2.1 time: 0.106811 Oct 28 17:39:47.577523 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1274/2640] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:47 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 178 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:47.582645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.583547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.590552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.591040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.591498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.592210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.592657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.593118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.616693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9cbd329b-b044-462d-a079-5e488f2c150c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-tnjhdjgi" status: 200 len: 2929 microversion: 2.1 time: 0.326579 Oct 28 17:39:47.623045 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1367/2641] 10.222.0.48 () {58 vars in 1197 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tnjhdjgi => generated 2929 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.625964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.626579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.638321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.638901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.639337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.640066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.640512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.640932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.802511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.811148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be6c4730-9271-40a0-a886-72632085f0bb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.232486 Oct 28 17:39:47.811852 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1275/2642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.816485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.826904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:47.831704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_groups [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Querying cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) for 2 instances {{(pid=120568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 17:39:47.832419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.832892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.833324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.834723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-594696d5-451c-45bc-9742-05fa83f98aa9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.214316 Oct 28 17:39:47.835876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1368/2643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:47.841398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.842082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.848333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.848997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.849425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.850107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.850571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.850973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.856694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:47.874865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f0c3c27-6735-4db7-9833-0f933de28a31 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/1a903c87-1291-45d5-a302-2707147b8d5d" status: 200 len: 270 microversion: 2.1 time: 0.061866 Oct 28 17:39:47.875640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1276/2644] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/os-server-groups/1a903c87-1291-45d5-a302-2707147b8d5d => generated 270 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:47.880096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:47.880989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:47.887123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.887637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.888074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.888772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:47.889226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:47.889649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:47.893800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:48.044738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.052471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27e98bc3-1693-4739-a4c3-59baeee13c22 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.215362 Oct 28 17:39:48.053041 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1369/2645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.058257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.058858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.064593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.065071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.065503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.066192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.066641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.067058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.067607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.076167 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e47f59fb-2817-423b-9f28-0d54481ffbce tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1494 microversion: 2.1 time: 0.199553 Oct 28 17:39:48.076738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1277/2646] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:47 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1494 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.081233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.081832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.088242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.088728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.089195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.089895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.090336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.090758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.263961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.271934 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10e5b37f-6713-45be-b58e-5463e32060dd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.217916 Oct 28 17:39:48.272603 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1370/2647] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.274327 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b905ca80-ccab-40be-83c3-a53bef84879d tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1621 microversion: 2.1 time: 0.196557 Oct 28 17:39:48.275459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1278/2648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1621 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.277563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.278167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.284077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.284570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.285007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.285702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.286156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.286580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.296644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.297171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.303058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.303580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.304022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.304719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.305173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.306105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.486943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.491409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.495493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dba39b01-88e7-4572-b958-5469cdcbda46 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.221875 Oct 28 17:39:48.496163 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1371/2649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.499302 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0f0dff1-eb4a-4d30-bac6-d78840e73c87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.206544 Oct 28 17:39:48.500067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1279/2650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.500647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.501310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.507081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.507665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.508170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.509475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.509997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.510500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.521768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:48.522374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:48.529120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.529606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.530043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.530732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:48.531183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:48.531634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:48.708783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:48.708986 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6113197-1af9-4d3f-b47b-1119f05f9a82 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 200 len: 1621 microversion: 2.1 time: 0.211701 Oct 28 17:39:48.709576 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1372/2651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 1621 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:48.716716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fd4e3da-54b7-4885-9835-cc7b4ab61a1e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.198633 Oct 28 17:39:48.717289 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1280/2652] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:48.822754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-662431698", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b50f55cd-d45e-4efc-9a70-f5e2065e866e"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:48.827163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-330129699", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "433988cf-7d9a-4f57-bc43-869692e1a0af"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:48.876416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:48.889098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] validate_networks() for [('433988cf-7d9a-4f57-bc43-869692e1a0af', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:49.736335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:49.736805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:49.737237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:49.737652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:49.738061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:49.746909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:49.747411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:49.747848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:49.748569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:49.749020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:49.749440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:49.766754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:49.772098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:49.786492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:49.788923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:49.859267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e0ed9b87-5bd0-45de-a563-b81368d082ac tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040858 Oct 28 17:39:49.860662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1373/2653] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:39:49.867967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:49.868833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:49.883544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:49.884956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:49.885586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:49.887056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:49.887736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:49.888341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.067041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:50.068272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:50.069188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:50.070380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:50.071472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:50.082756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.083664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.084393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.085509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.086041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.086711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.109011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:50.114966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:50.131318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:50.133256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.134125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:50.143630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c56370a-9f41-4154-8e6e-43cca2990c50 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.281646 Oct 28 17:39:50.156525 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1374/2654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:49 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.166753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:50.167438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:50.170363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:50.174497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.175084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.175568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.176776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.177288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.177718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.188201 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-091b9748-981b-486b-a22d-3ceaacb95f45 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364634 Oct 28 17:39:50.189301 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1281/2655] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:39:50.194218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:50.194857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:50.206704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.206704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.207150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.207936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.208400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.208842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.327298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.339546 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2b33283-6007-4917-b2e6-cbf84296912e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1452 microversion: 2.1 time: 0.149018 Oct 28 17:39:50.343580 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1282/2656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:50 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.344674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:50.345290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:50.361664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.362163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.362602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.363313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.366081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.366614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.471522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.492047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-305cd4c5-fbd5-437d-aa19-9313b2b77a4c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.324089 Oct 28 17:39:50.492634 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1375/2657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:50 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.512009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:50.520863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:50.528377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.528822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.529264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.529980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.530440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.530863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.549106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.558764 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89bcaa09-c08d-453c-adb4-833ba5a3d694 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.217605 Oct 28 17:39:50.559464 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1283/2658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:50 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.564279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f247f203-767f-45cb-80e7-d503f68706f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:50.565120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f247f203-767f-45cb-80e7-d503f68706f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:50.603553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.611984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86b7c1a9-6e48-437f-8a9f-0ab0977fbd03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1220 microversion: 2.1 time: 0.115636 Oct 28 17:39:50.624075 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1376/2659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:50 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.628851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea888bf3-ba23-4e7e-8406-4dccecaaa59f", "name": "network-vif-deleted", "tag": "786c57cd-9f00-4eda-aed8-442d85cf0091"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:50.633101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f247f203-767f-45cb-80e7-d503f68706f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:50.641004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f247f203-767f-45cb-80e7-d503f68706f4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1214 microversion: 2.1 time: 0.080177 Oct 28 17:39:50.641468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:50.641621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1284/2660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:50 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:50.642619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:50.642908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:50.658805 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] Creating event network-vif-deleted:786c57cd-9f00-4eda-aed8-442d85cf0091 for instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f on n-h1-860864-13 Oct 28 17:39:50.664201 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6589756f-37be-4267-a44d-fe64d2dc9525 req-f117f529-033c-4129-aa0f-257acbd5b019 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049806 Oct 28 17:39:50.665517 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1377/2661] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:51.171515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:51.172130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:51.179672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.180143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.180577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.181269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.181722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.182177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.313633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:51.321428 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03c1c0a1-8f52-4bc3-9ac5-6b8f8fa374e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.153730 Oct 28 17:39:51.322003 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1285/2662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:51 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:51.364687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:51.365887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:51.373523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.374019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.374459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.375157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.375635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.376059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.442240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:51.450951 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9ea06421-60b0-4dcc-98a8-9292dedbe337 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1452 microversion: 2.1 time: 0.089926 Oct 28 17:39:51.452412 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1378/2663] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:51 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:51.486610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7", "name": "network-vif-plugged", "status": "completed", "tag": "618178d3-3ee6-4ebc-a0c6-3d3be7827c86"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:51.500042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.500238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.500770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.518053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:51.518513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:51.532933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.533598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.535122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.536551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.537196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.538912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] Creating event network-vif-plugged:618178d3-3ee6-4ebc-a0c6-3d3be7827c86 for instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 on n-h1-860864-13 Oct 28 17:39:51.539468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.553637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-665d89e0-e2ea-4526-a397-9477bc6316ab req-57aaff4d-b711-47ab-9c96-bbeac297584a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072339 Oct 28 17:39:51.554953 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1286/2664] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:39:51.589198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:51.591483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:51.601294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.602572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.603106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.604170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.604770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.606635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.892220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:51.900034 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f93e4fa7-3c04-4bc8-b907-0fcec42211f6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.388416 Oct 28 17:39:51.900640 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1379/2665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:51 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:51.905768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:51.906366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:51.912786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.913400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.913837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:51.914524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:51.915153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:51.915611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.022499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:52.027809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:52.031408 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3b702ba-75d3-45a9-b690-84dcd388e1c6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1268 microversion: 2.1 time: 0.129729 Oct 28 17:39:52.032002 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1380/2666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:51 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1268 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:52.036501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:52.037097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:52.043347 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5ba6b79-1c5e-4a16-93fc-141b72fccbf2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.462579 Oct 28 17:39:52.044825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.045490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.045920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.046614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.047060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.047504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.052520 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1287/2667] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:51 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:52.124014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:52.132848 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcb75112-24fd-453e-a6b0-68bd873caff1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1272 microversion: 2.1 time: 0.099802 Oct 28 17:39:52.133478 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1381/2668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:52 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:52.345293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:52.345903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:52.354541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.355068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.356863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.358028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.361776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.362461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.476816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:52.477421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:52.484516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.485009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.485437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.486141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.486593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.487012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.520440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.520844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.521276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.521716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid ea888bf3-ba23-4e7e-8406-4dccecaaa59f {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:39:52.588994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:52.593250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:52.598680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11d11879-3e80-4fd1-8577-b795d7ec0ce3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1324 microversion: 2.1 time: 0.257158 Oct 28 17:39:52.599538 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1288/2669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:52 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:52.614867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-818bec6a-348c-422f-9c75-2e17af23ecd6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1304 microversion: 2.1 time: 0.141687 Oct 28 17:39:52.616167 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1382/2670] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:52 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:52.925640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:52.926306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:52.934351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.934953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.935487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:52.936251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:52.936764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:52.937252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.054526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.055217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.062859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.063443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.063940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.064724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.065240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.065723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.153845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.161657 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1d5715c-fa0a-42cc-aa7c-dc5367f44936 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1268 microversion: 2.1 time: 0.110968 Oct 28 17:39:53.162424 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1383/2671] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1268 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:53.166864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.167495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.173379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.173858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.174295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.174987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.175461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.175887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.186919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.195287 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a82fa6b5-f069-44a8-b6ae-f01f0b399a77 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.274245 Oct 28 17:39:53.195858 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1289/2672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:52 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:53.202295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.203037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.208087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:53.210133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.210818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.211425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.212243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.212903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.213378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.487710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.496819 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ea269ac-202a-468f-93c9-18490463fadf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1506 microversion: 2.1 time: 0.333425 Oct 28 17:39:53.498766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.510422 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd33302b-681f-481b-a19a-b1f429154868 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.313398 Oct 28 17:39:53.512329 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1384/2673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:53.515744 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1290/2674] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:53.625523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.626355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.633179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.633895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.634568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.637078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.637934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.638561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.639646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.640568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.648321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.649037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.649650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.650694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.651299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.651893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.692038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.692507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.692935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.693375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid ea888bf3-ba23-4e7e-8406-4dccecaaa59f {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:39:53.776401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.785899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d130a54-3e5f-4b7d-ac62-038888ac75bf tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1304 microversion: 2.1 time: 0.150960 Oct 28 17:39:53.786588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1291/2675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:53.867981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e96e69a-e36f-4e0c-9b39-d984ed83992b", "tag": "aa725a26-43ac-418f-9a6c-85ebb3c94858"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:53.878951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.879708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.880337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.894311 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] Creating event network-changed:aa725a26-43ac-418f-9a6c-85ebb3c94858 for instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b on n-h2-860864-13 Oct 28 17:39:53.898994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-86a7df3d-aace-403e-b489-ebcd77f1f197 req-73b0557f-1410-4064-a1c0-02f2551225b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034904 Oct 28 17:39:53.899691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1292/2676] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:53.919267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:53.927064 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d877356-eb7c-4fdc-b448-d57ca35e4a25 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.307449 Oct 28 17:39:53.927788 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1385/2677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:53.952530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:53.953378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:53.960522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.961016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.961481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:53.962365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:53.962847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:53.963272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.099455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:54.108421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e665dab-05a4-4f93-9a8f-3f463791dcb6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.161458 Oct 28 17:39:54.108997 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1293/2678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:53 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:54.132007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b25d0a-a48a-4eeb-929e-9776db31405d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1505464868", "metadata": {"": ""}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b25d0a-a48a-4eeb-929e-9776db31405d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action HTTP/1.1 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 107 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1505464868", "metadata": {"": ""}}} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1505464868', 'metadata': {'': ''}}}} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'': ''} Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:39:54.136123 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92b25d0a-a48a-4eeb-929e-9776db31405d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92b25d0a-a48a-4eeb-929e-9776db31405d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action" status: 400 len: 170 microversion: 2.1 time: 0.010433 Oct 28 17:39:54.141005 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1386/2679] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Oct 28 17:39:54 2022] POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action => generated 170 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:39:54.146721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.147326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.153247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.153720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.154151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.154929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.155411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.155829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.186880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.187429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.194444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.194928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.195359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.196069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.196521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.196944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.281865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:54.289505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:54.293630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-352219a4-10eb-417a-8b77-f8342c539c35 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1268 microversion: 2.1 time: 0.111393 Oct 28 17:39:54.296418 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1387/2680] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1268 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:54.303132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.304128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.315132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.315762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.316268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.318214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.318214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.318443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.349100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:54.365122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e6cff3e-3b93-4adf-952b-b6e2ff79697a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.219688 Oct 28 17:39:54.369505 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1294/2681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:54.396664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.397277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.408333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.409035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.409643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.410524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.411129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.411768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.712077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:54.721860 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37019479-9b9c-4a22-a098-418f80f54f92 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1476 microversion: 2.1 time: 0.423309 Oct 28 17:39:54.724227 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1388/2682] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1476 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:54.731411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.732432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.741379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.742084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.742888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.743779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.744551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.745317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.813404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:54.821817 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d55960b-0603-46fe-b05b-fc374ab4c36e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.431056 Oct 28 17:39:54.822449 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1295/2683] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:39:54.828213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:54.828987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:54.836848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.837694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.838291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.839214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:54.840814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:54.841510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:54.860923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:55.085780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:55.096451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5cdccb0e-9f93-4e31-b6e7-326fac0ecc22 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1486 microversion: 2.1 time: 0.370812 Oct 28 17:39:55.098686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1389/2684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:55.106891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:55.107908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:55.115937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.117250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.118071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.120153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.121583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.122208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.175309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.176198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.176792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.177389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid ea888bf3-ba23-4e7e-8406-4dccecaaa59f {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:39:55.194578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:55.207561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f9ec0413-6a67-4ddf-a81b-53a5789abbb4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.382647 Oct 28 17:39:55.208093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1296/2685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:54 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:55.234118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca7e6255-2e67-4844-88b4-78185dbc43bd tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-980055517", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca7e6255-2e67-4844-88b4-78185dbc43bd tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action HTTP/1.1 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 618 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-980055517", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-980055517', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:39:55.240106 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:39:55.244402 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:55.247199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca7e6255-2e67-4844-88b4-78185dbc43bd tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:55.247199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca7e6255-2e67-4844-88b4-78185dbc43bd tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action" status: 400 len: 938 microversion: 2.1 time: 0.020919 Oct 28 17:39:55.247199 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1297/2686] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Oct 28 17:39:55 2022] POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:39:55.253474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:55.254392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:55.264115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.265052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.265953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.267074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.267761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.268356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.270859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:55.281819 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fa13b6e-cd86-4e82-a845-51299a6ed96c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 200 len: 1304 microversion: 2.1 time: 0.182009 Oct 28 17:39:55.286541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1390/2687] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:55 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:55.321634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:55.322290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:55.333948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.334396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.335307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.338922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:55.340978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:55.341461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:55.471129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:55.490193 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db38d948-94b3-44da-85a3-84d22b377a03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1274 microversion: 2.1 time: 0.173395 Oct 28 17:39:55.505141 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1391/2688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:55 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:55.513476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1741454185", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:55.573329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] validate_networks() for [('24b50b8e-95f6-48c0-8a7b-db7ad2a819a1', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:56.103632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:56.112761 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c777843-5ee4-4d5c-80d7-260bc82f36f0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.863657 Oct 28 17:39:56.123126 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1298/2689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:55 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:56.128900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:56.140914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:56.141483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:56.141973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:56.155279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Creating event network-vif-unplugged:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h1-860864-13 Oct 28 17:39:56.161751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:39:56.173986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ed1c82d0-8ebb-4841-b52a-0bc8287070ac req-5a230ebd-b0a6-43dd-bebe-5a7f296dd980 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049318 Oct 28 17:39:56.174759 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1299/2690] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:56.181306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:56.182032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:56.188967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:56.189446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:56.189872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:56.190558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:56.191002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:56.191444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:56.644296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:56.655113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b905908-bcc0-4c0b-b0f4-6e8d68221a29 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1475 microversion: 2.1 time: 0.478894 Oct 28 17:39:56.656401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1300/2691] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:56 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1475 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:56.662025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:56.662726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:56.670669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:56.671690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:56.672367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:56.673170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:56.673835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:56.674328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:56.984951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:56.986035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:56.997410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:56.997949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:56.998789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:56.999226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:57.018254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=27 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:39:57.021299 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3f0562f-1ace-4440-9cc8-d82b8512cf26 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.362362 Oct 28 17:39:57.023199 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1301/2692] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:56 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:57.029492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.030014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.030459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.031193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.031691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.032122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.044150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:57.068806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:57.077145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.077646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Getting quotas for project a553d7c9baa545e5b21faa4ed1c63873. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:57.078366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.079977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.081633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.082412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.083193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.091774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Getting quotas for user 6b8ab14d2a2a435bb24e42c8d2a12dca and project a553d7c9baa545e5b21faa4ed1c63873. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:57.112436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:57.114793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:57.177031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07644f95-064e-447c-b12e-8e61df9e63d5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.670605 Oct 28 17:39:57.178375 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1392/2693] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:39:57.186145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:57.186992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:57.198634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.200595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.201249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.202692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.203322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.204048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.236321 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f HTTP/1.1 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ea888bf3-ba23-4e7e-8406-4dccecaaa59f'} Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:57.238351 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:39:57.243002 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.244665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:57.247177 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9ca887b-015b-411f-a9be-7e76c54d4079 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 404 len: 111 microversion: 2.1 time: 0.067023 Oct 28 17:39:57.251882 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1393/2694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:57 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:39:57.272417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:57.273328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:57.281175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.282035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.282637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.283520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.284179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.285154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.493127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:57.505013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3fc8a98-23e1-44cc-8da1-0af6da1f52bb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.478549 Oct 28 17:39:57.505766 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1302/2695] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:57 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:57.512517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63df2aea-a482-4e54-875d-d7417a9d9555 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63df2aea-a482-4e54-875d-d7417a9d9555 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action HTTP/1.1 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 285 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:57.517148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:39:57.520255 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:39:57.524777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63df2aea-a482-4e54-875d-d7417a9d9555 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:57.525930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63df2aea-a482-4e54-875d-d7417a9d9555 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action" status: 400 len: 619 microversion: 2.1 time: 0.018846 Oct 28 17:39:57.526745 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1303/2696] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Oct 28 17:39:57 2022] POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:39:57.537371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e96d3e4-82df-490a-9e41-7b36eff7bad1 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:57.538051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e96d3e4-82df-490a-9e41-7b36eff7bad1 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:57.660838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e96d3e4-82df-490a-9e41-7b36eff7bad1 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:57.665603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:57.670143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e96d3e4-82df-490a-9e41-7b36eff7bad1 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1214 microversion: 2.1 time: 0.138891 Oct 28 17:39:57.670727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1304/2697] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:57 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:57.675782 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-495aaf71-d8b9-4ecc-ae06-fef5ac96d22b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.422619 Oct 28 17:39:57.678132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1521086733", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e42edaa8-a19a-4de7-8138-df6f35b0a374"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:57.679442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1394/2698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:57 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:57.684724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:57.688466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:57.704227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.704726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.705165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.705864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:57.708032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:57.709027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:57.757155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] validate_networks() for [('e42edaa8-a19a-4de7-8138-df6f35b0a374', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:39:58.075391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:58.083890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d8b43bc-6302-44a4-bff9-b37dfa062ebb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.402973 Oct 28 17:39:58.095586 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1395/2699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:57 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:58.106058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:58.106891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.112928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.113446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.113881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.114584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.115065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.115524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.411593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:58.420017 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80b70df0-87dd-4dd1-b664-7e9284f88949 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1473 microversion: 2.1 time: 0.323340 Oct 28 17:39:58.421289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1396/2700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:58 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:58.426884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:58.427860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.434743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.435277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.435911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.436773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.437829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.437935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.617814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:39:58.618484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:39:58.618994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:39:58.619414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:39:58.619824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:39:58.629320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.629795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.630223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.630944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.631446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.631887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.649192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:39:58.654549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Getting quotas for user ca9954243b8a4260be0392adff6c2513 and project da1b7c0435044ce5a6f456c4e24cf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:39:58.663045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:58.668985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:39:58.671735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:39:58.674993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fbb7f143-7e5d-479c-bc45-6ec551fda114 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.252343 Oct 28 17:39:58.687488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1397/2701] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:58 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:58.687488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:58.694135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.695035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.695808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.711547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Creating event network-changed:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h1-860864-13 Oct 28 17:39:58.718520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:39:58.723622 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-450d674a-b8e9-4cc1-9077-4cb8bc6e5139 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050788 Oct 28 17:39:58.724544 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1305/2702] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:39:58.729375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:58.731281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.741084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.741671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.742182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.743095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.743640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.744067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.752566 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1e33a6bc-e5b1-4838-9d5a-6a24046830fd req-6b38b92a-246e-40cb-9611-faa5fa2fb1cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075366 Oct 28 17:39:58.753202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1398/2703] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:58.761724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c51a11-6843-4a8e-bcb9-f77db42e5d49", "tag": "e4117fbb-edb5-4307-b1e7-81cba4e60ad3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:58.771781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.772258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.772685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.784170 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] Creating event network-changed:e4117fbb-edb5-4307-b1e7-81cba4e60ad3 for instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 on n-h1-860864-13 Oct 28 17:39:58.788952 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-116df26d-52ed-4702-9def-7d02b0d34a3b req-44f7e07d-4bba-4fda-8796-76e36ffdbb31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Oct 28 17:39:58.789554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1399/2704] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:39:58.799548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:58.800939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.808323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.809563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.809984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.811060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.811710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.812380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.898038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:58.909770 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-59725f73-feae-437c-aa26-05e52f9f80b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1218 microversion: 2.1 time: 0.118815 Oct 28 17:39:58.920557 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1400/2705] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:58 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:58.926794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:58.927329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1721274659"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:58.929748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.938687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.939106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.939574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.940556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.941298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.941424 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af12b5d5-225f-4185-89b2-61c7ae57c3e2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.215561 Oct 28 17:39:58.941983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.942103 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1306/2706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:58 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:58.963578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:58.964388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:58.971089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.971623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.972298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:58.973003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:58.973457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:58.973879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.127257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:59.135040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba8d746b-e4a5-4193-9f21-f6697d803acc tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.177558 Oct 28 17:39:59.135655 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1307/2707] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:58 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:59.185274 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcc4bc44-8ed3-4301-a38f-c35ea0d3a4d8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action" status: 202 len: 0 microversion: 2.1 time: 0.262698 Oct 28 17:39:59.191675 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1401/2708] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:58 2022] POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:39:59.197656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-690229952"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:39:59.200555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.209611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.210287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.211001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.212022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.212577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.213411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.222871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ed965b8-93d7-43ab-8ea0-7ce41f546700 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.224231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ed965b8-93d7-43ab-8ea0-7ce41f546700 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.250032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Cannot 'createImage' instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 while it is in task_state image_snapshot_pending Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action HTTP/1.1 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 84 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-690229952"}} Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'createImage' instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 while it is in task_state image_snapshot_pending Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-690229952'}}} Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:39:59.251850 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 while it is in task_state image_snapshot_pending Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 while it is in task_state image_snapshot_pending Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 409 to user: Cannot 'createImage' instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 while it is in task_state image_snapshot_pending {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-846e7cf8-0b0e-46ea-8e87-ae27731cfba7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action" status: 409 len: 167 microversion: 2.1 time: 0.060375 Oct 28 17:39:59.256679 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1402/2709] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:39:59 2022] POST /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7/action => generated 167 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:39:59.263558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ce2c59e-e5b2-459e-94ec-99c3852f9ed1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f7524056af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.305504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3ed965b8-93d7-43ab-8ea0-7ce41f546700 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:59.313235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ed965b8-93d7-43ab-8ea0-7ce41f546700 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1215 microversion: 2.1 time: 0.168787 Oct 28 17:39:59.313893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1308/2710] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:59.393068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ce2c59e-e5b2-459e-94ec-99c3852f9ed1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/images/866ca414-3680-41dc-abd1-0b4cca077cc1" status: 204 len: 0 microversion: 2.1 time: 0.133010 Oct 28 17:39:59.393728 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1403/2711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] DELETE /compute/v2.1/images/866ca414-3680-41dc-abd1-0b4cca077cc1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:39:59.402042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.403241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.409272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.409747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.410172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.410856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.411298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.411756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.449534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.450294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.457457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.457948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.458579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.459804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.460275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.460708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.673590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:59.681278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-723b7013-ff42-4e25-a840-ad9ca7fd5941 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1540 microversion: 2.1 time: 0.283259 Oct 28 17:39:59.681856 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1309/2712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1540 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:59.730950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:39:59.738844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-602eb0a9-2770-4206-b841-dfd0c939ad0f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1473 microversion: 2.1 time: 0.295359 Oct 28 17:39:59.739439 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1404/2713] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:39:59.933909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.934666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.940660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.941219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.941658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.942349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.942797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.943219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.968221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:39:59.968783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:39:59.974999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.975519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.975957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:39:59.976654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:39:59.977105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:39:59.977527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.015510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:00.023092 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-281fcca8-1449-4e48-b237-7750f869e4d2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1218 microversion: 2.1 time: 0.093545 Oct 28 17:40:00.023902 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1310/2714] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:00.124095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:00.133510 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b32d20e6-5a15-465b-8f11-0ea6ec8618cf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.169086 Oct 28 17:40:00.134360 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1405/2715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:39:59 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:00.158677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:00.159282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:00.165425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.166107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.166702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.168081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.168742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.169324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.339118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:00.341158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:00.349410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.350193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.350623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.351462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.352344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.353531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.375744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:00.640896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:00.649389 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f324ccdc-be4a-4e27-87b0-a6ddf2cafad4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1211 microversion: 2.1 time: 0.316629 Oct 28 17:40:00.649987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1406/2716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:00 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1211 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:00.700635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:00.704430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:00.705486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:00.715674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.716283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.718680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ed4cc93-2280-450d-a7c3-e307cca52abd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.563630 Oct 28 17:40:00.719304 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1311/2717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:00 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:00.735697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.735697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.735697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.735697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.763963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:00.765064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:00.776070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.779462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.781472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:00.782932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:00.784364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:00.784912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.060660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.069524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b7a1d19-dbab-4a81-9a5a-5b7e6c14b060 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1532 microversion: 2.1 time: 0.368829 Oct 28 17:40:01.087548 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1407/2718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:00 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1532 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:01.093307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:01.093919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.100437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.100922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.101370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.102045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.102495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.102909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.137224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.147890 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fbc827d4-81af-4c0c-99e0-43270d64b72c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1470 microversion: 2.1 time: 0.389562 Oct 28 17:40:01.151201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1312/2719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:00 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:01.165819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:01.166643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.185996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.186497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.186935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.187688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.188141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.188592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.207146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.217401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb11c7ca-31a1-4099-a7b8-ef45cc9c3a1c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1210 microversion: 2.1 time: 0.128496 Oct 28 17:40:01.218173 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1408/2720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:01 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:01.223546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:01.224388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.232376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.233036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.233652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.234499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.235097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.235701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.390763 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bdfd2b1f-04cb-4d07-bfba-f482000a4529 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "POST /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271/action" status: 202 len: 0 microversion: 2.1 time: 0.170722 Oct 28 17:40:01.392468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1409/2721] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:01 2022] POST /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:01.405017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:01.405917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.413684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.414624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.414862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.415703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.416752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.416752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.448416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.461168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64906649-677e-47d2-946e-3c9ef7bf8cfd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.308678 Oct 28 17:40:01.461780 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1313/2722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:01 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:01.561297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.570472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd862a9b-6490-475e-b962-687b0cf1a821 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.170682 Oct 28 17:40:01.571084 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1410/2723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:01 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:01.677469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:01.686724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.695432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.698255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.698648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.702356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.703503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.709533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.744914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:01.745787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:01.758128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.764245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.766123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.769854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:01.771046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:01.771609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:01.840435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:01.856332 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a396453-65ba-43d4-9661-75744701d609 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1267 microversion: 2.1 time: 0.182118 Oct 28 17:40:01.857544 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1314/2724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:01 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:02.094161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:02.094787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:02.114243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.115019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.115653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.116566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.117172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.117766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.169234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.178149 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d628774f-45ff-462e-a0d2-97d5c6a02dfe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.438557 Oct 28 17:40:02.182805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1411/2725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:01 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:02.244205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:02.244819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:02.251997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.252469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.252900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.253614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.254085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.254504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.362395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.376617 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bf2ce7f-4880-4615-b00d-13e10374511a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1266 microversion: 2.1 time: 0.136198 Oct 28 17:40:02.377488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1412/2726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:02 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:02.425283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.439648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5b0a070-2d63-4d6f-80c4-f89707a19c76 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1532 microversion: 2.1 time: 0.349150 Oct 28 17:40:02.440180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1315/2727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:02 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1532 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:02.486115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:02.487582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:02.498178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.499314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.500477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.512071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.513375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.513841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.595653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:02.596333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:02.602947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.603465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.603905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.604603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.605086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.605526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.744174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.753272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d86b8fcc-80b4-4859-8419-e1361eff662f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.272087 Oct 28 17:40:02.754076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1413/2728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:02 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:02.777901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.786487 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60270609-b10b-4404-b9ce-1c6cfe44237b tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.195784 Oct 28 17:40:02.787065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1316/2729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:02 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:02.882502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:02.883069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:02.889950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.890844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.891424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.892855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:02.893477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:02.893972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:02.968881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:02.976964 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d42992b-e48b-49c8-8861-d6e6fbd78759 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1273 microversion: 2.1 time: 0.099142 Oct 28 17:40:02.977742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1414/2730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:02 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:03.202952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:03.203939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:03.210693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.211212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.211758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.212642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.213173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.215109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.349838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:03.358226 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebe1c4b9-e48e-4b73-a477-2c637628d9af tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.159826 Oct 28 17:40:03.358741 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1317/2731] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:03.400322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:03.400934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:03.407859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.408329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.408763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.409459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.409898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.410317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.464380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:03.465727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:03.472485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.473058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.473706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.474486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.475009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.475614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.477027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:03.480707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:03.487912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-448f9e7e-b4dc-4eff-ac9e-00cf62555945 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1266 microversion: 2.1 time: 0.091258 Oct 28 17:40:03.505452 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1415/2732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:03.511442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e96e69a-e36f-4e0c-9b39-d984ed83992b", "name": "network-vif-plugged", "status": "completed", "tag": "aa725a26-43ac-418f-9a6c-85ebb3c94858"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:03.519046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:03.523732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.524214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.524645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.541073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] Creating event network-vif-plugged:aa725a26-43ac-418f-9a6c-85ebb3c94858 for instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b on n-h2-860864-13 Oct 28 17:40:03.547440 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c74dabd9-3597-4d57-b7ef-868b97c6a645 req-5cfa2b71-ab7b-4192-aa45-ade67e5428d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Oct 28 17:40:03.547440 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1416/2733] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:03.664474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:03.672670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d1ad845-66c8-48a8-8edd-f6df7eb097e0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.212168 Oct 28 17:40:03.673244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1318/2734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:03.776531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:03.777411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:03.783608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.784093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.784529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.785218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.785671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.786086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.914509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:03.915257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:03.919260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:03.922294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.922848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.923277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.923991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:03.924430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:03.924928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:03.927167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3824c09f-f4b7-48d6-949c-d3a50db6710d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.155082 Oct 28 17:40:03.927920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1417/2735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:04.001381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.001989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.007986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.008462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.008889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.009970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.010065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.010411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.090485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.099119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d65ff618-f290-4c21-b62d-38a99fda857a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.292911 Oct 28 17:40:04.099725 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1319/2736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:04.154759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.162486 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f10b806d-7002-4b8a-b9ed-96585d1d5aa8 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.164968 Oct 28 17:40:04.163081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1418/2737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:03 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:04.380984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.381683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.388205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.388702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.389136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.389835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.390289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.390715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.420508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.421005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.427033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.427564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.427998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.428691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.429145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.429569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.455016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:04.529249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.537100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8162b523-16a6-463a-b7b4-837651f83533 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.159940 Oct 28 17:40:04.537579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2b48dec-8937-46e2-9d7f-33bbe6c3373a tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 204 len: 0 microversion: 2.42 time: 0.223884 Oct 28 17:40:04.547665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1419/2738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:04 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:04.547841 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1320/2739] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:40:04 2022] DELETE /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:40:04.547964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.547964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.549164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.549650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.550086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.550773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.551228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.551680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.556169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.556868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.563447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.563920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.564416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.565342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.565800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.566247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.616861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.629287 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a3b9b1a-881b-4cf2-a0d1-6587d789b0a3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1266 microversion: 2.1 time: 0.090214 Oct 28 17:40:04.630072 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1420/2740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:04 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:04.697285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.698067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.704850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.705338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.705773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.706476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.706927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.707569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.810094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.821626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.823062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.825471 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-175e1ba6-f74a-4426-8d69-b7a78fb80c2f tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.275482 Oct 28 17:40:04.826222 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1321/2741] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:04 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:04.868950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:04.871319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:04.879216 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b4550482-8601-4911-b317-14050e5ed6b3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.185737 Oct 28 17:40:04.879839 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1421/2742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:04 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:04.952479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:04.953090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:04.958989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.959519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.959937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:04.960626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:04.961072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:04.961489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.093821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:05.102635 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-39e90f37-8fb5-4103-a247-ddba539143fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1314 microversion: 2.1 time: 0.155341 Oct 28 17:40:05.103215 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1322/2743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:04 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:05.124187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.124718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.131651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.132128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.132555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.133308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.133762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.134182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.187745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.188433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.194746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.195302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.195830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.196734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.197207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.197715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.330074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:05.338320 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea0e593b-051f-4ad3-880b-c0aa96b19730 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.218908 Oct 28 17:40:05.339265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1422/2744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:05.372923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:05.380757 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ffd71b2-c253-4a13-90dd-aff7b89c6c4b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.197525 Oct 28 17:40:05.381268 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1323/2745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:05.560899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.561502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.562401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-plugged", "status": "completed", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:05.568537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.569017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.569439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.570132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.570579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.571005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.572488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.573110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.573556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.585300 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Creating event network-vif-plugged:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h1-860864-13 Oct 28 17:40:05.590686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:40:05.601758 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-35cc7907-24ed-4ac0-9d58-c8aeb2e9d50c req-4824e358-a52d-4991-94be-43a22cd5cc60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043623 Oct 28 17:40:05.602373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1324/2746] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:40:05.653841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.654617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.660720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.661201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.661627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.662318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.662760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.663179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.716478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:05.724899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd441d3a-ba66-487c-8c6e-799314e83106 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.168964 Oct 28 17:40:05.725510 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1423/2747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:05.732695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:05.740326 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a722327-8dff-497f-b002-ced4f25ec613 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1266 microversion: 2.1 time: 0.091383 Oct 28 17:40:05.740894 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1325/2748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:05.857100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.857741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.863765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.864248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.864694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.865390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.865840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.866265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.904089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:05.904608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:05.912207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.912691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.913126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:05.913824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:05.914268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:05.914696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.099045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.108867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.110617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.111876 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7e7b65d-5a56-431f-9e21-2f0e8a940f66 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.259870 Oct 28 17:40:06.112442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1424/2749] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:06.123129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.136041 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-57d86d59-f6cc-4bc2-81d8-ffd2e561c35c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.236548 Oct 28 17:40:06.137319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1326/2750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:05 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:06.176115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:06.176722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.182488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.182962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.183505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.184292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.184763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.185184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.318000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.326480 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6166997a-207b-435d-9b3f-95af8a3959f9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1501 microversion: 2.1 time: 0.204401 Oct 28 17:40:06.327235 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1425/2751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:06 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:06.350049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:06.352359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.359301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.359828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.360268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.360968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.361606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.362037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.363043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:06.363672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.369722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.370206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.370640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.371335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.371821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.372254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.401536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-375ebc48-e9ae-4954-b737-18ff8069d833 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.055455 Oct 28 17:40:06.405953 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1327/2752] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:06 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:06.410415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:06.411048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.419135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.419703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.420148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.420852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.421307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.421733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.600378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.608329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f1a5a9e8-8f9c-42b7-8a93-a502e082237f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.249395 Oct 28 17:40:06.608912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1426/2753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:06 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:06.627039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.646781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-16cb9d44-edea-4bc2-b87c-aebde17230ba tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.242770 Oct 28 17:40:06.647873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1328/2754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:06 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:06.748661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:06.749272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.755264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.755784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.756226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.758154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.758154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.758154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.765126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:06.765732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:06.772134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:06.774613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.775099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.775569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.776486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:06.777644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:06.778350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:06.871857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.880141 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbbf3a9d-dd0b-41c9-a539-d4e3ba1e46c0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1274 microversion: 2.1 time: 0.120493 Oct 28 17:40:06.880718 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1329/2755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:06 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:06.917223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:06.925219 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cdaf406b-6672-44e9-9995-61278b39a4ae tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.180867 Oct 28 17:40:06.925708 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1427/2756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:06 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:07.140292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.140899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.147872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.148354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.148783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.149466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.149918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.150338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.160363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.160964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.162807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:07.163746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:07.169667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.170154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.170583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.171274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.171751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.172170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.406455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.410298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.416081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.417678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.418387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2471d90-a1f0-49ef-ab74-6aaa511a8a98 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.261621 Oct 28 17:40:07.418666 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1428/2757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:07.418947 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af989b0a-3005-4f8f-ac12-277b2702a064 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.283240 Oct 28 17:40:07.431393 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1330/2758] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:07.431559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:07.431559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.431559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.431956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.432395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.433109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.434060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.434478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.480606 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf8d2a7d-e7aa-4078-b6b0-4a0ebd036baa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.060612 Oct 28 17:40:07.481203 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1429/2759] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:07 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:07.616802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7", "name": "network-vif-plugged", "status": "completed", "tag": "618178d3-3ee6-4ebc-a0c6-3d3be7827c86"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:07.626892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.627398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.627823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.634500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.635321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.640114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] Creating event network-vif-plugged:618178d3-3ee6-4ebc-a0c6-3d3be7827c86 for instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 on n-h1-860864-13 Oct 28 17:40:07.644724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.645121 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-56c43011-e74d-40f5-97c4-a4822ce3715e req-f034ec28-88b1-4975-8d0f-63a26b27709d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Oct 28 17:40:07.645496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.646013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1331/2760] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:07.646325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.647314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.648221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.648589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.671114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.671826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.678209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.678683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.679111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.679822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.680268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.680685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.839841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.847741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b414abb8-5453-4238-9330-6616ee328cb3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.218285 Oct 28 17:40:07.859630 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1430/2761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:07.863499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.871891 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bbdc788e-1462-4268-ad77-8eed7614fb9c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.206115 Oct 28 17:40:07.872453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1332/2762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:07.905168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.905767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.912226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.912703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.913131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.913815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.914259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.914674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.947909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:07.948515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:07.955079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.955602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.956066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.956756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:07.957209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:07.957627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:07.977507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:07.985800 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-463961f1-850d-4a9f-ab7a-6ba67720cd0b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1274 microversion: 2.1 time: 0.085685 Oct 28 17:40:07.986384 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1431/2763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:08.091251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:08.099089 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b607ae3-9dc3-476f-9bb3-4bfb5a32b309 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.155064 Oct 28 17:40:08.099694 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1333/2764] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:07 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:08.441488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:08.442106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:08.448470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:08.449437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.449610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.450132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:08.450243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.450750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.451210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.451657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.455981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.456458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.456895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.457593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.458026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.458440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.474668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:08.640000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:08.690686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:08.700143 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-122b1788-54da-4f7c-88d8-5d6aba8578a1 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.262406 Oct 28 17:40:08.700855 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1432/2765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:08 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:08.706192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:08.707702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:08.708978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:08.716872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.717916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.717916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.718687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.719208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.720084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.720206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:08.721671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:08.723168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d82aee21-0d1a-4b0e-aee5-20060e787d28 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.278731 Oct 28 17:40:08.724094 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1334/2766] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:08 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:08.759221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b29e224f-b4b1-41b3-9831-15a660c11a74 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.056845 Oct 28 17:40:08.759890 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1433/2767] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:08 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:08.876233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:08.877159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:08.884887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.885601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.886247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.887744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.888835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.889571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.898319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:08.899538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:08.911980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.912863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.913587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:08.916973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:08.917836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:08.919303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.179977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:09.183230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:09.188420 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6e0d665-a7a1-4369-837a-60ed70195f91 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.295959 Oct 28 17:40:09.189199 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1434/2768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:08 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:09.193636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:09.194405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:09.201020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.201508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.201949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.202632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.203090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.203668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.206263 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e1c07b5-7621-4ef1-9472-f2267809a9c3 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.335574 Oct 28 17:40:09.208473 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1335/2769] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:08 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:09.213782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:09.214485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:09.220771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.221256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.221882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.222987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.223611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.224190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.295621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:09.304432 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fccc3cf4-f553-4259-b144-bd50f299cd34 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1272 microversion: 2.1 time: 0.113684 Oct 28 17:40:09.305052 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1435/2770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:09 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:09.310774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=18 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:09.415978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:09.424754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4db59cc9-91bc-4a44-b3a3-d419d3c20df0 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.215059 Oct 28 17:40:09.425468 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1336/2771] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:09 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:09.724255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:09.725672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:09.733441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.733923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.734381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.735075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.735724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.736144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.751927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:09.752538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:09.760565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.761045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.761552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:09.762329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:09.763560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:09.764010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.064152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.080790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a450518-b5bf-48c0-a37a-c3caff27593f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.360145 Oct 28 17:40:10.082274 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1436/2772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:09 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:10.102012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:10.105255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:10.112419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.113154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.113590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.114292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.114408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.114820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.115248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.125832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.128319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.130018 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-741925dd-9007-4cb2-9ee4-6f21c4df18ae tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.382393 Oct 28 17:40:10.130792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1337/2773] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:09 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:10.140335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a178f9a-6846-420f-b8d9-5454a0be82fd", "tag": "97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:10.154193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.154757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.155191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.158968 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-279db301-b53e-450c-a9de-bfd6788121a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.074628 Oct 28 17:40:10.162804 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1437/2774] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:10 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:10.167200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] Creating event network-changed:97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6 for instance 2a178f9a-6846-420f-b8d9-5454a0be82fd on n-h1-860864-13 Oct 28 17:40:10.172941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-71c9f5f0-aef0-41b4-aad6-e55f58204f58 req-fb6f0f9e-db50-495c-971a-dc9303f0ba8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040010 Oct 28 17:40:10.173532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1338/2775] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:10.218326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:10.219140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:10.227355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.228509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.229026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.229943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.231193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.232579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.236912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:10.237697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:10.245762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.247317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.248069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.248964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.249603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.250091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.450948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.453919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.458880 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ae9fa12-b804-471f-924d-d07aa3fe5d00 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.246018 Oct 28 17:40:10.459474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1438/2776] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:10 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:10.462500 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ebedaa0-0a29-49fc-a1a4-7b444aa051c8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.234880 Oct 28 17:40:10.463071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1339/2777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:10 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.473456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.473952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.479136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:10.479767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:10.485959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.486439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.486875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.487589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:10.488040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:10.488461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:10.488778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:10.670707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.678681 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06be8cce-678d-4224-8eba-f8b1b0074e1d tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.218204 Oct 28 17:40:10.679265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1439/2778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:10 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:10.681541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:10.691160 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5804d3d-80e5-4958-a892-742f1a412ed1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.215698 Oct 28 17:40:10.691760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1340/2779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:10 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:11.106795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.107439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.114252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.114737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.115172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.115890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.116340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.116761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.160467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.161070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.168041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.168641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.169008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.169728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.170183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.170607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.327821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.335524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7d3ea681-89b0-46e5-88f3-a7c423690aa3 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.232590 Oct 28 17:40:11.336101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1440/2780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:11.341320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:11.343563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.349574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.350053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.350481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.351167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.351630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.352046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.385227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.394763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.396238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.397470 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a7fa3cb-2f51-4951-971a-69030a2ea95d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.240859 Oct 28 17:40:11.398044 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1341/2781] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:11.399455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61e83643-ad27-41ca-8efa-c7de36c99960 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.062026 Oct 28 17:40:11.400504 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1441/2782] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:11 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:11.482960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.483687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.486624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.487328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.490235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.491413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.491413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.492213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.492733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.493219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.494093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.495529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.495529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.496665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.496964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.497644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.700808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.705286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.719868 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28f563bd-974f-4193-8a6b-66fea38e7d86 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.240209 Oct 28 17:40:11.720907 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1342/2783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:11.726250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.727329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.736185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.737017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.737687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.738064 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a69def8-288f-4d90-8f90-1a1befe06c24 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.255203 Oct 28 17:40:11.738592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.739491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.739609 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1442/2784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:11.739703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.744511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:11.744698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:11.751970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.752523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.752968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.753675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.754130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.754560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:11.970779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.972867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:11.981952 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56233df5-5e8a-4ad2-99ec-1d4261935ea4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.241617 Oct 28 17:40:11.982158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-750b722d-de31-4dd8-bde4-2a672e6869d7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.259831 Oct 28 17:40:11.982855 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1443/2785] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:11.984593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1343/2786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:11 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:11.987403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c51a11-6843-4a8e-bcb9-f77db42e5d49", "name": "network-vif-plugged", "status": "completed", "tag": "e4117fbb-edb5-4307-b1e7-81cba4e60ad3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:11.997605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:11.998078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:11.998513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.009384 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] Creating event network-vif-plugged:e4117fbb-edb5-4307-b1e7-81cba4e60ad3 for instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 on n-h1-860864-13 Oct 28 17:40:12.015547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1634e063-2668-4000-a29a-daf9a5325f83 req-40015a75-35ef-41c8-8f61-ec728a9a2b5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 Oct 28 17:40:12.016575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1444/2787] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:12.361131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:12.362354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:12.377633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.378373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.378819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.379717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.380176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.380636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.416121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:12.424040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:12.445992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.447042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.447902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.448937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.449640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.450359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.499819 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-431e293f-7f0d-4a06-a487-7359dcbcce9f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.090845 Oct 28 17:40:12.500912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1445/2788] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:12 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:40:12.506472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:12.521419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:12.537096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.538125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.538782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.540134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.540786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.541422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.909237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:12.915534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:12.919053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1bb4d7c-f24f-4f21-a199-ecfc11714c74 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1538 microversion: 2.1 time: 0.562686 Oct 28 17:40:12.919921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1344/2789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:12 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1538 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:12.924778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8aa21e-d3db-42fa-b36b-00f8b40d88ca", "tag": "ad39617b-49a0-4342-ab22-ecf5da43ee8d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:12.937698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.938187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.938764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.944157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:12.945635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:12.946935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25dc0229-9579-43e5-986c-b3fde572a5fa tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2961 microversion: 2.42 time: 0.444713 Oct 28 17:40:12.951489 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1446/2790] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:12 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2961 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:12.954423 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] Creating event network-changed:ad39617b-49a0-4342-ab22-ecf5da43ee8d for instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca on n-h1-860864-13 Oct 28 17:40:12.956626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:12.957278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:12.960222 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-484972b5-a713-4efb-bd0a-2aeaac909a61 req-20cacb19-53c6-4d59-a0c1-345440d02037 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038353 Oct 28 17:40:12.961070 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1345/2791] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:12.967917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.968407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.968838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.969538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.969989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.970414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.970992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:12.971728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:12.978760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.979492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.980074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:12.981414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:12.982376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:12.983225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.265170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:13.270043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:13.273035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e4a4ff2-4906-4b94-bfc3-80bbef93a26d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.321311 Oct 28 17:40:13.273784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1447/2792] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:12 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:13.278882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26358c16-1e74-458b-8f7d-47f4cf7b6dc4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.312330 Oct 28 17:40:13.293650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1346/2793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:12 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:13.293650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:13.293650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:13.294890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:13.296288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:13.301815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.302304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.302426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.302743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.303294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.303547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.303839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.304226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.304684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.305289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.305789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.306731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.588496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:13.596795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f06a891c-c352-4542-9988-87281902e47b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.308212 Oct 28 17:40:13.597367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1448/2794] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:13 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:13.602629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:13.607791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:13.614068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.614545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.614970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.615885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.616338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.616753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.648679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:13.657210 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2e2995c-bbb0-4584-833b-a5528ab36153 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.376494 Oct 28 17:40:13.657830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1347/2795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:13 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:13.659954 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea46d743-30a7-4076-be5e-eb95d73a994c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.061048 Oct 28 17:40:13.664092 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1449/2796] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:13 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:13.947537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:13.948140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:13.954592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.955069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.955535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.956222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.956671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.957095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.981062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:13.981759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:13.988774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.989253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.989699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:13.990367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:13.990812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:13.991227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.172967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.180605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bee0ab77-968c-4faf-8ed2-fafe0b2d8a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1533 microversion: 2.1 time: 0.236991 Oct 28 17:40:14.181366 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1348/2797] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:13 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1533 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:14.210856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.221977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.223689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.224893 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68953ab7-b0d1-414e-8f90-ac748b36583e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2940 microversion: 2.42 time: 0.248719 Oct 28 17:40:14.225447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1450/2798] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:13 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2940 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:14.301390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:14.301920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:14.302378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:14.303052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:14.308031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.309038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.309521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.310152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.310459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.310598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.310945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.311065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.311392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.312081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.312534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.312954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.514240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.517691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.522381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8fb9050-6890-46c2-bb16-f9b74f58aa6e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.224893 Oct 28 17:40:14.523108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1349/2799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:14 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:14.525975 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8866a3b0-aea0-47b4-9ae5-7322a438749e tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.227726 Oct 28 17:40:14.526526 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1451/2800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:14 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:14.620444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:14.621091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:14.627066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.627585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.628018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.628693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.629139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.629554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.670592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:14.672914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:14.679443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.679928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.680367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.681063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.681520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.681945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.721293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5e2930c-0df0-4774-aa40-e22e0c866ad2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.054435 Oct 28 17:40:14.725210 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1452/2801] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:14 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:40:14.727355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:14.728103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:14.735208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.735729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.736169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.736866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:14.737319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:14.737746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:14.761356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.769057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cee675c1-3363-4cf0-9a81-bbc5eef45ba3 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.152420 Oct 28 17:40:14.769632 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1350/2802] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:14 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:14.874927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:14.883013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9687848b-2869-43cb-b3a7-4994809733c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.159677 Oct 28 17:40:14.883617 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1453/2803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:14 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:15.204825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.205354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.211344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.211856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.212290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.212996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.213442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.213867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.252277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.252885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.259438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.259924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.260358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.261053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.262074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.262566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.427550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.435353 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-347bc069-ecce-45e8-8c8e-b097c8c86e6c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1533 microversion: 2.1 time: 0.234466 Oct 28 17:40:15.435946 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1351/2804] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1533 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:15.466222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.475904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.477351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.478589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c9bba38-36ae-46b0-b67e-f7ab6ee27a9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2940 microversion: 2.42 time: 0.230233 Oct 28 17:40:15.479476 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1454/2805] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2940 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:15.545805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.546595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.548590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.549418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.553969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.554760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.555456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.556327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.556661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.556867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.557313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.557749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.558016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.559021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.559357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.559502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.578203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:15.796013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.801797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:15.805739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1db201d9-8017-43c7-be07-23682b7db02e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.264187 Oct 28 17:40:15.806593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1352/2806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:15.813156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:15.814925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2130e77e-0f4e-4d30-bff9-c71eb35aecd5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.270210 Oct 28 17:40:15.826413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1455/2807] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:15.826413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:15.826413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.831754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.832550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.833347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.833707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.834156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.834578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.837204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.837684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.838405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.851628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Creating event network-vif-unplugged:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h1-860864-13 Oct 28 17:40:15.858601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:40:15.871901 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e1339c26-8b23-43de-9354-bf507b661690 req-5ee7e926-3893-4579-bf8f-3c7731f9f56f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063589 Oct 28 17:40:15.872483 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1353/2808] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:15.877271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8fd23999-d2a7-4f46-b874-b1ab3289d2de tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.060129 Oct 28 17:40:15.878181 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1456/2809] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:15 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:15.878776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.879504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.885880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.886887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.887314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.888035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.888476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.888892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.907817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:15.908701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:15.916098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.916720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.917159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:15.918719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:15.919252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:15.919776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.087417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.096398 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32023aed-103c-48fa-8630-23a3d92ad05a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1316 microversion: 2.1 time: 0.222700 Oct 28 17:40:16.108330 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1354/2810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:16.113196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.122890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4847eb64-acb2-4a8e-87b6-ed05ecb86c40 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.220553 Oct 28 17:40:16.123614 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1457/2811] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:15 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:16.468487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:16.469391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:16.487817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.490828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.491504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.492799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.494612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.496518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.510675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:16.512929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:16.527354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.528690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.529131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.531720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.532200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.532636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.564940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:16.856262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.868453 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88795280-92c5-45b8-a2ab-f25fc1d8b510 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1520 microversion: 2.1 time: 0.412831 Oct 28 17:40:16.869254 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1355/2812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:16 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:16.874938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:16.875564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:16.881954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.882695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.883402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.884326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.885112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.885685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:16.936431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.952801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.954743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:16.956324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55a1870c-edd7-465a-bc4b-44930771dbd2 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2940 microversion: 2.42 time: 0.449733 Oct 28 17:40:16.977596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1458/2813] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:16 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2940 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:16.983782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:16.985555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:16.995459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:16.999011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:16.999515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.000516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.001074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.001536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.174687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:17.183753 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-564eddea-f483-40cb-88f1-b0586546734b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.312662 Oct 28 17:40:17.185441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1356/2814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:16 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:17.191378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:17.193987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.201121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.201890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.202506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.203258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.203888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.204310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.249853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c1e2e87-5d2a-4df9-b57d-60e89c19ba6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.062806 Oct 28 17:40:17.251683 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1357/2815] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:17 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:17.258305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:17.266327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:17.271486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.288219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.289124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.289747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.290446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.296126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.296756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.306248 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f11db311-0c95-424c-8ebd-4b5a91430679 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.327314 Oct 28 17:40:17.311685 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1459/2816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:16 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:17.328018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:17.328699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.346027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.346679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.347125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.348115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.348798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.349404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.378555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:17.512623 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5832e042-484c-4481-8e93-a61de78af58c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 204 len: 0 microversion: 2.1 time: 0.259121 Oct 28 17:40:17.513588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1358/2817] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:17 2022] DELETE /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:17.524901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:17.525527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.532164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.532813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.533855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.534571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.535204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.535664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.676371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:17.685474 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97950f45-62e9-4073-8ae0-ca0f1d26090f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1466 microversion: 2.1 time: 0.372629 Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1460/2818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:17 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1466 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.699400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.700401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.700724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.701378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.824391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:17.832299 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a2b58e6-7032-4006-b81c-bbfee3626675 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.316467 Oct 28 17:40:17.832877 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1359/2819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:17 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:17.840946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:17.840946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:17.844345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.844837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.845276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:17.845972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:17.846424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:17.846850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.058824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.066593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-139c264e-5707-4163-a149-3012a6892ab4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1526 microversion: 2.1 time: 0.379086 Oct 28 17:40:18.067255 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1461/2820] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:17 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1526 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:18.083739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "6bc07bb1-bae8-41c1-9ed6-2df11a20cdde"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "9b1c9f97-9495-48eb-b03c-cb90f9eb86dc"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "328f2b9e-4a6a-4b29-9cf3-5a19c18f834e"}, {"server_uuid": "e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7", "name": "network-vif-unplugged", "status": "completed", "tag": "618178d3-3ee6-4ebc-a0c6-3d3be7827c86"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "452a2cfa-f5b7-4060-afce-a8c1024694ff"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "c672d2c1-310f-453c-871d-9c962f2a558e"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-unplugged", "status": "completed", "tag": "4ccc5446-0359-471c-9f28-c5d8f7b673d3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:18.084518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.085076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.085580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.102341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:6bc07bb1-bae8-41c1-9ed6-2df11a20cdde for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.102932 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:9b1c9f97-9495-48eb-b03c-cb90f9eb86dc for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.103658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:328f2b9e-4a6a-4b29-9cf3-5a19c18f834e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.104467 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:618178d3-3ee6-4ebc-a0c6-3d3be7827c86 for instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 on n-h1-860864-13 Oct 28 17:40:18.105527 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:452a2cfa-f5b7-4060-afce-a8c1024694ff for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.106152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:c672d2c1-310f-453c-871d-9c962f2a558e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.106681 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] Creating event network-vif-unplugged:4ccc5446-0359-471c-9f28-c5d8f7b673d3 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.115197 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d2be32b2-22d8-4ef8-9a52-1c097caf8e8e req-b1fa64fb-6d9b-4377-bf7d-65452c41c952 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1223 microversion: 2.1 time: 0.046563 Oct 28 17:40:18.116121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1462/2821] 10.222.0.48 () {64 vars in 1318 bytes} [Fri Oct 28 17:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 1223 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:18.122481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:18.123246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:18.131290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.131996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.132514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.133301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.133838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.134543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.196689 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3295b3a-1b9d-4655-9299-8fc55b01ebfa tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1619 microversion: 2.1 time: 0.362733 Oct 28 17:40:18.211392 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1360/2822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:17 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1619 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:18.211392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:18.211392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:18.219503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.220674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.221248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.223288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.223933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.224653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.509338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.519110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.520671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.522176 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b997e70-45c9-4ab6-9548-156e673cde57 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2872 microversion: 2.42 time: 0.405066 Oct 28 17:40:18.522906 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1463/2823] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:18 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2872 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:18.535583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:18.539184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:18.547390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.548355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.549879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.550552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.551792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.552454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.553183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.555503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f067fab7-7f2f-46fb-b983-c83fccd32e6c tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.350030 Oct 28 17:40:18.556232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1361/2824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:18 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:18.575211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-deleted", "tag": "6bc07bb1-bae8-41c1-9ed6-2df11a20cdde"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:18.585694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.586266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.586936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.599659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5032965-8b68-42d2-bc03-0c5a10db3023 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 14 microversion: 2.1 time: 0.069335 Oct 28 17:40:18.601149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1464/2825] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:18 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:18.601792 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] Creating event network-vif-deleted:6bc07bb1-bae8-41c1-9ed6-2df11a20cdde for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:18.608278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d5771fcc-5f3e-4dd1-a2eb-bcf509d04960 req-b55da8dd-192c-4901-a6f7-6519a7c272d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047133 Oct 28 17:40:18.609190 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1362/2826] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:18.609308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1065026977", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b50f55cd-d45e-4efc-9a70-f5e2065e866e"]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:18.615281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:18.616061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:18.624287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.624860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.625282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.626057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:18.626516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:18.627006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:18.676794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:40:18.985493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:18.993254 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-06206163-2133-471b-b6f3-e8bf6a73dcaf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.382853 Oct 28 17:40:18.993837 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1363/2827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:18 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:18.998444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:18.999047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:19.004991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.005488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.005929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.006652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.007417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.007882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.577499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:40:19.578003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:40:19.578407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:40:19.578811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:40:19.579217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:40:19.583412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:19.590044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.590525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.590960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.591742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.592198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.592623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.612799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:40:19.618165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:40:19.631104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:40:19.633566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:40:19.679405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40901f16-98f7-468e-b886-eb3511809aaf tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076411 Oct 28 17:40:19.680064 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1465/2828] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:40:19.684689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:19.685290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:19.691861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.692349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.692777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.693470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.693914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.694333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.719268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:19.737570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4359a307-5a62-438a-a51b-99fec233752a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.742667 Oct 28 17:40:19.740836 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1364/2829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:18 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:19.747471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:19.748219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:19.758778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.760064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.760737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:19.763264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:19.764071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:19.766329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.205023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.212798 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4999617-e484-4f51-b48a-a2c93c570522 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1526 microversion: 2.1 time: 0.531709 Oct 28 17:40:20.213713 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1466/2830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:19 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1526 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.219450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.219606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.220408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.226992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.227838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.228496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.229415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.230961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.231709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.238503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.241302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.242935 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-779f686a-f124-400d-bb8b-9f0103b16c51 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2759 microversion: 2.42 time: 0.500642 Oct 28 17:40:20.243977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1365/2831] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:19 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2759 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:20.249660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:20.252233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.258735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.259293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.259820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.260723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.262186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.263026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.314269 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ba1d1d4-b410-4849-8cb1-3e324b872091 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action" status: 200 len: 8207 microversion: 2.1 time: 0.068264 Oct 28 17:40:20.314915 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1366/2832] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:20 2022] POST /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b/action => generated 8207 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.320867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.321591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.328533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.329019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.329453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.330173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.330618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.331065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.440443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.448161 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54db5ff2-ac8c-4c8d-bcd0-bd396283c227 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1221 microversion: 2.1 time: 0.132094 Oct 28 17:40:20.449350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1367/2833] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.454479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.455076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.461043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.461523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.461951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.462631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.463073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.463514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.628948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.636642 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cba96640-e112-4dd5-b44e-7a845ead5437 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.421107 Oct 28 17:40:20.637354 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1467/2834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.641776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a178f9a-6846-420f-b8d9-5454a0be82fd", "name": "network-vif-plugged", "status": "completed", "tag": "97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:20.651197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.651697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.652119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.663583 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] Creating event network-vif-plugged:97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6 for instance 2a178f9a-6846-420f-b8d9-5454a0be82fd on n-h1-860864-13 Oct 28 17:40:20.669349 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-210f59cc-e778-44b3-884b-5d80b5ed5e05 req-a062cb7f-bf38-4df5-8cf9-d44ecb9add6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Oct 28 17:40:20.669962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1468/2835] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:20.674958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.675716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.682678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.683204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.684210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.685081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.685536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.686184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.797541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.804971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-012a0570-1ade-43c9-b368-e2d0a9bc8dd8 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.353990 Oct 28 17:40:20.805999 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1368/2836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.811462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}, {"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-deleted", "tag": "328f2b9e-4a6a-4b29-9cf3-5a19c18f834e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:20.823641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.825404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.825831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.828902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:20.849049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Creating event network-changed:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h2-860864-13 Oct 28 17:40:20.850055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Creating event network-vif-deleted:328f2b9e-4a6a-4b29-9cf3-5a19c18f834e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:20.860556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 17:40:20.879264 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-97c56b6a-ca78-4caf-8862-341757760955 req-ee640d2f-c177-4cd1-91c8-bb8ae0e87661 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071882 Oct 28 17:40:20.880764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1369/2837] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:20.886891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.887660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.894538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.895068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.895601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.896372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.896761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.897235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:20.948413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:20.957242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e02e61ad-fd10-4aff-95f3-cf70b841bd1c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.286112 Oct 28 17:40:20.958512 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1469/2838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:20.989132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:20.990033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:20.996934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:20.997520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:20.998030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.004655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.005438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.006077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.122189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.130225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9afe8310-2dd4-4010-94de-90936acca428 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.248161 Oct 28 17:40:21.131057 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1370/2839] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.164985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.173489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a55238a-63cb-4f32-b242-a2b731d894a5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.188246 Oct 28 17:40:21.174061 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1470/2840] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:20 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.196274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.196883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.202842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.203323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.203792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.204478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.204950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.205372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.237130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.237731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.243891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.244469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.245006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.246561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.247278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.247825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.389184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.397060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a955620-29e6-4494-b57c-ca42e27277ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.204727 Oct 28 17:40:21.397617 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1371/2841] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.407635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.407635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.408437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.408915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.409341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.410022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.410465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.410879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.418872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.426680 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7422d5e5-73c4-45ab-ab7a-b9bb3fd5a165 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1526 microversion: 2.1 time: 0.193298 Oct 28 17:40:21.427258 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1471/2842] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1526 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:21.431690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.432297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.438728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.439465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.440072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.440769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.441409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.441840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.631578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.639274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.640799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.642233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.643466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56394719-0dca-47c6-8bba-68e04edbe583 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2712 microversion: 2.42 time: 0.244837 Oct 28 17:40:21.644026 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1372/2843] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2712 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:21.648626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.649220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.655778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.656260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.656684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.657367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.657810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.658226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.662754 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63f48778-62b5-469c-af0b-0393c4b02e5a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.234413 Oct 28 17:40:21.663454 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1472/2844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.668996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.669593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.675624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.676110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.676546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.677356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.677810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.678230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.722300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.730813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03c323bc-801c-43c3-98b6-9209b22693e2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1221 microversion: 2.1 time: 0.085554 Oct 28 17:40:21.731418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1373/2845] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.736103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:21.736668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.743762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.744249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.744678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.746495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.746683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.747220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.792703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Locking {{(pid=120568) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 28 17:40:21.827249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:21.836663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53a2ed3e-327b-4ef0-a4d6-08166796d880 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.172109 Oct 28 17:40:21.837926 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1473/2846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:21.844527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.845478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.853560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.854392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.857299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.857813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98e4342b-0642-44da-854b-5dbf3f7535e3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.125334 Oct 28 17:40:21.858540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.858970 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1374/2847] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:21 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:21.859442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.859870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.866868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:21.868110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:21.875255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.875780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.877170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:21.877891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:21.878624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:21.878775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.247615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.255718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee454203-4e1b-4de1-af33-3641e5d44f1f tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.416741 Oct 28 17:40:22.256569 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1474/2848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:22.261847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:22.268120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.269104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Searching by: {'deleted': False, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:40:22.275732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.276527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.278208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.279107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.279759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.280369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.312617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:40:22.358089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.366474 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45c4346a-cba0-46c7-a4c9-e05d80f91e54 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.503473 Oct 28 17:40:22.368924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71d89cde-b300-46f0-93d1-c29faa24b4f1 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.096323 Oct 28 17:40:22.371488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1475/2849] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:40:22 2022] GET /compute/v2.1/servers => generated 340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:22.382516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:22.383113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:22.388316 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1375/2850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:21 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:22.401089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.401587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.404079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.407950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.408444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.409036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.410690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:22.427966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.429382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Searching by: {'deleted': False, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:40:22.454867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:22.462741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.464994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.466384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.467908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.469396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.469853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.510817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:40:22.556847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.564350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.565255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.566070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.744657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:22.770472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eeef0304-1490-4f58-a69f-272afbc643a7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.395998 Oct 28 17:40:22.794076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1476/2851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:22 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:22.800065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:22.810339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.810568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c864fe10-f4b8-4263-8174-00550e00618a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.410060 Oct 28 17:40:22.810899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.819456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.819625 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1376/2852] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:40:22 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:22.819625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:22.819625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:22.833480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.833678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:22.835082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.835565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.836294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.836751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.837175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.846827 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action HTTP/1.1 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: {"os-stop": {}} Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6e49131a-4de5-4a84-b9a4-47ba09b70dae', 'body': {'os-stop': {}}} Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked Oct 28 17:40:22.848709 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:22.853276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 409 to user: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae is locked {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:22.853276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99445df7-806c-4979-944d-fb10f34315bc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 409 len: 107 microversion: 2.1 time: 0.054762 Oct 28 17:40:22.854267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1477/2853] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:22 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 107 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:40:22.861074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:22.861682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:22.868913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.868913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.869322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:22.870027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:22.870474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:22.870967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.192029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.201484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.203194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.204676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b08ac4a-b7b1-4fc2-a2f5-5a5d3635dcd7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2665 microversion: 2.42 time: 0.349449 Oct 28 17:40:23.216427 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1478/2854] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:22 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2665 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:23.227151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.232742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.236940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.240459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.241218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.241892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.242836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.243539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.244175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.247175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cf7a18d-b149-434d-9f1f-4bab6f73fe63 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1526 microversion: 2.1 time: 0.432640 Oct 28 17:40:23.260533 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1377/2855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:22 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1526 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:23.271650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a79eaf6f-ff74-4088-81ac-87df97d895fa tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.280586 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a79eaf6f-ff74-4088-81ac-87df97d895fa tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018718 Oct 28 17:40:23.289026 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1378/2856] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:23.294792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:23.295619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.302420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.303137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.303610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.304314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.304962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.305660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.335133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.344764 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f8c5be7-9734-442b-be7a-55c3f8fe5937 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1269 microversion: 2.1 time: 0.126877 Oct 28 17:40:23.345656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1479/2857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:23.351824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.352690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.380495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Unlocking {{(pid=120568) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 17:40:23.398178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.398983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.400993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.406230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.406878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.407326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.454068 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3e372ac-b16c-4063-a017-582901bcfb80 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.163556 Oct 28 17:40:23.458004 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1379/2858] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:23 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:23.460820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-deleted", "tag": "4ccc5446-0359-471c-9f28-c5d8f7b673d3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:23.472033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.472509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.473199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.486703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] Creating event network-vif-deleted:4ccc5446-0359-471c-9f28-c5d8f7b673d3 for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:23.492393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2a565da0-0ce2-497e-a85c-2a12170011dc req-e5d6539e-3966-4fd7-9517-1c9e12a66570 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Oct 28 17:40:23.493002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1380/2859] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:23.498466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.499157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.505552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.506038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.506497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.507194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.507743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.508298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.757250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.767212 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d4c167a-c249-4138-83aa-1229bf97f4b7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1315 microversion: 2.1 time: 0.420037 Oct 28 17:40:23.768197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1480/2860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:23.773676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:23.784605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.785106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.785550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.805289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:23.812755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Going to try to stop instance {{(pid=120567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:40:23.814446 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b57daa3-baf1-494f-ada9-874af33de626 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1469 microversion: 2.1 time: 0.320099 Oct 28 17:40:23.815030 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1381/2861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:23.835642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7", "name": "network-vif-deleted", "tag": "618178d3-3ee6-4ebc-a0c6-3d3be7827c86"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:23.846590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.846992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.847910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.852169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:23.860961 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] Creating event network-vif-deleted:618178d3-3ee6-4ebc-a0c6-3d3be7827c86 for instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 on n-h1-860864-13 Oct 28 17:40:23.861200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-030d8cbd-df10-49f1-89ac-2be48b2d1c70 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.091393 Oct 28 17:40:23.862393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1481/2862] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:23 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:23.869609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.869781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-cbf0ee46-7e33-4bc0-8ecd-f83b282bf2a4 req-29594d05-3ae4-402a-af97-af088cdfdfa4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037459 Oct 28 17:40:23.870249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1382/2863] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:23.873783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.876300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:23.876991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:23.881353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.881353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.881581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.882669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.884070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.884585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.885052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.885775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:23.886250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.887210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:23.891131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:23.891704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.192292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:24.196291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:24.201248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6fcadc26-0dc0-4f46-a763-dbe76e4ad9bf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.328790 Oct 28 17:40:24.202159 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1383/2864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:24.207530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:24.208220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:24.236295 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d01f7134-5525-4228-a46d-32e734e5d8b6 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.368109 Oct 28 17:40:24.238500 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1482/2865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:23 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:24.241564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.242068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.244870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.247690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.251512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.252153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.252485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:24.253214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:24.271314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.272070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.272653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.273533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.274203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.275609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.320986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:24.490756 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba5c90a8-d952-46fa-8d1a-1d0a9b0c75c2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "DELETE /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 204 len: 0 microversion: 2.1 time: 0.286427 Oct 28 17:40:24.492364 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1384/2866] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:24 2022] DELETE /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:24.499932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:24.501266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:24.511632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.512643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.514206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.517603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.518340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.518977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.573577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:24.575197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:24.575993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:24.578570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lazy-loading 'fault' on Instance uuid e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:24.969570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:24.980831 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4571b053-cbb0-4f4e-8c12-91ec06a54afa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1314 microversion: 2.1 time: 0.486352 Oct 28 17:40:24.983954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1385/2867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:24 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:24.995114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:24.996710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:25.007738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.008452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.009084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.009956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.010643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.011271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.133233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.140797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.150222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.155819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc0b14ca-969b-43a1-ba4a-bfd48879319c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1277 microversion: 2.1 time: 0.170007 Oct 28 17:40:25.158025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.159340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a37b6f35-60ec-441a-9369-0a8f4d2fd08e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2504 microversion: 2.42 time: 0.918519 Oct 28 17:40:25.171709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1386/2868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:24 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:25.171806 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1483/2869] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:24 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2504 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:25.171806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8aa21e-d3db-42fa-b36b-00f8b40d88ca", "name": "network-vif-plugged", "status": "completed", "tag": "ad39617b-49a0-4342-ab22-ecf5da43ee8d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:25.171970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:25.171970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:25.183720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.184344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.188331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.189054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.189512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.189940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.194582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.195281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.195927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.212841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] Creating event network-vif-plugged:ad39617b-49a0-4342-ab22-ecf5da43ee8d for instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca on n-h1-860864-13 Oct 28 17:40:25.220410 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-403201a3-9596-4000-8765-11564c8a515f req-bf2cdcfe-2da7-4260-8c55-972844f1e6e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057931 Oct 28 17:40:25.225523 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1484/2870] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:25.232482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:25.233214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:25.239585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.240063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.240491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.241189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.241791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.242211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.513846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.526966 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc723d31-3726-451b-99ff-4a3538e57c65 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1713 microversion: 2.1 time: 0.359333 Oct 28 17:40:25.530410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:25.533700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1387/2871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:25 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1713 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:25.541132 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01fdd661-36f7-4577-8752-67b3f392c04e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1502 microversion: 2.1 time: 0.313119 Oct 28 17:40:25.542546 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1485/2872] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:25 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:25.543592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:25.544656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:25.550464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:25.552764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:25.562836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.563118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.563661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.563922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.564215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.564566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.564927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.565384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.565805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:25.565967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:25.566342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:25.566919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.000018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.014133 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-94a8e71a-16d1-44f7-9a49-9f16d6c6f2d4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1462 microversion: 2.1 time: 0.479025 Oct 28 17:40:26.015398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1388/2873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:25 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1462 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.020146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.021057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.030517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.031722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.032520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.033476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.034742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.035412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.056081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.067506 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-afd07913-aded-406e-8bdb-6f2d815c1e62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.520750 Oct 28 17:40:26.068587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1486/2874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:25 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.075996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-deleted", "tag": "c672d2c1-310f-453c-871d-9c962f2a558e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:26.104698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.108288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.109222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.127260 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] Creating event network-vif-deleted:c672d2c1-310f-453c-871d-9c962f2a558e for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:26.134163 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-800fd659-c982-4adb-bbb7-b3a7d500660e req-7cd23a21-d45d-4785-846b-466b964208ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064097 Oct 28 17:40:26.135343 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1487/2875] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:26.142222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:26.143621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.153135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.153867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.154457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.155355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.156425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.157013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.185819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'flavor' on Instance uuid 2a178f9a-6846-420f-b8d9-5454a0be82fd {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:26.299687 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40d6eeb3-becf-4005-b75f-73b1b37cacc6 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "POST /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd/action" status: 202 len: 0 microversion: 2.1 time: 0.161026 Oct 28 17:40:26.303665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1488/2876] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:26 2022] POST /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:26.319703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.320686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.339694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.340298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.341109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.341976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.342641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.343887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.389766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.390355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.390850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.391562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lazy-loading 'fault' on Instance uuid e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:26.411300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.422140 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca046b6e-db95-4200-94d5-15b13a747916 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.404516 Oct 28 17:40:26.423627 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1389/2877] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.429155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.430007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.437722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.438550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.439681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.440775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.441039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.441465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.450310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.462253 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bfbf7dfe-e01b-4fd6-b835-f8a229a9e002 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1314 microversion: 2.1 time: 0.154480 Oct 28 17:40:26.480654 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1489/2878] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.488266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.489142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.496560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.497823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.498429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.499406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.500011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.500631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.592430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.604729 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad3e2e04-1457-4edd-ad06-a1925ef1cdb6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1275 microversion: 2.1 time: 0.121029 Oct 28 17:40:26.622548 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1490/2879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.627141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.627769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.633836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.634319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.635108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.635838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.637425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.637425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.758811 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9dbd3046-52de-478b-96df-d389f6d6ce98 tempest-MigrationsAdminTest-598534258 tempest-MigrationsAdminTest-598534258-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1615 microversion: 2.1 time: 0.333449 Oct 28 17:40:26.759741 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1390/2880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1615 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:26.769892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.770457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.780620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.780910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.781440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.782614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.783171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.783971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.811227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.822006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.824144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.826935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-42ecaa99-57eb-4ad0-b26e-dceb005fcb59 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 2436 microversion: 2.42 time: 0.203762 Oct 28 17:40:26.838606 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1491/2881] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 2436 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:26.852761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:26.852761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:26.859218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.861050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.862111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.862519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:26.863858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:26.863858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:26.880455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:26.984842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:26.996393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38a66e33-b490-4667-840e-632b282ef48d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1510 microversion: 2.1 time: 0.234867 Oct 28 17:40:26.997650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1391/2882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.002781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.003442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.014430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.014927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.015387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.016411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.016559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.016986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.061487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:27.069111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.087626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34ea339a-1045-4acf-a6bc-3e1430db6cb2 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1713 microversion: 2.1 time: 0.244024 Oct 28 17:40:27.088257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1492/2883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:26 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.099124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.099804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.111116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.111644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.112081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.112806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.113255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.113677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.234199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8e38cda-ca37-4110-aaac-c41774a2b1e5 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 204 len: 0 microversion: 2.1 time: 0.234927 Oct 28 17:40:27.235247 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1392/2884] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:26 2022] DELETE /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:27.252732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.253472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.265647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.266287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.266780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.270043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.270612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.271735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.323307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.334444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-904bbce5-a450-44b7-8d25-63c507fcbd47 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.244946 Oct 28 17:40:27.339977 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1493/2885] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.447254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.447907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.459169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.460066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.460505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.461348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.466432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.466602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.478726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.492821 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fcef74c9-c773-4212-b3b2-96627d09bb2d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1468 microversion: 2.1 time: 0.249319 Oct 28 17:40:27.494636 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1393/2886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.508215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.509166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.518030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.518818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.519552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.520538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.521531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.522303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.563608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.565552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.566609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.570717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lazy-loading 'fault' on Instance uuid e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:27.643079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.651133 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15bc3834-5adf-4377-9eeb-aea3f0199a4a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 200 len: 1314 microversion: 2.1 time: 0.153194 Oct 28 17:40:27.652682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1394/2887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.657418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.658112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.665213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.665763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.666293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.667058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.668194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.669029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.684882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:27.705381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.723461 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bcfc9853-1ed6-4ca0-8f8e-379332e8e880 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1314 microversion: 2.1 time: 0.274883 Oct 28 17:40:27.724553 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1494/2888] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:27.862058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:27.863233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:27.878786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.880192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.880888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.882388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:27.888422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:27.898296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:27.899396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:27.900933 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7612f50e-a7bf-4be8-a039-1bb088f26bd5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.243492 Oct 28 17:40:27.911465 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1395/2889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:28.021826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:28.022549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:28.035922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.044792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.045699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.046656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.048032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.050542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.051319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:28.066182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:28.071905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:28.073352 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df016fb0-5e7c-482c-a205-de571362e67e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.215403 Oct 28 17:40:28.076596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1495/2890] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:27 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:40:28.113842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:28.114713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:28.131127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.131885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.134035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.134958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.136176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.139507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.398514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:28.407719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a95ecd4c-5eeb-4923-b7f5-90eb1aa87d7f tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1646 microversion: 2.1 time: 0.298506 Oct 28 17:40:28.419395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1496/2891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:28 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1646 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:28.421583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65571bb-a385-43ee-9748-68ae332bca4f", "name": "network-vif-deleted", "tag": "452a2cfa-f5b7-4060-afce-a8c1024694ff"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:28.441244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.441734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.444276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.453789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:28.462326 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a796706f-2265-4cc8-9375-3e615b60c1df tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1493 microversion: 2.1 time: 0.445201 Oct 28 17:40:28.465947 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1396/2892] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:28 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1493 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:28.480111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:28.481429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:28.484103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] Creating event network-vif-deleted:452a2cfa-f5b7-4060-afce-a8c1024694ff for instance b65571bb-a385-43ee-9748-68ae332bca4f on n-h1-860864-13 Oct 28 17:40:28.489946 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-efcee6cd-44d2-4bf9-9e52-41e96e1013f7 req-ae9bb8cf-4ed7-4309-9e39-255923b44461 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078153 Oct 28 17:40:28.492476 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1497/2893] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:28.498925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.499686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.503607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.504583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.505203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84546210-6265-4273-9759-aa689156f9b5", "name": "network-vif-deleted", "tag": "6a1c3507-0640-4508-b0c7-16eac274211e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:28.505409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.506009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.539018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.539544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.539983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.570345 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] Creating event network-vif-deleted:6a1c3507-0640-4508-b0c7-16eac274211e for instance 84546210-6265-4273-9759-aa689156f9b5 on n-h1-860864-13 Oct 28 17:40:28.588242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-fc78c688-0b37-4761-a75c-f4cdf1d8e654 req-55ebdcfe-9877-4c9f-bdfb-68c24927335f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092112 Oct 28 17:40:28.589050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1498/2894] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:28.623146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:28.625152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:28.640128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.640633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.643404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.644159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.644644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.645305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.681235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:28.850532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a13aea9-70ee-4b2b-a02e-bf0a9c5ee482 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 204 len: 0 microversion: 2.1 time: 0.259169 Oct 28 17:40:28.851265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1499/2895] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:28 2022] DELETE /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:28.861710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:28.862413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:28.879001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.879551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.880052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:28.880784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:28.881241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:28.881666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.029116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.038946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dcd4475f-58b0-4f71-8aa6-7f11cf673341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.571875 Oct 28 17:40:29.042564 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1397/2896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:28 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:29.052953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-plugged", "status": "completed", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:29.074486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.075109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.075684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.102179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] Creating event network-vif-plugged:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h2-860864-13 Oct 28 17:40:29.121098 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-08595f03-e2c7-46ba-852b-ca206aca5d93 req-5cbeda10-b123-4f14-bfb0-b0444d42947d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075947 Oct 28 17:40:29.123319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1398/2897] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:29.131030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.132054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.139877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.142716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.145607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.146592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.147300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.147998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.170734 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 HTTP/1.1 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7'} Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:29.174755 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:40:29.178596 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:29.180533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:29.181611 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ad83a49-68f9-46b7-8b3c-68c3c9c20593 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 404 len: 111 microversion: 2.1 time: 0.055163 Oct 28 17:40:29.190874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1399/2898] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:29.196100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.197020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.204099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.204928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.206212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.207157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.207852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.208513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.372687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.387917 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ceb6838d-c71e-4396-a711-89030a1c2905 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1468 microversion: 2.1 time: 0.534352 Oct 28 17:40:29.399394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1500/2899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:28 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1468 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:29.405551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.405551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.418611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.419487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.420090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.421142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.421755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.422340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.575713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.586695 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-709daa17-c3f0-4376-94e6-7f8b29a8da4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1500 microversion: 2.1 time: 0.394163 Oct 28 17:40:29.587484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1400/2900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1500 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:29.592940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.593833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.601697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.602626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.603284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.604246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.604975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.605897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.627465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:29.692313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.701899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27a5cd68-896a-4f9e-a04a-b4751f4f526e tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1499 microversion: 2.1 time: 0.312311 Oct 28 17:40:29.711495 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1501/2901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1499 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:29.719896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.720515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.740624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.741103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.741541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.742251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.742706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.743129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.836217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.850906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.856925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.860108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.861491 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34d78fc9-e6a1-4385-8aa1-773053e37bad tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.149444 Oct 28 17:40:29.863040 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1502/2902] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:29.864616 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-459663b1-7843-4257-8499-2f6aa9280af2 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.275623 Oct 28 17:40:29.865831 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1401/2903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:29.873579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:29.874398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.881548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.882494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.883073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.884135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.884864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.885710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.887917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c98d49b8-97bd-4997-887e-cf06d4edb39e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'create', calling method: .version_select at 0x7f751f8705e0>, body: {"keypair": {"name": "tempest-keypair-1701527684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWfibboBGAnbZCEONwTerSt5kjia+lcD6LIi5X1btTwFy2hfAXtUCHUHxdfoSrnTwEtZCcQe42twTYtbyMwuvGhglMDoQA71EYJ9xl0wJYlLHsiD+tUrYYCyw/J/oqP2A=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:29.907342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c98d49b8-97bd-4997-887e-cf06d4edb39e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for project 617d7971a40643429240ed3e0fbb5093. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:40:29.913950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:29.915850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c98d49b8-97bd-4997-887e-cf06d4edb39e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for user 7b923545f92c4290b55733dd4cc1c866 and project 617d7971a40643429240ed3e0fbb5093. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:40:29.927594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.929188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:29.929638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:29.930415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lazy-loading 'fault' on Instance uuid 84546210-6265-4273-9759-aa689156f9b5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:29.953834 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c98d49b8-97bd-4997-887e-cf06d4edb39e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075898 Oct 28 17:40:29.955477 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1503/2904] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:40:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:29.977469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:29.986793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:29.989580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce591cb2e15d4fd49fb53d68bd32100b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ffc4eb74fe4929ac359d4d5bf395db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:29.998948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:29.999801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.000641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-584bad35-9ab0-4905-94a4-cba8619a0c5a tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 200 len: 1367 microversion: 2.1 time: 0.133394 Oct 28 17:40:30.001246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.002310 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1402/2905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:29 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 1367 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:30.002752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.004139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.004862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.066699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:30.067895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:30.075756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.076979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.078050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.079603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.080257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.080871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.104454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lazy-loading 'flavor' on Instance uuid 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:30.495065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:30.506659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3724a677-f472-4cb2-907d-d531dc2dff05 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.444271 Oct 28 17:40:30.507848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1403/2906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:30 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:30.514380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:30.515316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:30.523506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.524546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.525134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.526005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.526691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.527933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.607188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.609910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.610551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.611220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lazy-loading 'fault' on Instance uuid 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:30.704898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7edbf2bf-d813-4ade-8285-42df45352b59 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "POST /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca/action" status: 200 len: 32 microversion: 2.1 time: 0.746287 Oct 28 17:40:30.707316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1504/2907] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:29 2022] POST /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca/action => generated 32 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:40:30.723724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf59678-1eb6-43bf-a4e6-b2c3c05bb271", "name": "network-vif-deleted", "tag": "bfb5c5eb-f2ea-45d2-94a8-06fcb7601403"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:30.736294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:30.751962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.752536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.752989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.759745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4147bd09-f792-4e43-a0b4-abc7fe657c61 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 200 len: 1303 microversion: 2.1 time: 0.250155 Oct 28 17:40:30.775735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] Creating event network-vif-deleted:bfb5c5eb-f2ea-45d2-94a8-06fcb7601403 for instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 on n-h2-860864-13 Oct 28 17:40:30.780275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1404/2908] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:30 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:30.782390 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-54549f38-7b14-4dd3-906d-7d9dd64ae432 req-7203f945-25d3-4495-ac82-d11d167dea34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072826 Oct 28 17:40:30.783550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1505/2909] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:30.788307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dbd6937-f61c-4393-98db-7c0f6e3c1385", "tag": "5d73501c-407e-4485-bbe1-f179ed9f3f63"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:30.792064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:30.793080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:30.809374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.816072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.816589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.817359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.821500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.826769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.827852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.830971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.834803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.847622 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] Creating event network-changed:5d73501c-407e-4485-bbe1-f179ed9f3f63 for instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 on n-h1-860864-13 Oct 28 17:40:30.854414 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3799311a-48e3-4873-8eb2-078e448087c0 req-e5e615db-9ee6-467a-b946-fd16f184e487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072846 Oct 28 17:40:30.856236 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1405/2910] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:30.861540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:30.862463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:30.869866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.870632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.871756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:30.872622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:30.873231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:30.873808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.250297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:31.252611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:31.270962 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cb15a4b-3a61-4b26-8703-f850cbe7c221 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.485214 Oct 28 17:40:31.273644 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a4835af-62a9-4511-b0e0-b53a756c21ec tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1499 microversion: 2.1 time: 0.415910 Oct 28 17:40:31.288535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1506/2911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:30 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:31.290295 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1406/2912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:30 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:31.302043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:31.302666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:31.303498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:31.304393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:31.317423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.318587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.319730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.320394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.320986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.321570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.322458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.323409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.324090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.324707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.325284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.325889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.505925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:31.535197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:31.536722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:31.538001 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-96609778-28c9-4c1e-8f5c-f69b74988e93 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.246518 Oct 28 17:40:31.540059 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1407/2913] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:31 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:31.545615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:31.549125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] [instance: 84546210-6265-4273-9759-aa689156f9b5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:31.557223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.557967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.559230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.560128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.560742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.561322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.584360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] HTTP exception thrown: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Request method failure captured: Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 HTTP/1.1 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSn7Zmwmw8iYLUpME9PP_lKCt3hpd-XJgyRbD_QnzQeteo5rTQG2ie4QDMaPvcFzyrXX3iJHWe7LoAO0gsEexwRpcJreSz8rpWETplVk4HBhO91njuElrIE7NG6guViZqxEbvyKRstgivOh4NQgwlrAHH_VXRl9Lntn4Qr1c0adFM Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 88ffc4eb74fe4929ac359d4d5bf395db Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestManualDisk-1716560902 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/88ffc4eb74fe4929ac359d4d5bf395db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/88ffc4eb74fe4929ac359d4d5bf395db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_88ffc4eb74fe4929ac359d4d5bf395db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/88ffc4eb74fe4929ac359d4d5bf395db"}]}] Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestManualDisk-1716560902 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 88ffc4eb74fe4929ac359d4d5bf395db Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestManualDisk-1716560902 Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestManualDisk-1716560902-project Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ce591cb2e15d4fd49fb53d68bd32100b Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestManualDisk-1716560902-project Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '84546210-6265-4273-9759-aa689156f9b5'} Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:31.586287 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. Oct 28 17:40:31.591640 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:31.593904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Returning 404 to user: Instance 84546210-6265-4273-9759-aa689156f9b5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:31.594943 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-786f4218-fa88-4164-a5e5-2f07b6350f7e tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5" status: 404 len: 111 microversion: 2.1 time: 0.053712 Oct 28 17:40:31.599515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1408/2914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:31 2022] GET /compute/v2.1/servers/84546210-6265-4273-9759-aa689156f9b5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:31.605931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:31.608411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:31.616793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.617560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.618180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:31.619044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:31.619730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:31.620308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.125713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.155678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0f7ae76-b292-45e8-b4cb-c29f6003dd0a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.865589 Oct 28 17:40:32.177170 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1507/2915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:31 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:32.187581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb313801-f3d1-4053-9a21-1dbd6fbca323 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] Calling method '.version_select at 0x7f751f860c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.229613 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb313801-f3d1-4053-9a21-1dbd6fbca323 tempest-ServersTestManualDisk-1716560902 tempest-ServersTestManualDisk-1716560902-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188870245" status: 202 len: 0 microversion: 2.1 time: 0.046227 Oct 28 17:40:32.230829 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1508/2916] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188870245 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:32.242846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.243854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.259702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.261107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.261693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.262874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.263564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.264599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.292359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.309988 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e62af54a-c32f-421f-8b47-fa88294b12db tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.709048 Oct 28 17:40:32.323395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1409/2917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:31 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] HTTP exception thrown: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Request method failure captured: Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 HTTP/1.1 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLEAVV5HgKpXQx907PPjTfPu3XPha6fngrMiJzc6nErnR2Cb5Ur2Vq5Kr-Kl9tiQTJzxScbGdzOaG-JTuMFjDUWLMf0Brc3n49jMAbo_zqdlWwTjyBfW4nJw2T0FMAyCNJDlXR8oJWszpbYoZ0WhSp9GzHjkQ2hVSU7iEfk6X1NcfY Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}] Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e174a38769804247965891c498020315 Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2cf59678-1eb6-43bf-a4e6-b2c3c05bb271'} Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:32.323598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Returning 404 to user: Instance 2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:32.330240 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63dd4b15-d024-40d8-b215-f76aa866a57d tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271" status: 404 len: 111 microversion: 2.1 time: 0.088509 Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.331408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.335534 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1509/2918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:32 2022] GET /compute/v2.1/servers/2cf59678-1eb6-43bf-a4e6-b2c3c05bb271 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:32.341414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.342153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.367938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.368442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.368883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.369604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.370061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.370489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.379834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:32.480755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:32.515188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.530777 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7aea4ff-b2da-4e4f-a2ac-1857630f55b2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1457 microversion: 2.1 time: 0.193979 Oct 28 17:40:32.531894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1510/2919] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:32 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1457 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:32.537756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.538272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.549179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.549962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.550399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.552215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.552338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:32.552673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.553097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.588418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:32.693139 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d5f0e5d-652f-4c31-b60d-0aa87fda7ef4 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 204 len: 0 microversion: 2.1 time: 0.158504 Oct 28 17:40:32.694119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1511/2920] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:32 2022] DELETE /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:32.705061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.705805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.706590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.714717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.715109 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b55fbc64-d5a1-464a-95c4-f0fd4c0a8ee2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.403066 Oct 28 17:40:32.715245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.715668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.716692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.717159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.717601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.719844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1410/2921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:32 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:32.728257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:32.728881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:32.740124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.740634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.743586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.744379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.744856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.745292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:32.812480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.828406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.829922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:32.831118 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddf04fb0-2489-49df-85e5-5bb458830e9d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.134073 Oct 28 17:40:32.832071 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1512/2922] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:32 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:32.960769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a178f9a-6846-420f-b8d9-5454a0be82fd", "name": "network-vif-deleted", "tag": "97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:32.989646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:32.990424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:32.992596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.005033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:33.009120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] Creating event network-vif-deleted:97d2c1fd-0dc0-4c0b-90cf-a3e1b0cae7c6 for instance 2a178f9a-6846-420f-b8d9-5454a0be82fd on n-h1-860864-13 Oct 28 17:40:33.014899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-701d8b0a-5d72-4c75-a2ee-7572b241b025 req-8170cd45-994b-49df-8927-c4f5a16d02ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081885 Oct 28 17:40:33.015919 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1513/2923] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:40:33.018407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-132181fb-94e3-45b4-b488-055c5bbe15ec tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1534 microversion: 2.1 time: 0.292928 Oct 28 17:40:33.019253 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1411/2924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:32 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1534 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:33.187776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:33.188844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:33.195240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.196021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.196630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.197431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.197992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.198664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.339240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:33.341685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:33.349950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.350788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.352015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.354092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.355484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.358240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.513192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:33.526446 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c87129da-d0e0-4765-a70a-68e3aab2954a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.345523 Oct 28 17:40:33.528195 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1514/2925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:33 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:33.558761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:33.559820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:33.568861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.569630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.570288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.571446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.572136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.572746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.601952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:33.614250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5d4bd15-0b02-46ea-9bad-23f1a16186a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.280262 Oct 28 17:40:33.617507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1412/2926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:33 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:33.634004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1950999163", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:33.658828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:33.667326 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54fbb7c5-0705-48ed-9bfd-19eb7f743156 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1457 microversion: 2.1 time: 0.114977 Oct 28 17:40:33.669927 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1515/2927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:33 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1457 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:33.703614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] validate_networks() for [('8e53cf83-ea72-42d2-b2ea-483082deaa8d', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:40:33.748806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:33.749621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:33.762581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.763183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.763773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:33.764592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:33.765152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:33.765678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.005915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:34.026473 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-376c2eca-1e46-4a5d-80de-9d8c1df2ee25 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.282408 Oct 28 17:40:34.028747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1516/2928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:33 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:34.036087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:34.036921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:34.049013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.049666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.050446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.051288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.051867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.052374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.161272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:34.171292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:34.172831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:34.174149 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bad55c3-13c9-423c-90a8-27d0651971d3 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.143936 Oct 28 17:40:34.174932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1517/2929] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:34 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:34.185111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:34.185990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:34.196661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.197483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.197939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.199309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.200698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.200698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.587534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:34.603681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:40:34.604828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:40:34.606572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:40:34.607202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:40:34.607788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:40:34.612810 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd84f3b6-8b18-4c90-8aa1-0cb1e2a58ba7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1534 microversion: 2.1 time: 0.432111 Oct 28 17:40:34.618943 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1518/2930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:34 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1534 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:34.627461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:34.628335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:34.635872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.636488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.638128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.638892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.639738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.641393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.654605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.655115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.655587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.656317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:34.656786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:34.657218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:34.679188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:34.700716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:40:34.741200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for user 7b923545f92c4290b55733dd4cc1c866 and project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:40:34.794720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:40:34.798748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:40:34.943660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-195d3ab3-3d23-41fb-b744-c64052e62954 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.313978 Oct 28 17:40:34.944389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1413/2931] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:40:34.958735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:34.959360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:35.016957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:35.026601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.027157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.029841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4cd3656f-3c98-4bee-a2b9-f3c6a9d942cd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.409470 Oct 28 17:40:35.032587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1519/2932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:34 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:35.043595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:35.046935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:35.054416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.055209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.055719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.056158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.063067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.065050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.066948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.067949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.069444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.070528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.135182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.136099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.136801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.137648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lazy-loading 'fault' on Instance uuid 2a178f9a-6846-420f-b8d9-5454a0be82fd {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:35.359225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9954243b8a4260be0392adff6c2513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1b7c0435044ce5a6f456c4e24cf44f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:35.374134 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7483376e-8c98-4df9-91c3-685f93988d5d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 200 len: 1305 microversion: 2.1 time: 0.339865 Oct 28 17:40:35.399125 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1520/2933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:35 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 1305 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:35.408461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa79182c-5429-4a0a-8762-9dc22af37373 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:35.409511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa79182c-5429-4a0a-8762-9dc22af37373 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:35.764655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa79182c-5429-4a0a-8762-9dc22af37373 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:35.774067 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa79182c-5429-4a0a-8762-9dc22af37373 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1225 microversion: 2.1 time: 0.372511 Oct 28 17:40:35.781253 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1521/2934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:35 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1225 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:35.799713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:35.807576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:35.824417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.825834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.827892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:35.830984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:35.835425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:35.837763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.014292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.017370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:36.039204 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b2d7873-b888-4445-b7a4-a77622374cae tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1658 microversion: 2.1 time: 1.093777 Oct 28 17:40:36.045692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1414/2935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:34 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1658 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:36.065859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.067657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:36.107068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.118617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.119241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.121663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.122273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.125334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.361222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.390244 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d464d594-a703-4d31-84e7-66467211854c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.604040 Oct 28 17:40:36.403395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1522/2936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:35 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:36.412505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.413462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:36.435817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.436329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.436769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.439949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.444960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.448013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.457593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.475229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.483641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.497099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69d2c44b-ed46-4267-bbe5-bf708c84c842 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.449184 Oct 28 17:40:36.511542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1415/2937] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:36.534090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82828f5b-aef0-46db-bbef-7b6f74930211", "name": "network-vif-deleted", "tag": "b4703af9-f45d-47f5-8dce-2236b269f5ef"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:36.547716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.548208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.548651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.549113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lazy-loading 'fault' on Instance uuid 82828f5b-aef0-46db-bbef-7b6f74930211 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:40:36.578445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.584415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.585361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.612716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] Creating event network-vif-deleted:b4703af9-f45d-47f5-8dce-2236b269f5ef for instance 82828f5b-aef0-46db-bbef-7b6f74930211 on n-h2-860864-13 Oct 28 17:40:36.618328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2e4ccd1c-68fd-4e17-8ef7-06d6c38a2a03 req-e9e6b50d-8cf0-49fa-af93-a1b65f08b4a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105157 Oct 28 17:40:36.619264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1416/2938] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:36.625171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.626077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:36.632711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.633438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.634039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.634957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.635684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.636473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.638034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.650697 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2eec6f0b-9d9b-45bd-b185-b2a2845d0ddb tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 200 len: 1369 microversion: 2.1 time: 0.255791 Oct 28 17:40:36.659784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1523/2939] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:36.666796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:36.685994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.686787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.687444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.750915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Going to try to start instance {{(pid=120567) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 17:40:36.853066 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9a966ec-a616-4a4f-8242-c15b93148a44 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.191805 Oct 28 17:40:36.857291 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1524/2940] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:36 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:36.868891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.869633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:36.890106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.890627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.901551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.902782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:36.903009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:36.903480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:36.913739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:36.953636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd HTTP/1.1 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2a178f9a-6846-420f-b8d9-5454a0be82fd'} Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:36.955395 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:36.959303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:36.961185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:36.962379 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1fdb2540-5bab-4821-b462-6a33c61771f0 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 404 len: 111 microversion: 2.1 time: 0.107146 Oct 28 17:40:36.972126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:36.974822 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1525/2941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:36.982970 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7804e702-9082-424a-8d3d-db5a4b927d7a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.362452 Oct 28 17:40:36.984166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.984795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:36.988059 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1417/2942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:36.997686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:36.998303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.010735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.018873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.019521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.020805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.021369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.021511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.021867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.022617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.022795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.023435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.023927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.024362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.262292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:37.274758 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc9f7586-5937-4cf0-a4b5-8232b0901b46 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1221 microversion: 2.1 time: 0.295836 Oct 28 17:40:37.287397 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1526/2943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1221 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:37.287397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.287397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.291890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.301253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.301950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.302869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.304756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.305379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.331441 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd HTTP/1.1 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2a178f9a-6846-420f-b8d9-5454a0be82fd'} Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:37.336266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.340594 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.350960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:37.357961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3e3612b-a2bc-45de-896b-83a385574788 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 404 len: 111 microversion: 2.1 time: 0.080070 Oct 28 17:40:37.362910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1527/2944] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:37 2022] DELETE /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:37.389758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.390386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 2a178f9a-6846-420f-b8d9-5454a0be82fd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.404517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.405018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.405670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.406749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.407471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.408111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.431252 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd HTTP/1.1 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2a178f9a-6846-420f-b8d9-5454a0be82fd'} Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.437486 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 2a178f9a-6846-420f-b8d9-5454a0be82fd could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:37.442245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c32cfa61-57c1-47c7-ad4f-5ef239b4336f tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd" status: 404 len: 111 microversion: 2.1 time: 0.073343 Oct 28 17:40:37.449318 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1528/2945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:37 2022] GET /compute/v2.1/servers/2a178f9a-6846-420f-b8d9-5454a0be82fd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:37.454361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.455170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.469493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.470250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.470877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.471828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.472443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.473284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.607522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:37.615914 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9dff3fd4-f5e2-4652-b8c3-e6eff85b5a4d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1667 microversion: 2.1 time: 0.626479 Oct 28 17:40:37.621597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1418/2946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:36 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1667 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:37.639448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.640185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.654536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.655244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.655977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.656873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.657496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.660967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.693870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f HTTP/1.1 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ea888bf3-ba23-4e7e-8406-4dccecaaa59f'} Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:37.695625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:37.700159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ca687da-01bd-4022-a50f-978d2978590b tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 404 len: 111 microversion: 2.1 time: 0.074120 Oct 28 17:40:37.703463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1419/2947] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:37 2022] DELETE /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:37.722315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.723308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.746939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.747392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.747832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.748651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.748989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.765937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.934643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:37.954077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82c8ef6c-e8c9-474b-b197-b21ec71696b7 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.503333 Oct 28 17:40:37.955785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1529/2948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:37 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:37.977276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:37.978564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 82828f5b-aef0-46db-bbef-7b6f74930211] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:37.987529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.988358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.988990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.990486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:37.991924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:37.992542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:37.995475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:38.012400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:38.014235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:38.015614 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5bb06fce-2da5-4bb5-a848-62e565c412b8 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.311058 Oct 28 17:40:38.016849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1420/2949] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:37 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:38.022289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.023742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: ea888bf3-ba23-4e7e-8406-4dccecaaa59f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.031487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.032573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.033316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.034513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.035305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.036098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.040012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] HTTP exception thrown: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Request method failure captured: Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 HTTP/1.1 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLEAVV5HgKpXQx907PPjTfPu3XPha6fngrMiJzc6nErnR2Cb5Ur2Vq5Kr-Kl9tiQTJzxScbGdzOaG-JTuMFjDUWLMf0Brc3n49jMAbo_zqdlWwTjyBfW4nJw2T0FMAyCNJDlXR8oJWszpbYoZ0WhSp9GzHjkQ2hVSU7iEfk6X1NcfY Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}] Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e174a38769804247965891c498020315 Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '82828f5b-aef0-46db-bbef-7b6f74930211'} Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.041584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. Oct 28 17:40:38.048172 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.050551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Returning 404 to user: Instance 82828f5b-aef0-46db-bbef-7b6f74930211 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.051647 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1bbc2a1e-fd5b-42ae-b3ad-7b7652f28c1c tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211" status: 404 len: 111 microversion: 2.1 time: 0.094613 Oct 28 17:40:38.052741 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1530/2950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:37 2022] GET /compute/v2.1/servers/82828f5b-aef0-46db-bbef-7b6f74930211 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.057682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.058630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.065475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.066270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.067587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.068649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.069393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.070195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.083709 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f HTTP/1.1 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ea888bf3-ba23-4e7e-8406-4dccecaaa59f'} Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.091117 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. Oct 28 17:40:38.095171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.098382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance ea888bf3-ba23-4e7e-8406-4dccecaaa59f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.102405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f659a231-dbf5-4500-9c58-46e110f17734 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f" status: 404 len: 111 microversion: 2.1 time: 0.083203 Oct 28 17:40:38.107272 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1421/2951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/ea888bf3-ba23-4e7e-8406-4dccecaaa59f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.113782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81f16fa0-e52a-4d31-99e8-d4cb32aa9334 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '.version_select at 0x7f751f7a8550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.151566 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81f16fa0-e52a-4d31-99e8-d4cb32aa9334 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196641540" status: 202 len: 0 microversion: 2.1 time: 0.045798 Oct 28 17:40:38.152931 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1422/2952] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196641540 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:38.158738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.160074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.172204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.172923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.173442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.175137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.175693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.176252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.207102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c HTTP/1.1 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'dbbdee1b-247b-4d3b-808f-0848600dcf6c'} Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.209349 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.213533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6410de3-cbc7-4115-aca4-2b9b675a3fe7 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 404 len: 111 microversion: 2.1 time: 0.058894 Oct 28 17:40:38.217972 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1423/2953] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:38 2022] DELETE /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.226261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.227219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: dbbdee1b-247b-4d3b-808f-0848600dcf6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.237410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.238245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.239004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.239987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.240724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.241405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.259618 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c HTTP/1.1 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'dbbdee1b-247b-4d3b-808f-0848600dcf6c'} Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.262954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance dbbdee1b-247b-4d3b-808f-0848600dcf6c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.266971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12280d3c-2291-4c62-9d09-db9eac1bc945 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c" status: 404 len: 111 microversion: 2.1 time: 0.047892 Oct 28 17:40:38.268063 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1424/2954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/dbbdee1b-247b-4d3b-808f-0848600dcf6c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.276111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.276604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.288607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.290374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.291356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.306312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.310273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.310908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.335255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 HTTP/1.1 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c48e8b72-0a15-4b2d-86fd-752efa288371'} Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.338072 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.342054 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.344841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.345958 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5676dae-aaec-4cea-9fdf-81202f0a0ff2 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 404 len: 111 microversion: 2.1 time: 0.073848 Oct 28 17:40:38.347034 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1425/2955] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:38 2022] DELETE /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.352563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.353391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.381413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.383526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.385186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.387347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.389831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.390482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.610120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:38.622374 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1e31212-4cdf-45d2-9f62-9ae3227cf8af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1283 microversion: 2.1 time: 0.271140 Oct 28 17:40:38.623153 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1426/2956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1283 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:38.643668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.644487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: c48e8b72-0a15-4b2d-86fd-752efa288371] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.661912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.662472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.663043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.663925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.665216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.666563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.693469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 HTTP/1.1 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c48e8b72-0a15-4b2d-86fd-752efa288371'} Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.695024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance c48e8b72-0a15-4b2d-86fd-752efa288371 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce5a7cd7-4943-4f75-ad91-87b02caf7dc9 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371" status: 404 len: 111 microversion: 2.1 time: 0.067276 Oct 28 17:40:38.700150 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1427/2957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/c48e8b72-0a15-4b2d-86fd-752efa288371 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.725622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.726242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.737463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.737837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.739639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.740629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.741297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.741951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.763250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:38.775253 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b795595-b24d-479c-a18a-a3b0da62797a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.721169 Oct 28 17:40:38.778150 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1531/2958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:38.797319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.804188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.817304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.818906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.819350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.820088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.820540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.820961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.872121 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 HTTP/1.1 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b23e126f-ca33-47c4-8b76-65e51758e673'} Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.873727 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.877513 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad1af7d2-61a0-492c-aefc-59119a282b7d tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673" status: 404 len: 111 microversion: 2.1 time: 0.094598 Oct 28 17:40:38.880554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1532/2959] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:38 2022] DELETE /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.898064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.899007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: b23e126f-ca33-47c4-8b76-65e51758e673] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.915141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.916060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.916823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.918504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.919198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.919894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.950857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 HTTP/1.1 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b23e126f-ca33-47c4-8b76-65e51758e673'} Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:38.952828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. Oct 28 17:40:38.956608 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:38.965719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance b23e126f-ca33-47c4-8b76-65e51758e673 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:38.968235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2b80a40-ec91-4b6d-993a-05d181f75b50 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673" status: 404 len: 111 microversion: 2.1 time: 0.083751 Oct 28 17:40:38.969490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1533/2960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/b23e126f-ca33-47c4-8b76-65e51758e673 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:38.978034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:38.979355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:38.987144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.988074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.988727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:38.989682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:38.990352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:38.991281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.066217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:39.090513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91e2c073-97f9-4062-ad54-3be59b83ed62 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1667 microversion: 2.1 time: 0.382913 Oct 28 17:40:39.103109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1428/2961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1667 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:39.116864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:39.117487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:39.133133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.133638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.134076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.134788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.135357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.145823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.310797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:39.331197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:39.333771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:39.335176 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffd152e4-3873-472e-8501-ce3df62c8baf tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.231287 Oct 28 17:40:39.336374 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1429/2962] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:39 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:39.343915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbd6937-f61c-4393-98db-7c0f6e3c1385", "name": "network-vif-plugged", "status": "completed", "tag": "5d73501c-407e-4485-bbe1-f179ed9f3f63"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:39.357032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:39.399138 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a262c910-fb44-4ea1-afe7-b57d5a095f4f tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.422168 Oct 28 17:40:39.400705 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1534/2963] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:38 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:39.411357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.412536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.413240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.429444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] Creating event network-vif-plugged:5d73501c-407e-4485-bbe1-f179ed9f3f63 for instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 on n-h1-860864-13 Oct 28 17:40:39.438976 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-11b9d4d2-62d7-4d33-b788-27bded29e958 req-9b332bb5-d368-4dbb-b5e4-e0c1b594a5e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100356 Oct 28 17:40:39.440947 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1430/2964] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:39.652574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:39.653998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:39.674805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.675983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.676688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.677661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.678821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.681768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.763401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:39.764242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:39.778349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.779698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.780949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.781749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.783891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.784524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.821631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:39.950096 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98089190-9254-431e-bb2c-9a67eafb471a tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 204 len: 0 microversion: 2.1 time: 0.198440 Oct 28 17:40:39.953716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1431/2965] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:39 2022] DELETE /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:39.960025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:39.962243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:39.980844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.987339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.987827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:39.988691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:39.989150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:39.989645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.033366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.054851 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98964391-79aa-4151-89c8-f8f88a40294b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1283 microversion: 2.1 time: 0.404715 Oct 28 17:40:40.058039 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1535/2966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:39 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:40.077820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:40.079047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:40.094355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.099937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.101384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.104617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.105668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.107811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.536951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.546368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b69a48ef-62d2-42d1-92d5-196515831c03 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.593952 Oct 28 17:40:40.550107 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1432/2967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:39 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:40.557854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:40.561589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:40.574498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.574995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.575461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.576166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.576620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.577042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.603776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.613172 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8020a3bd-4ba2-4797-ab6f-1b94dc17a6e6 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1468 microversion: 2.1 time: 0.553602 Oct 28 17:40:40.616598 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1536/2968] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:40 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1468 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:40.625136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:40.625964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:40.632706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.633558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.634182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.635185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.636034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.637264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.753259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.771965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.773657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.775221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec758be4-5dea-4bff-b6a5-ddd93a86fb06 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.156808 Oct 28 17:40:40.776303 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1537/2969] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:40 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:40.784006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:40.785030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:40.794536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.795601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.795730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.796534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.797210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.798814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.895984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:40.908257 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca0381fb-c5c1-4dc9-827a-90b480910a56 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.356658 Oct 28 17:40:40.924205 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1433/2970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:40 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:40.932562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:40.935739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:40.943263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.943794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.944229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:40.944983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:40.946154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:40.946591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.187293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:41.198323 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0c157d8-a17d-4274-9f18-954d6bccfa50 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.419810 Oct 28 17:40:41.214421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1538/2971] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:40 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:41.222815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:41.232070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:41.233041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:41.236628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26e99d15-90cb-415c-b150-646f3c1a30d3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.308044 Oct 28 17:40:41.241519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.242308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.242981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.244126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.245317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.246510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.257362 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1434/2972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:40 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:41.262507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:41.263034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:41.281008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.281493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.281923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.282620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.283068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.283513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.355534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:41.377979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Unlocking {{(pid=120568) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 17:40:41.449930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3ee6942-7a16-4736-9398-1c32ecebe146 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.191285 Oct 28 17:40:41.451462 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1435/2973] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:41 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:41.464182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:41.465328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:41.486334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.487401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.488145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.491657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.494796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.496428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.613505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:41.622131 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fdab097a-53a8-44f2-aa1c-11bd1b458fb5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.405265 Oct 28 17:40:41.627111 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1539/2974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:41 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:41.642881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:41.643774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:41.652201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.653360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.654232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.655113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.655758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.656344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.843992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:41.859517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5274d00c-a563-4b5a-a595-734bf22280fd tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.398948 Oct 28 17:40:41.871403 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1436/2975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:41 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:41.871403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:41.871403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:41.904548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.905053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.905489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.910273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:41.910872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:41.911854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:41.990098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.001582 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c169f6b2-cbfb-4913-8dd2-42d3bbb64568 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1317 microversion: 2.1 time: 0.370436 Oct 28 17:40:42.002490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1540/2976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:41 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:42.019432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:42.020055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:42.049908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.054946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.056828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.058268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.060142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.064384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.302058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.317347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.320139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.321556 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d006205-6483-4aa6-a951-f81f9d1c884c tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.318121 Oct 28 17:40:42.322269 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1541/2977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:42 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:42.329936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:42.333566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:42.346928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.347771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.349441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.350332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.350794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.351225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.396969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.407323 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18aa5f8a-4fe1-451b-a791-4f19e93b5530 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 200 len: 1468 microversion: 2.1 time: 0.545946 Oct 28 17:40:42.409180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1437/2978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:41 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 1468 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:42.434734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:42.435419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:42.450364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.450858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.451305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.455489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.456105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.459750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.875719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.889167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b9f0b55-e3fd-4273-bcce-2a8ee414d2a2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.564866 Oct 28 17:40:42.904222 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1542/2979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:42 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:42.904984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:42.916665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9247c627-5e6e-40e2-99cc-7f0a69dfbce0 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.489617 Oct 28 17:40:42.919912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1438/2980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:42 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:42.927506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:42.928115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:42.953263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.953764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.967677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:42.968536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:42.969010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:42.969438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.133948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62866332-de89-4947-adaa-4e8ce008cace tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1956389406", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:43.139105 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-62866332-de89-4947-adaa-4e8ce008cace tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] HTTP exception thrown: min_count must be <= max_count Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62866332-de89-4947-adaa-4e8ce008cace tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Request method failure captured: Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 184 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQaOHyrGfmCQhVvoWlm9swF4J8hEojK89__qSN7pcniGTED204smcgo5Ct5Rptay2_Cpbm2nHgjfIocdFQMdA1dsA9QXvdF3-dtSjmJh9wyLr9rHvZTuUp9qLh7gvZYor8ywMgkf959c8JRXfxYasLBUe2F7VuB1RUpuxdBm3ASlWg Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed97a0942da7410cb70c152c5def95f5"}]}] Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 81bff7b1fc584c009b9978df8b99d4ce Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1956389406", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: exception: min_count must be <= max_count Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1956389406', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 28 17:40:43.141824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.148544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62866332-de89-4947-adaa-4e8ce008cace tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Returning 400 to user: min_count must be <= max_count {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:43.149690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-62866332-de89-4947-adaa-4e8ce008cace tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.257755 Oct 28 17:40:43.151184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1543/2981] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:42 2022] POST /compute/v2.1/servers => generated 74 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:40:43.170119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f64f378-dc56-43ca-bd06-4a6cefd81c8f", "name": "network-vif-deleted", "tag": "e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:43.183847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:43.187123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.189168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.189849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.204795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] Creating event network-vif-deleted:e313cc07-1272-4c3f-b8e9-6f6abf8ed9d1 for instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f on n-h2-860864-13 Oct 28 17:40:43.212004 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-398b89f8-b5bf-4c9e-835a-7750c68f9896 req-207b800a-d69f-4c4d-9a06-13139f253894 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058783 Oct 28 17:40:43.217821 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1544/2982] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:43.225265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:43.226791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:43.237393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.238285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.240145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.241300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.241936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.242641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.388196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:43.405303 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7fd4b61b-140d-4731-ae85-2e56a41cd566 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.484128 Oct 28 17:40:43.406395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1439/2983] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:42 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:43.410981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:43.416169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:43.429645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.430410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.430992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.440684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.441417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.442006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.857981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:43.877251 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c167dd75-3cb1-44c7-8545-26be961660a1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.655771 Oct 28 17:40:43.888691 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1545/2984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:43 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:43.901315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef8962c9-1f77-4ead-8d62-5e88656e478a tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467922544", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "max_count": 0}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef8962c9-1f77-4ead-8d62-5e88656e478a tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Request method failure captured: Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 167 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQaOHyrGfmCQhVvoWlm9swF4J8hEojK89__qSN7pcniGTED204smcgo5Ct5Rptay2_Cpbm2nHgjfIocdFQMdA1dsA9QXvdF3-dtSjmJh9wyLr9rHvZTuUp9qLh7gvZYor8ywMgkf959c8JRXfxYasLBUe2F7VuB1RUpuxdBm3ASlWg Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed97a0942da7410cb70c152c5def95f5"}]}] Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 81bff7b1fc584c009b9978df8b99d4ce Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467922544", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "max_count": 0}} Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-467922544', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'max_count': 0}}} Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 0 Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:40:43.907049 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:43.912118 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:43.916090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef8962c9-1f77-4ead-8d62-5e88656e478a tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:43.917182 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ef8962c9-1f77-4ead-8d62-5e88656e478a tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027223 Oct 28 17:40:43.918541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1546/2985] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:40:43.924204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:43.925700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:43.937594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.938075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.938506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.939211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:43.939708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:43.941108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:43.989237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:43.999824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d4bfe54-3413-452d-80fe-14447295633f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1467 microversion: 2.1 time: 0.591466 Oct 28 17:40:44.016963 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1440/2986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:43 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1467 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:44.023962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.024788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: 4f64f378-dc56-43ca-bd06-4a6cefd81c8f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.034832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.035482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.035967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.036413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.037105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.037552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.037975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.048166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.050288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.051710 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de3fb8e1-d46c-4dbd-a022-0accb1d91e74 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.131947 Oct 28 17:40:44.053344 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1547/2987] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:43 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:44.059043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a801a5c-9bc8-4109-aa5a-3adcf9320495", "tag": "dfded2ee-a84f-4695-9386-e1d31280326c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:44.070146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.070878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.071518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.080113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] HTTP exception thrown: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Request method failure captured: Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f HTTP/1.1 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLEAVV5HgKpXQx907PPjTfPu3XPha6fngrMiJzc6nErnR2Cb5Ur2Vq5Kr-Kl9tiQTJzxScbGdzOaG-JTuMFjDUWLMf0Brc3n49jMAbo_zqdlWwTjyBfW4nJw2T0FMAyCNJDlXR8oJWszpbYoZ0WhSp9GzHjkQ2hVSU7iEfk6X1NcfY Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}] Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e174a38769804247965891c498020315 Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4f64f378-dc56-43ca-bd06-4a6cefd81c8f'} Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.082038 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. Oct 28 17:40:44.087583 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.089541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Returning 404 to user: Instance 4f64f378-dc56-43ca-bd06-4a6cefd81c8f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:44.090847 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5d05c13-085a-48ce-ab1e-4238c7aba7c7 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f" status: 404 len: 111 microversion: 2.1 time: 0.072819 Oct 28 17:40:44.091957 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1441/2988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/4f64f378-dc56-43ca-bd06-4a6cefd81c8f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:44.096883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:44.097624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.104750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.106005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.106597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.107645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.108245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.109248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.111043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] Creating event network-changed:dfded2ee-a84f-4695-9386-e1d31280326c for instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 on n-h2-860864-13 Oct 28 17:40:44.119796 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-75ea9a86-33db-4b0b-9264-d1c8f046cefa req-977d7f10-90f3-4a6b-a3c6-2cb9d9885825 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064900 Oct 28 17:40:44.121148 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1548/2989] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:44.132878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.134400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.152801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.153586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.154840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.156294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.157079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.157667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.163449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:44.200522 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d802999f-055b-4563-a68c-d22d34153a33 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.106494 Oct 28 17:40:44.205401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1442/2990] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:44 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:44.213275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-569eb8f9-0e6b-4d20-9707-b9028c1a82a6 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2004603118", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "max_count": 2.5}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-569eb8f9-0e6b-4d20-9707-b9028c1a82a6 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Request method failure captured: Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 170 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQaOHyrGfmCQhVvoWlm9swF4J8hEojK89__qSN7pcniGTED204smcgo5Ct5Rptay2_Cpbm2nHgjfIocdFQMdA1dsA9QXvdF3-dtSjmJh9wyLr9rHvZTuUp9qLh7gvZYor8ywMgkf959c8JRXfxYasLBUe2F7VuB1RUpuxdBm3ASlWg Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed97a0942da7410cb70c152c5def95f5"}]}] Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 81bff7b1fc584c009b9978df8b99d4ce Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2004603118", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "max_count": 2.5}} Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2004603118', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'max_count': 2.5}}} Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:40:44.216108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:44.220731 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.221889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-569eb8f9-0e6b-4d20-9707-b9028c1a82a6 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:44.222877 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-569eb8f9-0e6b-4d20-9707-b9028c1a82a6 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015948 Oct 28 17:40:44.224276 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1443/2991] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:40:44.232231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.233445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.243239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.244121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.244792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.246735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.247758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.248535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.469342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.478370 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2eeebc6c-8cba-4a54-bc60-76ee902064b9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.355599 Oct 28 17:40:44.479138 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1549/2992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:44.489891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.492642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.503560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.504048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.504683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.505575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.506191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.506776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.522392 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba233136-24eb-46a9-9744-4aab25329b64 tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1620 microversion: 2.1 time: 0.296731 Oct 28 17:40:44.524864 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1444/2993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1620 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:44.535657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.535657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.546624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:40:44.563896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.564469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.564978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.565798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.567238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.567910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.662311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c66b2d1-3597-45ef-a8d3-a7dbbe484342 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 204 len: 0 microversion: 2.1 time: 0.181509 Oct 28 17:40:44.664763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1550/2994] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:44 2022] DELETE /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:44.668588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:44.672893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-820f3884-d392-4b11-9109-b67650360281 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-274341556", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 0}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-820f3884-d392-4b11-9109-b67650360281 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Request method failure captured: Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 167 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQaOHyrGfmCQhVvoWlm9swF4J8hEojK89__qSN7pcniGTED204smcgo5Ct5Rptay2_Cpbm2nHgjfIocdFQMdA1dsA9QXvdF3-dtSjmJh9wyLr9rHvZTuUp9qLh7gvZYor8ywMgkf959c8JRXfxYasLBUe2F7VuB1RUpuxdBm3ASlWg Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed97a0942da7410cb70c152c5def95f5"}]}] Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 81bff7b1fc584c009b9978df8b99d4ce Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-274341556", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 0}} Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-274341556', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'min_count': 0}}} Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 0 Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:40:44.677827 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:44.682678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-820f3884-d392-4b11-9109-b67650360281 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:44.684056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-820f3884-d392-4b11-9109-b67650360281 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016126 Oct 28 17:40:44.687840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1551/2995] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:44 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:40:44.705544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.706281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.719997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.720556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.721002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.721824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.722288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.722863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.777663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:44.817900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.829787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-16666da5-0841-448e-971b-9ec73b83cb57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1656 microversion: 2.1 time: 0.300612 Oct 28 17:40:44.844283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1445/2996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1656 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:44.849884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:44.850725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:44.858447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.859230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.859964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.860877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:44.861522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:44.862775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:44.893416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:44.902649 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba2a8874-1ddb-4036-8ed1-649bd9cc66ae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.212451 Oct 28 17:40:44.912221 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1552/2997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:44.921108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1074423033", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b50f55cd-d45e-4efc-9a70-f5e2065e866e"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:44.991024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:40:45.084828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.093569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac7013e8-e28f-480a-a4a0-e1d1d4450045 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1467 microversion: 2.1 time: 0.247908 Oct 28 17:40:45.109081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1446/2998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:44 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:45.115654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7cf6ae0-fb56-411b-a326-d34ac1aacd02 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-131699906", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 2.5}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7cf6ae0-fb56-411b-a326-d34ac1aacd02 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Request method failure captured: Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 169 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQaOHyrGfmCQhVvoWlm9swF4J8hEojK89__qSN7pcniGTED204smcgo5Ct5Rptay2_Cpbm2nHgjfIocdFQMdA1dsA9QXvdF3-dtSjmJh9wyLr9rHvZTuUp9qLh7gvZYor8ywMgkf959c8JRXfxYasLBUe2F7VuB1RUpuxdBm3ASlWg Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed97a0942da7410cb70c152c5def95f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed97a0942da7410cb70c152c5def95f5"}]}] Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ed97a0942da7410cb70c152c5def95f5 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1462077730 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 81bff7b1fc584c009b9978df8b99d4ce Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1462077730-project Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-131699906", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 2.5}} Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-131699906', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'min_count': 2.5}}} Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:40:45.120098 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7cf6ae0-fb56-411b-a326-d34ac1aacd02 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:45.124170 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7cf6ae0-fb56-411b-a326-d34ac1aacd02 tempest-MultipleCreateNegativeTestJSON-1462077730 tempest-MultipleCreateNegativeTestJSON-1462077730-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012462 Oct 28 17:40:45.129233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1447/2999] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:40:45.137287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:45.137840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.145419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.145911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.146349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.147046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.147570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.147999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.252465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d616091f-3f89-42f9-9eda-6466421e4eb9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.120418 Oct 28 17:40:45.255631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1448/3000] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:45 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:40:45.263817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:45.264524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.275563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.276162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.277228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.278062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.278626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.279193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.353975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:40:45.358641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:40:45.358641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:40:45.358641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:40:45.358641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:40:45.377150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.378100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.378100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.379259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.379259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.379679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.398049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.400360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:40:45.410743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.411582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Getting quotas for user 8ec2fb62cf9e4361b829a3cff20435e3 and project 4bd416e1e7074e30b6b75e6da33cf49b. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:40:45.413433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.415331 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a601959-87e1-4397-b275-f9a44649086b tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.155912 Oct 28 17:40:45.416516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1449/3001] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:45 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:45.426768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:40:45.429228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:40:45.429783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:45.430669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.440536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.441301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.441905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.443097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.443834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.444435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.522260 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ddfb934-60c5-4478-b68e-af204361c1c4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608532 Oct 28 17:40:45.525328 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1553/3002] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:40:45.538799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:45.540125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.552282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.553177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.555188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.559105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.559638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.560086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.756481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.761830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:45.782264 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c29e1b46-acfa-4580-aebb-05c5d9c66667 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1663 microversion: 2.1 time: 0.361620 Oct 28 17:40:45.785226 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1450/3003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:45 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1663 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:45.808268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a881701-782e-4f56-986a-5551df61c6ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:45.809516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a881701-782e-4f56-986a-5551df61c6ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.905439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a881701-782e-4f56-986a-5551df61c6ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:45.913837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a881701-782e-4f56-986a-5551df61c6ef tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1217 microversion: 2.1 time: 0.125242 Oct 28 17:40:45.917640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1451/3004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:45 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:45.924773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:45.925270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:45.945462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.946450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.946953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:45.947729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:45.948158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:45.951930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.003892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb HTTP/1.1 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'efb6b040-ddd8-4c9e-80f3-6dfafd27faeb'} Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:46.005666 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.009517 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.010323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.010763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:46.010763 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50b4d1bd-f1f6-4786-b49f-9323d126f720 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 404 len: 111 microversion: 2.1 time: 0.088042 Oct 28 17:40:46.013435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1452/3005] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:45 2022] DELETE /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:46.026042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.026217 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6771ee2b-b626-42c3-984e-0b429ea86fdb tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.497046 Oct 28 17:40:46.028327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1554/3006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:45 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:46.054525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.055283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.059274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: efb6b040-ddd8-4c9e-80f3-6dfafd27faeb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.079904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.083481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.084333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.085351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.086345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.086817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.089433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.090029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.091588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.092699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.093191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.093779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.122223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb HTTP/1.1 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'efb6b040-ddd8-4c9e-80f3-6dfafd27faeb'} Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.126532 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance efb6b040-ddd8-4c9e-80f3-6dfafd27faeb could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b5b5a6b-cadd-481f-b4b6-8d95e6f44c97 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb" status: 404 len: 111 microversion: 2.1 time: 0.095918 Oct 28 17:40:46.132687 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1555/3007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/efb6b040-ddd8-4c9e-80f3-6dfafd27faeb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:46.137226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.138191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.147837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.148597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.151061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.152808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.154041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.154807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.545044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.559101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f23a2948-47c3-4c4e-8db8-39cfbcf13b78 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.546216 Oct 28 17:40:46.559954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.561249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1453/3008] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:46.579357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.583009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c720259-ad23-430f-87d3-1b4c38e50adf tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1467 microversion: 2.1 time: 0.451607 Oct 28 17:40:46.583905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.596638 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1556/3009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1467 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:46.597542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.600118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.617131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.617663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.617818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.618138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.618250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.618811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.618947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.619326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.619629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.619775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.620079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.622706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.684674 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc HTTP/1.1 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1478932a-8fb6-494a-8945-1d5767134fbc'} Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:46.693502 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.697856 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.702433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:46.705197 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30797c51-1d6b-4eb8-b954-b9598c6cbcb4 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 404 len: 111 microversion: 2.1 time: 0.142171 Oct 28 17:40:46.707353 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1454/3010] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:40:46 2022] DELETE /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:46.722434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.723593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] [instance: 1478932a-8fb6-494a-8945-1d5767134fbc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.738199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:46.741174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.741841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.742949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.745987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.748151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.750107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.779432 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] HTTP exception thrown: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Request method failure captured: Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc HTTP/1.1 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLCemfJTe1zC08sq5r00m-u9dhjPcHAQbaOs4Qn2_hjsk8SF6eCsMl8Ulujz-YCKIc6NouzC1HulQQATK51NWYXgMRgeSSMUf7xtpyeQCkeRy1SslJ9VLOWnOJwOapTa74YJhkfgOsL4FMeexJYIpS2crwlIhwQLri-XOwRx-uRsk8 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da1b7c0435044ce5a6f456c4e24cf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da1b7c0435044ce5a6f456c4e24cf44f"}]}] Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: da1b7c0435044ce5a6f456c4e24cf44f Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-1473661835 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ca9954243b8a4260be0392adff6c2513 Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-1473661835-project Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '1478932a-8fb6-494a-8945-1d5767134fbc'} Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:46.780970 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] Returning 404 to user: Instance 1478932a-8fb6-494a-8945-1d5767134fbc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:46.785562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf0bffaa-5085-448b-8438-ed3dba2a6c66 tempest-DeleteServersTestJSON-1473661835 tempest-DeleteServersTestJSON-1473661835-project] 10.222.0.48 "GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc" status: 404 len: 111 microversion: 2.1 time: 0.071101 Oct 28 17:40:46.788306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1455/3011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/1478932a-8fb6-494a-8945-1d5767134fbc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:46.793400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.811056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.818131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.820933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:46.824034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.827655 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bf55efb-16e9-468d-ba8e-e29228353e26 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.235623 Oct 28 17:40:46.830103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1557/3012] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:46.855920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.857477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.859350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.860084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.861287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.861728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.937817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:46.938446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:46.951086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.952036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.952651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:46.955308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:46.956731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:46.957282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:47.254250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:47.269501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:47.272126 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36039167-7c5f-4432-a796-175ea02f3090 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1221 microversion: 2.1 time: 0.339406 Oct 28 17:40:47.276363 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1558/3013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:47.282493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a950eb54-8f4c-424e-86be-8f6454fed954 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.476395 Oct 28 17:40:47.286305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:47.287083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:47.299543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:47.299946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:47.301159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:47.302138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:47.302786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:47.303433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:47.305162 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1456/3014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:46 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:47.319402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:47.320969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:47.327595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:47.328444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:47.329068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:47.330048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:47.330658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:47.331240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.375990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:48.394179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0c29721-c6e7-4164-bd08-e343e9783821 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 1.080831 Oct 28 17:40:48.395391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1457/3015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:47 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:48.400093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:48.400879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:48.418262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.419030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.419681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.420555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.421161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.421749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.610875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:48.620118 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-993a5f07-5147-4609-a78e-7ce488b0fce2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 1.342316 Oct 28 17:40:48.628467 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1559/3016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:47 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:48.633478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:48.644266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:48.650775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.651504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.653210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.655197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.657375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.658209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.798269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e174a38769804247965891c498020315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93d7a495ce6c42f08f2b2dbacaf6c46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:48.805795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:48.806737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f38799f-8371-4bc4-9a4c-02780f84bc55 tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 200 len: 1425 microversion: 2.1 time: 0.176924 Oct 28 17:40:48.807333 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1560/3017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:48 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 1425 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:48.816963 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f71ac890-ab4e-4eca-b324-5601df977dee tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.420292 Oct 28 17:40:48.818126 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1458/3018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:48 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:48.823244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:48.829543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:48.836128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.836760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:48.841749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:48.844598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.850693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.851749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.852222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.852812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.853254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.853415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.853986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.858595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:48.859161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:48.859898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:48.996613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:49.012335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:49.013763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b564af2dfb0847d8b01822a2d218ad5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fdae183be19441db9cd63cc277740cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:49.015001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1242c17-2a78-428d-a811-1f2f2587217e tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 200 len: 1605 microversion: 2.42 time: 0.203305 Oct 28 17:40:49.031882 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1561/3019] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:48 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:40:49.050240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:49.050900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:49.073309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:49.083851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.084368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.086248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.086408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.086818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.087248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.092890 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20285825-d73e-4305-b106-d38c994a8f51 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1275 microversion: 2.1 time: 0.272773 Oct 28 17:40:49.094008 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1459/3020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:48 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:49.104641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61b7309-93b1-4d1e-a284-18dd5c76dcf7", "name": "network-vif-deleted", "tag": "fde44b55-d08f-42e1-b9f6-cc1139d8babb"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:49.158937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.161656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.162571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.194915 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] Creating event network-vif-deleted:fde44b55-d08f-42e1-b9f6-cc1139d8babb for instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 on n-h1-860864-13 Oct 28 17:40:49.205922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-47453eab-7573-4553-8044-ae32e2e0e0f6 req-cbca05ab-106c-432b-8fb3-826a896c9cf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107033 Oct 28 17:40:49.207724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1460/3021] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:49.432514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:49.442274 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7847a4b7-ced4-4e26-9780-7525d0a16d57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.408175 Oct 28 17:40:49.457687 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1562/3022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:49 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:49.469871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:49.470656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:49.485080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.485767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.486401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.487298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.488107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.488637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.656807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:49.658891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:49.685401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.686475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.688110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.689678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:49.694267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:49.699819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:49.999160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:50.009171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dccf927c-a799-46b3-918c-dd3066958539 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.544915 Oct 28 17:40:50.027011 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1461/3023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:49 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:50.037630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.038557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] [instance: d61b7309-93b1-4d1e-a284-18dd5c76dcf7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.052032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.052777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.053460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.054741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.055532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.056174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.062889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:50.074355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] HTTP exception thrown: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. Oct 28 17:40:50.076677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f603a623-f593-47d1-a9b7-082c7a83b088 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.425413 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Request method failure captured: Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 HTTP/1.1 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLEAVV5HgKpXQx907PPjTfPu3XPha6fngrMiJzc6nErnR2Cb5Ur2Vq5Kr-Kl9tiQTJzxScbGdzOaG-JTuMFjDUWLMf0Brc3n49jMAbo_zqdlWwTjyBfW4nJw2T0FMAyCNJDlXR8oJWszpbYoZ0WhSp9GzHjkQ2hVSU7iEfk6X1NcfY Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_93d7a495ce6c42f08f2b2dbacaf6c46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/93d7a495ce6c42f08f2b2dbacaf6c46f"}]}] Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 93d7a495ce6c42f08f2b2dbacaf6c46f Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-MigrationsAdminTest-847870155 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e174a38769804247965891c498020315 Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-MigrationsAdminTest-847870155-project Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'd61b7309-93b1-4d1e-a284-18dd5c76dcf7'} Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:50.078040 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. Oct 28 17:40:50.081925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.084972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] Returning 404 to user: Instance d61b7309-93b1-4d1e-a284-18dd5c76dcf7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:50.086096 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9035440e-8a07-4cf3-aaa0-6cf9f0faf7be tempest-MigrationsAdminTest-847870155 tempest-MigrationsAdminTest-847870155-project] 10.222.0.48 "GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7" status: 404 len: 111 microversion: 2.1 time: 0.061926 Oct 28 17:40:50.090615 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1462/3024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/d61b7309-93b1-4d1e-a284-18dd5c76dcf7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:40:50.095580 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1563/3025] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:49 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:50.096647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.097580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.100742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.101357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.106299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.107061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.107760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.109399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.110118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.112425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.119640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.120268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.121496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.123093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.124623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.125292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.624767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:50.629613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:50.642225 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d794e032-ce2a-404e-99ff-ae0f7da8c0c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.545300 Oct 28 17:40:50.643559 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1564/3026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:50.644607 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-205dae85-3b13-447d-acfd-cae1eb372bcb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.552600 Oct 28 17:40:50.646069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1463/3027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:50.656340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.657584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.665018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.667088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.679343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.680081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.681956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.682538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.684194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.685572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.687582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.688590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.689101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.689550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.690234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.691020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.713002 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] HTTP exception thrown: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Request method failure captured: Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f HTTP/1.1 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJ9A4orFd7cpZEvpoJPq8TwMRtyLO-SetK29-RjZR34lo93XvOfjk7K5I6FfX1KAXUrU2znGcBqXPUuHKwf5LtH87i5IYsSYGlIEt8f5gAHkq2jr8ncSQvtVb72hirZ8uGKFTmx1NnfpvH55tteo_CWmFuSQmIbvvtIXc6MF5PiCQI Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8fdae183be19441db9cd63cc277740cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8fdae183be19441db9cd63cc277740cf"}]}] Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b564af2dfb0847d8b01822a2d218ad5b Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b65571bb-a385-43ee-9748-68ae332bca4f'} Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.715099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:40:50.719958 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:50.722567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Returning 404 to user: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:50.723942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21621275-799b-4932-aeaa-815e73decfc7 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 404 len: 111 microversion: 2.42 time: 0.078940 Oct 28 17:40:50.728658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1565/3028] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:40:50.735188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:50.736146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:50.743435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.746600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.747626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:50.749463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:50.750179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:50.750822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:51.178282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:51.202130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f227aa20-db9e-4745-b74c-2d48d1b1999e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.469455 Oct 28 17:40:51.219888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:51.228468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1566/3029] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:51.232389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9c89118-1f10-458c-bd94-01b0737185eb tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.585140 Oct 28 17:40:51.234998 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1464/3030] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:50 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:51.237308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57fd69a4-5385-4bd5-a536-d9a0cd0f663d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '.version_select at 0x7f7524296700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:51.246854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:51.247504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:51.259465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:51.261574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:51.262067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:51.264205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:51.268373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:51.269038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:51.272200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57fd69a4-5385-4bd5-a536-d9a0cd0f663d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383743115" status: 204 len: 0 microversion: 2.42 time: 0.040703 Oct 28 17:40:51.275678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1567/3031] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383743115 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:40:51.291869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a801a5c-9bc8-4109-aa5a-3adcf9320495", "name": "network-vif-plugged", "status": "completed", "tag": "dfded2ee-a84f-4695-9386-e1d31280326c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:51.320386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:51.321286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:51.322012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:51.338672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:51.341445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] Creating event network-vif-plugged:dfded2ee-a84f-4695-9386-e1d31280326c for instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 on n-h2-860864-13 Oct 28 17:40:51.351025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-92e83438-d40a-450c-b081-157a5b48b5ac req-499f4a23-0198-445c-8e42-c2b05d809459 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073019 Oct 28 17:40:51.352319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1568/3032] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:40:51.675911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:51.678798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:51.687710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:51.705146 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4dee0792-5a29-4b78-8f65-6760e3196d7a tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.462848 Oct 28 17:40:51.706584 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1465/3033] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:51 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:51.713583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:51.714954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:51.715684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:51.716593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:51.717189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:51.717790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.185769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:52.200505 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-663cbb72-ecab-4bac-aa85-0874aa7393f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.531078 Oct 28 17:40:52.203358 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1569/3034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:51 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:52.258082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:52.259046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:52.274382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:52.274929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:52.277988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.277988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:52.277988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:52.277988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.718708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:52.734184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3481e00d-a7b4-4ea4-9428-df75624b4571 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.479911 Oct 28 17:40:52.734398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:52.734951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:52.738531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1466/3035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:52 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:52.747129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:52.747660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:52.748635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.749381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:52.749881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:52.750317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.832900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda", "tag": "fd42677d-930b-44c4-8f9c-1902b45e150b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:52.848022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:52.849133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:52.850214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:52.870253 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] Creating event network-changed:fd42677d-930b-44c4-8f9c-1902b45e150b for instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda on n-h2-860864-13 Oct 28 17:40:52.878168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-514ed375-51b8-47b5-8be8-c4135cb9d2eb req-c8881a4e-73f9-48ea-aa89-47f1c15193a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051954 Oct 28 17:40:52.879462 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1467/3036] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:40:53.240259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:53.241864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:53.263720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:53.269908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:53.271922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:53.274664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:53.275320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:53.276780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:53.372363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:53.390658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27dd2abe-22d3-49d3-bb40-6717669569e5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.657885 Oct 28 17:40:53.391434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1570/3037] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:52 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:53.615283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:53.629838 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79443100-8b4a-4b5e-a0e5-c94594c33a36 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1325 microversion: 2.1 time: 0.403498 Oct 28 17:40:53.647067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1468/3038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:53 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:53.764356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:53.768192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:53.778367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:53.779710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:53.780318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:53.781634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:53.782245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:53.782835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:54.308430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:54.317757 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aac12cd3-0628-4341-a0ff-548ab03da647 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.560565 Oct 28 17:40:54.318899 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1571/3039] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:53 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:54.416129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:54.416844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:54.425497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:54.426218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:54.426851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:54.428233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:54.428945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:54.429558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:54.662980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:54.663624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:54.679283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:54.680127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:54.680789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:54.681736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:54.682397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:54.683754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:55.070011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:55.082636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ebfaa30-d272-49e3-a40b-fd5c817c0012 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1522 microversion: 2.1 time: 0.431243 Oct 28 17:40:55.089915 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1572/3040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:54 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:40:55.119647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:55.123621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:55.145502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:55.146047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:55.146696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:55.147463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:55.148086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:55.148521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:55.238316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:55.255660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72fc64a4-779c-4752-b873-10f8efd50549 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.843489 Oct 28 17:40:55.258497 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1469/3041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:54 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:55.391974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:55.422025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:55.513172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9eff44aa-d1ed-4270-859d-8d0db0e753e2 tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] Calling method '.version_select at 0x7f751f745820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:55.535873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9eff44aa-d1ed-4270-859d-8d0db0e753e2 tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.258052 Oct 28 17:40:55.536786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1470/3042] 10.222.0.48 () {60 vars in 1226 bytes} [Fri Oct 28 17:40:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:40:55.542863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:55.544216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:55.553221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:55.554090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:55.554714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:55.555632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:55.556292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:55.556877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:55.945410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:55.966387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-217d136a-106e-4827-ab07-c9364411f1f7 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1522 microversion: 2.1 time: 0.851831 Oct 28 17:40:55.980520 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1573/3043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:55 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1522 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:55.990310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3231993-ebb0-4584-98cc-261320ef087d tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] Action: 'update', calling method: .version_select at 0x7f7524263160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:56.239878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3231993-ebb0-4584-98cc-261320ef087d tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.255862 Oct 28 17:40:56.241746 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1574/3044] 10.222.0.48 () {62 vars in 1247 bytes} [Fri Oct 28 17:40:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:40:56.256106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-684694577"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:56.258819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:56.268275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=8,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:56.280401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:56.281514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:56.284021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:56.285639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:56.286389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:56.287030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:56.575210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:56.589368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-093c0ade-3717-4137-9a17-66c2e7af19d4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 1.051356 Oct 28 17:40:56.592622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1471/3045] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:55 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:56.606768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55f997aa-4d2f-4e53-a051-1d2623938c6e tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] Calling method '.version_select at 0x7f751f745b80>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:56.636000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55f997aa-4d2f-4e53-a051-1d2623938c6e tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.039024 Oct 28 17:40:56.639057 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1472/3046] 10.222.0.48 () {60 vars in 1226 bytes} [Fri Oct 28 17:40:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:40:56.656333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:56.658518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:56.679788 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56c268e6-05f1-4d05-9eba-c781f88555a8 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495/action" status: 202 len: 0 microversion: 2.1 time: 0.435841 Oct 28 17:40:56.681750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:56.683658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:56.684326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:56.685269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:56.685881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:56.686771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:56.696866 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1575/3047] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:40:56 2022] POST /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:40:56.703172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ea6ca44-99fa-44b7-afd4-6b474d29f16e tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] Action: 'update', calling method: .version_select at 0x7f7524649670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:40:56.889885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ea6ca44-99fa-44b7-afd4-6b474d29f16e tempest-QuotaClassesAdmin257Test-1059648304 tempest-QuotaClassesAdmin257Test-1059648304-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.190698 Oct 28 17:40:56.893095 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1576/3048] 10.222.0.48 () {62 vars in 1247 bytes} [Fri Oct 28 17:40:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:40:56.909680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13c7a7c4-3149-45a0-aa1e-31cb9d6cb12a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f7524263940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:57.258338 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13c7a7c4-3149-45a0-aa1e-31cb9d6cb12a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3" status: 204 len: 0 microversion: 2.1 time: 0.363910 Oct 28 17:40:57.259918 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1577/3049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:56 2022] DELETE /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:40:57.269000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d835da3-2d5d-49d8-8666-50969b0990af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f7524388af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:57.317005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6d835da3-2d5d-49d8-8666-50969b0990af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Image not found. Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d835da3-2d5d-49d8-8666-50969b0990af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 HTTP/1.1 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2c5d38d2-59ab-4fe2-9fd5-a615798b08d3'} Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:40:57.320514 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 could not be found. Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:40:57.325054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:40:57.335326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d835da3-2d5d-49d8-8666-50969b0990af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:40:57.336448 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d835da3-2d5d-49d8-8666-50969b0990af tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3" status: 404 len: 62 microversion: 2.1 time: 0.072241 Oct 28 17:40:57.338321 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1578/3050] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:40:57 2022] GET /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:40:57.360888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:57.372028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:57.395879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:57.398333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:57.403691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:57.406039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:57.407856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:57.408319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:57.841174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:57.863340 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7e441ef2-23f0-49e4-bdde-24ff9016a6cf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 1.210795 Oct 28 17:40:57.864384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1473/3051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:56 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:57.892123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:57.893821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:57.911066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:57.912157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:57.912920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:57.916709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:57.917562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:57.918217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:57.950612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:40:57.982650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:57.996817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e6e99a6-b06b-425d-91d5-1bd1bd234d15 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1534 microversion: 2.1 time: 0.655078 Oct 28 17:40:58.001347 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1579/3052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:57 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1534 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:58.384082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:40:58.394247 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63bc7aa0-b30c-4778-978c-ea3ea9cb8476 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.525876 Oct 28 17:40:58.394842 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1474/3053] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:57 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:40:58.889671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:58.890418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:58.898651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:58.899534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:58.900784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:58.902600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:58.903828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:58.911562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:59.023566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:40:59.024863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:40:59.037970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:59.039429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:59.039922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:40:59.042303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:40:59.042925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:40:59.043353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:00.037050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:00.060362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:00.071050 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-729ea05d-a4cb-438f-a833-c4da41c332a4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1534 microversion: 2.1 time: 1.051335 Oct 28 17:41:00.080861 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1475/3054] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:59 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1534 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:00.086968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:00.094173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:00.107262 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc3681f7-0b1c-458b-bdb1-7ee865401248 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 1.222285 Oct 28 17:41:00.110411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:00.114164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:00.114696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:00.117976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:00.120037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:00.121602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:00.127118 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1580/3055] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:40:58 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:00.370095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:00.382109 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9710d78f-0eb3-45f2-b72c-5415150e1163 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.299263 Oct 28 17:41:00.383205 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1476/3056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:00 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:01.108809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:01.110226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:01.134718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:01.135325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:01.146866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.147511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.147962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.148700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.153151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.153943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.161610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.166452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.167875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.170312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.177846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.178403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.639668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:01.648265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d765b05-33c7-4d4e-a0a3-1413715af91d tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1540 microversion: 2.1 time: 0.548666 Oct 28 17:41:01.649544 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1581/3057] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:01 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1540 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:01.669759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:01.670699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:01.678124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.678628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.679068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.687929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:01.688886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:01.689520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:01.839877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:01.854421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9230418-dff1-425a-8d1c-47b5934cbfdf tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.723642 Oct 28 17:41:01.855110 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1477/3058] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:01 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:02.047519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-451835104", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:02.123828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] validate_networks() for [('56f3770e-9a08-4897-a409-2108dd800f27', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:02.296788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:02.306276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2627b2f-ecd4-42e7-81cf-dc3f30c5cc07 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.655399 Oct 28 17:41:02.307180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1582/3059] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:01 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:02.675932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:02.676850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:02.686310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:02.686814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:02.687254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:02.688771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:02.689511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:02.690166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.125587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:03.141211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c933bf53-25af-43a2-af0f-2b56f031982e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1540 microversion: 2.1 time: 0.469044 Oct 28 17:41:03.157637 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1583/3060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:02 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1540 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:03.168900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:03.170447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:03.179917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.180737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.181395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.182432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.183322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.184118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.206324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] HTTP exception thrown: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Request method failure captured: Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f HTTP/1.1 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBJ9A4orFd7cpZEvpoJPq8TwMRtyLO-SetK29-RjZR34lo93XvOfjk7K5I6FfX1KAXUrU2znGcBqXPUuHKwf5LtH87i5IYsSYGlIEt8f5gAHkq2jr8ncSQvtVb72hirZ8uGKFTmx1NnfpvH55tteo_CWmFuSQmIbvvtIXc6MF5PiCQI Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8fdae183be19441db9cd63cc277740cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8fdae183be19441db9cd63cc277740cf"}]}] Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b564af2dfb0847d8b01822a2d218ad5b Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b65571bb-a385-43ee-9748-68ae332bca4f'} Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:03.208893 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.212944 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.219512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Returning 404 to user: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:03.220737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-12a4e7d2-7bbf-44aa-b877-173477baaec1 tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 404 len: 111 microversion: 2.42 time: 0.061667 Oct 28 17:41:03.222104 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1584/3061] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:41:03 2022] DELETE /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:41:03.233181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:03.234240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:03.243859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.244678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.245617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.246530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:03.247639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:03.247833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.248159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:03.249075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:03.249075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:03.249497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.250028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.263767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.264537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.265520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.267283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.268119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.269323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.314194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:03.335100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for user 498c3bcb751a435cac9703a0ff8a6361 and project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:03.370061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:03.375462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:03.446464 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac18d9cd-eae6-46f6-bc6d-0e0026d9a586 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.586432 Oct 28 17:41:03.453591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1478/3062] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:41:03.459714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:03.460586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] [instance: b65571bb-a385-43ee-9748-68ae332bca4f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:03.467973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.468751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.469381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.470285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.471805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.472437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.497084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] HTTP exception thrown: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Request method failure captured: Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f HTTP/1.1 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBJ9A4orFd7cpZEvpoJPq8TwMRtyLO-SetK29-RjZR34lo93XvOfjk7K5I6FfX1KAXUrU2znGcBqXPUuHKwf5LtH87i5IYsSYGlIEt8f5gAHkq2jr8ncSQvtVb72hirZ8uGKFTmx1NnfpvH55tteo_CWmFuSQmIbvvtIXc6MF5PiCQI Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8fdae183be19441db9cd63cc277740cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8fdae183be19441db9cd63cc277740cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8fdae183be19441db9cd63cc277740cf"}]}] Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 8fdae183be19441db9cd63cc277740cf Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-103689415 Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b564af2dfb0847d8b01822a2d218ad5b Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TaggedBootDevicesTest_v242-103689415-project Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b65571bb-a385-43ee-9748-68ae332bca4f'} Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.514427 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. Oct 28 17:41:03.520131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:03.527407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] Returning 404 to user: Instance b65571bb-a385-43ee-9748-68ae332bca4f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:03.530620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b965048-b6c6-4cd6-8214-4a8756a8e61d tempest-TaggedBootDevicesTest_v242-103689415 tempest-TaggedBootDevicesTest_v242-103689415-project] 10.222.0.48 "GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f" status: 404 len: 111 microversion: 2.42 time: 0.077387 Oct 28 17:41:03.534196 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1479/3063] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:41:03 2022] GET /compute/v2.1/servers/b65571bb-a385-43ee-9748-68ae332bca4f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:41:03.545585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda", "name": "network-vif-plugged", "status": "completed", "tag": "fd42677d-930b-44c4-8f9c-1902b45e150b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:03.576145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:03.577406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.577909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.578351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.594570 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c171ebb-b596-40f3-b49c-9c9cdea4c2b5 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.369358 Oct 28 17:41:03.610571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1585/3064] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:03 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:03.611200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:03.613397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:03.621815 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] Creating event network-vif-plugged:fd42677d-930b-44c4-8f9c-1902b45e150b for instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda on n-h2-860864-13 Oct 28 17:41:03.630883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.631746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.632200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.641655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0aad01b4-e8bd-4ab6-80eb-7e1ef0bbd4c4 req-065fd94c-9e26-41d9-8a4d-6b027b5243cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103720 Oct 28 17:41:03.643291 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1480/3065] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:03.648720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:03.653931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:03.656471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9193c1c-849f-4ab4-a6f2-9429a2e5b350 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:03.657027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9193c1c-849f-4ab4-a6f2-9429a2e5b350 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:03.657333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:03.884092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9193c1c-849f-4ab4-a6f2-9429a2e5b350 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:03.902972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9193c1c-849f-4ab4-a6f2-9429a2e5b350 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1221 microversion: 2.1 time: 0.257848 Oct 28 17:41:03.906521 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1481/3066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:03 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1221 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:04.115038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-154286229", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:04.164999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:04.188014 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-681647ae-3239-4feb-9549-9ee720a99b13 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1317 microversion: 2.1 time: 0.580288 Oct 28 17:41:04.189869 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1586/3067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:03 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:04.198555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:04.210144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:04.221727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:04.223283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:04.225724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:04.227761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:04.230131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:04.230836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:04.240490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] validate_networks() for [('56f3770e-9a08-4897-a409-2108dd800f27', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:05.731587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:05.743119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c51672dc-23f7-4da1-bfa3-4b34d1845a90 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1540 microversion: 2.1 time: 1.548441 Oct 28 17:41:05.759429 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1587/3068] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:04 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1540 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:05.759429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:05.766239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:05.782673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:05.798872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:05.799559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:05.800410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:05.801228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:05.804858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:06.412924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:06.417992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:06.429759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9823ec81-5ae3-42c7-bbb7-48beaa986898 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.680338 Oct 28 17:41:06.430379 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1588/3069] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:05 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:06.443397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:06.444493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:06.458669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:06.462501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:06.463225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:06.469488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:06.470350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:06.471633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:06.596249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:06.597315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:06.597993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:06.598564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:06.599404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:06.634655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:06.635322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:06.635798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:06.636795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:06.637260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:06.637697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:06.674155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:06.680536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for user 498c3bcb751a435cac9703a0ff8a6361 and project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:06.706932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:06.716634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:06.807748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb42c4c6-3eb8-4e56-be42-22f7c7bb5933 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.696660 Oct 28 17:41:06.816386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1482/3070] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:41:06.885227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:06.931193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:06.954091 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d181e6bf-0ff3-43ab-921c-4212e43e93c7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1467 microversion: 2.1 time: 0.512375 Oct 28 17:41:06.956074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1589/3071] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:06 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1467 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:06.966396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a801a5c-9bc8-4109-aa5a-3adcf9320495", "name": "network-vif-plugged", "status": "completed", "tag": "dfded2ee-a84f-4695-9386-e1d31280326c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:06.993646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:06.994137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:06.994755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.013704 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] Creating event network-vif-plugged:dfded2ee-a84f-4695-9386-e1d31280326c for instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 on n-h2-860864-13 Oct 28 17:41:07.020090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6b0383ed-e43e-4c5d-9667-cd1c193f1db3 req-b11b93ef-904a-4a47-ad92-b0c2d7bc32ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061274 Oct 28 17:41:07.020286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-410775541", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:07.025870 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1590/3072] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:07.033257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:07.034157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:07.047262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.049354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.050435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.052030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.053677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.057390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.094699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:07.463525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:07.479454 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07dfbbba-4f95-4769-a1f3-b30eb1012175 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1522 microversion: 2.1 time: 0.450371 Oct 28 17:41:07.481017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1591/3073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:07 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:07.485742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:07.492682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:07.508023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.508526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.511830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.512866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.513349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.513783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.596075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:07.596865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:07.598048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:07.599000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:07.599700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:07.614120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:07.615547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.617842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.618457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.622346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.623040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.623613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.624867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ba25dbe-748d-4066-a55e-7b5b182a0ed3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1225 microversion: 2.1 time: 0.142802 Oct 28 17:41:07.625987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1592/3074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:07 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:07.631025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:07.632001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:07.639318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.640058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.640634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.641647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.642579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.643152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.685749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Getting quotas for project 7afaa10d89b64e7db02e37552dd67684. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:07.692926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Getting quotas for user 1119173fa2c9420d89a18d9bcb96689b and project 7afaa10d89b64e7db02e37552dd67684. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:07.737630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:07.743140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:07.810706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:07.858471 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67077a76-1321-41e9-8897-2373836d7cf2 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040418 Oct 28 17:41:07.859736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1483/3075] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:41:07.867219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:07.868187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:07.879007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.879811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.880419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:07.881750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:07.882411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:07.883176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.026648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-afc7f850-ff77-446d-ae02-0783c2445e0b tempest-ServersOnMultiNodesTest-859638202 tempest-ServersOnMultiNodesTest-859638202-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1620 microversion: 2.1 time: 0.399206 Oct 28 17:41:08.043094 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1593/3076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:07 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1620 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:08.048148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:08.063990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:08.093132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.093996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.095897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.104570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.106299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.110261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.220114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:08.431807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-239e4539-d7bb-4b42-80dc-f6ec176189b5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 204 len: 0 microversion: 2.1 time: 0.386271 Oct 28 17:41:08.438045 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1594/3077] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:08 2022] DELETE /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:08.459922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78376769-f321-49ba-9ef9-92ff1628bf90 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:08.462082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78376769-f321-49ba-9ef9-92ff1628bf90 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:08.605903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78376769-f321-49ba-9ef9-92ff1628bf90 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:08.618147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78376769-f321-49ba-9ef9-92ff1628bf90 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1221 microversion: 2.1 time: 0.178667 Oct 28 17:41:08.620254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1595/3078] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:08 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:08.629341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:08.630150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:08.638430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:08.644054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.644870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.645707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.647328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.648037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.648794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.655201 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70c2dbbf-c351-47a6-998c-a05d8c493793 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.793418 Oct 28 17:41:08.668244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1484/3079] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:07 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:08.680882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:08.685382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:08.697479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:08.703625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.706442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.707849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.710001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.710734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.712783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.886879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a41cd30-d975-4620-9777-041917660779 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 204 len: 0 microversion: 2.1 time: 0.263492 Oct 28 17:41:08.893156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1596/3080] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:08 2022] DELETE /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:08.908148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:08.911029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:08.928752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.930553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.932567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:08.934598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:08.936174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:08.936812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.080794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:09.093798 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06524564-f6c9-43b5-b645-63a6f178fd02 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1273 microversion: 2.1 time: 0.194834 Oct 28 17:41:09.094704 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1597/3081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:08 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:09.109720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:09.110641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:09.125756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.128246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.129408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.131268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.132273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.133445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.144099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:09.157886 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dcc58bcb-dd56-4af2-879c-d66a554df5c2 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1528 microversion: 2.1 time: 0.482531 Oct 28 17:41:09.161533 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1485/3082] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:08 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:09.457619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:09.471860 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17607105-17b6-4060-b413-04b972b7f60e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1473 microversion: 2.1 time: 0.370161 Oct 28 17:41:09.491510 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1598/3083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:09 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1473 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:09.643447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:09.646083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:09.668562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.668789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.669912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.670855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.671532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.672330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.680219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:09.680872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:09.699049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.706443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.707296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.708253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:09.716256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:09.716641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:09.875049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:09.887124 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99d59c38-896a-4889-a2d8-7c6f0d5a343f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1217 microversion: 2.1 time: 0.247764 Oct 28 17:41:09.894447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1486/3084] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:09 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:10.118030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:10.118744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:10.129230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.129736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.130179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:10.130895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.131349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.143827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:10.490203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:10.502380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-749a3956-514e-42b0-ba72-c433db8933d0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1273 microversion: 2.1 time: 0.388089 Oct 28 17:41:10.519691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1487/3085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:10 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1273 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:10.536219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:10.536841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:10.556262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.556802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.557245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:10.570477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.571066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.571576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:10.633360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:10.646270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3cbdd7f5-6bc8-4e52-9121-fba0f7563231 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.972041 Oct 28 17:41:10.650542 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1599/3086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:09 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:10.662572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:10.678526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:10.699302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.699796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.700249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:10.701007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:10.701472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:10.701901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.108428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:11.133858 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62be4dd9-be69-436a-88ff-c27fb52dcc20 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1528 microversion: 2.1 time: 0.611044 Oct 28 17:41:11.151402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1488/3087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:10 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1528 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:11.156784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:11.159994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:11.175851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.176361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.176794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.177521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.177971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.178399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.258666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:11.275240 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-339b9ee0-0718-4192-8d65-2b2a2624821b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1473 microversion: 2.1 time: 0.621389 Oct 28 17:41:11.276387 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1600/3088] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:10 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:11.286058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a801a5c-9bc8-4109-aa5a-3adcf9320495", "name": "network-vif-unplugged", "status": "completed", "tag": "dfded2ee-a84f-4695-9386-e1d31280326c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:11.318602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.319279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.320030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.321867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:11.331341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-244d1715-996c-45c8-86ea-beff06db35be tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1291 microversion: 2.1 time: 0.190567 Oct 28 17:41:11.338479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1489/3089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:11 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1291 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:11.349667 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] Creating event network-vif-unplugged:dfded2ee-a84f-4695-9386-e1d31280326c for instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 on n-h2-860864-13 Oct 28 17:41:11.377971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d2b42989-1298-43f4-b53e-cd909dc3087c req-85a4e890-1abd-41c5-a2d2-957c59a89179 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099754 Oct 28 17:41:11.379086 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1601/3090] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:11.530408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:11.531210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:11.542950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.545680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.547488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.551271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.553211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.555539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.679455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:11.680168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:11.697445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.698238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.699003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.700014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:11.700646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:11.701262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:11.978203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:11.987693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf297ef2-4035-4ffc-9e14-61c78b0ab661 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1273 microversion: 2.1 time: 0.461283 Oct 28 17:41:11.993462 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1490/3091] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:11 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:12.165800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:12.167075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:12.176409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.179598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.180423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.183776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.184447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.192564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:12.199885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.204853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10322ef3-31c0-4034-acad-9ffb64369473 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1486 microversion: 2.1 time: 0.530324 Oct 28 17:41:12.219396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1602/3092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:11 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1486 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:12.233182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:12.234079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:12.248450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.248938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.249451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.250158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.250617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.251037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.394957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:12.434227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65ab1eb7-f433-47d4-81bc-b7c1515d8383 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "POST /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca/action" status: 202 len: 0 microversion: 2.1 time: 0.205745 Oct 28 17:41:12.436062 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1603/3093] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:41:12 2022] POST /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:41:12.455996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:12.456733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:12.463094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.463663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.464147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.464875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.465554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.465755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.690066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:12.700163 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c9e977a-f814-4120-b0de-ec967d348393 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1528 microversion: 2.1 time: 0.538218 Oct 28 17:41:12.700754 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1491/3094] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:12 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:12.710713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:12.711582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:12.728102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.728855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.729498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.730601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:12.731224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:12.731857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:12.948372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:12.966645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc57f1e7-4f50-4724-914e-2f4edfa5a9c1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1279 microversion: 2.1 time: 0.264373 Oct 28 17:41:12.967775 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1492/3095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:12 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:12.972520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:12.973371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:13.000699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.001260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.001709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.004061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.005056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.005651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.046927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:13.058351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8cabda85-06f1-401c-9e7f-25a2dd157e41 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1473 microversion: 2.1 time: 0.607248 Oct 28 17:41:13.060800 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1604/3096] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:12 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:13.067053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:13.069014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:13.080905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.081844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.082478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.084440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.085700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.086466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.249107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:13.259885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c54da918-b443-4fba-9d2f-6c91affec9fb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1279 microversion: 2.1 time: 0.197567 Oct 28 17:41:13.268773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1605/3097] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:13 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:13.268773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63353499-8d0b-4b38-98d1-0a8a047ac115", "tag": "b21b1fa8-d2ee-43b5-93ba-26690d768c32"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:13.281754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.282243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.282690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.300242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] Creating event network-changed:b21b1fa8-d2ee-43b5-93ba-26690d768c32 for instance 63353499-8d0b-4b38-98d1-0a8a047ac115 on n-h1-860864-13 Oct 28 17:41:13.306898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4d78416d-ca31-4f42-9015-30eeab5c8642 req-a509cc8c-fcc5-4d10-852e-baa9ac048e26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043337 Oct 28 17:41:13.309542 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1606/3098] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:13.520655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:13.571168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e7440c03-64b8-4ee8-9705-8a9786b20691 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1494 microversion: 2.1 time: 0.602146 Oct 28 17:41:13.588165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1493/3099] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:12 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1494 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:13.730880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:13.731877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:13.743115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.744393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.748074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.749039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:13.752076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:13.753097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:13.994914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:13.996023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:14.022031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:14.030938 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9bf6a48-f7a8-4b01-9c27-4521b2e362c0 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1486 microversion: 2.1 time: 0.305778 Oct 28 17:41:14.032643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.034170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.034619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.040742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1607/3100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:13 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1486 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:14.041001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.043231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.043827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.089849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:14.090648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:14.099044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.106825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.111545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.112502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.112997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.113440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.192672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.193180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.193642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.195962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lazy-loading 'fault' on Instance uuid 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:14.447105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:14.464743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d135830-141c-497e-9a12-6d207d91a728 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1279 microversion: 2.1 time: 0.470271 Oct 28 17:41:14.468391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1494/3101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:13 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1279 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:14.492012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:14.494755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:14.497055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:14.506119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa6255c4-fa53-4a25-a65c-3e4c1fc94978 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 200 len: 1307 microversion: 2.1 time: 0.417364 Oct 28 17:41:14.508630 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1608/3102] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:14 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:14.513310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.513743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.514192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.515726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.516197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.516635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.521837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a801a5c-9bc8-4109-aa5a-3adcf9320495", "name": "network-vif-deleted", "tag": "dfded2ee-a84f-4695-9386-e1d31280326c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:14.546457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.549851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.552261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.560124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:14.580230 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] Creating event network-vif-deleted:dfded2ee-a84f-4695-9386-e1d31280326c for instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 on n-h2-860864-13 Oct 28 17:41:14.613571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e2b25950-5421-4c9b-aafb-56263305efe7 req-0f0a235f-daed-4ab4-89b6-c1570b808401 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103338 Oct 28 17:41:14.619942 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1609/3103] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:14.636618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:14.644203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:14.646635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:14.648522 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12d94701-9ba1-4074-8a0f-01c3de9bfb28 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1279 microversion: 2.1 time: 0.159840 Oct 28 17:41:14.649818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1495/3104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:14 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:14.664961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.666278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.667765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:14.669377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:14.669965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:14.670645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.036551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:15.048614 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-087f71f8-d3cf-4ac9-b7a9-deaf8da4f273 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1494 microversion: 2.1 time: 0.424721 Oct 28 17:41:15.057335 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1610/3105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:14 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1494 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:15.063294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:15.063947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:15.082995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.084589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.086856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.088922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.093069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.094467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.191742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.192377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.193387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.195527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lazy-loading 'fault' on Instance uuid 3a801a5c-9bc8-4109-aa5a-3adcf9320495 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:15.299856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:15.327918 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd172a75-198e-430a-9237-63f31e3411df tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 200 len: 1315 microversion: 2.1 time: 0.268155 Oct 28 17:41:15.330113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1496/3106] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:15 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:15.354708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda", "name": "network-vif-deleted", "tag": "fd42677d-930b-44c4-8f9c-1902b45e150b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:15.391568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.392054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.399578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.482548 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] Creating event network-vif-deleted:fd42677d-930b-44c4-8f9c-1902b45e150b for instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda on n-h2-860864-13 Oct 28 17:41:15.501260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:15.502322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:15.516010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-28d2915c-131d-45d3-b0cd-f4fc040f1ed0 req-daea95a8-1720-47a1-b4d7-4225d40b5746 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180601 Oct 28 17:41:15.518191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.518871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.519847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.521202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1611/3107] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:15.530468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.532065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.535203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.541323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:15.543287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:15.551022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=9 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:15.563411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.564890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.565827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.575881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.578621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.579325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.626759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda HTTP/1.1 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda'} Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:15.628843 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. Oct 28 17:41:15.633407 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:15.635936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance 9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:15.637741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1aa98bc7-b71a-488d-8028-ad06ec5f6e64 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda" status: 404 len: 111 microversion: 2.1 time: 0.109464 Oct 28 17:41:15.642203 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1612/3108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:15 2022] GET /compute/v2.1/servers/9c2f7f6c-c45c-42d1-bbf8-03f452b1bcda => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:15.647255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:15.652207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:15.666168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.666956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.671852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.672786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.673371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.674149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.742042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:15.918699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15b46f32-ce64-44ff-96b7-58a9f51f1fa7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 204 len: 0 microversion: 2.1 time: 0.274199 Oct 28 17:41:15.924176 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1613/3109] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:15 2022] DELETE /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:15.931811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:15.932996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:15.939962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.941020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.941608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.942795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:15.943587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:15.944232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:15.992378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:16.001574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45e939ec-f3bb-41c6-81fa-a3a12c6fd054 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.511215 Oct 28 17:41:16.002889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1497/3110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:15 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:16.008041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:16.008943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:16.016768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.017691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.018345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.019353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.020047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.020682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.308486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:16.319930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f8d11c9-aa76-4207-9565-ae14ac038c6a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1473 microversion: 2.1 time: 0.315414 Oct 28 17:41:16.322845 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1498/3111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:16 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:16.342254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:16.342913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:16.370049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.371291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.384214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.385085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.385578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.386081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.469714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:16.477916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5c04e6a-7e1f-40c4-944e-0607bba44046 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.551775 Oct 28 17:41:16.478546 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1614/3112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:15 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:16.488813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:16.489426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:16.506577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.507070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.507540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.508259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:16.508711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:16.509135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:16.540208 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 HTTP/1.1 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3a801a5c-9bc8-4109-aa5a-3adcf9320495'} Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:16.541903 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:16.547801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:16.552591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9099a2ab-4593-49db-8db7-328b28ad24b6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 404 len: 111 microversion: 2.1 time: 0.067516 Oct 28 17:41:16.553202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1615/3113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:16 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:16.759091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-691042452", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:16.764068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:16.773500 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f1c62cc-7f96-466e-b244-177649935d9c tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1494 microversion: 2.1 time: 0.448966 Oct 28 17:41:16.774091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1499/3114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:16 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1494 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:16.865422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] validate_networks() for [('8e53cf83-ea72-42d2-b2ea-483082deaa8d', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:17.039685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:17.041189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:17.054052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:17.055432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:17.056490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:17.071758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:17.074296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:17.075606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:17.590467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:17.607407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b481c5ef-5c19-4b47-bb2d-54ead8056104 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.577013 Oct 28 17:41:17.608441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1500/3115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:17 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:17.614040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:17.614782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:17.630412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:17.630903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:17.637761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:17.638776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:17.639248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:17.639716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:17.689250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:17.727759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=26 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:17.968988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:17.984053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bea60d1f-18b3-4895-89df-176fa91842de tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1473 microversion: 2.1 time: 0.374461 Oct 28 17:41:17.985007 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1501/3116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:17 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1473 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:17.989859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:17.990484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:18.007564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.008053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.008493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.009201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.009654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.010123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.060384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:18.060893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:18.061424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:18.061901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:18.062639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:18.082286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.085496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.087210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.088533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.091188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.092726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.128605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:18.136910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Getting quotas for user 7b923545f92c4290b55733dd4cc1c866 and project 617d7971a40643429240ed3e0fbb5093. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:18.153743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:18.157851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:18.239080 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57cdb7df-1431-4456-b93b-c9cf3561fa0f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.485083 Oct 28 17:41:18.246876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1616/3117] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:41:18.247278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:18.248023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:18.256349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.258090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.259121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.259985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.260822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.261512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.305385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:18.314390 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de865153-7f5c-426c-96fa-fafec77804c2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.328263 Oct 28 17:41:18.321683 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1502/3118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:17 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:18.341220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8612034c-4542-491d-b7fe-8b10221332ac", "tag": "5215cb8e-aa0b-4220-bf05-719c80e8be35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:18.379727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.380280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.380778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.425913 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] Creating event network-changed:5215cb8e-aa0b-4220-bf05-719c80e8be35 for instance 8612034c-4542-491d-b7fe-8b10221332ac on n-h2-860864-13 Oct 28 17:41:18.442665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3d8487b6-d764-4e8b-910a-1b26555d4310 req-d78cda5a-92a8-4541-914c-60ea457a411a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119692 Oct 28 17:41:18.446447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1503/3119] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:18.452391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-674a3c15-693f-449e-9fae-afaf160c15f4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:18.462351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-674a3c15-693f-449e-9fae-afaf160c15f4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:18.612592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-674a3c15-693f-449e-9fae-afaf160c15f4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:18.629553 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-674a3c15-693f-449e-9fae-afaf160c15f4 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1224 microversion: 2.1 time: 0.179760 Oct 28 17:41:18.631285 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1504/3120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:18 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:18.649045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:18.657508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:18.666417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:18.669211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bc24a24-83bb-4b97-8667-9f17da8f3ab9 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1494 microversion: 2.1 time: 0.423799 Oct 28 17:41:18.670677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1617/3121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:18 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1494 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:18.677984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.678657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.679309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:18.680727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:18.682289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:18.685454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.000293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:19.053574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:19.060453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:19.093823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f47b4da-94e5-4834-a6cd-8357b05bad1b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.452215 Oct 28 17:41:19.101304 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1505/3122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:18 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:19.124228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.126790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.128395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.129535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.130103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.130627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.339185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:19.340084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:19.345705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:19.360454 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e5b7924-10d5-4d44-ad2a-053917928987 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1473 microversion: 2.1 time: 0.351561 Oct 28 17:41:19.360454 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1618/3123] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:19 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:19.383004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.383692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.384206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.387080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.387919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.388704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.651051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:19.658852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:19.659648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:19.667189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2703d0df-026b-4615-a06a-b482a0ca6d2c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.331970 Oct 28 17:41:19.668560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.669636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.672942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.675345 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1506/3124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:19 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:19.684479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.685015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.685463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.697230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:19.698093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:19.706147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.706741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.707244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.708171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:19.708629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:19.709054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:19.802168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:19.835014 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-759d3597-9bd1-4064-8645-1d9194834c96 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1276 microversion: 2.1 time: 0.180322 Oct 28 17:41:19.840886 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1619/3125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:19 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:20.072399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:20.098481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f09ba06-94ac-42d6-9343-71d4eb5b6173 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1494 microversion: 2.1 time: 0.405653 Oct 28 17:41:20.100313 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1507/3126] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:19 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:20.128453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:20.129068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:20.138387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.139344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.140037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.140931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.141548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.142131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.330208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:20.342001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f80088c-ef7f-47e2-b1fc-f468e44615ea tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.217340 Oct 28 17:41:20.345781 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1620/3127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:20 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:20.386973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:20.388227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:20.395735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.396478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.397080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.397951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.398555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.399127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.536662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3216d511-c2be-42f5-86ea-b4ed08c7c810", "tag": "d6cb231f-3c3a-4b70-b682-a1b7076b581f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:20.556951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.557434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.575121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.603436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] Creating event network-changed:d6cb231f-3c3a-4b70-b682-a1b7076b581f for instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 on n-h1-860864-13 Oct 28 17:41:20.613093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-045abf24-141f-4b53-a9a8-019ab6f6e05d req-4e0c3df3-fd80-4b38-b414-490de0415831 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078794 Oct 28 17:41:20.615791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1621/3128] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:41:20.701782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:20.703330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:20.724861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.727415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.728081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.736263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.737005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.737683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.750538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:20.764469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-111ecf6b-84d0-4ecb-9908-d85a37216896 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1473 microversion: 2.1 time: 0.381975 Oct 28 17:41:20.765053 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1508/3129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:20 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1473 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:20.866972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:20.868025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:20.883491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.884077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.884530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:20.887067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:20.889181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:20.889771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.146875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:21.151074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:21.189917 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89b9a96b-7088-44bb-a8a9-a4845a7052a9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.495365 Oct 28 17:41:21.194551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:21.203960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1622/3130] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:20 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:21.226420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7fc6fa55-0069-47b4-84cc-3cee0c29ad97 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1276 microversion: 2.1 time: 0.368658 Oct 28 17:41:21.233392 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1509/3131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:20 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:21.254443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:21.258329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:21.314174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.326172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.327613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.331270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.332726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.333580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.374414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:21.375402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:21.390656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.398023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.398733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.399501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.399961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.400393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.890625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:21.906307 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e3e2b9f-36f8-4753-872f-1d569152b4ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.538408 Oct 28 17:41:21.914874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:21.926262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1510/3132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:21 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:21.929097 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9d36baf-3636-453a-8e85-af190a125481 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1500 microversion: 2.1 time: 0.712642 Oct 28 17:41:21.929782 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1623/3133] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:21 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1500 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:21.933555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:21.936480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:21.943058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.943829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.944476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.945913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.946562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.947164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.977200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:21.978607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:21.988104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.988899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.995981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:21.997827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:21.998524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:21.999166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:22.054516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:22.248320 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-addf7f34-7010-4fd2-9c3c-74f7205fcd4b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 204 len: 0 microversion: 2.1 time: 0.279194 Oct 28 17:41:22.253073 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1624/3134] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:21 2022] DELETE /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:22.263446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:22.265284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:22.278845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:22.279716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:22.280416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:22.282041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:22.282740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:22.283391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:22.898438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:22.910589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7bbf1c0c-0bb1-4625-9976-362b09d83e25 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.655518 Oct 28 17:41:22.913838 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1625/3135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:22 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:22.938522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:22.939835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:22.947435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:22.948183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:22.949557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:22.950961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:22.951655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:22.952288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:22.953137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:23.021969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e5312e9-544a-4898-ab76-64aa171f2b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1473 microversion: 2.1 time: 1.093730 Oct 28 17:41:23.031244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1511/3136] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:21 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1473 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:23.036935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:23.045736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:23.055041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.059258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.059954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.060893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.062758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.064094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.275213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:23.289143 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea6b9cd0-e10e-431e-8eb6-c4a3d2c7ccaa tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1284 microversion: 2.1 time: 0.356678 Oct 28 17:41:23.290754 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1626/3137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:22 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1284 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:23.311269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:23.311925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:23.341120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.342718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.346006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.347765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.357464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.358166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.413066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:23.423928 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-692d54be-4c64-4656-9948-fa4ad3e88a87 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.390912 Oct 28 17:41:23.426870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1512/3138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:23 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:23.440026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63353499-8d0b-4b38-98d1-0a8a047ac115", "name": "network-vif-plugged", "status": "completed", "tag": "b21b1fa8-d2ee-43b5-93ba-26690d768c32"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:23.462698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.463885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.467299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.498566 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] Creating event network-vif-plugged:b21b1fa8-d2ee-43b5-93ba-26690d768c32 for instance 63353499-8d0b-4b38-98d1-0a8a047ac115 on n-h1-860864-13 Oct 28 17:41:23.505637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5b77a996-d207-44b5-ba9d-04e71d24e432 req-079ef23d-13f1-488b-8232-71ab43a22b4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077125 Oct 28 17:41:23.507167 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1513/3139] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:23.689571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:23.700025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f37cdf3-52bd-48b6-94e8-fab487e70d8b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.407057 Oct 28 17:41:23.702077 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1627/3140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:23 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:23.760435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dbd6937-f61c-4393-98db-7c0f6e3c1385", "name": "network-vif-deleted", "tag": "5d73501c-407e-4485-bbe1-f179ed9f3f63"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:23.790910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.796110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.798619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.810043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:23.827745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] Creating event network-vif-deleted:5d73501c-407e-4485-bbe1-f179ed9f3f63 for instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 on n-h1-860864-13 Oct 28 17:41:23.841900 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-50e9d694-0ae2-465e-9c98-251f9a897ace req-581c6e00-b898-48da-a426-4537528ed95d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085207 Oct 28 17:41:23.843214 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1514/3141] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:23.938945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:23.939674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:23.954623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.955587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.956393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:23.957873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:23.958558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:23.959224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.056155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:24.056840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:24.076136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.076661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.077099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.077808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.078254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.078671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.231508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:24.248748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c61d2ff8-67ba-4794-9459-aea3dc1dcfa4 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1431 microversion: 2.1 time: 0.196890 Oct 28 17:41:24.250065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1515/3142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:24 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1431 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:24.314814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:24.315491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:24.325374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.332087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.332831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.333740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.334352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.334962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.348262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:24.357817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5c29d68-36a1-423a-ad56-f6cb827b13da tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.422785 Oct 28 17:41:24.371985 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1628/3143] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:23 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:24.451850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:24.452727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:24.462671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.464428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.465046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.466081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.467988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.472318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.558560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:24.569790 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebead72d-6398-4cc0-acad-e3ca999cbf52 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1282 microversion: 2.1 time: 0.259302 Oct 28 17:41:24.572439 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1516/3144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:24 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:24.729127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:24.730523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:24.740871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.744366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.744859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:24.746659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:24.751810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:24.752722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.281894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:25.306540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32c3c86b-99d7-4d72-9d89-edf9fb1a3354 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.858050 Oct 28 17:41:25.333315 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1629/3145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:24 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:25.341207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:25.343946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:25.352964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.354319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.355744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.357252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.358454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.359293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.410072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:25.415092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.416009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.418346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.420299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lazy-loading 'fault' on Instance uuid 5dbd6937-f61c-4393-98db-7c0f6e3c1385 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:25.441665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fca50e0c-5bc9-4524-9752-ff0e0a8f914b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.719281 Oct 28 17:41:25.443647 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1517/3146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:24 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:25.450463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:25.451288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:25.457924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.458743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.463139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.465692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.468146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.470629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.552863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:25.569308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1ffb278-2e53-4964-bf2e-2a07ece8a703 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 200 len: 1307 microversion: 2.1 time: 0.234457 Oct 28 17:41:25.571750 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1630/3147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:25 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:25.596433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:25.598900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:25.612284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.614255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.616204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:25.618844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:25.619578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:25.620855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:26.544495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:26.566570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3b72f0f-bedd-4830-a6a2-a8d785a6764c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 1.121306 Oct 28 17:41:26.582843 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1518/3148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:25 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:26.591595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9e6f3c-8b01-4418-ac3d-3e781178b966", "tag": "32e9e7b0-f1ae-4536-b36a-df1f5c899d4a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:26.607544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:26.608446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:26.609075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:26.647589 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] Creating event network-changed:32e9e7b0-f1ae-4536-b36a-df1f5c899d4a for instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 on n-h2-860864-13 Oct 28 17:41:26.667782 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d540847d-58d6-4e8e-9678-c66f5ddfeb4b req-d9deb58e-9cb3-4eb4-a0fa-46ad8787351a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080160 Oct 28 17:41:26.670079 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1519/3149] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:26.679445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:26.680789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:26.696837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:26.697774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:26.698522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:26.699511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:26.700173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:26.700802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:26.763713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:26.772555 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-05e2a714-1f01-4aed-ab04-622f9a25e7cf tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 1.183211 Oct 28 17:41:26.787874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1631/3150] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:25 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:26.810944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:26.811760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:26.818415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:26.819652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:26.820181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:26.821005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:26.821542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:26.822671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.358464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:27.378402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66c0855e-49b4-4916-9191-6bdcb8a32ab2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1506 microversion: 2.1 time: 0.706843 Oct 28 17:41:27.385267 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1520/3151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:26 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:27.390462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:27.391901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 5dbd6937-f61c-4393-98db-7c0f6e3c1385] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:27.401279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.402804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.403302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.404207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.404853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.405452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.421019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 HTTP/1.1 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5dbd6937-f61c-4393-98db-7c0f6e3c1385'} Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:27.423108 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance 5dbd6937-f61c-4393-98db-7c0f6e3c1385 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-220f5550-82e6-44c7-8ce8-2d5613d46916 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385" status: 404 len: 111 microversion: 2.1 time: 0.038165 Oct 28 17:41:27.427107 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1521/3152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:27 2022] GET /compute/v2.1/servers/5dbd6937-f61c-4393-98db-7c0f6e3c1385 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:27.429808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8aa21e-d3db-42fa-b36b-00f8b40d88ca", "name": "network-vif-unplugged", "status": "completed", "tag": "ad39617b-49a0-4342-ab22-ecf5da43ee8d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:27.434745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:27.439992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.440467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.441016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.443940 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-12ebcf96-3442-443b-a231-42c9b6a6a581 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.651698 Oct 28 17:41:27.453754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] Creating event network-vif-unplugged:ad39617b-49a0-4342-ab22-ecf5da43ee8d for instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca on n-h1-860864-13 Oct 28 17:41:27.463690 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a96b134b-f06c-4b18-a4f1-52173e32c979 req-27c9e0b7-10db-47ef-9d15-03a9687c5309 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033919 Oct 28 17:41:27.465377 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1522/3153] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:27.471257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1632/3154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:26 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:27.472168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:27.472948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:27.480732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.481544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.482285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.483169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.484155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.484750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.514778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:27.590217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:27.590828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:27.608493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.609229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.609849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.610809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.611470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.612055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.645106 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46484535-f86f-4f2c-b97b-58c2c26edf9d tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 204 len: 0 microversion: 2.1 time: 0.177992 Oct 28 17:41:27.646758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1523/3155] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:27 2022] DELETE /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:27.666381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:27.667919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:27.675698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.676457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.677052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:27.677988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:27.678595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:27.679174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.087821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:28.096919 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9bbac93-4bce-454e-950c-f1bf9108339a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.510946 Oct 28 17:41:28.098011 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1633/3156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:27 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:28.121268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:28.121900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:28.131356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:28.133084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.133582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.134017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.134914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.135591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.136121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.148893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:28.164876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:28.173185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8329b1eb-87f0-4780-b9a5-771145d46288 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1472 microversion: 2.1 time: 0.513480 Oct 28 17:41:28.187783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1524/3157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:27 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:28.194785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8aa21e-d3db-42fa-b36b-00f8b40d88ca", "name": "network-vif-deleted", "tag": "ad39617b-49a0-4342-ab22-ecf5da43ee8d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:28.205443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.206217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.206805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.226047 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] Creating event network-vif-deleted:ad39617b-49a0-4342-ab22-ecf5da43ee8d for instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca on n-h1-860864-13 Oct 28 17:41:28.232518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-39855d0e-f8dc-4290-87bd-4b748ae9ec12 req-1dc83588-b961-4467-9bd1-f47920cd3057 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043219 Oct 28 17:41:28.233558 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1525/3158] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:28.404280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:28.406855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:28.414824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.418776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.419299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.420464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.421801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.422397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.466891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:28.478870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-989fc485-72ee-45ff-bc85-cb1e5a427efc tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.379497 Oct 28 17:41:28.481156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1634/3159] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:28 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:28.486851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:28.487977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:28.496177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.497874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.498545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.500269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:28.500960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:28.501617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:28.526113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:28.537784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5727e87-d30f-4790-89c2-21949bd7672b tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1464 microversion: 2.1 time: 0.138762 Oct 28 17:41:28.539043 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1526/3160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:28 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:28.812765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:28.827184 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba8514fc-1657-47c1-82fb-48eeba5ad9d1 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.343841 Oct 28 17:41:28.829188 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1635/3161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:28 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:29.125994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:29.127346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:29.133852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:29.137208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.137958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.138566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.139717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.140413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.140840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.201228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:29.201837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:29.214918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.215726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.216283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.217338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.217935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.218601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.432605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:29.447814 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ec3dc737-d2a9-4b8f-858c-f0ae174c0a75 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.330375 Oct 28 17:41:29.449099 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1527/3162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:29 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:29.479289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8612034c-4542-491d-b7fe-8b10221332ac", "name": "network-vif-plugged", "status": "completed", "tag": "5215cb8e-aa0b-4220-bf05-719c80e8be35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:29.485667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:29.492375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.493025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.493634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.544605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:29.563798 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d443a2a0-62ea-416c-a2ad-b6b5bbfd4b7b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1472 microversion: 2.1 time: 0.362152 Oct 28 17:41:29.563798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1636/3163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:29 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:29.566036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:29.566657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:29.584840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.585347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.585888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.586628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.587092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.587601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.662039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:29.801614 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] Creating event network-vif-plugged:5215cb8e-aa0b-4220-bf05-719c80e8be35 for instance 8612034c-4542-491d-b7fe-8b10221332ac on n-h2-860864-13 Oct 28 17:41:29.811102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5dc72361-db1f-41c0-a28a-4d19aae5a730 req-23f0db35-42aa-409d-897d-b402d82abda4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335527 Oct 28 17:41:29.817755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1528/3164] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:29.845509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:29.846419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:29.856663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.857171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.858153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:29.859061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:29.859877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:29.860320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.137609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:30.158832 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a89d7c3-d3b6-44f1-81c2-cad972ace0bc tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1299 microversion: 2.1 time: 0.316924 Oct 28 17:41:30.160021 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1529/3165] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:29 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1299 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:30.165091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:30.169847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:30.189567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.190156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.190814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.192582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.193232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.193875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.486273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:30.498039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5cbaee8e-3d6b-40f1-89f5-d86d78b1783a tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.935665 Oct 28 17:41:30.499235 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1637/3166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:29 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:30.504303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:30.505142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:30.512786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.513510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.514136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.515040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.515811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.516388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.602364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:30.613934 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0019043a-09e4-4d35-a9e5-05ca1ac8dd3c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.452552 Oct 28 17:41:30.636966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1530/3167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:30 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:30.642608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:30.643220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:30.658646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.661744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.662392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:30.663309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:30.666092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:30.666773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.007742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:31.017098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3d85bc46-2411-476d-80bb-d6db97a80ee6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1321 microversion: 2.1 time: 0.516469 Oct 28 17:41:31.018358 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1638/3168] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:30 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:31.054428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:31.066178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c145185-6fd0-4d4a-9adc-6b1c4e59a847 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1472 microversion: 2.1 time: 0.427769 Oct 28 17:41:31.067045 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1531/3169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:30 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:31.182425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:31.184086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:31.192088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.192777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.193634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.195537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.196395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.221423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.371145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.375132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.375665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.376386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lazy-loading 'fault' on Instance uuid 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:31.482569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:31.494871 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-729e7d0f-1ceb-4ba3-b084-6a5bf80633c4 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 200 len: 1304 microversion: 2.1 time: 0.316663 Oct 28 17:41:31.501025 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1639/3170] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:31 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 1304 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:31.525783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:31.528048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:31.557036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.564034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.566775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.569053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.572676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.574604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.643431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:31.644413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:31.656546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.657322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.657937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:31.664343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:31.665069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:31.665670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.258306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:32.268056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b65c973-b574-4a6f-9f7e-a29ff0052a1d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.628926 Oct 28 17:41:32.277880 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1640/3171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:31 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:32.283278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:32.284979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:32.303218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.304025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.304679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.305865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.306661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.307233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.445278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:32.455333 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d87dff4-0be5-40cc-b500-c3d014048518 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.933870 Oct 28 17:41:32.468104 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1532/3172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:31 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:32.473570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:32.474445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:32.484891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.492641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.492641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.493208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.493670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.499679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.504855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:32.652257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:32.670790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-91ab6a27-cbc0-46c7-9eb8-9643a2f77d37 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1515 microversion: 2.1 time: 0.388159 Oct 28 17:41:32.673024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1641/3173] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:32 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:32.684552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:32.685768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:32.697174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.697839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.698519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.699538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.700151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.700737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.729289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] HTTP exception thrown: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Request method failure captured: Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca HTTP/1.1 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOt-QeuHan3tomCvVNK6a3Q_36lkErICCB-vXCGMPPiQcmzGqiElTZu71GbiFzzoB1DgEwb2aXLSDQdr67tnoH-sK_PP2fU2G6Acw5ta2py1pCsqzfKWQiopulXqyMBh2N5agEiOB9mUsuziuX7A2revC_2M118pfG_ggAAM57Vln0 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: a553d7c9baa545e5b21faa4ed1c63873 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a553d7c9baa545e5b21faa4ed1c63873"}]}] Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: a553d7c9baa545e5b21faa4ed1c63873 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerRescueTestJSON-498835726-project Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6b8ab14d2a2a435bb24e42c8d2a12dca Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerRescueTestJSON-498835726-project Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7b8aa21e-d3db-42fa-b36b-00f8b40d88ca'} Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:32.732943 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. Oct 28 17:41:32.737954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:32.742345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Returning 404 to user: Instance 7b8aa21e-d3db-42fa-b36b-00f8b40d88ca could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:32.743945 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9824929c-27d3-4488-a312-f768617705aa tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca" status: 404 len: 111 microversion: 2.1 time: 0.067938 Oct 28 17:41:32.744666 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1642/3174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:32 2022] GET /compute/v2.1/servers/7b8aa21e-d3db-42fa-b36b-00f8b40d88ca => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:32.759663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:32.765709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:32.779148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.780341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.780994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.782220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.787757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.789146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.858247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'flavor' on Instance uuid 8612034c-4542-491d-b7fe-8b10221332ac {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:32.903516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:32.916160 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed5109ad-68dd-4b14-86a9-2ce80dbeb399 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1472 microversion: 2.1 time: 0.447019 Oct 28 17:41:32.917154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1533/3175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:32 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:32.925007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:32.925749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:32.933006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.934460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.935224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:32.937054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:32.937691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:32.938322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.019077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:33.046854 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-843aad7c-020e-49f3-a8d7-d84586896ffb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action" status: 200 len: 32 microversion: 2.1 time: 0.300730 Oct 28 17:41:33.055722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1643/3176] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:41:32 2022] POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:41:33.066218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:33.077410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:33.100656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.101147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.101583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.102295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.114217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.114667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.264306 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b409fd30-dad5-4d7d-bbe8-75ee2932ea79 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 204 len: 0 microversion: 2.1 time: 0.345343 Oct 28 17:41:33.264915 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1534/3177] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:32 2022] DELETE /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:33.273636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:33.277186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:33.296795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.297788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.298243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.298951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.299401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.299826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.643949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:33.681780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0c475ba-1985-4e21-b8c4-f451868b260b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.624320 Oct 28 17:41:33.703583 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1644/3178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:33 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:33.710899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:33.736648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:33.744451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.744950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.746045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.746775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.747239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.747691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.876749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:33.884791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a695acd6-2c41-42b4-a18a-2c4e6a329021 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1492 microversion: 2.1 time: 0.615566 Oct 28 17:41:33.888172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1535/3179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:33 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1492 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:33.892814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c51a11-6843-4a8e-bcb9-f77db42e5d49", "name": "network-vif-deleted", "tag": "e4117fbb-edb5-4307-b1e7-81cba4e60ad3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:33.922879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:33.923574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:33.923702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:33.956336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] Creating event network-vif-deleted:e4117fbb-edb5-4307-b1e7-81cba4e60ad3 for instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 on n-h1-860864-13 Oct 28 17:41:33.963737 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-dbc17de1-2212-482f-be80-28feda2243e3 req-fba5d7f3-822f-44b5-ae55-d566a1fa6bf2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074231 Oct 28 17:41:33.970432 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1536/3180] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:33.981706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:33.984612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:34.004544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.012468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.013565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.014874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.016961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.017389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.144150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:34.161947 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25f1bec9-6b68-405b-b157-91c14e6d2f35 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.451903 Oct 28 17:41:34.163101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1645/3181] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:33 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:34.173698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3216d511-c2be-42f5-86ea-b4ed08c7c810", "name": "network-vif-plugged", "status": "completed", "tag": "d6cb231f-3c3a-4b70-b682-a1b7076b581f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:34.202177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.203283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.204658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.239578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] Creating event network-vif-plugged:d6cb231f-3c3a-4b70-b682-a1b7076b581f for instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 on n-h1-860864-13 Oct 28 17:41:34.250572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0f78a622-6e52-43cb-9caf-b4830ccd1a1d req-a0b9186a-d8b8-4d7a-b480-cca026220993 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085216 Oct 28 17:41:34.251194 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1646/3182] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:34.262013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:34.265714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:34.272663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:34.274939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.275693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.277252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.278442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.279074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.279930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.393355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:34.407278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10f8fe91-26a0-44fc-b629-22e9644da159 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.434280 Oct 28 17:41:34.408117 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1537/3183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:33 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:34.432121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:34.443294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a65efcd4-bbf0-4f75-9d4d-35893fc67f7f tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 200 len: 1430 microversion: 2.1 time: 0.185913 Oct 28 17:41:34.444106 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1647/3184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:34 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 1430 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:34.714651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:34.715260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:34.723160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.725404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.726202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.727355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.728777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.730081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.911260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:34.912782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:34.956186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.959681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.961316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.963076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:34.963781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:34.965107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:34.968170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:34.988193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1b7e415-4f18-41a1-84cc-9dbd09496059 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.277921 Oct 28 17:41:35.001004 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1538/3185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:34 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:35.190494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:35.191522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:35.204963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:35.210908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:35.211796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:35.217785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:35.219926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:35.221110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.113323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:36.128775 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e815386c-cccf-4a96-896a-e7dc668a1c43 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1492 microversion: 2.1 time: 1.223978 Oct 28 17:41:36.129382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1648/3186] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:34 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1492 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:36.147231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:36.151949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:36.171183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.172353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.173005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.173948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.175224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.176991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.352016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:36.378814 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b6e6a8c3-a5df-474a-a9a1-f091016d3d7f tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 1.192516 Oct 28 17:41:36.398809 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1539/3187] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:35 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:36.425698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:36.428267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: f3c51a11-6843-4a8e-bcb9-f77db42e5d49] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:36.443763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.452863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.453386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.457029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.458127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.458608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:36.459296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.470530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16b798de-8974-4e5e-adc5-bfde3794947b tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.333398 Oct 28 17:41:36.475265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1649/3188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:36 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:36.489911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:36.491234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:36.502999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. Oct 28 17:41:36.514202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.515248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.515933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.516920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.517871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.518627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 HTTP/1.1 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'f3c51a11-6843-4a8e-bcb9-f77db42e5d49'} Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:36.533785 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. Oct 28 17:41:36.538055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:36.541083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance f3c51a11-6843-4a8e-bcb9-f77db42e5d49 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:36.542979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6772531b-5e07-4342-a5ea-0e9f3db883f6 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49" status: 404 len: 111 microversion: 2.1 time: 0.133544 Oct 28 17:41:36.543796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1540/3189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:36 2022] GET /compute/v2.1/servers/f3c51a11-6843-4a8e-bcb9-f77db42e5d49 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:36.561306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:36.563316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:36.570285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.571032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.571580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.572388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.572927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.573487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.619194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:36.773470 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7d2e869-303b-44ac-9f5e-84482a5a1632 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 204 len: 0 microversion: 2.1 time: 0.223678 Oct 28 17:41:36.779337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1541/3190] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:36 2022] DELETE /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:36.786661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e6f3c-8b01-4418-ac3d-3e781178b966", "name": "network-vif-plugged", "status": "completed", "tag": "32e9e7b0-f1ae-4536-b36a-df1f5c899d4a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:36.817897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.817897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.817897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.843600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] Creating event network-vif-plugged:32e9e7b0-f1ae-4536-b36a-df1f5c899d4a for instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 on n-h2-860864-13 Oct 28 17:41:36.855488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b6631c46-3365-4008-a38f-0cc818793230 req-608601b4-0bf0-4611-885f-5d984a7110a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073089 Oct 28 17:41:36.862386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1542/3191] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:36.874176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:36.874845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:36.886924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.887111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.887611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.888360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:36.888904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:36.889303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:36.891947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:36.906922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97b254a1-bec7-4f29-a258-6c2e447a2210 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.428449 Oct 28 17:41:36.924165 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1650/3192] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:36 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:36.952010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:37.085655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1bb17a2-2131-45b8-a7f8-8ab563820f85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 204 len: 0 microversion: 2.1 time: 0.228071 Oct 28 17:41:37.086444 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1543/3193] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:36 2022] DELETE /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:37.094946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:37.095589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:37.102479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.103221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.103884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.105229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.105686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.106119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.166350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:37.169197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:37.176117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.177252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.177942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.179158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.179938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.180758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.267464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:37.275737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75d2fb84-f9c9-481a-aa1e-c12d36edf274 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 200 len: 1474 microversion: 2.1 time: 0.184403 Oct 28 17:41:37.276650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1651/3194] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:37 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 1474 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:37.281715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3607d568-e8b5-4edf-a0bc-602f9a34f065", "name": "network-vif-deleted", "tag": "6ec41165-2ef0-403a-abee-e5d36fe29da3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:37.293024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.293596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.294105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.296050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:37.305251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac5daca1-ee90-4543-831c-03e12473b3f2 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1450 microversion: 2.1 time: 0.145947 Oct 28 17:41:37.321032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] Creating event network-vif-deleted:6ec41165-2ef0-403a-abee-e5d36fe29da3 for instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 on n-h1-860864-13 Oct 28 17:41:37.322968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1544/3195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:37 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:37.327782 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-22a01cba-4a02-4bb6-b78e-2f5c3f1beb16 req-9594cf26-5158-458f-b90e-5fcee28acace service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049550 Oct 28 17:41:37.328773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1652/3196] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:37.406751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:37.407420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:37.413933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.414417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.414851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.415592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.416053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.416502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.512272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:37.513051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:37.520098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.520893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.521878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.523038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.524315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.524960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.574664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:37.583917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84afe009-493b-4b52-9572-da301cdeb449 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1321 microversion: 2.1 time: 0.180938 Oct 28 17:41:37.585709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1545/3197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:37 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:37.769836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:37.772215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:37.789871 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71b8e6db-d13d-4587-976c-dc8e2f9d2ffb tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.283304 Oct 28 17:41:37.790469 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1653/3198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:37 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:37.931678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:37.932289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:37.948183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.949393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.949986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:37.950705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:37.951164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:37.951616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.148189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:38.152687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:38.160751 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ff681bee-3730-49a1-aa8b-4b792babbaa8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.233127 Oct 28 17:41:38.161757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1546/3199] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:37 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:38.302922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:38.305527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:38.320561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.321311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.324372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.325524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.327161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.327917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.329407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:38.330014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:38.358857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.359480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.359998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.364422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.364913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.365356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.475566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8ab14d2a2a435bb24e42c8d2a12dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553d7c9baa545e5b21faa4ed1c63873', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:38.488217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-177ded28-6dce-4fd3-8a21-8e5be0dbfbf3 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 200 len: 1450 microversion: 2.1 time: 0.163717 Oct 28 17:41:38.489349 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1547/3200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:38 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:38.567587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:38.577336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d922f24-0dc1-42f2-85b9-a4f39b478f34 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 200 len: 1474 microversion: 2.1 time: 0.281251 Oct 28 17:41:38.577989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1654/3201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:38 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 1474 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:38.609216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:38.609830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:38.616384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.616884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.617328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.618156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.618620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.619044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.814476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:38.815353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:38.825703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.826202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.826677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.830436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:38.830916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:38.831585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:38.851346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:38.865426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7c0a1b6-995b-4bf0-ba36-35f5b4aa51ec tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1471 microversion: 2.1 time: 0.260231 Oct 28 17:41:38.882966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1548/3202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:38 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:39.011355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:39.022125 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a61b6720-6e49-434e-8895-5c1e357062db tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1324 microversion: 2.1 time: 0.211754 Oct 28 17:41:39.038722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1655/3203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:38 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1324 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:39.186247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:39.187227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:39.196865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.197704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.198449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.199678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.200348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.201033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.281331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:39.281907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] [instance: e8152bed-4e90-4a90-b929-31bed14d8c92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:39.287634 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] HTTP exception thrown: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Request method failure captured: Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/e8152bed-4e90-4a90-b929-31bed14d8c92/action HTTP/1.1 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 15 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQw_7vqfVvxkmcSd-3G0UTKlYE699VhfYQEaO1qDd7J1tueksPPvlhjxmd577nGK_eJqFf2vOdyCDORbiP6XvHkX6FDmNM-Kv-ZDpN6H72QbX_-BB2GsB_Yak9eewG4YYOKX8bWR4gcml_gRgUdBaYpcBW7MwtyqqNVn0lsM5QIyMM Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f52250a4d844d4ea1c344f370449ec9"}]}] Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a4a2175e6b27404685a5e1b85275e424 Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: {"migrate": {}} Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e8152bed-4e90-4a90-b929-31bed14d8c92', 'body': {'migrate': {}}} Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.289804 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Returning 404 to user: Instance e8152bed-4e90-4a90-b929-31bed14d8c92 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4012c8d-739f-434a-9385-62650c31cba8 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/e8152bed-4e90-4a90-b929-31bed14d8c92/action" status: 404 len: 111 microversion: 2.1 time: 0.402191 Oct 28 17:41:39.298146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1549/3204] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:41:38 2022] POST /compute/v2.1/servers/e8152bed-4e90-4a90-b929-31bed14d8c92/action => generated 111 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:39.433892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1083192250", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:39.545633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:39.576062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8263ff1b-5210-4d44-863d-78cd42af2011 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.390853 Oct 28 17:41:39.590511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1656/3205] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:39 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:39.596037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:39.596619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:39.596619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] [instance: 3607d568-e8b5-4edf-a0bc-602f9a34f065] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:39.607441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.608823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.609451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.613616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.614386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.616233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.648136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] HTTP exception thrown: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Request method failure captured: Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 HTTP/1.1 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOt-QeuHan3tomCvVNK6a3Q_36lkErICCB-vXCGMPPiQcmzGqiElTZu71GbiFzzoB1DgEwb2aXLSDQdr67tnoH-sK_PP2fU2G6Acw5ta2py1pCsqzfKWQiopulXqyMBh2N5agEiOB9mUsuziuX7A2revC_2M118pfG_ggAAM57Vln0 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: a553d7c9baa545e5b21faa4ed1c63873 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a553d7c9baa545e5b21faa4ed1c63873"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a553d7c9baa545e5b21faa4ed1c63873"}]}] Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: a553d7c9baa545e5b21faa4ed1c63873 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerRescueTestJSON-498835726 Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerRescueTestJSON-498835726-project Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6b8ab14d2a2a435bb24e42c8d2a12dca Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerRescueTestJSON-498835726-project Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3607d568-e8b5-4edf-a0bc-602f9a34f065'} Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:39.651329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. Oct 28 17:41:39.657563 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:39.672697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] Returning 404 to user: Instance 3607d568-e8b5-4edf-a0bc-602f9a34f065 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:39.677451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac6c02ff-e941-445a-b241-4fe8dba53745 tempest-ServerRescueTestJSON-498835726 tempest-ServerRescueTestJSON-498835726-project] 10.222.0.48 "GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065" status: 404 len: 111 microversion: 2.1 time: 0.082407 Oct 28 17:41:39.683200 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1657/3206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:39 2022] GET /compute/v2.1/servers/3607d568-e8b5-4edf-a0bc-602f9a34f065 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:39.697501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:39.700174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:39.717881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.723493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.724185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.726908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:39.728567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:39.729334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:39.942034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:39.959275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78744f72-e2f8-431c-b036-191bd181e92c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 200 len: 1432 microversion: 2.1 time: 0.273710 Oct 28 17:41:39.961493 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1658/3207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:39 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 1432 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:39.981617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b93f32-d36f-4426-a086-6a7f92b2e169", "name": "network-vif-deleted", "tag": "fe025865-d83a-4040-85a4-0bf479488041"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:40.013223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.013854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.018842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.052781 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] Creating event network-vif-deleted:fe025865-d83a-4040-85a4-0bf479488041 for instance a4b93f32-d36f-4426-a086-6a7f92b2e169 on n-h1-860864-13 Oct 28 17:41:40.068172 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1b96e31a-07c6-4bd4-aad6-975729a76487 req-2cb0ee49-a03c-4da9-88ce-c17b265fd7e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102386 Oct 28 17:41:40.070901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1659/3208] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:40.098993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.103196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:40.125828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.127116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.128759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.131454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.132215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.133319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.241989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:40.242410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:40.242935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:40.244083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:40.244555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:40.266553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.272502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.273368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.275652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.277991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.279392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.327404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Getting quotas for project 7afaa10d89b64e7db02e37552dd67684. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:40.336527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Getting quotas for user 1119173fa2c9420d89a18d9bcb96689b and project 7afaa10d89b64e7db02e37552dd67684. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:40.351310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:40.356471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:40.442810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b1604a4-370d-40fe-ab9d-5a1b4bd27682 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013174 Oct 28 17:41:40.450895 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1550/3209] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:41:40.455985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a58eda1-9b1a-4822-b7bc-f43e42786f7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.456602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a58eda1-9b1a-4822-b7bc-f43e42786f7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:40.483939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:40.493692 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15ab071c-9dd2-4a82-9df0-1c406bacebae tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1520 microversion: 2.1 time: 0.416919 Oct 28 17:41:40.494290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1660/3210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:40 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:40.532023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.532885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:40.541118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.544891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.546213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.546818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a58eda1-9b1a-4822-b7bc-f43e42786f7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:40.547864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.548546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.549217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.556870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a58eda1-9b1a-4822-b7bc-f43e42786f7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1222 microversion: 2.1 time: 0.104717 Oct 28 17:41:40.559128 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1551/3211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:40 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:40.597425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.598037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:40.598197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:40.610975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.611474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.611919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.612632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.613087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.613515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.780322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d4bd0da-dbe0-440b-86e8-ec3b2c164348 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 204 len: 0 microversion: 2.1 time: 0.252535 Oct 28 17:41:40.780917 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1661/3212] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:40 2022] DELETE /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:41:40.790284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.790992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:40.809136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.810444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.811065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.811992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:40.812783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:40.813433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:40.864426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:40.876746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab5ee231-07a8-49ec-a7e4-6fc12a34b54b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.283008 Oct 28 17:41:40.878566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1552/3213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:40 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:40.989586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:40.990334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: a4b93f32-d36f-4426-a086-6a7f92b2e169] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:41.000211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.001861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.002349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.003084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.003561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.003995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.027309 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 HTTP/1.1 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a4b93f32-d36f-4426-a086-6a7f92b2e169'} Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:41.030243 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. Oct 28 17:41:41.035208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:41.038359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance a4b93f32-d36f-4426-a086-6a7f92b2e169 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:41.039258 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc91c52f-53b6-44d5-842a-fab4826ec41c tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169" status: 404 len: 111 microversion: 2.1 time: 0.054906 Oct 28 17:41:41.043650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1553/3214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:40 2022] GET /compute/v2.1/servers/a4b93f32-d36f-4426-a086-6a7f92b2e169 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:41:41.049686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:41.050315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:41.056919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.058209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.058907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.060498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.061222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.061900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.080980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:41.090735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df914cd0-6ef4-4286-b6ac-9c88839c747e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1526 microversion: 2.1 time: 0.304955 Oct 28 17:41:41.092686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1662/3215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:40 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:41.255518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:41.267899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-651ee1a2-67c0-49a9-a8b3-feaac2a1cc6e tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1474 microversion: 2.1 time: 0.222224 Oct 28 17:41:41.279323 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1554/3216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:41 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1474 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:41.596268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:41.596268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:41.606749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.608630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.609919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.612548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.616372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.617247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.743190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:41.754928 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9268b828-6251-481e-84aa-0f940b94920b tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1274 microversion: 2.1 time: 0.177594 Oct 28 17:41:41.760382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1663/3217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:41 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:41.903167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:41.904705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:41.912602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.915655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.919917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:41.921393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:41.921935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:41.923194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.113988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:42.114772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:42.127501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.134335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.135083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.139859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.140651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.142280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.405862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:42.418600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-401eda6a-deb2-4db2-8ec1-71012a98e846 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.520422 Oct 28 17:41:42.426995 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1555/3218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:41 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:42.443667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a384cbc-9072-45a6-ab25-18e4379db3b4", "name": "network-vif-deleted", "tag": "864abb35-1fa2-4b24-aa34-b021625b04a7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:42.456563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.457103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.457542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.486849 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] Creating event network-vif-deleted:864abb35-1fa2-4b24-aa34-b021625b04a7 for instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 on n-h2-860864-13 Oct 28 17:41:42.495668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5b54cbea-7d2d-4b0e-b95f-e984cc29ac75 req-a3c61d60-5225-40d5-8a8e-3494ee371e05 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066666 Oct 28 17:41:42.503950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1556/3219] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:42.511838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:42.520571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:42.531852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.534988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.535892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.538174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.540356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.540817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.595922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:42.612331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a20df3b-acdc-4541-8f0a-b6812ae62b4f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1526 microversion: 2.1 time: 0.502274 Oct 28 17:41:42.612948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.614703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.614863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1664/3220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:42 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1526 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:42.615197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.622509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lazy-loading 'fault' on Instance uuid 4a384cbc-9072-45a6-ab25-18e4379db3b4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:42.699995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:42.714582 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef20685c-1d57-4140-a461-b2f743973b27 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 200 len: 1308 microversion: 2.1 time: 0.204144 Oct 28 17:41:42.720509 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1557/3221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:42 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:42.781825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:42.782442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:42.794882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.795396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.795845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.796554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:42.797007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:42.797435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:42.982661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:42.991852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb1d5a35-aa53-4c4d-b3e0-45d31c9769c5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1292 microversion: 2.1 time: 0.214104 Oct 28 17:41:42.992661 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1665/3222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:42 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1292 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:43.446809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:43.447453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:43.458717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.467529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.468262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.469274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.469954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.470674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.640497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:43.641056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:43.664576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.664576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.664868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.665888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.672480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.673517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.803666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:43.819727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ab974aa-46eb-4996-80be-f9d8ea72c60b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.378090 Oct 28 17:41:43.823755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1558/3223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:43 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:43.829944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e6f3c-8b01-4418-ac3d-3e781178b966", "name": "network-vif-unplugged", "status": "completed", "tag": "32e9e7b0-f1ae-4536-b36a-df1f5c899d4a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:43.863643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.865250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.868358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.894658 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] Creating event network-vif-unplugged:32e9e7b0-f1ae-4536-b36a-df1f5c899d4a for instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 on n-h2-860864-13 Oct 28 17:41:43.913301 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4a3673ad-34ad-4947-926d-c3e477895f51 req-0f42d581-fc67-4398-8f64-f83187c99942 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086952 Oct 28 17:41:43.918736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1559/3224] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:43.924681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:43.925627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 4a384cbc-9072-45a6-ab25-18e4379db3b4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:43.939180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:43.941675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.942408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.943006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.945442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:43.946107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:43.950506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:43.976717 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 HTTP/1.1 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4a384cbc-9072-45a6-ab25-18e4379db3b4'} Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:43.980662 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. Oct 28 17:41:43.985520 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:43.988674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance 4a384cbc-9072-45a6-ab25-18e4379db3b4 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:43.989939 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f6970bb-c570-403e-b0a8-b66ad5199efd tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4" status: 404 len: 111 microversion: 2.1 time: 0.069275 Oct 28 17:41:43.990551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1560/3225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:43 2022] GET /compute/v2.1/servers/4a384cbc-9072-45a6-ab25-18e4379db3b4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:44.004211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-907e3ffe-eccf-43e3-b807-423e76a1f426 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.050334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-907e3ffe-eccf-43e3-b807-423e76a1f426 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/1a903c87-1291-45d5-a302-2707147b8d5d" status: 204 len: 0 microversion: 2.1 time: 0.051764 Oct 28 17:41:44.050955 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1561/3226] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:41:43 2022] DELETE /compute/v2.1/os-server-groups/1a903c87-1291-45d5-a302-2707147b8d5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:44.062529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.063154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:44.080533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.081036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.082426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.083109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.083807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.084283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.113780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:44.123267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55263f75-6af8-49e1-b4d6-701152226926 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1526 microversion: 2.1 time: 0.486701 Oct 28 17:41:44.124436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1666/3227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:43 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1526 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:44.129308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.130070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:44.137214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.138000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.138680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.139664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.140338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.140976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.173536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:44.262917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:44.274481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55fe928b-1fd9-4d13-ba7e-0e7252b1c10e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1280 microversion: 2.1 time: 0.218997 Oct 28 17:41:44.275087 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1562/3228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:44 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:44.312476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09fb6a2b-ff02-493d-9c85-d2dcd7791151 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 204 len: 0 microversion: 2.1 time: 0.186223 Oct 28 17:41:44.313722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1667/3229] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:44 2022] DELETE /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:44.322016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.322536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:44.330525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.331407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.332041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.333228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.334456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.334994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.379255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:44.506942 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-499a7dcc-64f5-4f09-b299-51d1d659c5c5 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 204 len: 0 microversion: 2.1 time: 0.188928 Oct 28 17:41:44.511273 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1563/3230] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:44 2022] DELETE /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:44.519106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.519850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:44.528049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.528617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.529066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.530058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.530524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.531209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.571921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:44.579243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9e6f3c-8b01-4418-ac3d-3e781178b966", "name": "network-vif-deleted", "tag": "32e9e7b0-f1ae-4536-b36a-df1f5c899d4a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:44.597432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.597918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.598350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.621707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] Creating event network-vif-deleted:32e9e7b0-f1ae-4536-b36a-df1f5c899d4a for instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 on n-h2-860864-13 Oct 28 17:41:44.639666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-484426ac-2936-4ae8-9c92-6b93c4b11915 req-a4488374-cddc-498e-b6a2-7e79e54f6543 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063081 Oct 28 17:41:44.642816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1564/3231] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:41:44.787010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:44.799898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ad3f8c9-c7b1-49bd-92cd-2255c3e34c32 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1474 microversion: 2.1 time: 0.286545 Oct 28 17:41:44.802258 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1668/3232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:44 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1474 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:44.886701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:44.905348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:44.920809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.922632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.924727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:44.925845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:44.929074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:44.929610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.154035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:45.154706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:45.163544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.167992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.169936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.173279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.173778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.175685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.413989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:45.432659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b218617f-bca5-47bf-9fd0-088cea4f398f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1484 microversion: 2.1 time: 0.284650 Oct 28 17:41:45.437807 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1669/3233] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:45 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1484 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:45.451532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:45.454301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:45.472881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.475718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.479424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.482268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.484107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.486104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.592988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:45.611772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8875b59b-64c1-44f5-ad32-e33df40e8a53 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.762979 Oct 28 17:41:45.612671 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1565/3234] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:44 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:45.814941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:45.827275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb2cfcfc-a4b7-4f4c-882e-b10601d7d988 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.384870 Oct 28 17:41:45.827557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:45.828254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:45.829303 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1670/3235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:45 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:45.851970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.852484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.853145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:45.854102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:45.854801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:45.855642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.144448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:46.155486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e15c8a93-8b17-4d9f-9db0-ee2bd05131c1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1474 microversion: 2.1 time: 0.333285 Oct 28 17:41:46.156092 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1566/3236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:45 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:46.463144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:46.464269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:46.482900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.484216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.485108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.486919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.487767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.488483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.596764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:46.608572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc7b9d8f-7818-402b-bde3-ea69e296e2a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1309 microversion: 2.1 time: 0.150311 Oct 28 17:41:46.624536 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1671/3237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:46 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:46.639977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:46.641649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:46.664238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.665598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.666279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.667121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.667619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.668059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.854758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:46.856419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:46.873996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.875059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.875859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.877127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:46.877768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:46.878400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:46.936831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:46.952439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ecdaa78c-a800-4cb8-b23b-90f6d6906816 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.317183 Oct 28 17:41:46.957371 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1567/3238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:46 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:47.184784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:47.185834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:47.217001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.218003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:47.218690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:47.220197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.220894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:47.221725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:47.307189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:47.393304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:47.408139 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fdcea267-2704-489a-a25d-3b72f08691ab tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.555368 Oct 28 17:41:47.408803 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1672/3239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:46 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:47.637443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:47.638539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:47.648079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.649257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:47.650270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:47.651102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.651733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:47.652381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:47.702590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.703396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:47.704031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:47.704688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lazy-loading 'fault' on Instance uuid 4b9e6f3c-8b01-4418-ac3d-3e781178b966 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:47.816538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b923545f92c4290b55733dd4cc1c866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617d7971a40643429240ed3e0fbb5093', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:47.828063 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-975266a9-97bc-41b6-a090-0c21b7e53345 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 200 len: 1314 microversion: 2.1 time: 0.196785 Oct 28 17:41:47.832461 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1673/3240] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:47 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:47.981810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:47.984855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:47.999245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:47.999786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.000227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.012730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.015595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.017755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.241076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:48.255746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d73c66d2-1dc5-4cb8-b35b-ea2535eba3f7 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1474 microversion: 2.1 time: 1.078643 Oct 28 17:41:48.256655 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1568/3241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:47 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1474 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:48.390664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:48.402740 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5bba215-5009-449a-a078-6762ac06568f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.424840 Oct 28 17:41:48.419757 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1674/3242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:47 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:48.430393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:48.431003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:48.442108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.442615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.443050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.443977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.444430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.445056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.744452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebde4b96-b9b7-43ff-9050-d15e3fda5cd3", "tag": "5947eefc-9a55-4419-9e39-1fc71b1521f6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:48.759236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.759752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.760185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.771948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:48.782740 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] Creating event network-changed:5947eefc-9a55-4419-9e39-1fc71b1521f6 for instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 on n-h1-860864-13 Oct 28 17:41:48.785060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4002f1c-baf2-4441-bd50-9c2cd18e2226 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.357294 Oct 28 17:41:48.786502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1569/3243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:48 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:48.802476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8af23e4a-819e-4389-af71-d3e68e981d49 req-b1541cfe-2445-412a-9ba7-8bffed86a658 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061696 Oct 28 17:41:48.803109 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1675/3244] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:41:48.862586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:48.864267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 4b9e6f3c-8b01-4418-ac3d-3e781178b966] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:48.879297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.880688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.882045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.884954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:48.889636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:48.891954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:48.919443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 HTTP/1.1 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4b9e6f3c-8b01-4418-ac3d-3e781178b966'} Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:48.921726 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. Oct 28 17:41:48.926084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:48.928911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance 4b9e6f3c-8b01-4418-ac3d-3e781178b966 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:48.930624 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f75730f-47b6-45fb-bed8-62f3ba708b3c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966" status: 404 len: 111 microversion: 2.1 time: 0.073249 Oct 28 17:41:48.931797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1570/3245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:48 2022] GET /compute/v2.1/servers/4b9e6f3c-8b01-4418-ac3d-3e781178b966 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:48.951518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2164997f-92c8-4720-b92a-d7893b50e4ea tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f7524abb790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.005033 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2164997f-92c8-4720-b92a-d7893b50e4ea tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Image not found. Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2164997f-92c8-4720-b92a-d7893b50e4ea tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 HTTP/1.1 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2c5d38d2-59ab-4fe2-9fd5-a615798b08d3'} Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 to delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 could not be found. Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.009195 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2164997f-92c8-4720-b92a-d7893b50e4ea tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2164997f-92c8-4720-b92a-d7893b50e4ea tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3" status: 404 len: 62 microversion: 2.1 time: 0.073628 Oct 28 17:41:49.013587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1676/3246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:48 2022] DELETE /compute/v2.1/images/2c5d38d2-59ab-4fe2-9fd5-a615798b08d3 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:41:49.023856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.025072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:49.047001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.049278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.050908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.054027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.056198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.057672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.106389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 HTTP/1.1 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3a801a5c-9bc8-4109-aa5a-3adcf9320495'} Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:49.116422 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.124129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:49.126188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b9a1cde-7e7f-4080-a648-8f484f16fd17 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 404 len: 111 microversion: 2.1 time: 0.105137 Oct 28 17:41:49.133722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1571/3247] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:49 2022] DELETE /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:49.142441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.143973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: 3a801a5c-9bc8-4109-aa5a-3adcf9320495] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:49.150664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.151717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.152174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.152907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.153375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.153811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.174265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 HTTP/1.1 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3a801a5c-9bc8-4109-aa5a-3adcf9320495'} Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.180368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance 3a801a5c-9bc8-4109-aa5a-3adcf9320495 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d330f34-7461-41b9-9c42-57999b5bb1a5 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495" status: 404 len: 111 microversion: 2.1 time: 0.043749 Oct 28 17:41:49.185008 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1677/3248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:49 2022] GET /compute/v2.1/servers/3a801a5c-9bc8-4109-aa5a-3adcf9320495 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:41:49.191820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4274418e-86c8-4fd4-b3a3-a057ea0c3e2c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f752429d4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.216630 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4274418e-86c8-4fd4-b3a3-a057ea0c3e2c tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701527684" status: 202 len: 0 microversion: 2.1 time: 0.028907 Oct 28 17:41:49.218082 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1572/3249] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701527684 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:41:49.278540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.279420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:49.296017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.296841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.297513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.298442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.299076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.299695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.426703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:49.427472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:49.437274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.438706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.440046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:49.448185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:49.451189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:49.454120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:50.103139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:50.116243 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3734beb4-050d-4cd2-b68f-15c99c0d1182 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1474 microversion: 2.1 time: 0.840620 Oct 28 17:41:50.118021 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1678/3250] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:49 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1474 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:50.124248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:50.125106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:50.141720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:50.143190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:50.144681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:50.146373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:50.147977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:50.148612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:50.213785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:50.241780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a818b802-685a-406e-afba-41bae6020055 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.807064 Oct 28 17:41:50.245301 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1573/3251] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:49 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:50.728910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:50.742887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bb2c5f7-613b-46f8-937e-4fde2c9d053a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.623576 Oct 28 17:41:50.743519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1679/3252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:50 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:51.013691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ede4a2a-bcf3-4c92-b308-577bd9e1e996", "name": "network-vif-deleted", "tag": "93abd6ef-2a2d-4ed2-adaf-7060c13fe2df"}, {"server_uuid": "df39b6c1-c773-4c8e-b8f3-87a561bbde60", "name": "network-vif-deleted", "tag": "dd170404-9356-4571-bea2-ffe70c92544f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:51.023019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:51.028476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:51.046926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.047726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.051628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.085609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Creating event network-vif-deleted:93abd6ef-2a2d-4ed2-adaf-7060c13fe2df for instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 on n-h2-860864-13 Oct 28 17:41:51.088007 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] Creating event network-vif-deleted:dd170404-9356-4571-bea2-ffe70c92544f for instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 on n-h2-860864-13 Oct 28 17:41:51.094362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:51.096927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:51.112704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.113382 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0267bdf3-ba17-42ff-80cc-cba232b05e34 req-3355e5b8-9b18-4256-b89b-4cdfce9635c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103662 Oct 28 17:41:51.113953 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1574/3253] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:51.119728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.120574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.121565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.122275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.124578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.144857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:51.145718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:51.156278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.156766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.157202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.157903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.158349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.158768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.235658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.243902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.245958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.246984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lazy-loading 'fault' on Instance uuid df39b6c1-c773-4c8e-b8f3-87a561bbde60 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:41:51.270648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc8129e3-3a35-4bbc-9836-2f4bfe070eda tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.179480 Oct 28 17:41:51.276063 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1680/3254] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:41:51 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:41:51.282826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:51.284604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:51.293220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.294154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.294867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.295892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.296786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.297449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.469430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:51.504365 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0fdcef4-db04-4109-adb9-43b7f8199b85 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 200 len: 1309 microversion: 2.1 time: 0.363791 Oct 28 17:41:51.505763 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1575/3255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:51 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 1309 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:51.512230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:51.513886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:51.522816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.524232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.525030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.526433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.527998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.529375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.923886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:51.932858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e445bb15-6eb3-44c2-8cff-92d37e7a7a08 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.654424 Oct 28 17:41:51.933454 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1681/3256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:51 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:51.951723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:51.952633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:51.963570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.964946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.965632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:51.966583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:51.967256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:51.967934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.056706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:52.066858 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32c569ca-af59-4923-a327-ea54c709fc51 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1673 microversion: 2.1 time: 0.559149 Oct 28 17:41:52.067865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1576/3257] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:51 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1673 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:52.072944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54263906-7b21-4fbc-819a-52f71097287e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '.version_select at 0x7f751f86d1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.109455 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-54263906-7b21-4fbc-819a-52f71097287e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Image not found. Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54263906-7b21-4fbc-819a-52f71097287e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/866ca414-3680-41dc-abd1-0b4cca077cc1 HTTP/1.1 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '866ca414-3680-41dc-abd1-0b4cca077cc1'} Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 866ca414-3680-41dc-abd1-0b4cca077cc1 to delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 866ca414-3680-41dc-abd1-0b4cca077cc1 could not be found. Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.114767 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54263906-7b21-4fbc-819a-52f71097287e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54263906-7b21-4fbc-819a-52f71097287e tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/images/866ca414-3680-41dc-abd1-0b4cca077cc1" status: 404 len: 62 microversion: 2.1 time: 0.047424 Oct 28 17:41:52.120562 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1577/3258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] DELETE /compute/v2.1/images/866ca414-3680-41dc-abd1-0b4cca077cc1 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:41:52.128429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.128945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.166273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.166839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.167923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.168898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.169377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.170140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.196994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 HTTP/1.1 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7'} Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:52.198423 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d99dbc2b-c699-4762-8e14-850c277ba38f tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 404 len: 111 microversion: 2.1 time: 0.076597 Oct 28 17:41:52.202996 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1578/3259] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:52 2022] DELETE /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:52.209761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.210754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] [instance: e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.238687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.239185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.240926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.241706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.242221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.242682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.274316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] HTTP exception thrown: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Request method failure captured: Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 HTTP/1.1 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBPbeY1qdAEdEjtBNjQ3OLxbF70NOalrC3iyLRoEaP6CfJDY7CKCD3atyEdsXqA1l7LSOAqtXn5Fjp8G5xNNzyHWNqMZN42DwN8eoSveQR8kWjS2cJ_KbqqqizEUPAuRPV29V1dW5q4v0kz7NDxJtANzGOUMD_7Y6LQq7e4JKXaIjkU Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/617d7971a40643429240ed3e0fbb5093"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_617d7971a40643429240ed3e0fbb5093"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/617d7971a40643429240ed3e0fbb5093"}]}] Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 617d7971a40643429240ed3e0fbb5093 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7b923545f92c4290b55733dd4cc1c866 Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2039089592-project Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7'} Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.275858 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.281474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] Returning 404 to user: Instance e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:52.282341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1699875-c30a-40ec-a9af-c7ce8cd460a6 tempest-ImagesOneServerNegativeTestJSON-2039089592 tempest-ImagesOneServerNegativeTestJSON-2039089592-project] 10.222.0.48 "GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7" status: 404 len: 111 microversion: 2.1 time: 0.076382 Oct 28 17:41:52.286671 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1579/3260] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] GET /compute/v2.1/servers/e1eaaaa3-90a4-4ae6-8e99-2f3a6aec16b7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:52.292368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:52.312768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b65820a5-4503-45f3-80d6-e801dbda4e0c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.378148 Oct 28 17:41:52.313702 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1682/3261] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:51 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:52.533269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.533886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: df39b6c1-c773-4c8e-b8f3-87a561bbde60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.544740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.545239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.545682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.546388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.546839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.547267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.569401 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 HTTP/1.1 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'df39b6c1-c773-4c8e-b8f3-87a561bbde60'} Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.571573 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. Oct 28 17:41:52.576696 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.578891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance df39b6c1-c773-4c8e-b8f3-87a561bbde60 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:52.580125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-44654380-9c73-4b09-a782-d177d83e10d1 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60" status: 404 len: 111 microversion: 2.1 time: 0.051070 Oct 28 17:41:52.581302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1580/3262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] GET /compute/v2.1/servers/df39b6c1-c773-4c8e-b8f3-87a561bbde60 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:52.589408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.590171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: 6ede4a2a-bcf3-4c92-b308-577bd9e1e996] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.601432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.601924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.602361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.603074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.603535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.603972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.642867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 HTTP/1.1 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6ede4a2a-bcf3-4c92-b308-577bd9e1e996'} Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:52.644862 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. Oct 28 17:41:52.649711 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:52.650275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance 6ede4a2a-bcf3-4c92-b308-577bd9e1e996 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:52.652085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7d4d0c5f-62c9-4329-8f5b-7907debbc053 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996" status: 404 len: 111 microversion: 2.1 time: 0.066367 Oct 28 17:41:52.655757 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1683/3263] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] GET /compute/v2.1/servers/6ede4a2a-bcf3-4c92-b308-577bd9e1e996 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:52.661937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8ccc50e-5219-4958-8028-6f3ebdb11b06 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.693551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8ccc50e-5219-4958-8028-6f3ebdb11b06 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/9c1ae1a3-6450-437a-9e2a-84c50544cfb4" status: 204 len: 0 microversion: 2.1 time: 0.036053 Oct 28 17:41:52.694720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1581/3264] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:41:52 2022] DELETE /compute/v2.1/os-server-groups/9c1ae1a3-6450-437a-9e2a-84c50544cfb4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:52.703400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.703876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.711358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.712171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.712827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.714445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.715066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.715688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.750185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:41:52.894297 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-70d3d252-13cb-4a24-8802-ed9d13c4a24a tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 204 len: 0 microversion: 2.1 time: 0.195152 Oct 28 17:41:52.895327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1684/3265] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:41:52 2022] DELETE /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:41:52.905444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.906116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.923910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.924416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.924865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.925591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.931866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.932327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.957991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:52.959142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:52.983165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.984297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.985199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:52.988133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:52.989956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:52.991437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:53.005115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:54.397262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:54.409541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98e6e4db-c46a-404c-94d1-d8fcf11d6487 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 1.456557 Oct 28 17:41:54.417145 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1685/3266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:41:54.461207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:54.468623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:54.484950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:54.486619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:54.488265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:54.490831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:54.491907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:54.492801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:54.653215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:54.679496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-129ace20-c3dd-404e-a547-516db08cd914 tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1470 microversion: 2.1 time: 1.778558 Oct 28 17:41:54.685678 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1582/3267] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:52 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1470 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:54.701268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:54.704048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:54.714865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:54.715982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:54.716673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:54.717622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:54.718484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:54.719151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:55.054589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:55.067027 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03e1080e-974d-473c-9364-a54368b06878 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1673 microversion: 2.1 time: 0.634470 Oct 28 17:41:55.079932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1686/3268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:54 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1673 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:55.210895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:55.228605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ebaf2cc-34fb-4ad6-a89d-4483f50dbf00 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.541243 Oct 28 17:41:55.247217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1583/3269] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:54 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:55.442433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:55.443142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:55.455061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:55.455850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:55.456494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:55.457382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:55.464322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:55.467016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:55.810202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:55.824690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ace22666-52ee-4631-a386-20f02d24f7fe tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.387029 Oct 28 17:41:55.839811 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1687/3270] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:55 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:55.853188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:55.854205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:55.860867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:41:55.873203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:55.874182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:55.874790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:55.875943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:55.876559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:55.878490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:56.099314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1463236230", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "022add87-7cf6-4aa6-9cdc-3ce276d0fdee"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:56.229409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] validate_networks() for [('022add87-7cf6-4aa6-9cdc-3ce276d0fdee', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:41:56.418022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ec2fb62cf9e4361b829a3cff20435e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd416e1e7074e30b6b75e6da33cf49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:56.427428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8396f4d4-39af-4293-82e6-3161cbb3ad3b tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 200 len: 1470 microversion: 2.1 time: 0.586402 Oct 28 17:41:56.433308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1688/3271] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:55 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:56.448854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebde4b96-b9b7-43ff-9050-d15e3fda5cd3", "name": "network-vif-plugged", "status": "completed", "tag": "5947eefc-9a55-4419-9e39-1fc71b1521f6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:56.485699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:56.486189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:56.486745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:56.525418 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] Creating event network-vif-plugged:5947eefc-9a55-4419-9e39-1fc71b1521f6 for instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 on n-h1-860864-13 Oct 28 17:41:56.541404 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-aef52b7c-1594-4ffc-a979-2d85b9a74cee req-dd14d9c0-9aef-45b8-9de3-48be1b1ed029 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105275 Oct 28 17:41:56.552237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1689/3272] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:56.574722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:56.575777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:56.604737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:56.605715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:56.606314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:56.607199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:56.608160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:56.608963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.123767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:58.134565 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abb3af6c-ff8e-4e81-ba31-1097bb39dd8c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1678 microversion: 2.1 time: 1.579877 Oct 28 17:41:58.142526 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1690/3273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:56 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1678 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:58.166435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:58.167942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:58.184536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.185290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.187554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.189917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.191753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.193391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.516744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:41:58.517268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:41:58.517619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:41:58.519270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:41:58.519911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:41:58.534875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.535412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.535828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.536552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.545272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.546275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.670796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Getting quotas for project 0ac07d4c75cd4e178f6ed787c89cb40d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:41:58.688996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Getting quotas for user d38137b99444457fbd6d39c9efecff6a and project 0ac07d4c75cd4e178f6ed787c89cb40d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:41:58.754938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:41:58.757616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:41:58.850569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:58.866382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3b7700a-7682-48c9-82f6-490eae36cefa tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.708210 Oct 28 17:41:58.877815 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80ebf421-1ec2-40f2-9e9b-6a7954d20e54 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.167102 Oct 28 17:41:58.879440 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1584/3274] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:41:58.885012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:58.887160 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1691/3275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:58 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:58.888057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:58.896235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50f55cd-d45e-4efc-9a70-f5e2065e866e", "name": "network-vif-deleted", "tag": "73868f29-a1a3-435f-bdf9-58111447d35b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:41:58.917781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.928278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.929143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.952945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.953822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] Creating event network-vif-deleted:73868f29-a1a3-435f-bdf9-58111447d35b for instance b50f55cd-d45e-4efc-9a70-f5e2065e866e on n-h2-860864-13 Oct 28 17:41:58.961645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.963038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:58.976800 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-79443da7-e891-4475-a1b7-4b99820d3526 req-bcb52735-fd8e-4bfa-ab18-3f63dfe19810 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088167 Oct 28 17:41:58.977960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1692/3276] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:41:58.978480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:58.979101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:58.984945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:59.002439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:59.005972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] [instance: b50f55cd-d45e-4efc-9a70-f5e2065e866e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:59.025923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:59.043542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:59.044315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:59.047577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:59.048193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:59.050105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:59.112058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] HTTP exception thrown: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Request method failure captured: Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e HTTP/1.1 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBOSpJNjH76PFJc8tbVD_E-kiNbyGtrobNfmKHsGiP_kEvkAATvSbOOb0mLLVQotu2IysLe6YvBPKeJfSG-DBoY-dre6MTH_7TYM6dC1Xlosfi75ZJYT63bvboF7kcFBv919cp6632ThGfDxMF49K-e_pfIthtz_4n0JjoxS-VHjKic Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4bd416e1e7074e30b6b75e6da33cf49b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4bd416e1e7074e30b6b75e6da33cf49b"}]}] Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4bd416e1e7074e30b6b75e6da33cf49b Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1776836118 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8ec2fb62cf9e4361b829a3cff20435e3 Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersOnMultiNodesTest-1776836118-project Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b50f55cd-d45e-4efc-9a70-f5e2065e866e'} Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:41:59.113930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] Returning 404 to user: Instance b50f55cd-d45e-4efc-9a70-f5e2065e866e could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:41:59.118053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37a320d9-1d09-45a0-9269-9ecf892bebbe tempest-ServersOnMultiNodesTest-1776836118 tempest-ServersOnMultiNodesTest-1776836118-project] 10.222.0.48 "GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e" status: 404 len: 111 microversion: 2.1 time: 0.134864 Oct 28 17:41:59.129063 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1693/3277] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:58 2022] GET /compute/v2.1/servers/b50f55cd-d45e-4efc-9a70-f5e2065e866e => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:41:59.139526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18a90fa3-833e-4ddb-a863-de3d29c46d51 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:59.140526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18a90fa3-833e-4ddb-a863-de3d29c46d51 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:59.535892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-18a90fa3-833e-4ddb-a863-de3d29c46d51 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:41:59.556287 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18a90fa3-833e-4ddb-a863-de3d29c46d51 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1225 microversion: 2.1 time: 0.425152 Oct 28 17:41:59.565579 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1694/3278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:59 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1225 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:41:59.576735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:41:59.581687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:41:59.603235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:59.604206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:59.607012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:41:59.612900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:41:59.613660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:41:59.614322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:00.131958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:00.147177 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b0d2dc6-177b-4388-b012-5dbf8e736b7f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1678 microversion: 2.1 time: 0.578286 Oct 28 17:42:00.155128 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1695/3279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:59 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1678 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:00.160740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:00.173943 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8d179f5-1edc-4167-8bf7-61d9ad49fc10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 1.290972 Oct 28 17:42:00.178768 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1585/3280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:41:58 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:00.179484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:00.180321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:00.196433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:00.199976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:00.200477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:00.201231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:00.201703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:00.202144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:00.592441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:00.593674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:00.618005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:00.619026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:00.619770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:00.620980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:00.621680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:00.622345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:00.957349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:00.969072 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17f924f5-df67-4314-8deb-219c21f8b52f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1277 microversion: 2.1 time: 0.381322 Oct 28 17:42:00.995591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1586/3281] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:00 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1277 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:01.042691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:01.056171 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cad3fbf-0471-45d0-bc85-438a0880ad7e tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.898111 Oct 28 17:42:01.069480 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1696/3282] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:00 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:01.177464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:01.178257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:01.190937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:01.193225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:01.194708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:01.197047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:01.198357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:01.200254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:01.200535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:01.204312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:01.216160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:01.217012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:01.217635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:01.232705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:01.233608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:01.234466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:01.995352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:02.009867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2019138e-7072-4c79-a673-220b1f537603 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.815536 Oct 28 17:42:02.023404 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1697/3283] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:01 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:02.023404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:02.023404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:02.042901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:02.071827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e733bd75-73a3-4d6b-81c8-f20f3256cf38 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1678 microversion: 2.1 time: 0.898580 Oct 28 17:42:02.073502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1587/3284] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:01 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1678 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:02.117062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:02.117567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:02.118087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:02.118743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:02.119198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:02.133803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:02.148178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:02.149188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:02.176500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:02.178763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:02.180853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:02.181639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:02.182838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:02.183471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:02.486322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:02.499644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1c91ebb-03c6-465b-b462-37106e50388b tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1283 microversion: 2.1 time: 0.486842 Oct 28 17:42:02.503836 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1698/3285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:02 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1283 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:02.965920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:02.986305 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cfbea2ba-91b6-4616-a00d-d55f512c5b10 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.874703 Oct 28 17:42:02.987670 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1588/3286] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:02 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:03.044823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:03.045657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:03.053112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.071026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.071669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.072453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.075897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.075897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.106395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:03.107579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:03.124943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.125840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.126720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.127732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.128367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.128988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.610944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:03.624543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c77f7fb-b624-4368-b8d7-3bcb209d1de5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.523938 Oct 28 17:42:03.640053 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1589/3287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:03 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:03.650715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:03.655320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:03.669067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.670734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.671711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.672617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:03.673562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:03.675162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:03.698091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:03.711494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f95e1501-30ba-4c91-a470-aa48cf8b0f73 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 0.677886 Oct 28 17:42:03.712257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1699/3288] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:03 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:03.819877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:03.832534 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-456b9bc7-7dda-43f6-aca5-b182a6623f2f tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1283 microversion: 2.1 time: 0.190514 Oct 28 17:42:03.836388 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1590/3289] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:03 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:04.024577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:04.025982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:04.072673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.076266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.076996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:04.080090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.080759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.081362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:04.576486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:04.590776 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abcc6e50-280a-43ee-b7a3-3569dd588d44 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1322 microversion: 2.1 time: 0.582452 Oct 28 17:42:04.592307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1700/3290] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:04 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:04.736277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:04.737511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:04.753149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.755272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.756357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:04.757798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.760123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.762828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:04.864784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:04.865518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:04.880794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.881942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.882917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:04.886062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:04.888690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:04.889341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:05.981974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:05.993478 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99aacda8-a6e6-488e-aec8-828c82d91db7 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 1.133611 Oct 28 17:42:06.002649 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1701/3291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:04 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:06.015789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:06.018576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:06.044014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:06.051851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0893f126-de2f-4951-907c-7d6ca966a1c1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1521 microversion: 2.1 time: 1.319330 Oct 28 17:42:06.053040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.054365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.054816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.055620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.056080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.060581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1591/3292] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:04 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1521 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:06.075753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.314310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:06.328140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80ce208c-9087-46ad-bd27-5c21c2598114 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1472 microversion: 2.1 time: 0.323733 Oct 28 17:42:06.330294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1702/3293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:06 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:06.352521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:06.353343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:06.360698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.362357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.363148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.364121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.364739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.365329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.398216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:06.408641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lazy-loading 'flavor' on Instance uuid ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:06.524380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73499ed0-c57e-45c5-97a3-ac2e50e513de tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3/action" status: 202 len: 0 microversion: 2.1 time: 0.175202 Oct 28 17:42:06.526194 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1592/3294] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:06 2022] POST /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:42:06.534594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:06.535511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:06.546570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.547343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.548151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.549546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:06.550253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:06.550970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:06.928902 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d473f1f-325b-4914-9fa8-204f320be26d tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T17%3A42%3A06.750209&end=2022-10-29T17%3A42%3A06.750209" status: 404 len: 112 microversion: - time: 0.173709 Oct 28 17:42:06.929972 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1593/3295] 10.222.0.48 () {58 vars in 1316 bytes} [Fri Oct 28 17:42:06 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T17%3A42%3A06.750209&end=2022-10-29T17%3A42%3A06.750209 => generated 112 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 17:42:06.956376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21d5fd07-546a-4ad6-a97d-ac693288e9b9 tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] Calling method '.version_select at 0x7f75243bc3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:06.976851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-21d5fd07-546a-4ad6-a97d-ac693288e9b9 tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21d5fd07-546a-4ad6-a97d-ac693288e9b9 tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] Request method failure captured: Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-simple-tenant-usage/b31fe8ad142a4c1ca144b6c9449f0086?start=2022-10-29T17%3A42%3A06.750209&end=2022-10-27T17%3A42%3A06.750209 HTTP/1.1 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBRuGcUXcAvJhdj9lccJViHQGIzimDVc0mnIKE_kqB_twFS0uLOcbJ-EwCjAn4lA6Q0bCdxns9UHi9-pPNmgTxzl_KxI4j2Gge90UdKBzki0YoV-cBxDKBn8ZRqecjp9Av1n7BjN_oGST-9eEXDeWwZt71M0EqN0G9Hqb9c0z402MEo Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 3a01d1034b494bdcbfe31d494931852b Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-399667890 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a01d1034b494bdcbfe31d494931852b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3a01d1034b494bdcbfe31d494931852b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3a01d1034b494bdcbfe31d494931852b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3a01d1034b494bdcbfe31d494931852b"}]}] Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-399667890 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 3a01d1034b494bdcbfe31d494931852b Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-399667890 Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TenantUsagesNegativeTestJSON-399667890-project-admin Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a361f77bfad649cab9f9e60d461f3e5e Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-399667890-project-admin Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid start time. The start time cannot occur after the end time. Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b31fe8ad142a4c1ca144b6c9449f0086'} Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 28 17:42:06.988260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:06.994801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21d5fd07-546a-4ad6-a97d-ac693288e9b9 tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:06.994801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-21d5fd07-546a-4ad6-a97d-ac693288e9b9 tempest-TenantUsagesNegativeTestJSON-399667890 tempest-TenantUsagesNegativeTestJSON-399667890-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/b31fe8ad142a4c1ca144b6c9449f0086?start=2022-10-29T17%3A42%3A06.750209&end=2022-10-27T17%3A42%3A06.750209" status: 400 len: 111 microversion: 2.1 time: 0.053783 Oct 28 17:42:06.994801 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1594/3296] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Oct 28 17:42:06 2022] GET /compute/v2.1/os-simple-tenant-usage/b31fe8ad142a4c1ca144b6c9449f0086?start=2022-10-29T17%3A42%3A06.750209&end=2022-10-27T17%3A42%3A06.750209 => generated 111 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:42:07.125180 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-251d2228-f1ec-44a8-bd2c-adaf1d434880 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1633 microversion: 2.1 time: 0.595001 Oct 28 17:42:07.136129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1703/3297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:06 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1633 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:07.142305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:07.142929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:07.151872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.152393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.153227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:07.154127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.154748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.155619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:07.298850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-609404ed-cb57-44f8-a13a-28ce604bfe4a tempest-TenantUsagesNegativeTestJSON-384420562 tempest-TenantUsagesNegativeTestJSON-384420562-project] Calling method '.version_select at 0x7f752866f4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:07.310152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-609404ed-cb57-44f8-a13a-28ce604bfe4a tempest-TenantUsagesNegativeTestJSON-384420562 tempest-TenantUsagesNegativeTestJSON-384420562-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5082ed7c7b6a45e4a942d6df4e821e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31fe8ad142a4c1ca144b6c9449f0086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-609404ed-cb57-44f8-a13a-28ce604bfe4a tempest-TenantUsagesNegativeTestJSON-384420562 tempest-TenantUsagesNegativeTestJSON-384420562-project] Request method failure captured: Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T17%3A42%3A06.750209&end=2022-10-29T17%3A42%3A06.750209&detailed=1 HTTP/1.1 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBRtBjwtCRzMveGrfL3xPB5tH5GyUXtxnn2g6xI3igZm4coDWQzJobWH8Ct2ZVgKIOu_bftVIJ3jg6-Ll3KKh2L0gnCqr_j9-SJLml0d070hyTx2O-DR39dN5e0WTPfnxM8NpucqUVqwAwgndnqPge2VQdxCOMZVI24rqBIyLGOUmz4 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: b31fe8ad142a4c1ca144b6c9449f0086 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-384420562 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b31fe8ad142a4c1ca144b6c9449f0086"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b31fe8ad142a4c1ca144b6c9449f0086"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b31fe8ad142a4c1ca144b6c9449f0086"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b31fe8ad142a4c1ca144b6c9449f0086"}]}] Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-384420562 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: b31fe8ad142a4c1ca144b6c9449f0086 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-384420562 Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TenantUsagesNegativeTestJSON-384420562-project Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5082ed7c7b6a45e4a942d6df4e821e8f Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-384420562-project Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 17:42:07.313182 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-609404ed-cb57-44f8-a13a-28ce604bfe4a tempest-TenantUsagesNegativeTestJSON-384420562 tempest-TenantUsagesNegativeTestJSON-384420562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:07.319875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-609404ed-cb57-44f8-a13a-28ce604bfe4a tempest-TenantUsagesNegativeTestJSON-384420562 tempest-TenantUsagesNegativeTestJSON-384420562-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T17%3A42%3A06.750209&end=2022-10-29T17%3A42%3A06.750209&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.318497 Oct 28 17:42:07.323936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1595/3298] 10.222.0.48 () {58 vars in 1335 bytes} [Fri Oct 28 17:42:06 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T17%3A42%3A06.750209&end=2022-10-29T17%3A42%3A06.750209&detailed=1 => generated 123 bytes in 325 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:42:07.330533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:07.331276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:07.350527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:07.352892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.382370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.383152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:07.390021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.390905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.391565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:07.464409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:07.467900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:07.478813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e5eb023-9fa1-43c7-98e5-558407728703 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.340615 Oct 28 17:42:07.486081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1704/3299] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:07 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:07.756754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:07.773346 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49f5fe79-ce32-44b0-a0e7-bb33bab14156 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1501 microversion: 2.1 time: 0.451264 Oct 28 17:42:07.789840 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1596/3300] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:07 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1501 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:07.802152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:07.803945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:07.815530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.816689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.817391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:07.820356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:07.821431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:07.823777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.055441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:08.072735 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cadb9860-0977-4e62-aa82-019e9097a99a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1516 microversion: 2.1 time: 0.278469 Oct 28 17:42:08.074290 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1597/3301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:07 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:08.089148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25496c1-d133-4723-8932-24ca4618cc85", "tag": "f97429d5-3504-44aa-ad5a-b40f6db902ad"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:08.105792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1969143174", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "cde39a66-ed25-40a9-8c84-00dbf1f2d1a3"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:08.115738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:08.116292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:08.116742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.161617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] Creating event network-changed:f97429d5-3504-44aa-ad5a-b40f6db902ad for instance d25496c1-d133-4723-8932-24ca4618cc85 on n-h2-860864-13 Oct 28 17:42:08.177333 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a98698f2-da77-45f5-bfd6-8dfe226a4760 req-28266ec5-53e6-4e86-bbc9-7699133c6437 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099790 Oct 28 17:42:08.179502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1598/3302] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:08.197046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:08.199310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] validate_networks() for [('cde39a66-ed25-40a9-8c84-00dbf1f2d1a3', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:42:08.201602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 43840c11-39f8-4273-a982-1f05b3169b50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:08.207725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/43840c11-39f8-4273-a982-1f05b3169b50/action HTTP/1.1 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 14 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: {"rescue": {}} Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '43840c11-39f8-4273-a982-1f05b3169b50', 'body': {'rescue': {}}} Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:08.218227 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 404 to user: Instance 43840c11-39f8-4273-a982-1f05b3169b50 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:08.222643 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b751ad80-db59-4f80-80b2-9b0f809fd5ef tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/43840c11-39f8-4273-a982-1f05b3169b50/action" status: 404 len: 111 microversion: 2.1 time: 0.040804 Oct 28 17:42:08.223180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1599/3303] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:08 2022] POST /compute/v2.1/servers/43840c11-39f8-4273-a982-1f05b3169b50/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:42:08.239048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:08.242474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:08.258222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:08.259481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:08.260684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.262711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:08.263711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:08.267404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.596582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:08.736388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:08.825853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3999dfb4-eb2d-4d72-a778-533cb4930560 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1616 microversion: 2.1 time: 0.597403 Oct 28 17:42:08.839984 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1600/3304] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:08 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1616 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:08.852596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:08.853400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:08.861744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:08.862553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:08.863164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.864111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:08.864780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:08.865629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:08.976610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b3ae499-c3cf-4d29-9a41-494544e1689b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action" status: 202 len: 0 microversion: 2.1 time: 0.132929 Oct 28 17:42:08.987333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1601/3305] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:08 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:42:09.007034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:09.010833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:09.023712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.026603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.028218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.030403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.031089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.031777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.343235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:42:09.343743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:42:09.344307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:42:09.344762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:42:09.345281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:42:09.364183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.365058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.365674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.366583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.367196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.367813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.389204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Getting quotas for project 180695244f9c44378ded87aa783e9768. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:09.394745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Getting quotas for user 145ce0b15bbe44a7b8f575e647ce559f and project 180695244f9c44378ded87aa783e9768. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:09.411808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:42:09.414141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:42:09.484269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5de07bc5-1df0-4ef1-86d7-bb2bb4d093a1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.868225 Oct 28 17:42:09.488179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:09.488789 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1705/3306] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 17:42:09.497426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfadcd3b-03fc-4124-93f6-945eb3ae4ae8 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.506556 Oct 28 17:42:09.497973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:09.498134 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1602/3307] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:08 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:09.506142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:09.506755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:09.512744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:09.523386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.524118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.524829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.526127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.527231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.527910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.556847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.557926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.570019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.571236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:09.571745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:09.572178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:09.657553 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] HTTP exception thrown: Cannot 'migrate' instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 while it is in vm_state suspended Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Request method failure captured: Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3/action HTTP/1.1 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQw_7vqfVvxkmcSd-3G0UTKlYE699VhfYQEaO1qDd7J1tueksPPvlhjxmd577nGK_eJqFf2vOdyCDORbiP6XvHkX6FDmNM-Kv-ZDpN6H72QbX_-BB2GsB_Yak9eewG4YYOKX8bWR4gcml_gRgUdBaYpcBW7MwtyqqNVn0lsM5QIyMM Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f52250a4d844d4ea1c344f370449ec9"}]}] Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a4a2175e6b27404685a5e1b85275e424 Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: {"migrate": {}} Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'migrate' instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 while it is in vm_state suspended Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ebde4b96-b9b7-43ff-9050-d15e3fda5cd3', 'body': {'migrate': {}}} Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 in vm_state suspended. Cannot resize while the instance is in this state. Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:09.659219 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 while it is in vm_state suspended Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 while it is in vm_state suspended Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Returning 409 to user: Cannot 'migrate' instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 while it is in vm_state suspended {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3527bb55-a59d-4fa4-835f-ffe6558886f6 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3/action" status: 409 len: 148 microversion: 2.1 time: 0.170830 Oct 28 17:42:09.663251 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1706/3308] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:09 2022] POST /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3/action => generated 148 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:09.956180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:09.971168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e7865697-c866-4e7b-b53d-7be89f0011d4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1501 microversion: 2.1 time: 0.468516 Oct 28 17:42:09.974717 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1603/3309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:09 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1501 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:09.986270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:09.986996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.086972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Calling method '.version_select at 0x7f75245b2ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:10.096569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:10.114905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:10.116924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.117099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:10.117779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.118470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.119388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.120515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.121203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.122681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df7ea3da-2884-457d-b50c-9e0f0e661777 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1262 microversion: 2.26 time: 0.145233 Oct 28 17:42:10.123337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1604/3310] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:09 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1262 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:10.129425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d627bcb-e36c-48bd-9d4b-7dd2b05c3c91 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d627bcb-e36c-48bd-9d4b-7dd2b05c3c91 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Request method failure captured: Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action HTTP/1.1 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 39 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQw_7vqfVvxkmcSd-3G0UTKlYE699VhfYQEaO1qDd7J1tueksPPvlhjxmd577nGK_eJqFf2vOdyCDORbiP6XvHkX6FDmNM-Kv-ZDpN6H72QbX_-BB2GsB_Yak9eewG4YYOKX8bWR4gcml_gRgUdBaYpcBW7MwtyqqNVn0lsM5QIyMM Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f52250a4d844d4ea1c344f370449ec9"}]}] Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a4a2175e6b27404685a5e1b85275e424 Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: {"os-resetState": {"state": "invalid"}} Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3216d511-c2be-42f5-86ea-b4ed08c7c810', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:42:10.133725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 17:42:10.138499 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.140395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d627bcb-e36c-48bd-9d4b-7dd2b05c3c91 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:10.141469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d627bcb-e36c-48bd-9d4b-7dd2b05c3c91 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action" status: 400 len: 144 microversion: 2.1 time: 0.016898 Oct 28 17:42:10.142297 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1605/3311] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:10 2022] POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:42:10.151787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ea0aa2b-9e6e-4e37-bcb7-b91533b333d6 tempest-AbsoluteLimitsTestJSON-1502317103 tempest-AbsoluteLimitsTestJSON-1502317103-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.488767 Oct 28 17:42:10.153084 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1707/3312] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Oct 28 17:42:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:10.159322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a43758e-e9ce-4075-9236-31b19a93cedc tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a43758e-e9ce-4075-9236-31b19a93cedc tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Request method failure captured: Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action HTTP/1.1 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 31 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQw_7vqfVvxkmcSd-3G0UTKlYE699VhfYQEaO1qDd7J1tueksPPvlhjxmd577nGK_eJqFf2vOdyCDORbiP6XvHkX6FDmNM-Kv-ZDpN6H72QbX_-BB2GsB_Yak9eewG4YYOKX8bWR4gcml_gRgUdBaYpcBW7MwtyqqNVn0lsM5QIyMM Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f52250a4d844d4ea1c344f370449ec9"}]}] Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a4a2175e6b27404685a5e1b85275e424 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: {"os-resetState": {"state": 1}} Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3216d511-c2be-42f5-86ea-b4ed08c7c810', 'body': {'os-resetState': {'state': 1}}} Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 1 Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 17:42:10.166979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 17:42:10.173557 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.176028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a43758e-e9ce-4075-9236-31b19a93cedc tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:10.177106 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a43758e-e9ce-4075-9236-31b19a93cedc tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action" status: 400 len: 120 microversion: 2.1 time: 0.022620 Oct 28 17:42:10.177882 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1708/3313] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:10 2022] POST /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810/action => generated 120 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:42:10.194680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:10.196697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:10.199447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.199922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Failed to fetch instance by id 999 {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:42:10.200648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Request method failure captured: Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 37 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQw_7vqfVvxkmcSd-3G0UTKlYE699VhfYQEaO1qDd7J1tueksPPvlhjxmd577nGK_eJqFf2vOdyCDORbiP6XvHkX6FDmNM-Kv-ZDpN6H72QbX_-BB2GsB_Yak9eewG4YYOKX8bWR4gcml_gRgUdBaYpcBW7MwtyqqNVn0lsM5QIyMM Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f52250a4d844d4ea1c344f370449ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f52250a4d844d4ea1c344f370449ec9"}]}] Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6f52250a4d844d4ea1c344f370449ec9 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-809820116 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a4a2175e6b27404685a5e1b85275e424 Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-809820116-project-admin Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: {"os-resetState": {"state": "error"}} Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 999 could not be found. Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.208846 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:10.215181 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:10.215181 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 17:42:10.215181 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.216845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:10.217765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.219780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.223713 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-734c5c6c-a708-4b05-b5a6-9c562a79fa97 tempest-ServersAdminNegativeTestJSON-809820116 tempest-ServersAdminNegativeTestJSON-809820116-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027572 Oct 28 17:42:10.224443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.225707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.226385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.227775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.232662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1709/3314] 10.222.0.48 () {60 vars in 1179 bytes} [Fri Oct 28 17:42:10 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:10.242876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:10.243627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.256430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.257577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.258290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.259299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.259863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.261374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.283722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'flavor' on Instance uuid 63353499-8d0b-4b38-98d1-0a8a047ac115 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:10.299227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:42:10.314420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Cannot 'rescue' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state paused Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action HTTP/1.1 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 14 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: {"rescue": {}} Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'rescue' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state paused Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '63353499-8d0b-4b38-98d1-0a8a047ac115', 'body': {'rescue': {}}} Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 in vm_state paused. Cannot rescue while the instance is in this state. Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state paused Oct 28 17:42:10.323193 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state paused Oct 28 17:42:10.327769 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:10.331264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 409 to user: Cannot 'rescue' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state paused {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:10.333509 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b22360d9-8d37-4462-9ead-6055bbe3072c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action" status: 409 len: 144 microversion: 2.1 time: 0.181527 Oct 28 17:42:10.337462 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1606/3315] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:10 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action => generated 144 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:10.345913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:10.347194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.356965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.357469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.357999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.358724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.359182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.359797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.456728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4457b868-12fc-48fc-9f1a-3b7c7e72b198 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action" status: 202 len: 0 microversion: 2.1 time: 0.116777 Oct 28 17:42:10.462906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1607/3316] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:10 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:42:10.472328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:10.473622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.484523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.485759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.486510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.487763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.488695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.489458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.507456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2da79f9-7227-4c3a-967e-df2a5fea8529 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 204 len: 0 microversion: 2.1 time: 0.272677 Oct 28 17:42:10.513896 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1710/3317] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:42:10 2022] DELETE /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:42:10.529711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:10.533811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.548594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.551611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.552069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.552520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:10.553317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:10.554690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:10.925151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:10.940035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8cda9ac-05d9-4c65-95fe-b00399d4ea9c tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1469 microversion: 2.1 time: 0.420671 Oct 28 17:42:10.955690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1711/3318] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:10 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:10.973761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:10.974462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:10.995353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.000055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.000874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:11.013736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.015043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.015713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:11.112581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:11.124162 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c8d2e19-6f11-4f37-88fc-f6078db5c2ee tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1508 microversion: 2.1 time: 0.658265 Oct 28 17:42:11.145277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1608/3319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:10 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:11.164111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:11.165030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:11.188827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.189503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.190823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:11.192583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.194046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.194679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:11.431467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:11.457926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:11.460051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:11.470639 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8cb5a775-8e11-4019-a249-20721be16d95 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1258 microversion: 2.26 time: 0.320066 Oct 28 17:42:11.471801 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1609/3320] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:11 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1258 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:11.722064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:11.739779 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3d8484ea-20bb-4218-b6f8-13452ded0fce tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.778546 Oct 28 17:42:11.755395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1712/3321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:10 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:11.966203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:11.966817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:11.978010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.980436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.983776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:11.984769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:11.987006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:11.990602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.158431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:12.159070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:12.168286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.169103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.169718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.170968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.171646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.172276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.638861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:12.648363 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e063b31-3476-426f-8a46-3dddbec92332 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1516 microversion: 2.1 time: 0.495509 Oct 28 17:42:12.659509 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1713/3322] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:12 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1516 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:12.664805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:12.675434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:12.685496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.689744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.690845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.691810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.692444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.693025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.715159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:12.743489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aecca3e1-9b78-456c-bc80-a856be501a55 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1469 microversion: 2.1 time: 0.765699 Oct 28 17:42:12.744174 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1610/3323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:11 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1469 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:12.768640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:12.769558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:12.783168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.784766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.785104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.786517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:12.788363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:12.788832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:12.924854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:12.949605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:12.960334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:12.961703 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21a20c04-b3c5-49f1-a86c-e4186482cfe2 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1314 microversion: 2.26 time: 0.300847 Oct 28 17:42:12.966870 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1714/3324] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:12 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:13.616013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:13.624791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-461cd874-ce39-49c1-8b83-ff3725a248e0 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.860576 Oct 28 17:42:13.636136 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1611/3325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:12 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:13.786623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:13.787289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:13.799824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:13.803573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:13.807744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:13.808965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:13.811931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:13.815045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:13.823248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:14.031883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:14.033641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:14.034226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:14.035152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:14.038373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:14.039023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:14.039493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:14.112113 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3fa3710-4666-48cd-b98c-815175d09347 tempest-AZV2TestJSON-1056379399 tempest-AZV2TestJSON-1056379399-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.381257 Oct 28 17:42:14.131244 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1715/3326] 10.222.0.48 () {58 vars in 1164 bytes} [Fri Oct 28 17:42:13 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:42:14.149164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:14.152563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:14.171850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:14.175961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:14.178831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:14.179837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:14.182758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:14.183552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:15.079983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:15.094660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ba3c786-ae59-4d62-b027-42732caffd5d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1469 microversion: 2.1 time: 1.325327 Oct 28 17:42:15.095338 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1612/3327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:13 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1469 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:15.108875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:15.110011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:15.121085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:15.121954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:15.122701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:15.124182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:15.125870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:15.126375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:15.370339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:15.382414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:15.385061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:15.386776 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9974b21f-6737-4b61-8bfc-ee8932ae6300 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 1.253978 Oct 28 17:42:15.388018 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1716/3328] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:14 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:15.629458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:15.633058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:15.645896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:15.646399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:15.649648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:15.650341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:15.650825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:15.660028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:15.737909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'flavor' on Instance uuid 63353499-8d0b-4b38-98d1-0a8a047ac115 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:15.966726 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0245b399-b75b-478d-bd94-2ea26d01702f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action" status: 200 len: 32 microversion: 2.1 time: 0.341786 Oct 28 17:42:15.969676 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1717/3329] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:15 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:42:15.983458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:15.987074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:16.004947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.006251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.007915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.008872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.011304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.014107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.405719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:16.414241 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-159aae2d-8ca1-429d-b446-cc1652359aa2 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 1.316470 Oct 28 17:42:16.414840 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1613/3330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:15 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:16.430298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:16.431101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:16.446684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.455566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.456709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.457760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.458422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.459520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.708062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:16.725720 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e98d82d-b906-43a2-a9e4-53f4561413d5 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 200 len: 1427 microversion: 2.1 time: 0.296558 Oct 28 17:42:16.727268 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1614/3331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:16 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 1427 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:16.736465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25496c1-d133-4723-8932-24ca4618cc85", "name": "network-vif-plugged", "status": "completed", "tag": "f97429d5-3504-44aa-ad5a-b40f6db902ad"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:16.759989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.760983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.762313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.818785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] Creating event network-vif-plugged:f97429d5-3504-44aa-ad5a-b40f6db902ad for instance d25496c1-d133-4723-8932-24ca4618cc85 on n-h2-860864-13 Oct 28 17:42:16.831476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-18dd4177-c5fa-43da-af4c-b98ed8b95c4e req-eb88014b-44e7-4b49-ab7a-023a4bba3ac7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101260 Oct 28 17:42:16.832676 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1615/3332] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:16.849332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:16.851831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:16.870335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.872637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.873680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:16.876854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:16.877578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:16.880637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.359862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:17.377661 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b45b532-1816-405d-8f50-14511c985fac tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 1.403725 Oct 28 17:42:17.378314 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1718/3333] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:15 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:17.387559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebde4b96-b9b7-43ff-9050-d15e3fda5cd3", "name": "network-vif-deleted", "tag": "5947eefc-9a55-4419-9e39-1fc71b1521f6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:17.411800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.413418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.414201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.434864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] Creating event network-vif-deleted:5947eefc-9a55-4419-9e39-1fc71b1521f6 for instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 on n-h1-860864-13 Oct 28 17:42:17.445543 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c9f00617-bb12-4e71-b55e-18696c1a4a66 req-1162a93f-b45e-43ef-8f44-68f5ecbf0555 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064545 Oct 28 17:42:17.446840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1719/3334] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:17.454160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e1c1f6-c141-4e2d-b046-90ee3ffd93f7", "tag": "02a743ca-26ac-4f47-bfb7-268cf97fe7d1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:17.467755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.468690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.470867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.488306 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] Creating event network-changed:02a743ca-26ac-4f47-bfb7-268cf97fe7d1 for instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 on n-h1-860864-13 Oct 28 17:42:17.496277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-320f00ae-b8b9-42ae-a9a7-a4a0043229fd req-e4548c95-3ca6-422a-ac6b-363d90993d7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046052 Oct 28 17:42:17.497785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1720/3335] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:17.507083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:17.508688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:17.518179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.520349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.522483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.523688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.524495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.525264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.570452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:17.586919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:17.588981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:17.590187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6d8f5a2-a7db-49e6-9629-4aae88d60d58 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.754865 Oct 28 17:42:17.592456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1616/3336] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:16 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:17.759181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:17.760172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: ebde4b96-b9b7-43ff-9050-d15e3fda5cd3] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:17.774679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.775617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.776473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.777769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.780550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.781232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.803748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] HTTP exception thrown: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Request method failure captured: Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 HTTP/1.1 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQvPg3ZcGGVmOwPJBOrHWB1itMfooiKJXQotDdSUmbol6PQuQvc9hqOVguH6iq-jwNGe-2XKG-suFNtIGJXROZI7TMKXgBnBdNaaa__8csXPzJF6lU7yrCnPV0OBKS_ML866T7u92CJ9xzrU_ayemvsSlugYpZ0LBqBWf8IxhMGgXk Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7afaa10d89b64e7db02e37552dd67684 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7afaa10d89b64e7db02e37552dd67684"}]}] Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7afaa10d89b64e7db02e37552dd67684 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-688719268-project Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 1119173fa2c9420d89a18d9bcb96689b Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-688719268-project Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ebde4b96-b9b7-43ff-9050-d15e3fda5cd3'} Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:17.805411 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Returning 404 to user: Instance ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-753ba289-59b7-4aa0-95ca-09b64aa64295 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3" status: 404 len: 111 microversion: 2.1 time: 0.056409 Oct 28 17:42:17.811799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1617/3337] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:17 2022] GET /compute/v2.1/servers/ebde4b96-b9b7-43ff-9050-d15e3fda5cd3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:42:17.842615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:17.843103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:17.865101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:17.868997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.869497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.870232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.871869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:17.872407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:17.872900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:17.883119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2dfdf11-2b86-4aa4-8d47-1ee9d3961913 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.383588 Oct 28 17:42:17.886278 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1721/3338] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:17 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:17.906966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:42:18.076289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3217f11a-ed18-4d0b-913c-9548766390b3 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 204 len: 0 microversion: 2.1 time: 0.240484 Oct 28 17:42:18.077874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1618/3339] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:42:17 2022] DELETE /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:42:18.087616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:18.089047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:18.100625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.103902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.104760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.107792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.108594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.108988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.404039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:18.406802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:18.408986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:18.419006 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8505671-a845-43f6-be94-a80fe845e01a tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1477 microversion: 2.1 time: 0.336887 Oct 28 17:42:18.421696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.435394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1722/3340] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:18 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:18.435624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.435624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.435624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.435624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.435624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.619060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:18.621310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:18.633819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.634324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.634759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.638059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:18.638547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:18.638977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:18.707345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:18.816070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:18.846011 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f931d9d-a5ff-48ca-b757-39bfde875b16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.446551 Oct 28 17:42:18.864170 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1619/3341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:18 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:18.886258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf5eb964-39f2-44b3-adfb-b89c14548108 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Action: 'create', calling method: .version_select at 0x7f752423e940>, body: {"keypair": {"name": "tempest-keypair-1706237274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4YmsHD0NW19EkT37IfB4+x+/BlCaIC5MrUUb2OdPpZ2rhV9R5rd4gozlXoZl+rjn6B8aqQ/f8spDagMkS0sAEUZGG4l/tK7YkIrL6FvWA2NIoZRU25td51gFIGnrVqZg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:18.912312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-bf5eb964-39f2-44b3-adfb-b89c14548108 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Getting quotas for project 67b880bf735045c6867c0b9b685d4ecf. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:18.923736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-bf5eb964-39f2-44b3-adfb-b89c14548108 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Getting quotas for user 6b786518922243a5a98472bfc538ed29 and project 67b880bf735045c6867c0b9b685d4ecf. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:18.963071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf5eb964-39f2-44b3-adfb-b89c14548108 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.097520 Oct 28 17:42:18.964798 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1620/3342] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:42:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:42:18.978209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:18.980392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:18.999771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.000937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.001622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.005061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.005977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.006684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.085359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:19.101656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:19.113309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:19.121194 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45b2af2e-3dbb-411a-8488-5521540a5b62 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.505226 Oct 28 17:42:19.122505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1723/3343] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:18 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:19.463028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:19.465478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:19.484636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:19.493402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.495406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.495540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1603954-673f-4b3b-9ef9-8aa5e069cdad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1325 microversion: 2.1 time: 0.527447 Oct 28 17:42:19.496227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.496846 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1621/3344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:18 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1325 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:19.521828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.522819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.523541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.882023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:19.882766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:19.885966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:19.892228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.893110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.893656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.894603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:19.895223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:19.895515 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75050e08-e059-48de-8234-d3aa80a97fac tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1477 microversion: 2.1 time: 0.449606 Oct 28 17:42:19.911117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:19.912767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1724/3345] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:19 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:20.139273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:20.150701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:20.152416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:20.152738 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cab14432-0b0b-45b5-ace3-cfeeeee2b0ed tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.278466 Oct 28 17:42:20.153339 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1622/3346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:19 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:20.155497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:20.160972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.172328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.172885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:20.173724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.174264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.174762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:20.525002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:20.525986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:20.536700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.537528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.538219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:20.539245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.539950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.541229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:20.808234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:20.824368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:20.829681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:20.832631 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00dcb300-925f-4ed8-b856-2435a44a64f8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.686305 Oct 28 17:42:20.840341 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1725/3347] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:20 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:20.846435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb5d8a8a-687b-422e-a166-1333a06aac82 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f752469cf70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:20.915690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb5d8a8a-687b-422e-a166-1333a06aac82 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1c19046f-95fb-4427-aec6-dadef15e594d" status: 200 len: 351 microversion: 2.1 time: 0.074119 Oct 28 17:42:20.917096 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1726/3348] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:42:20 2022] GET /compute/v2.1/os-volumes/1c19046f-95fb-4427-aec6-dadef15e594d => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:20.933753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:20.934548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:20.938456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:20.947152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.958317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.966906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:20.967746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:20.968246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:20.968690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.134765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:21.149688 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-377b5328-8bfe-43ed-978b-c685968cab44 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1521 microversion: 2.1 time: 0.629709 Oct 28 17:42:21.155340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1623/3349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:20 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:21.177140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:21.178285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:21.189910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.191449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.193118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.193871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.194320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.195014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.351406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:21.374206 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ffbaa87-df84-4e3f-aa65-3b4cc586f56d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1477 microversion: 2.1 time: 0.455785 Oct 28 17:42:21.375055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1727/3350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:20 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:21.386829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:21.388029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:21.396142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.398253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.399011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.400142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.400651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.402674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.433807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] HTTP exception thrown: Instance is not a member of specified network Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Request method failure captured: Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85/ips/invalid HTTP/1.1 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBRjKnXjcPuMeIIajhL3oA64gAW1ClUwMXadzS_NNCXC0Nz4DuW8tyScU4j-rFRRzM-eMjJRZGnhpCxKwOBnU8PerNGFJkWO3Pf48GYpWB_0h2G8i6dyWzMf4kx8fCTCmbrsMSMcjzbI3yJL9w8aaemXm7Vl5ThdZEITZjDb_UJWBxM Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ac07d4c75cd4e178f6ed787c89cb40d"}]}] Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d38137b99444457fbd6d39c9efecff6a Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance is not a member of specified network Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': 'd25496c1-d133-4723-8932-24ca4618cc85', 'id': 'invalid'} Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 28 17:42:21.445329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.450085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:21.450199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b27e1081-9237-4e79-8cff-f5e839572618 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.072915 Oct 28 17:42:21.451319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1728/3351] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:42:21 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85/ips/invalid => generated 91 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:21.457467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-911321316", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7b023f74-b0a8-421b-a991-01b736a3d32c"}, {"port": "5284497a-6c0c-4edf-850e-e36915f72749", "tag": "port-1"}, {"port": "e9c4923c-4e52-4880-812a-744639bff60d", "tag": "port-2"}, {"uuid": "7ebdf96b-83b0-4cbd-b5f7-3c82f2726d17", "tag": "net-1"}, {"uuid": "7ebdf96b-83b0-4cbd-b5f7-3c82f2726d17"}, {"uuid": "4d27fbfd-ae8e-4114-8738-5c92102971d2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4d27fbfd-ae8e-4114-8738-5c92102971d2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8bcebcf9-f4b6-45c8-a507-047adee3a63f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6623527e-6efa-4889-95b2-0cc52e1f4cd9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "19ed9d94-beda-4245-b83e-8c96b405559c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--316789450"}], "key_name": "tempest-keypair-1706237274", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:21.484197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:21.491870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e058be5-8f0b-4f7c-b518-d358d95d2986 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.320494 Oct 28 17:42:21.492443 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1624/3352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:21 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:21.500161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:21.500644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Failed to fetch instance by id 999 {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:42:21.501147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] HTTP exception thrown: Instance 999 could not be found. Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Request method failure captured: Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBRjKnXjcPuMeIIajhL3oA64gAW1ClUwMXadzS_NNCXC0Nz4DuW8tyScU4j-rFRRzM-eMjJRZGnhpCxKwOBnU8PerNGFJkWO3Pf48GYpWB_0h2G8i6dyWzMf4kx8fCTCmbrsMSMcjzbI3yJL9w8aaemXm7Vl5ThdZEITZjDb_UJWBxM Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ac07d4c75cd4e178f6ed787c89cb40d"}]}] Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d38137b99444457fbd6d39c9efecff6a Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 999 could not be found. Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '999'} Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 17:42:21.502897 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:21.509063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:21.509063 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a657005-7244-4ba5-bdef-714b299fcaad tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007791 Oct 28 17:42:21.509063 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1625/3353] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:42:21 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:21.524016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:21.524875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:21.534122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.534620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.535711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.536472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.536939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.537371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.574656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:42:21.619004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] validate_networks() for [('7b023f74-b0a8-421b-a991-01b736a3d32c', None, None, None, None, None), (None, None, '5284497a-6c0c-4edf-850e-e36915f72749', None, None, None), (None, None, 'e9c4923c-4e52-4880-812a-744639bff60d', None, None, None), ('7ebdf96b-83b0-4cbd-b5f7-3c82f2726d17', None, None, None, None, None), ('7ebdf96b-83b0-4cbd-b5f7-3c82f2726d17', None, None, None, None, None), ('4d27fbfd-ae8e-4114-8738-5c92102971d2', '10.2.2.100', None, None, None, None), ('4d27fbfd-ae8e-4114-8738-5c92102971d2', '10.2.2.200', None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:42:21.777109 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e46423b2-8b8a-4f21-9644-51d062c16c4c tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 204 len: 0 microversion: 2.1 time: 0.258259 Oct 28 17:42:21.780249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1626/3354] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:42:21 2022] DELETE /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:42:21.803238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:21.810020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:21.817579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.818384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.819067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:21.823182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:21.824001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:21.825265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:22.435313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:22.445320 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a354c815-0020-45b0-9d0a-739e2e6ddb45 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1527 microversion: 2.1 time: 0.660514 Oct 28 17:42:22.445921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1627/3355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:21 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1527 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:22.460661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:22.461283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:22.476345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:22.483433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:22.483433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:22.483433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:22.483433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:22.483433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:22.903518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:22.909769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:22.917946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:22.920015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:22.922218 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3865e3b6-97f2-4895-bcec-84eb115e8823 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.468999 Oct 28 17:42:22.929414 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1628/3356] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:22 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:22.936781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:22.937608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:22.955757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:22.957369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:22.958066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:22.959601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:22.960740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:22.962274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:23.416378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1119173fa2c9420d89a18d9bcb96689b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afaa10d89b64e7db02e37552dd67684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:23.439494 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ddcbb31c-4ea3-47c0-b415-eab6b310be4d tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 200 len: 1477 microversion: 2.1 time: 0.496344 Oct 28 17:42:23.441351 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1629/3357] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:22 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 1477 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:23.449238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:23.449852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:23.456186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:23.457906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:23.458356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:23.459070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:23.459560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:23.459988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.065442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:24.418207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:24.427053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91c20189-5b71-46f1-8399-3c3a63f4a2cc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.984672 Oct 28 17:42:24.427878 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1630/3358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:23 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:24.437270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:24.438294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:24.450577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.451200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.451518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.452297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.452927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.453304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.490287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.490770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.491206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.491683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lazy-loading 'fault' on Instance uuid d25496c1-d133-4723-8932-24ca4618cc85 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:24.589160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd38137b99444457fbd6d39c9efecff6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac07d4c75cd4e178f6ed787c89cb40d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:24.608954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-524f33ff-0c11-4a81-b476-49fdef41e714 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 200 len: 1315 microversion: 2.1 time: 0.176013 Oct 28 17:42:24.610645 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1631/3359] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:24 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:24.618217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e74393b7-0e52-4a39-b4c2-4813de10b056 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f75242da160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:24.682313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e74393b7-0e52-4a39-b4c2-4813de10b056 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1caaa720-1eb0-49e3-be23-9effc3514f7d" status: 200 len: 349 microversion: 2.1 time: 0.069848 Oct 28 17:42:24.682616 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1632/3360] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:42:24 2022] GET /compute/v2.1/os-volumes/1caaa720-1eb0-49e3-be23-9effc3514f7d => generated 349 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:24.687235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3216d511-c2be-42f5-86ea-b4ed08c7c810", "name": "network-vif-deleted", "tag": "d6cb231f-3c3a-4b70-b682-a1b7076b581f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:24.701241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.701760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.702727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.721626 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] Creating event network-vif-deleted:d6cb231f-3c3a-4b70-b682-a1b7076b581f for instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 on n-h1-860864-13 Oct 28 17:42:24.732108 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-02fbdb6f-86b0-4ebb-b56b-e7f3ad7d491b req-87de681b-1728-4e0d-8b34-74438622733c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048041 Oct 28 17:42:24.733437 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1633/3361] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:24.743417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25496c1-d133-4723-8932-24ca4618cc85", "name": "network-vif-deleted", "tag": "f97429d5-3504-44aa-ad5a-b40f6db902ad"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:24.767668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.769731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.772299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.788651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] Creating event network-vif-deleted:f97429d5-3504-44aa-ad5a-b40f6db902ad for instance d25496c1-d133-4723-8932-24ca4618cc85 on n-h2-860864-13 Oct 28 17:42:24.795513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7f766529-1b27-40d2-b457-55cae9455d56 req-46c83bab-1b51-479e-bd6c-f63d966cdd4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059606 Oct 28 17:42:24.796384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1634/3362] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:24.805683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:24.807674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:24.813793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.814295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.814735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:24.815471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:24.816230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:24.816854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:25.407349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:25.436766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:25.446467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:25.451851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5dc1ee5b-7c9f-4f17-b4b9-dbdb67004ce5 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.651899 Oct 28 17:42:25.453954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1635/3363] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:24 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:25.467142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:25.468090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] [instance: 3216d511-c2be-42f5-86ea-b4ed08c7c810] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:25.476589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:25.484623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:25.485778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:25.487133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:25.488442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:25.489494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:25.490218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:25.554682 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] HTTP exception thrown: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Request method failure captured: Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 HTTP/1.1 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQvPg3ZcGGVmOwPJBOrHWB1itMfooiKJXQotDdSUmbol6PQuQvc9hqOVguH6iq-jwNGe-2XKG-suFNtIGJXROZI7TMKXgBnBdNaaa__8csXPzJF6lU7yrCnPV0OBKS_ML866T7u92CJ9xzrU_ayemvsSlugYpZ0LBqBWf8IxhMGgXk Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7afaa10d89b64e7db02e37552dd67684 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7afaa10d89b64e7db02e37552dd67684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7afaa10d89b64e7db02e37552dd67684"}]}] Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7afaa10d89b64e7db02e37552dd67684 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-688719268 Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-688719268-project Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 1119173fa2c9420d89a18d9bcb96689b Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-688719268-project Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3216d511-c2be-42f5-86ea-b4ed08c7c810'} Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:25.558762 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. Oct 28 17:42:25.565476 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:25.576787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] Returning 404 to user: Instance 3216d511-c2be-42f5-86ea-b4ed08c7c810 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:25.576787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-416c58c9-f192-438b-b0c6-956093f3bd94 tempest-ServersAdminNegativeTestJSON-688719268 tempest-ServersAdminNegativeTestJSON-688719268-project] 10.222.0.48 "GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810" status: 404 len: 111 microversion: 2.1 time: 0.118081 Oct 28 17:42:25.576787 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1636/3364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:25 2022] GET /compute/v2.1/servers/3216d511-c2be-42f5-86ea-b4ed08c7c810 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:42:25.587844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:25.588465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:25.607279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:25.609466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:25.610695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:25.612426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:25.614269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:25.616908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:25.995776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:26.009662 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1da0b64-506a-4551-baea-72d09761a93c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.433474 Oct 28 17:42:26.010821 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1637/3365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:25 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:26.029120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1c1f6-c141-4e2d-b046-90ee3ffd93f7", "name": "network-vif-plugged", "status": "completed", "tag": "02a743ca-26ac-4f47-bfb7-268cf97fe7d1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:26.045677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:26.046497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:26.047156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:26.065289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] Creating event network-vif-plugged:02a743ca-26ac-4f47-bfb7-268cf97fe7d1 for instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 on n-h1-860864-13 Oct 28 17:42:26.070849 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a8e7d93c-95b0-4239-b862-276c600459f3 req-4ef4e350-980f-40a5-a6ea-a6240e02ac9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058528 Oct 28 17:42:26.074612 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1638/3366] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:26.082457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:26.083164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] [instance: d25496c1-d133-4723-8932-24ca4618cc85] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:26.091471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:26.091974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:26.092412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:26.093684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:26.094226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:26.094719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:26.113949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] HTTP exception thrown: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Request method failure captured: Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 HTTP/1.1 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBRjKnXjcPuMeIIajhL3oA64gAW1ClUwMXadzS_NNCXC0Nz4DuW8tyScU4j-rFRRzM-eMjJRZGnhpCxKwOBnU8PerNGFJkWO3Pf48GYpWB_0h2G8i6dyWzMf4kx8fCTCmbrsMSMcjzbI3yJL9w8aaemXm7Vl5ThdZEITZjDb_UJWBxM Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ac07d4c75cd4e178f6ed787c89cb40d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ac07d4c75cd4e178f6ed787c89cb40d"}]}] Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 0ac07d4c75cd4e178f6ed787c89cb40d Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-739670957 Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d38137b99444457fbd6d39c9efecff6a Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-739670957-project Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'd25496c1-d133-4723-8932-24ca4618cc85'} Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:26.115999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. Oct 28 17:42:26.120677 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:26.123802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] Returning 404 to user: Instance d25496c1-d133-4723-8932-24ca4618cc85 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:26.125673 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cacfb693-2222-497a-880d-6ce6443bc313 tempest-ServerAddressesNegativeTestJSON-739670957 tempest-ServerAddressesNegativeTestJSON-739670957-project] 10.222.0.48 "GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85" status: 404 len: 111 microversion: 2.1 time: 0.048302 Oct 28 17:42:26.126604 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1639/3367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:26 2022] GET /compute/v2.1/servers/d25496c1-d133-4723-8932-24ca4618cc85 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:42:26.484919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:26.485567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:26.492133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:26.492622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:26.493711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:26.494428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:26.494906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:26.502371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:26.838043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:26.851708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:26.854835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:26.857984 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c467490-a11f-45b8-a4fd-1261bac9cce7 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1362 microversion: 2.26 time: 0.379702 Oct 28 17:42:26.863705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1640/3368] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:26 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:27.036820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:27.037831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:27.048117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:27.048815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:27.049421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:27.053245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:27.053892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:27.054504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:27.480540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:42:27.481115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:42:27.481115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:42:27.481546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:42:27.481953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:42:27.492349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:27.493557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:27.494411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:27.495575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:27.496519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:27.497180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:27.497786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:27.503745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4a41b1a-1a03-49e0-bb2f-2a64b7115ad9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.470801 Oct 28 17:42:27.506901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1641/3369] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:27 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:27.519246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Getting quotas for project 67b880bf735045c6867c0b9b685d4ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:27.520531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9a9fd8d-f5a7-4f8a-ac97-7d1f46e165f5 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f75240b94c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:27.525410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Getting quotas for user 6b786518922243a5a98472bfc538ed29 and project 67b880bf735045c6867c0b9b685d4ecf. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:27.606291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9a9fd8d-f5a7-4f8a-ac97-7d1f46e165f5 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/655e9680-7e50-42d9-8cb9-2cf286a8dc1c" status: 200 len: 351 microversion: 2.1 time: 0.093752 Oct 28 17:42:27.608309 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1642/3370] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:42:27 2022] GET /compute/v2.1/os-volumes/655e9680-7e50-42d9-8cb9-2cf286a8dc1c => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:27.826407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:42:27.837703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8bcebcf9-f4b6-45c8-a507-047adee3a63f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6623527e-6efa-4889-95b2-0cc52e1f4cd9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19ed9d94-beda-4245-b83e-8c96b405559c',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:42:27.920922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-653564207", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:28.014854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:42:28.525536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3911c3b-a5d7-4f58-a1c3-9553b322fc95 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.072327 Oct 28 17:42:28.532552 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1729/3371] 10.222.0.48 () {62 vars in 1189 bytes} [Fri Oct 28 17:42:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 7079 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:42:28.550118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7c5f3a92-39a4-4eb7-a477-22ff946649b1 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f7524137550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:28.746114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7c5f3a92-39a4-4eb7-a477-22ff946649b1 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210900 Oct 28 17:42:28.747347 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1730/3372] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Oct 28 17:42:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:28.754172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:28.755077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:28.772846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:28.773676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:28.774417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:28.775316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:28.776494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:28.777942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:28.934235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:29.504231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:42:29.505204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:42:29.506005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:42:29.506848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:42:29.507522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:42:29.526822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:29.528511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:29.531686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:29.536133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:29.538799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:29.539677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:29.601305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:29.607926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:29.616441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:29.618361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:29.622590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:29.624047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-780a600d-6939-43c2-929d-4bd121c34c68 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1546 microversion: 2.26 time: 0.875432 Oct 28 17:42:29.624817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1731/3373] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:28 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1546 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:29.629582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:29.630421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:29.639441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:29.640184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:29.640813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:29.641705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:29.648888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:29.649524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:29.659585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:42:29.662308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:42:29.826126 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5174f7d4-074f-48a4-99cb-145be6b001bf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214225 Oct 28 17:42:29.827401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1643/3374] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:42:29.845832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:29.859890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:29.967910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:29.984564 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c08da87a-f740-4ff7-b2ef-044c6ba2a0d5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.358413 Oct 28 17:42:29.986519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1732/3375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:29 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:30.005694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2eff63f-1589-4a6d-beae-48e10df7fdd4 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f752424ff70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.086610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:30.101614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:30.106975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:30.108773 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28868b49-bd1b-4597-8cfd-1cd1b70f71d4 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1285 microversion: 2.32 time: 0.279982 Oct 28 17:42:30.141217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1644/3376] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:29 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1285 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:30.152107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f752423e310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.203738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.209500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.211069 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2eff63f-1589-4a6d-beae-48e10df7fdd4 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.222089 Oct 28 17:42:30.215564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.215771 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1733/3377] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Oct 28 17:42:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:30.215876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:30.220930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3395b334-a39f-4a1f-a2b4-f0f250f51ba5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.221816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3395b334-a39f-4a1f-a2b4-f0f250f51ba5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:30.226841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.233721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.235265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.237159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.240487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.241203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.323256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.325861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.327092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.357849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3395b334-a39f-4a1f-a2b4-f0f250f51ba5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:30.375807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.376303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.376745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.381822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3395b334-a39f-4a1f-a2b4-f0f250f51ba5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1207 microversion: 2.1 time: 0.165730 Oct 28 17:42:30.383845 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1734/3378] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1207 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:30.396686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a7167be-7677-427e-8640-6b3ab744e4fa tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f752424fe50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.492682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:30.544421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ecba005-8bbf-4405-93cf-1e29e8568ceb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-462392112" status: 201 len: 0 microversion: 2.26 time: 0.401650 Oct 28 17:42:30.545416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1645/3379] 10.222.0.48 () {62 vars in 1377 bytes} [Fri Oct 28 17:42:30 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-462392112 => generated 0 bytes in 403 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 17:42:30.555649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71c48c7c-8169-4cff-87ca-fb28bca61ed8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f751f754ee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.575336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71c48c7c-8169-4cff-87ca-fb28bca61ed8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.576170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71c48c7c-8169-4cff-87ca-fb28bca61ed8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.576804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71c48c7c-8169-4cff-87ca-fb28bca61ed8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.608647 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a7167be-7677-427e-8640-6b3ab744e4fa tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.222728 Oct 28 17:42:30.611628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1735/3380] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:30.626029 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71c48c7c-8169-4cff-87ca-fb28bca61ed8 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-462392112" status: 204 len: 0 microversion: 2.26 time: 0.074453 Oct 28 17:42:30.629532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f41ef25-18da-47b6-86b9-29ac3f3728f1 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f75286f0700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.634324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1646/3381] 10.222.0.48 () {60 vars in 1358 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-462392112 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:42:30.644197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f75240b91f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.673999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.689826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.691284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.692031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:30.709116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.709644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.710109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.711075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.711759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.712547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.755673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.758326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.759250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.782731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:30.811870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f41ef25-18da-47b6-86b9-29ac3f3728f1 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.192231 Oct 28 17:42:30.812954 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1736/3382] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:30.816397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6a00049-8c61-4d24-8894-813521b076a9 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 204 len: 0 microversion: 2.26 time: 0.176516 Oct 28 17:42:30.817021 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1647/3383] 10.222.0.48 () {60 vars in 1295 bytes} [Fri Oct 28 17:42:30 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:42:30.830785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6676680-4181-4ec6-aebb-266f14291666 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f751faf7280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.849964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8bece044-2274-4dcc-9329-98a52072cbb3 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f752434a0d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.888393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bece044-2274-4dcc-9329-98a52072cbb3 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.889248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bece044-2274-4dcc-9329-98a52072cbb3 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.889905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bece044-2274-4dcc-9329-98a52072cbb3 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.915215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8bece044-2274-4dcc-9329-98a52072cbb3 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 12 microversion: 2.26 time: 0.072021 Oct 28 17:42:30.922142 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1648/3384] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 12 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:30.927265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f75242fe430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:30.938671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.939431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.939959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.940440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:30.949579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.950072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.950510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:30.951225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:30.951715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:30.952608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.008476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.009385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.010733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.040878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.043519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.044356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.063530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6676680-4181-4ec6-aebb-266f14291666 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.237815 Oct 28 17:42:31.064616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1737/3385] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:42:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:31.070709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.075783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:31.081016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:31.089326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.093627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.094468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.096309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.097757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.100694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.153779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:31.190316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-382d2f1f-aa90-42ce-8221-18746b4a7bdb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-412613057" status: 201 len: 0 microversion: 2.26 time: 0.266968 Oct 28 17:42:31.196838 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1649/3386] 10.222.0.48 () {62 vars in 1377 bytes} [Fri Oct 28 17:42:30 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-412613057 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 17:42:31.202741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-079dccde-cb40-4236-8409-485e80fc08df tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f75248894c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.390085 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-079dccde-cb40-4236-8409-485e80fc08df tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.191616 Oct 28 17:42:31.391490 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1650/3387] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:31.405398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.406017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:31.422075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.422574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.423287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.424859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.425648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.426307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.535586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:31.548610 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c3f75f9-c88f-4ab3-b8af-8b5e56e0949f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.482715 Oct 28 17:42:31.551144 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1738/3388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:31.569618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5002555-4ce0-4b76-829f-d94492af02fb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f751faf7310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.599792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5002555-4ce0-4b76-829f-d94492af02fb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.601824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5002555-4ce0-4b76-829f-d94492af02fb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.602276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5002555-4ce0-4b76-829f-d94492af02fb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.614076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:31.631513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:31.632983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:31.634812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6b3de17-388d-48c0-9804-6e56f3de1c6b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1575 microversion: 2.32 time: 0.242065 Oct 28 17:42:31.636447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1651/3389] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:31.668335 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5002555-4ce0-4b76-829f-d94492af02fb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 35 microversion: 2.26 time: 0.105591 Oct 28 17:42:31.687504 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1739/3390] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 35 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:31.710300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.710976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:31.749369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.752681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.753412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.755711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:31.757333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:31.758816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:31.896674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:31.906362 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9a9c114-4895-4b04-9209-af7d2ec33a1b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1203 microversion: 2.1 time: 0.206698 Oct 28 17:42:31.909131 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1740/3391] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:31.917764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c41b80fb-901d-41dd-81e5-b452a442c33e tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f7524572430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:31.948030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1672734810", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:32.053472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:42:32.065171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:42:32.066157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:42:32.067871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:42:32.069066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:42:32.073199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c41b80fb-901d-41dd-81e5-b452a442c33e tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.161995 Oct 28 17:42:32.074056 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1741/3392] 10.222.0.48 () {58 vars in 1188 bytes} [Fri Oct 28 17:42:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:32.079732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f7524246af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.111672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.112137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.112644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.112981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.113138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.113570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:32.114128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.116146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.116968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.118340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.142136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.142721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.143151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.144500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.145451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.151398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Getting quotas for project 9f57cbb28a73437aa218952540d86298. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:32.152250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.157972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Getting quotas for user b7d5080241304ed99e731438822e8de7 and project 9f57cbb28a73437aa218952540d86298. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:32.174484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:42:32.178045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:42:32.237031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.242235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.248256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.273346 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6245a6b5-8ef6-4c6a-b043-c07685990ceb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.634626 Oct 28 17:42:32.276064 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1652/3393] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:42:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:42:32.307841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e27f9c1-968f-42ff-b721-634678df4da7 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] Calling method '.version_select at 0x7f75244291f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.343003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:32.410220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-baddfe78-c3f2-4581-afbb-afcea443f5e0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-412613057" status: 204 len: 0 microversion: 2.26 time: 0.334209 Oct 28 17:42:32.410738 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1742/3394] 10.222.0.48 () {60 vars in 1361 bytes} [Fri Oct 28 17:42:32 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-412613057 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:32.428105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.428788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:32.571387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:32.576983 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e27f9c1-968f-42ff-b721-634678df4da7 tempest-VolumesTestJSON-1125600124 tempest-VolumesTestJSON-1125600124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.297519 Oct 28 17:42:32.578136 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1653/3395] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 17:42:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:32.584824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d50eca4-9977-4005-ae4c-426d9477f288 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f751f71de50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.592067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:32.594702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:32.610709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-460a4125-471c-4514-bb77-0ec51039ca8f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1454 microversion: 2.91 time: 0.198895 Oct 28 17:42:32.611534 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1743/3396] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:32 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:32.619298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d50eca4-9977-4005-ae4c-426d9477f288 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.620360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d50eca4-9977-4005-ae4c-426d9477f288 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.622114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d50eca4-9977-4005-ae4c-426d9477f288 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.630327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.633450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:32.647883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d50eca4-9977-4005-ae4c-426d9477f288 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 12 microversion: 2.26 time: 0.068027 Oct 28 17:42:32.657235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.659740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.662404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.663401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.664635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.667089 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1654/3397] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:42:32 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:32.668347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.680881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f75242f5040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.703875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.704462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.706676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.710053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:32.740658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.741812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.742574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.744120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.745273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.746476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.858417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:32.858907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:32.859344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:32.894257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:32.936551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1c86454-df73-408b-929a-f664dc0b189c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 204 len: 0 microversion: 2.26 time: 0.266351 Oct 28 17:42:32.943447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1655/3398] 10.222.0.48 () {60 vars in 1295 bytes} [Fri Oct 28 17:42:32 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:32.978994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:32.979680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.019856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.020499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.021378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.022828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.023571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.032117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.098238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.128095 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db5755ae-3b72-449b-8a42-acdae6fd3d16 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1502 microversion: 2.1 time: 0.514749 Oct 28 17:42:33.128996 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1744/3399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:32 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1502 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:33.134503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.135438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.143658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.144580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.145190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.146106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.147200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.148419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.242365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.271746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.281373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.286924 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa4a8777-58eb-4753-9b2b-3b9219c44c54 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1593 microversion: 2.32 time: 0.340328 Oct 28 17:42:33.289791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.291354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1656/3400] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:32 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1593 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:33.317770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f75244298b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.320007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dbabab40-e5c1-4d9e-aa59-35e165ec47cf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1267 microversion: 2.1 time: 0.189609 Oct 28 17:42:33.321530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1745/3401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:33 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:33.329765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47a8b361-2041-4f2f-a18b-03bca387c543"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:33.334065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.353874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.355076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.357003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.359324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.360112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.362153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.363388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.371926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.372584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.373241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.392220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.392810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.393188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.393904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.396946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.397400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.443816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Cannot 'attach_volume' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state rescued Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/os-volume_attachments HTTP/1.1 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 74 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: {"volumeAttachment": {"volumeId": "47a8b361-2041-4f2f-a18b-03bca387c543"}} Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'attach_volume' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state rescued Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': '63353499-8d0b-4b38-98d1-0a8a047ac115', 'body': {'volumeAttachment': {'volumeId': '47a8b361-2041-4f2f-a18b-03bca387c543'}}} Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 17:42:33.453544 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state rescued Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state rescued Oct 28 17:42:33.458035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:42:33.461030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 409 to user: Cannot 'attach_volume' instance 63353499-8d0b-4b38-98d1-0a8a047ac115 while it is in vm_state rescued {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:33.464148 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f7f73d6-c52d-427f-b680-6189f93c87ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.140641 Oct 28 17:42:33.467715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.468286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.470678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1746/3402] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:42:33 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/os-volume_attachments => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:42:33.472358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.484343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.484828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.485261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.491461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:33.492350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.504178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.505031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.506928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.509058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.509785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.510565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.535519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:33.574912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65ac97f6-d54a-440a-8ff6-2fabda7579e6 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-2135898021" status: 201 len: 0 microversion: 2.26 time: 0.275027 Oct 28 17:42:33.584246 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1657/3403] 10.222.0.48 () {62 vars in 1380 bytes} [Fri Oct 28 17:42:33 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-2135898021 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 17:42:33.598467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f752423e1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.631308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.631871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.632319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.632801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.659225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.680603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.683701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.687866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.690099 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09e06768-c66b-462f-b2c2-84c045f9993b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action" status: 202 len: 0 microversion: 2.1 time: 0.215448 Oct 28 17:42:33.690596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.691045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.705238 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1747/3404] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:33 2022] POST /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:42:33.726843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.734684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.751220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.752059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.752979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.754217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.754923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.755605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.803572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.804101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.804552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.847695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.848540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.848989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.902897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:33.920686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.928279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:33.936298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.940239 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cfe345ec-e782-428b-9842-1f3b59bd409c tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1382372962" status: 201 len: 0 microversion: 2.26 time: 0.353500 Oct 28 17:42:33.945035 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1658/3405] 10.222.0.48 () {62 vars in 1380 bytes} [Fri Oct 28 17:42:33 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1382372962 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 17:42:33.945183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:33.959057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e8db3cc1-faa8-4b53-88cb-a2e59f8b5daa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1458 microversion: 2.91 time: 0.248471 Oct 28 17:42:33.971652 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1748/3406] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:33 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1458 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:33.971786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.971966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f75245b4820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:33.984104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:33.988022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:33.993777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:33.995467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:33.995915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.003249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.003249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.003658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.006873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.008167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.009344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.015526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.016286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.016750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.018381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.018849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.022049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.094420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.095009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.095562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.126495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:34.158291 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-677ec8ec-dc40-42c8-88ae-05bc06c6a8eb tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 204 len: 0 microversion: 2.26 time: 0.197308 Oct 28 17:42:34.158944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1749/3407] 10.222.0.48 () {60 vars in 1295 bytes} [Fri Oct 28 17:42:33 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:34.168875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea8dcf75-0071-494b-b0bf-0f53eb3db0b1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f7524654310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.179951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea8dcf75-0071-494b-b0bf-0f53eb3db0b1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.180455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea8dcf75-0071-494b-b0bf-0f53eb3db0b1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.180901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea8dcf75-0071-494b-b0bf-0f53eb3db0b1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.219208 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea8dcf75-0071-494b-b0bf-0f53eb3db0b1 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 12 microversion: 2.26 time: 0.055046 Oct 28 17:42:34.219882 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1750/3408] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:42:34 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:34.242295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f7524137430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.282326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.282774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.283216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.285509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.299421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.299999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.321598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.322436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.324344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.324791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.384026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.384861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.385983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.399239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:34.417803 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e1593e3-7089-4541-ba19-368207caa065 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 204 len: 0 microversion: 2.26 time: 0.181828 Oct 28 17:42:34.426695 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1751/3409] 10.222.0.48 () {60 vars in 1295 bytes} [Fri Oct 28 17:42:34 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:34.429172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:34.433105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.433951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.437406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-833efff4-e580-4055-86ef-c1d4d75326ce tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1510 microversion: 2.1 time: 0.494937 Oct 28 17:42:34.441778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.442456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.443058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.443974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.444614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.445205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.454698 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1659/3410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:33 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:34.466562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.467233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.474952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.475748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.476242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.477347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.477810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.478292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.564241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:34.581071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:34.582625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:34.585175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c990a2ee-9c4c-42c0-8983-2ee212cce80a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1593 microversion: 2.32 time: 0.157164 Oct 28 17:42:34.590655 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1752/3411] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:34 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:34.600624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f7524c683a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.625310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.625918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.626372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.626872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.637179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:34.638904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.639692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.641453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.646089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.646773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.647397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.648741 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-489f9778-12ad-43df-a0a5-0a1ba8e5b26f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1265 microversion: 2.1 time: 0.186458 Oct 28 17:42:34.652493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1660/3412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:34 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:34.709095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.709684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.713097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.734524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.735029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.735493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.788743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:34.826491 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3d76752e-ccc1-44be-ac64-bd8a0b4c2970 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1030113550" status: 201 len: 0 microversion: 2.26 time: 0.234328 Oct 28 17:42:34.832074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1753/3413] 10.222.0.48 () {62 vars in 1380 bytes} [Fri Oct 28 17:42:34 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1030113550 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 17:42:34.839700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f752423e700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.878877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.879346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.889921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.890536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:34.911868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.912452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.912897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.913640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:34.914087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:34.914505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:34.991762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:34.992380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.009766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.010805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.011290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.012096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.012581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.013039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.031698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.033507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.033969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.072028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.074541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.075170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.142198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:35.197420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee6da802-5889-496e-aa1c-56bced800c82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1136758847" status: 201 len: 0 microversion: 2.26 time: 0.357794 Oct 28 17:42:35.198660 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1661/3414] 10.222.0.48 () {62 vars in 1380 bytes} [Fri Oct 28 17:42:34 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags/tempest-tag-1136758847 => generated 0 bytes in 366 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 17:42:35.219317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Action: 'update_all', calling method: .version_select at 0x7f7524513550>, body: {"tags": ["tempest-tag-1225678516", "tempest-tag-1073039283"]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:35.238286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:35.251144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:35.254921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.257366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:35.258100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.259219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.261119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.270357 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6f52f81-e363-42f8-bee8-1ec8e5ac8970 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1524 microversion: 2.91 time: 0.283322 Oct 28 17:42:35.274728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.275286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.275954 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1754/3415] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:34 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:35.284120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.290233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.293651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.294503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.333566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.334454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.335115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.340187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:35.378227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:35.400494 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5cbeb02f-79e5-4a76-8dd8-8774b8ddd51f tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 62 microversion: 2.26 time: 0.196058 Oct 28 17:42:35.401969 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1662/3416] 10.222.0.48 () {62 vars in 1312 bytes} [Fri Oct 28 17:42:35 2022] PUT /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 62 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:35.414319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c4ff30e-53b1-4290-a80b-86da60651c5a tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f751faf7310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:35.423962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4ff30e-53b1-4290-a80b-86da60651c5a tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.424838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4ff30e-53b1-4290-a80b-86da60651c5a tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.425517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4ff30e-53b1-4290-a80b-86da60651c5a tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.442293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c4ff30e-53b1-4290-a80b-86da60651c5a tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 200 len: 62 microversion: 2.26 time: 0.032082 Oct 28 17:42:35.455556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '.version_select at 0x7f752423e550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:35.460513 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1755/3417] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Oct 28 17:42:35 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 62 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:35.468345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:35.472848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.473687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.474779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.477188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.479187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.488957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.490988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.491801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.492440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.493826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.495771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.496111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.497011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.497742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.498366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.498999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.501237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.566302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.567999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.568642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.620629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lazy-loading 'flavor' on Instance uuid 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:35.657514 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1882ab98-6f11-47fa-8635-91717c4b39b0 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags" status: 204 len: 0 microversion: 2.26 time: 0.206782 Oct 28 17:42:35.667652 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1663/3418] 10.222.0.48 () {60 vars in 1295 bytes} [Fri Oct 28 17:42:35 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7/tags => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:35.679618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:35.684137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.700376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.715164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.717076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.719492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.722553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.723311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.879310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:35.894578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-802b11ab-9d27-44cf-a747-d3f8419d9d26 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1510 microversion: 2.1 time: 0.427074 Oct 28 17:42:35.895780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1756/3419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:35 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:35.909919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:35.912769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:35.939331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.940318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.947993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:35.948777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:35.949258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:35.949688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.012068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:42:36.043979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.054205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.060270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.064420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4f0beb4-69d6-4f46-a1d2-1f1a49504c14 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1660 microversion: 2.32 time: 0.395083 Oct 28 17:42:36.065039 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1664/3420] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:35 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1660 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:36.072977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:36.074310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:36.081288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:36.083026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.083806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.086171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.087291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.088040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.088799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.161446 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23282402-f593-438e-88fe-372193c7d33b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 204 len: 0 microversion: 2.26 time: 0.258806 Oct 28 17:42:36.167815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1757/3421] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:42:35 2022] DELETE /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:42:36.186565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:36.187360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:36.205364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.206898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.208341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.209552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.210248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.210915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.219574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.262013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03fda78e-5abc-4436-9c4c-5a0e4a6c0afc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1265 microversion: 2.1 time: 0.193480 Oct 28 17:42:36.268849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1665/3422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:36 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:36.308154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:36.309341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:36.330764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.334792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.335002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.343331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.343615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.344064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.606975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.621962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.631676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.655555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3181d3f-47b3-4277-987c-38aa3d81608a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1512 microversion: 2.91 time: 0.343276 Oct 28 17:42:36.671418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1666/3423] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:36 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:36.875120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.887976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.889918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:36.891286 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8538f30e-9970-4ef0-8916-53a2b3a95f82 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1552 microversion: 2.26 time: 0.721678 Oct 28 17:42:36.907396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1758/3424] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:36 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1552 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:36.926077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:36.926649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:36.940598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.942255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.946461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:36.947759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:36.948710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:36.951167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:37.185649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:37.204699 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c499a539-bbaa-46cf-9ecf-a5fb74c933a8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1510 microversion: 2.1 time: 0.281081 Oct 28 17:42:37.205347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1667/3425] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:36 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:37.228484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:37.232521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:37.246942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:37.247464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:37.247906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:37.248820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:37.249274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:37.260917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:37.290964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c478c3-4f15-4895-b2b8-f9d73b676fa3 tempest-ComputeTenantNetworksTest-100500954 tempest-ComputeTenantNetworksTest-100500954-project] Calling method '.version_select at 0x7f751fac3dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:37.511427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:37.919139 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2c478c3-4f15-4895-b2b8-f9d73b676fa3 tempest-ComputeTenantNetworksTest-100500954 tempest-ComputeTenantNetworksTest-100500954-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.864955 Oct 28 17:42:37.920967 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1759/3426] 10.222.0.48 () {58 vars in 1158 bytes} [Fri Oct 28 17:42:37 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:37.926774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:37.928206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:37.936814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:37.937879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:37.938550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:37.939666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:37.940354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:37.941012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:37.984044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:37.997186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.007875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.009385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65b8ecfa-e10a-41f8-99ef-bd7e771e1c31 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1706 microversion: 2.32 time: 0.800673 Oct 28 17:42:38.010667 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1668/3427] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:37 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1706 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:38.015535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:38.016832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:38.023839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.024650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.025273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.026483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.027250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.027880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.120350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.134708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.140057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.157563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9febf9e4-a998-48b1-892f-80cb030c77a4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1512 microversion: 2.91 time: 0.145798 Oct 28 17:42:38.158190 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1669/3428] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:38 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:38.177090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:38.177953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:38.190679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.199539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.202068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.202984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.203910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.212490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.215693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.236153 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2851f78a-b8b3-4923-acb4-2eb083f704d0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 0.310555 Oct 28 17:42:38.237975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1760/3429] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:37 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:38.249814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3a3ed5c-fd70-4253-aa7f-e0d7fa02037a tempest-ComputeTenantNetworksTest-100500954 tempest-ComputeTenantNetworksTest-100500954-project] Calling method '.version_select at 0x7f751faf7a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:38.459650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3a3ed5c-fd70-4253-aa7f-e0d7fa02037a tempest-ComputeTenantNetworksTest-100500954 tempest-ComputeTenantNetworksTest-100500954-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks/9513ec31-afcf-4538-ab40-18b0ca44c007" status: 200 len: 139 microversion: 2.1 time: 0.220195 Oct 28 17:42:38.461355 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1761/3430] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:42:38 2022] GET /compute/v2.1/os-tenant-networks/9513ec31-afcf-4538-ab40-18b0ca44c007 => generated 139 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:38.471936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:38.472638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:38.488937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.489432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.490088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.492749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.493429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.495831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.829435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.842439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.848053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.848679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:38.849833 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6279eee6-d933-4818-b2f8-139781cbc115 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1552 microversion: 2.26 time: 0.690410 Oct 28 17:42:38.852422 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1670/3431] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:38 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1552 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:38.858978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba10a9f6-a302-49e1-a55b-27a2a85729cf", "tag": "ceee59ac-9eb1-45e3-b567-06a2085fb44a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:38.859183 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-193bdd44-c677-4932-8afa-af697005d00d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1510 microversion: 2.1 time: 0.396451 Oct 28 17:42:38.862671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1762/3432] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:38 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:38.887775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:38.888791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:38.889452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:38.930444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] Creating event network-changed:ceee59ac-9eb1-45e3-b567-06a2085fb44a for instance ba10a9f6-a302-49e1-a55b-27a2a85729cf on n-h2-860864-13 Oct 28 17:42:38.940272 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ade3188f-1bd3-4227-a275-4ae0ccef5476 req-dffaab9f-d5ce-44f4-a07e-c03b031f3129 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085637 Oct 28 17:42:38.940862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1671/3433] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:39.037820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:39.038430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:39.055263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.056079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.056684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.058344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.058972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.059590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.190006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:39.190587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:39.206300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.226455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.227018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.228181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.230075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.230767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.366142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.394693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.397076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.410766 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70b5618b-7b3b-4fcd-8870-cdca4919e7bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1512 microversion: 2.91 time: 0.221741 Oct 28 17:42:39.413450 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1672/3434] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:39 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:39.418380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:39.423785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:39.434221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.435129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.441788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.442643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.443270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.444253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.445231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.461392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.464938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.468867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6f4b9a3-04c6-4693-9732-fe25b050f202 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1752 microversion: 2.32 time: 0.433791 Oct 28 17:42:39.469731 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1763/3435] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:39 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1752 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:39.658862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:39.674827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb32aee5-4d68-4d9d-aff5-1b3dd5af99ec tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 0.255936 Oct 28 17:42:39.675607 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1673/3436] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:39 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:39.882677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:39.883298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:39.890301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:39.890914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:39.908793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.909181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.909632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.910369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.910805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.911221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.914104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.914596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.915515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.916310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:39.916740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:39.918421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:39.923145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:40.247491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.259668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81352f02-8f45-4628-ba82-3d236f493cd6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1516 microversion: 2.1 time: 0.370637 Oct 28 17:42:40.264004 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1674/3437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:39 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:40.443603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:40.444849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:40.456861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.461563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.462326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:40.463749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.465281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.467988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:40.497770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.529233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.534943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.554772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6839577a-5944-46fa-b9b4-295c16fc9c4b tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1552 microversion: 2.26 time: 0.676131 Oct 28 17:42:40.557956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1764/3438] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:39 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1552 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:40.581922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:40.582552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:40.609058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:40.623426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.627474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.636165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:40.639914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.640499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.641096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:40.677248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.691109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.693600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:40.701399 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97da03eb-f4b4-4512-86e2-f30179551abd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1512 microversion: 2.91 time: 0.262436 Oct 28 17:42:40.716734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1675/3439] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:40 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:40.730399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:40.731531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:40.740083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.740593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.741038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:40.741747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:40.742438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:40.743240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:41.156977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:41.178039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:41.181245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:41.183912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9f16d7c-cb58-4c28-940d-a77598d65a2a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1752 microversion: 2.32 time: 0.624901 Oct 28 17:42:41.186155 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1765/3440] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:40 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1752 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:41.279049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:41.287671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a56e4cc9-a812-4fd8-9c99-4ac50fc77528 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 0.568300 Oct 28 17:42:41.312505 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1676/3441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:40 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:41.584380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:41.585714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:41.607787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:41.608285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:41.608969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:41.609685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:41.610134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:41.612092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:41.734989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:41.735890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:41.751008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:41.770545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:41.771052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:41.780573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:41.782046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:41.787310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:41.998689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.032539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.041816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.058094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1512 microversion: 2.91 time: 0.326741 Oct 28 17:42:42.061142 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1677/3442] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:41 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:42.062207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.064401 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002416 Oct 28 17:42:42.075829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1678/3443] 10.222.0.48 () {56 vars in 886 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 17:42:42.077510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.083172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.006084 Oct 28 17:42:42.091111 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1679/3444] 10.222.0.48 () {54 vars in 1035 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 28 17:42:42.093130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.094336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001802 Oct 28 17:42:42.106163 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1680/3445] 10.222.0.48 () {54 vars in 1041 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:42.113513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.114627 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8e6c9c6-ea53-4747-adc2-62ca9036e854 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005360 Oct 28 17:42:42.116458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1681/3446] 10.222.0.48 () {56 vars in 886 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 17:42:42.214174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.214802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:42.226305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:42.227073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:42.240500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:42.241089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:42.241539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:42.242746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:42.243398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:42.245297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:42.362830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.422708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.427900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:42.447967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7f49090-0c1f-4209-bd43-07f62d28d880 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1552 microversion: 2.26 time: 0.861240 Oct 28 17:42:42.450988 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1766/3447] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:41 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1552 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:42.466936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:42.468920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:42.497689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:42.500948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:42.501624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:42.504255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:42.505294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:42.506668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:42.621554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:43.280043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.287537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:43.304313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.321771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.325411 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-467b7aad-af39-46d1-8572-b5bf7d63d9c6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1798 microversion: 2.32 time: 1.116026 Oct 28 17:42:43.332215 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1682/3448] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1798 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:43.355310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:43.358969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:43.393181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:43.397662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:43.401820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:43.403218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:43.406265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:43.409883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:43.431418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.455956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-897d0be1-5486-4807-bd52-ab6c475dca19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 1.003427 Oct 28 17:42:43.467014 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1767/3449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:42 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:43.498107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:43.499880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:43.529720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:43.532693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:43.536599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:43.540255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:43.543548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:43.546092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:43.699015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.724887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.727192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.743689 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d63cf31a-758d-4dbd-84b5-46550b70871e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1533 microversion: 2.91 time: 0.408669 Oct 28 17:42:43.774187 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1683/3450] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:43 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1533 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:43.784057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b96ba606-1e90-4526-a809-cf2ded8d2c7a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: .version_select at 0x7f752411adc0>, body: {"keypair": {"name": "tempest-keypair-292873078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/xu5tSCGOYia/ozWObxscNilON8QunggOSgvhVARrigp3zs2bqd4KZreGNEqzBo03MxOVTGWy+NnpWrLz1b1+kBMvzEXDX7cflM8yvRtCbJv5PUTVXvDt0vqNGj/q1WA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:43.817493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.832604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.834067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '145ce0b15bbe44a7b8f575e647ce559f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180695244f9c44378ded87aa783e9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:43.844687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b96ba606-1e90-4526-a809-cf2ded8d2c7a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for project e2c8393105434854a4e3f16340409957. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:43.846887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee8cbebb-74e0-42d0-8a84-6319e44007bc tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 200 len: 1510 microversion: 2.26 time: 0.360484 Oct 28 17:42:43.847598 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1768/3451] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:43 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:43.858252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b96ba606-1e90-4526-a809-cf2ded8d2c7a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for user 498c3bcb751a435cac9703a0ff8a6361 and project e2c8393105434854a4e3f16340409957. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:43.911075 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b96ba606-1e90-4526-a809-cf2ded8d2c7a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140333 Oct 28 17:42:43.911894 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1684/3452] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:42:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:43.944289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e1c1f6-c141-4e2d-b046-90ee3ffd93f7", "name": "network-vif-deleted", "tag": "02a743ca-26ac-4f47-bfb7-268cf97fe7d1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:44.000092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:44.000579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:44.001015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:44.058144 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] Creating event network-vif-deleted:02a743ca-26ac-4f47-bfb7-268cf97fe7d1 for instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 on n-h1-860864-13 Oct 28 17:42:44.088439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ace37cf8-ffa5-483c-b241-81de79b4324d req-faab6eff-cfa1-4e65-8882-ff552c9fdfef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145370 Oct 28 17:42:44.089423 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1685/3453] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:42:44.364755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:44.368432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:44.390189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:44.390684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:44.391118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:44.395077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:44.396200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:44.396887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:44.586389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:44.587086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:44.601992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:44.606510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:44.607623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:44.610365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:44.611342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:44.613157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:44.947322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lazy-loading 'services' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:44.973721 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad78c65f-82b0-4e6e-8527-6f3aeb97449f tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1940 microversion: 2.91 time: 1.102481 Oct 28 17:42:44.998209 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1769/3454] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:43 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1940 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:45.014630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:45.015360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:45.033461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.034716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.035326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.037049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.038297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.039358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.092043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:45.118092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:45.122538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:45.125050 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82bbd8cb-a3f7-4c38-b103-b8cc8a74ede5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1798 microversion: 2.32 time: 0.768086 Oct 28 17:42:45.129392 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1686/3455] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:44 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1798 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:45.142551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:45.144205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] [instance: 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:45.159360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.163145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.164640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.165666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.168705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.169525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.211912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] HTTP exception thrown: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Request method failure captured: Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 HTTP/1.1 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBRvPwBMWCwYECDwVuJ8nTvSZk9oGt9Gtv3mp3jdXO2hcL8-s2sbrdXS-wWMtCpg88iQ9cKmYHYGIaJkyKXwTg01AnvE-wl8n1RNpQyyQXP0jC2ivCbYCDqa2bm7IgmgtRWsCwasB-shi5blhdDtgwmD9rsUmpWpRknzAXYeDaNOS3k Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.26 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 180695244f9c44378ded87aa783e9768 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerTagsTestJSON-1650732894 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/180695244f9c44378ded87aa783e9768"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/180695244f9c44378ded87aa783e9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_180695244f9c44378ded87aa783e9768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/180695244f9c44378ded87aa783e9768"}]}] Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerTagsTestJSON-1650732894 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 180695244f9c44378ded87aa783e9768 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerTagsTestJSON-1650732894 Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerTagsTestJSON-1650732894-project Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 145ce0b15bbe44a7b8f575e647ce559f Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerTagsTestJSON-1650732894-project Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '56e1c1f6-c141-4e2d-b046-90ee3ffd93f7'} Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:42:45.217052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. Oct 28 17:42:45.221262 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:42:45.228979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] Returning 404 to user: Instance 56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:42:45.231062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4e4ea59-9feb-48a4-b105-d4548354b980 tempest-ServerTagsTestJSON-1650732894 tempest-ServerTagsTestJSON-1650732894-project] 10.222.0.48 "GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7" status: 404 len: 111 microversion: 2.26 time: 0.100473 Oct 28 17:42:45.233966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1687/3456] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:45 2022] GET /compute/v2.1/servers/56e1c1f6-c141-4e2d-b046-90ee3ffd93f7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:42:45.248866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:45.249758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:45.270384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.271073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.273038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.274057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.277793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.278797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.586513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lazy-loading 'services' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:45.640438 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6497c32-b1c0-4f50-8fd5-55b9fe7c2e5a tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1940 microversion: 2.91 time: 0.404884 Oct 28 17:42:45.645320 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1688/3457] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:45 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1940 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:45.677138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:45.681589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.682480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.684026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.686762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.689805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.690560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.713035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:45.726330 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd1bdad3-3b6f-46f7-b181-8bd510af874d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 0.726909 Oct 28 17:42:45.728243 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1770/3458] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:44 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:45.762491 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbb968bc-c33c-4a46-9917-62dfc1d3a469 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.089788 Oct 28 17:42:45.775650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1689/3459] 10.222.0.48 () {60 vars in 1217 bytes} [Fri Oct 28 17:42:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:42:45.782313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:45.782862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:45.795049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.798833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.801347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.803739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:45.804356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:45.805529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:45.861754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lazy-loading 'flavor' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:42:46.156098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:46.156400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:46.176060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.177870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.178265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.180392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.180864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.181299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.340022 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39f94e43-7ba7-49da-9460-c0fb27081e45 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action" status: 202 len: 0 microversion: 2.91 time: 0.562708 Oct 28 17:42:46.340961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1771/3460] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:42:45 2022] POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:42:46.367228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:46.368614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:46.381351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.383966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.385437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.388437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.390594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.392860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.688866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:46.700042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:46.701426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:46.720741 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90010639-6592-4d07-beaa-d29757aae9a8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.365283 Oct 28 17:42:46.728175 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1772/3461] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:46 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:46.750925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba10a9f6-a302-49e1-a55b-27a2a85729cf", "name": "network-vif-plugged", "status": "completed", "tag": "ceee59ac-9eb1-45e3-b567-06a2085fb44a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:46.773219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.773701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.776311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.802573 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] Creating event network-vif-plugged:ceee59ac-9eb1-45e3-b567-06a2085fb44a for instance ba10a9f6-a302-49e1-a55b-27a2a85729cf on n-h2-860864-13 Oct 28 17:42:46.816989 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b8feb1a2-8daf-4859-89a5-cfe5f45c69f3 req-149ec6dc-6388-437a-9d65-8afd88d31463 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086913 Oct 28 17:42:46.819466 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1773/3462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:46.829557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:46.836598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:46.851472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.872585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.873583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:46.874573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:46.877135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:46.877865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:47.354883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.388903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.390793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.402818 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e06cbe11-57a1-4169-9b7e-8335bb8118c3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1844 microversion: 2.32 time: 1.244011 Oct 28 17:42:47.404282 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1690/3463] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:46 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1844 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:47.459727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "227cc944-f0ea-411e-9ecf-6429793f35a0"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:47.474076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:47.474924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:47.475861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:47.488241 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] Creating event network-changed:227cc944-f0ea-411e-9ecf-6429793f35a0 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:42:47.493881 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-771c19ac-4c8a-4015-a98d-5236f8d21909 req-a35ea0e4-c55a-45c3-b83f-b4d4dd3345bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039767 Oct 28 17:42:47.495698 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1691/3464] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:47.757701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:47.759599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:47.769615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:47.772290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:47.777438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:47.782226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:47.783738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:47.784881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:47.837282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.853633 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0433ce6f-5a46-4344-84b3-b9f7054cae5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1307 microversion: 2.1 time: 1.032601 Oct 28 17:42:47.856534 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1774/3465] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:46 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1307 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:47.953339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.969004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.972943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:47.987042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3b9376f-a0fa-4608-9e42-b7323b4407fa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.237144 Oct 28 17:42:47.998888 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1692/3466] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:47 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:48.437202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:48.438442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:48.451778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:48.455455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:48.462781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:48.464126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:48.464920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:48.465525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:48.886136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:48.886750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:48.898796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:48.901578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:48.902218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:48.905974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:48.907273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:48.908834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:49.180258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.199253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.200771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.209340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cdb1914a-5a3a-4b06-b3e3-263427e96d64 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1844 microversion: 2.32 time: 0.772829 Oct 28 17:42:49.212692 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1775/3467] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:48 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1844 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:49.226894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:49.228803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:49.245854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:49.247542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:49.248007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:49.248771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:49.249244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:49.255414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:49.507444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.523694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.526542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:49.541790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0b8d5b3-2d5e-40b9-971a-2371dbc8716d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.325971 Oct 28 17:42:49.544931 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1776/3468] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:49 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:49.564034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "5284497a-6c0c-4edf-850e-e36915f72749"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:49.593646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:49.594522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:49.598963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:49.629415 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] Creating event network-changed:5284497a-6c0c-4edf-850e-e36915f72749 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:42:49.675031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3608c86a-63d2-4236-b6e3-1f1735a94e99 req-9dd00f05-3e64-41fc-9de8-20690f9954c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101645 Oct 28 17:42:49.676779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1777/3469] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:50.135812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:50.158431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-000ce7af-5921-47f3-b6ff-aab79c3ea6ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1487 microversion: 2.1 time: 1.271638 Oct 28 17:42:50.159932 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1693/3470] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:48 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1487 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:50.193666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:50.197085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:50.216640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1322972246", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56f3770e-9a08-4897-a409-2108dd800f27"}], "security_groups": [{"name": "tempest-securitygroup--2044923808"}], "key_name": "tempest-keypair-292873078", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:50.230864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:50.235262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:50.236131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:50.239103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:50.246545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:50.247961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:50.446432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:50.462065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] validate_networks() for [('56f3770e-9a08-4897-a409-2108dd800f27', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:42:50.475124 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5aecc933-965d-4118-a681-90a1f0eda0e7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf/action" status: 202 len: 0 microversion: 2.1 time: 0.288072 Oct 28 17:42:50.478001 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1778/3471] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:50 2022] POST /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:42:50.495684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:50.496482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:50.533290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:50.535130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:50.537505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:50.541506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:50.543307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:50.545310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:51.404796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:51.423150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:51.427776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:51.430290 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6c8b343-4387-4171-84a0-30622a074c13 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1865 microversion: 2.32 time: 0.949867 Oct 28 17:42:51.434538 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1779/3472] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:50 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1865 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:51.442546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:51.443626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:51.462857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:51.468264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:51.469261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:51.473409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:51.474143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:51.475143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:51.679311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:42:51.680687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:42:51.682494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:42:51.683398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:42:51.684053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:42:51.713171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:51.715020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:51.715879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:51.719346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:51.720049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:51.724463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:51.784007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:42:51.802159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Getting quotas for user 498c3bcb751a435cac9703a0ff8a6361 and project e2c8393105434854a4e3f16340409957. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:42:51.836903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:42:51.840340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:42:51.915871 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-890f1fcd-5648-495b-9ba2-86c399354bf6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.705178 Oct 28 17:42:51.917521 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1694/3473] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:42:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:42:51.964894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:51.965540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:51.994712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:51.995619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.014653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.015319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.016211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.016511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.203844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:52.214733 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87dfb9fe-c3a8-41e4-96e5-6ecf722bc27f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 200 len: 1472 microversion: 2.1 time: 0.778637 Oct 28 17:42:52.223818 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1780/3474] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:51 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 1472 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:52.229773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "e9c4923c-4e52-4880-812a-744639bff60d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:52.252593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:52.263391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:52.266361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.267273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.267912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.275187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:52.288068 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc5dafe3-4d17-4b5c-8d65-73848c8b687b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.368399 Oct 28 17:42:52.292485 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1695/3475] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:51 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:52.298514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f45a4c9-7385-421b-a6c2-0151674fdda4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:52.299481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f45a4c9-7385-421b-a6c2-0151674fdda4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:52.309826 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] Creating event network-changed:e9c4923c-4e52-4880-812a-744639bff60d for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:42:52.314046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:52.315812 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-39a9a09d-ebed-4c97-a4e3-a2b8275ff2d0 req-55a697e2-a5c1-459f-afb2-6e56f96431ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090444 Oct 28 17:42:52.316631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1781/3476] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:52.334388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-648565541"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:52.343115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:52.380710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.381488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.382435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.383354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.383994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.384581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.498938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f45a4c9-7385-421b-a6c2-0151674fdda4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:52.507359 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f45a4c9-7385-421b-a6c2-0151674fdda4 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1245 microversion: 2.1 time: 0.213471 Oct 28 17:42:52.507985 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1696/3477] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:52 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1245 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:52.527012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:52.527663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:52.558613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.559033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.559330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.560068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:52.560519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:52.566618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:52.921992 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc15e08b-7189-4d0a-93ca-448b0d863e11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf/action" status: 202 len: 0 microversion: 2.1 time: 0.602900 Oct 28 17:42:52.924911 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1782/3478] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:42:52 2022] POST /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:42:52.963713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa967621-a556-48e9-a8c2-6d89535ed9a4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751faf7940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:53.068279 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa967621-a556-48e9-a8c2-6d89535ed9a4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.137046 Oct 28 17:42:53.077147 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1783/3479] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:52 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:53.114691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.128063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.141699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.144742 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d869815-0eb6-4301-98a9-189d52ddaae9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.632482 Oct 28 17:42:53.145576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1697/3480] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:52 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:53.322758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:53.324220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:53.348848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:53.351775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:53.353455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:53.356080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:53.360424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:53.361323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:53.502948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.515062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.517472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.523809 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1fb3aa0-6f67-4afe-92f2-bae07e8ef16f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.207462 Oct 28 17:42:53.530670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:53.531315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:53.534381 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1784/3481] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:53 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:53.541264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:53.542534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:53.546708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:53.550129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:53.551877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:53.554029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:53.712318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:53.732573 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6bd04131-9cf4-41b6-8dad-12183b555b6c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1297 microversion: 2.1 time: 0.205810 Oct 28 17:42:53.733179 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1698/3482] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:53 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1297 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:54.085263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cbe368d1-82a3-4f5b-89f5-c62bb04f111b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751faf74c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:54.177281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:54.177911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:54.191805 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cbe368d1-82a3-4f5b-89f5-c62bb04f111b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.110100 Oct 28 17:42:54.193370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.194612 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1785/3483] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:54 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:54.195557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.198298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.200608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.201478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.204097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.558428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:54.559057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:54.583873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.584385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.584827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.590830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.592949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.594531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.740347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:54.757120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:54.758643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:54.776736 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23062bd6-0ebe-4008-887c-fe55032791d2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.225894 Oct 28 17:42:54.792860 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1786/3484] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:54 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:54.806389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:54.809004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:54.825956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.826685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.827239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.831796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:54.832511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:54.833108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:54.993401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:55.010153 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-909a635f-a8cf-4822-892e-f9447c32f7bd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1303 microversion: 2.1 time: 0.214862 Oct 28 17:42:55.011348 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1787/3485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:54 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1303 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:55.024033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "f907d2df-6958-4d4c-8e76-5f6e901369f6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:55.071446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:55.087603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:55.089150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:55.089150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:55.096518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:55.106576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:55.116642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e21ccaa1-608f-4554-a141-9db486ee8e79 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.940674 Oct 28 17:42:55.118896 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1699/3486] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:54 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:55.129332 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] Creating event network-changed:f907d2df-6958-4d4c-8e76-5f6e901369f6 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:42:55.136468 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ea6213db-be8f-4d8e-9313-698626ee16aa req-0c0d4d4f-3ab4-4890-8063-08eb82647d1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122219 Oct 28 17:42:55.137613 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1788/3487] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:55.219035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32dba80f-aa74-4232-8a9e-edde0e474a9d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75240c1ca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:55.341235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32dba80f-aa74-4232-8a9e-edde0e474a9d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.124239 Oct 28 17:42:55.344526 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1700/3488] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:55 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:55.814458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:55.815317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:55.829018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:55.830634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:55.831410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:55.835909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:55.836790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:55.837644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:56.036435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:56.037348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:56.050659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:56.051224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:56.051701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:56.054988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:56.056455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:56.059088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:56.444622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.465501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.469262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1aebaab-2f60-4cc1-93ba-218ea9b4ec20 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1303 microversion: 2.1 time: 0.424718 Oct 28 17:42:56.475298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.476084 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1701/3489] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:56 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1303 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:42:56.482760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:56.484644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.491453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:56.514769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da2c5fb5-47b0-4265-a0d2-66dd237a2f66 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.705213 Oct 28 17:42:56.516022 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1789/3490] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:55 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:56.528000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:56.528881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:56.529563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:56.530790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:56.535104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6906578b-6717-49cd-a43b-2da1df99137b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f86f940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:56.536003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:56.545830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:56.619755 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6906578b-6717-49cd-a43b-2da1df99137b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.098973 Oct 28 17:42:56.631630 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1790/3491] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:56 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:56.953652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.970696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.977833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:56.985044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4695f450-640d-4d75-be5d-466e1810ba0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.504657 Oct 28 17:42:56.985689 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1702/3492] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:56 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:57.501986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:57.503208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:57.522931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:57.524609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:57.526805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:57.528454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:57.531021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:57.531760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:57.550190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:57.550962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:57.566375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:57.571416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:57.572743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:57.577219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:57.577784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:57.579469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:57.959098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:57.972350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:57.974319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:57.980597 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6caec3f6-93fa-431b-b837-c9d600268c7e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.436083 Oct 28 17:42:57.981930 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1703/3493] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:57 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:58.004398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73515295-9b42-4d89-aa28-c2fc67ed252e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752460ae50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:58.083788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73515295-9b42-4d89-aa28-c2fc67ed252e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.100265 Oct 28 17:42:58.084493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1704/3494] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:57 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:58.098580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:58.099619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:58.107644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:58.108396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:58.109129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:58.110003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:58.110613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:58.111193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:58.178599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:58.194778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eba34592-e957-49e4-ae34-fe67e4987c96 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 0.698213 Oct 28 17:42:58.196153 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1791/3495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:57 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:58.523681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba10a9f6-a302-49e1-a55b-27a2a85729cf", "name": "network-vif-plugged", "status": "completed", "tag": "ceee59ac-9eb1-45e3-b567-06a2085fb44a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:58.559030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:58.571621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:58.575445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:58.577718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:58.578323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:58.580456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:58.581651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dddceab4-156d-4ee2-ae38-742a13c4f16c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.487293 Oct 28 17:42:58.582215 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1705/3496] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:58 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:42:58.599666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "fcd454a0-1272-40ad-b466-feba429913b5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:58.613069 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] Creating event network-vif-plugged:ceee59ac-9eb1-45e3-b567-06a2085fb44a for instance ba10a9f6-a302-49e1-a55b-27a2a85729cf on n-h2-860864-13 Oct 28 17:42:58.626143 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a15f46ab-79f0-4e28-ab2d-55743a89b796 req-fe303204-80a2-43d2-89d1-282f0cee15ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110659 Oct 28 17:42:58.630621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1792/3497] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:42:58.644630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:58.647649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:58.648694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:58.673318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] Creating event network-changed:fcd454a0-1272-40ad-b466-feba429913b5 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:42:58.683267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-29f63050-ade6-422b-a21b-939a817ad1c8 req-ad8d3904-7f34-430e-90e9-a7d34a74abc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093817 Oct 28 17:42:58.688910 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1706/3498] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:42:58.858991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:42:58.877216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:58.878378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:58.879452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:58.913667 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] Creating event network-changed:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:42:58.923708 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b536c753-fc4d-4c8b-ad19-296500933d91 req-e99cda2b-a136-44fb-91c2-f1b4a5aec26a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070163 Oct 28 17:42:58.925463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1793/3499] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:42:58.991604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:58.995304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:59.012149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:59.012895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:59.015165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.016024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.016712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.019098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.020426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.021409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.024891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:42:59.028759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.029253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.030041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.032365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.033148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.035177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.185603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:59.205604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:59.207501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:59.216392 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88ddc3ea-ef03-464f-92ac-b6c7f0e9e448 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.208944 Oct 28 17:42:59.217464 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1794/3500] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:59 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:42:59.223180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5126e633-38d7-4592-961d-1794879b2897 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa9ba60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:59.298371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5126e633-38d7-4592-961d-1794879b2897 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.078513 Oct 28 17:42:59.298940 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1795/3501] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:42:59 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:59.306363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:59.307991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:59.318253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.319195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.320065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.321687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.323789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.324399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.483042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:59.493471 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72d57015-e10e-4c0b-b913-86b8c27b5171 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.507206 Oct 28 17:42:59.498258 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1707/3502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:58 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:59.523778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:59.524675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:59.531505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.532896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.533803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.535158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.536996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.539062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.774859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:42:59.789163 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06106eb5-89da-4b27-8bac-8d3bb11b5356 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 0.488689 Oct 28 17:42:59.790076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1796/3503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:59 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:42:59.795546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:42:59.799688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:42:59.810675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.815330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.815450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:42:59.816507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:42:59.817188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:42:59.818525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.034761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.049477 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-658ed8cb-3a38-49fe-9e4c-88fc4038e701 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.529197 Oct 28 17:43:00.054545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1708/3504] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:42:59 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:00.079786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:00.080397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:00.091458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.091971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.092476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.094427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.094897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.097487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.691821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.708870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.712134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.712455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.713639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b108078-0e7e-45d7-b990-93b6c2ef4535 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.922399 Oct 28 17:43:00.714215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1797/3505] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:42:59 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:00.723438 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f49273e8-c88e-4ff5-8d7d-69c8dbb7630a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.647663 Oct 28 17:43:00.727165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1709/3506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:00 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:00.745020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:00.747051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:00.755755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81aab031-2419-4fd1-9aee-c1b2f37ddd7b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75242d0a60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:00.765562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.766598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.767296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.781849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.787725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.789177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.861421 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81aab031-2419-4fd1-9aee-c1b2f37ddd7b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.132562 Oct 28 17:43:00.865264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1710/3507] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:00 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:00.878682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:00.881612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:00.899882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.902843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.904244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.905334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:00.907880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:00.911105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:00.959867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.980258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:00.985388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:01.006354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-543ab804-3f0e-4864-90e1-e889f52d0847 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.283684 Oct 28 17:43:01.009811 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1798/3508] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:00 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:01.033077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:01.034186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:01.059413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:01.060362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:01.061651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:01.066133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:01.066999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:01.068874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:01.399766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:01.409358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1ba0ed89-119e-4751-97a6-c9cce71bdee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.542049 Oct 28 17:43:01.413558 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1711/3509] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:00 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:01.424734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "8e04acb9-0d66-4306-96e6-722988ad0615"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:01.461123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:01.461841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:01.462469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:01.489787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] Creating event network-changed:8e04acb9-0d66-4306-96e6-722988ad0615 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:01.507400 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b00aaa54-765a-4951-9833-618001f8a1f3 req-26ac7dbb-b9e2-44a8-9c57-686b5222dd92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092364 Oct 28 17:43:01.514609 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1712/3510] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:01.649183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1764045817", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "433988cf-7d9a-4f57-bc43-869692e1a0af"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:01.744595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:01.782045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] validate_networks() for [('433988cf-7d9a-4f57-bc43-869692e1a0af', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:43:02.128153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:02.151909 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c94a91e-e226-4bb8-9449-b6c842c286a1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 1.136188 Oct 28 17:43:02.159048 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1799/3511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:01 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:02.165799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:02.170683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:02.186085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:02.186943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:02.187588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:02.190846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:02.191584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:02.192405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:02.506455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:03.051947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.065295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:03.075085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.080307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.081791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10a4423c-200a-4f64-ae90-489f66a2dce0 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1886 microversion: 2.32 time: 0.921624 Oct 28 17:43:03.089544 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1800/3512] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:02 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1886 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:03.098847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32089056-1f80-4c49-b4fd-158ba3e55146 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7528654af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:03.220939 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32089056-1f80-4c49-b4fd-158ba3e55146 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.129332 Oct 28 17:43:03.224854 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1801/3513] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:03 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:03.240484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:03.244833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:03.267317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.268311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.268969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.269990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.271145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.271774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.440329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.473377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.477878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.492310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6134dc40-bf3e-4951-bb5e-2ae5036074a6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.265590 Oct 28 17:43:03.497995 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1802/3514] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:03 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:03.508387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:03.511732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:03.528545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.529907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.532064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.533099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.534693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.536515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.566947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:43:03.567610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:43:03.567866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:43:03.568454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:43:03.569205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:43:03.606649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.607503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.609181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.610566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:03.612641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:03.613521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:03.688343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:43:03.705528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:43:03.763803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:43:03.773247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:43:03.844047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:03.858839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93c2efd6-b4be-4b10-aa6a-507542168d27 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 0.357807 Oct 28 17:43:03.861175 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1803/3515] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:03 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:03.913181 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0e1585b-9e35-40b3-a8a8-797b54bfa0c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272713 Oct 28 17:43:03.914893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1713/3516] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:43:03.928157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60ccc5b0-6159-4d61-a18f-d8c0a90e85d5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:03.928773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60ccc5b0-6159-4d61-a18f-d8c0a90e85d5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:04.120354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:04.121772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:04.135707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:04.136094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:04.143619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:04.145418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:04.149569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:04.153312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:04.700856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60ccc5b0-6159-4d61-a18f-d8c0a90e85d5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:04.718452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60ccc5b0-6159-4d61-a18f-d8c0a90e85d5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1215 microversion: 2.1 time: 0.793720 Oct 28 17:43:04.720281 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1804/3517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:03 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1215 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:04.743867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97bb569e-2d43-4a1f-86de-92390b3e8a82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7528654af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:04.845982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97bb569e-2d43-4a1f-86de-92390b3e8a82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.118168 Oct 28 17:43:04.846568 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1805/3518] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:04 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:05.145116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.176434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.180823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.184235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b12ad7b-6cca-44bc-b67d-dd14a9ed09eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 1.068429 Oct 28 17:43:05.202695 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1714/3519] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:04 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:05.222349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:05.225499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:05.239711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.241937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.242902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.245161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.246019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.248081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.297609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "631384cb-f1f9-45fb-a90b-2db7fc6373cd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:05.341886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.342380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.344556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.393668 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] Creating event network-changed:631384cb-f1f9-45fb-a90b-2db7fc6373cd for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:05.405685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d3986e7b-f73d-4149-931b-87d19847ce4e req-5bc3b04b-0ae2-42b4-8d50-e632ad055e90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.557006 Oct 28 17:43:05.409329 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1806/3520] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:05.416841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:05.430292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:05.467674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.468291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.468753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.474580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.475151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.479994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.805199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.842258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.847829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.883863 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-084b2e60-b4b4-46e9-ae93-be757ae28ad4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.673544 Oct 28 17:43:05.896944 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1715/3521] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:05 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:05.907077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:05.921142 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96ea7218-8f0c-4fa9-817f-7a570b542be6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 0.507098 Oct 28 17:43:05.921300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:05.923750 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1807/3522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:05 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:05.924366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:05.929420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5dbd5078-61bd-4030-aa95-98c82300b994 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fac6820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:05.956425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.000580 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5dbd5078-61bd-4030-aa95-98c82300b994 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.073961 Oct 28 17:43:06.011594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1808/3523] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:05 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:06.153684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:06.164158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c5f2587-7cb6-4785-aca7-8b48161059b1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1267 microversion: 2.1 time: 0.265829 Oct 28 17:43:06.169127 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1716/3524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:05 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:06.237479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:06.240082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:06.257732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.258724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.260229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.262230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.271205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.273740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.852698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:06.869992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:06.881939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:06.883528 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ea6f677-2edc-46f2-a21d-37de3001fb26 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.667393 Oct 28 17:43:06.884814 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1809/3525] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:06 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:06.929758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:06.930779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:06.949961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:06.950577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:06.957882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.960065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.960562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.961008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.961720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.962174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.962460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.963668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.964591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:06.965227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:06.965879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:06.969249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:07.187022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:07.202646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:07.205022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:07.213989 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8c6e527-62b0-4045-a683-7883761066f2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.289001 Oct 28 17:43:07.223014 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1717/3526] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:06 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:07.228209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3ef8a1a-4f6b-4ba3-af7d-9198350cc020 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75287df9d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:07.328744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3ef8a1a-4f6b-4ba3-af7d-9198350cc020 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.104511 Oct 28 17:43:07.329341 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1718/3527] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:07 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:07.343408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:07.344314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:07.354976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:07.360131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:07.361351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:07.364434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:07.367540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:07.368205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.183762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.198038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80da6c11-3663-44d0-bd02-4f373a5ea68a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1273 microversion: 2.1 time: 0.862284 Oct 28 17:43:08.215826 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1719/3528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:07 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1273 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:08.238729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:08.243829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:08.261337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:08.263121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:08.266304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.269140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:08.271950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:08.273737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.329397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.341500 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-231c6ba4-c871-4839-97e6-f5bafeff24f6 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 1.395554 Oct 28 17:43:08.348938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1810/3529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:06 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:08.354826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:08.372644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:08.396542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:08.397068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:08.397505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.398370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:08.398686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:08.399119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.787559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.805445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.810437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.822715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:08.846724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.847610 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66340a18-a6e0-4dd0-832d-b75973b14578 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.497250 Oct 28 17:43:08.848224 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1811/3530] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:08 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:08.862853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5281dc3-30b3-4709-aeff-e2f96a1ef601 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75244810d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:08.863290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.865041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:08.887038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1ce9f3f5-368f-4bc9-bdf9-5301ae01925d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.665129 Oct 28 17:43:08.890484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1720/3531] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:08 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:08.911625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "name": "network-vif-plugged", "status": "completed", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:08.947061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:08.963138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:08.966119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5281dc3-30b3-4709-aeff-e2f96a1ef601 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.114266 Oct 28 17:43:08.966865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:08.967712 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1812/3532] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:08 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:09.025931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] Creating event network-vif-plugged:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:43:09.043436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4ccb9eee-82ba-4e14-804b-4f65d7cb20e7 req-e0e6ea9e-fb75-441d-8af0-70013710cfa2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148361 Oct 28 17:43:09.059469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1721/3533] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:09.237264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:09.237264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:09.248546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:09.249073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:09.253225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:09.256018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:09.256500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:09.256941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:09.374808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:09.375551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:09.391402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:09.391925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:09.392379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:09.393090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:09.393552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:09.393999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:10.380185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:10.388735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15b39ec5-55e3-4d88-9b11-39bad341ec52 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 1.162773 Oct 28 17:43:10.399785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1813/3534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:09 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:10.426028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:10.426704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:10.429341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:10.441459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f9fe3daa-0717-4247-8032-91c24367e7fd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 1.070781 Oct 28 17:43:10.453238 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1722/3535] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:09 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:10.458177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:10.458791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:10.472946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:10.480084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:10.483664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:10.484751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:10.486646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:10.487288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:10.510588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:10.511130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:10.513953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:10.519843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:10.520892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:10.523584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:10.769086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:10.811711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:10.813530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:10.834449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e369f978-58cf-4eae-9cb8-bf1dbda3a5b4 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.431894 Oct 28 17:43:10.835845 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1814/3536] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:10 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:10.842518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5880c834-7058-4727-adc8-e7defe0ba3a5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524620670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:10.911027 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5880c834-7058-4727-adc8-e7defe0ba3a5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.073896 Oct 28 17:43:10.911859 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1815/3537] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:10 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:11.139755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:11.158176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:11.161279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:11.168710 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fec9f4d-f21e-4d6b-aa8f-2c52c5c51e3b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.714250 Oct 28 17:43:11.173283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1723/3538] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:10 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:11.414075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:11.414802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:11.444681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:11.447683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:11.453910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:11.454325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:11.458567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:11.459153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:11.477036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:11.477654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:11.494524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:11.503124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:11.504793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:11.508957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:11.512083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:11.513590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.080626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.091666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0cddc0d3-43d8-4212-b38e-dcb3b87c62ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.681780 Oct 28 17:43:12.095267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1816/3539] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:11 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:12.112560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:12.116749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:12.125891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:12.142533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:12.143301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.144513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:12.145155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:12.145715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.175881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.185687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b3f5092-b5bb-4d8d-b49f-b0f150be6d4a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1371 microversion: 2.1 time: 0.712821 Oct 28 17:43:12.188580 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1724/3540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:11 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1371 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:12.204409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d4879f3-0a94-4b3b-8db4-078547b9a881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752460a4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:12.288066 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d4879f3-0a94-4b3b-8db4-078547b9a881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.098214 Oct 28 17:43:12.289143 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1725/3541] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:12 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:12.294961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:12.306737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:12.319570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:12.320418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:12.321065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.322047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:12.323196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:12.323845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.424415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.443334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.444946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.460530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ea55c5e-5819-4f12-94ec-2f7286c5b816 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.363870 Oct 28 17:43:12.461257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1817/3542] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:12 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:12.705587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.721718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.729280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:12.733539 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d531aff3-b270-46e3-9f37-34dc34cede4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.440509 Oct 28 17:43:12.736147 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1726/3543] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:12 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:12.919723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b006730-d94a-4793-8568-4403474c1098", "tag": "52ace948-d479-4172-9543-c5f0ea41304b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:12.941108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:12.941972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:12.942659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:12.966395 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] Creating event network-changed:52ace948-d479-4172-9543-c5f0ea41304b for instance 2b006730-d94a-4793-8568-4403474c1098 on n-h1-860864-13 Oct 28 17:43:12.982141 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4d79a617-4bb7-4b41-8a0b-7bce2ccc87d0 req-0b6d96a5-2a43-4961-ba12-ce1a75623b85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067530 Oct 28 17:43:12.983485 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1818/3544] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:13.121275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:13.122237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:13.141314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:13.144521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:13.148048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:13.152079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:13.154496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:13.155676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:13.222914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:13.224523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:13.235434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:13.236825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:13.237445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:13.238390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:13.239015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:13.239980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:13.647008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:13.740776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:13.846378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:13.855422 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a26ece44-adbc-4cc4-8484-e00e01cc4ef0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.739401 Oct 28 17:43:13.861324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1727/3545] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:13 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:13.871857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e68aae8f-f302-4d49-93a2-4b34ed897312 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa4be50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:13.973434 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e68aae8f-f302-4d49-93a2-4b34ed897312 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.110930 Oct 28 17:43:13.974412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1728/3546] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:13 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:13.987621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:13.988797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:14.005052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.014960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.015658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.017759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.018395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.019014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.055508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.074052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa7ef405-d90c-4f33-b409-cd1fa9861e2b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1565 microversion: 2.1 time: 0.856154 Oct 28 17:43:14.076297 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1819/3547] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:13 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1565 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:14.083900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:14.088392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:14.102720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.103307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.104351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.106531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.107028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.108783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.204739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.208633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:14.219787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.224965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.242252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b67f9b2-e969-4de7-a88f-941fc5bc57b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.265787 Oct 28 17:43:14.246160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1729/3548] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:13 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:14.253710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:14.255114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:14.273714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.276203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.277179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.278975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.281689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.283808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.664845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7fa7c69-7567-4bc4-8415-7d1dced2dc7d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.417055 Oct 28 17:43:14.665444 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1730/3549] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:43:14 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-interface => generated 284 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:14.713511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:14.846241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.862454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.865317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:14.870623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-14b7d28d-13c5-4c06-9021-899cdf0f5dbc tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.793271 Oct 28 17:43:14.888895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:14.890185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:14.899269 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1820/3550] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:14 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:14.908228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.910147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.912947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.914029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:14.914736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:14.917871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:14.990137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-560a1ac4-fbb0-4024-81b5-e061165a7bd7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7528654310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:15.100443 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-560a1ac4-fbb0-4024-81b5-e061165a7bd7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.113939 Oct 28 17:43:15.101564 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1821/3551] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:14 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:15.278111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:15.278716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:15.292110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:15.292607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:15.293041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:15.293753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:15.294201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:15.314626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:15.322607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:15.323062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebc85e8a-adb2-476d-80be-da0e4c3306ab tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.438353 Oct 28 17:43:15.323682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1731/3552] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:14 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:15.562293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:15.585520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:15.596603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:15.636393 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d322fe0a-bcc3-4c94-a869-a6687c55f5ea tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.359833 Oct 28 17:43:15.646571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1822/3553] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:15 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:15.914470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:15.915754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:15.925329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:15.929267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:15.930798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:15.936848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:15.937580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:15.940041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:16.116899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64ae49c1-2783-4a97-8d01-f91d9ed14e37 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f8b6c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:16.242893 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64ae49c1-2783-4a97-8d01-f91d9ed14e37 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.129861 Oct 28 17:43:16.244968 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1823/3554] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:16 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:16.353939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:16.374477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:16.394499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:16.395012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:16.395468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:16.396192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:16.396647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:16.397076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:16.748679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:16.758644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:16.760167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:16.761358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15f1dce0-17ca-4f60-a256-c4b921434ed5 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.850988 Oct 28 17:43:16.788254 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1732/3555] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:15 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:16.810011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:16.811109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:16.830565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:16.832408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:16.846679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:16.852613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:16.853119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:16.859254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:17.121064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:17.135527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:17.136557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:17.143651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:17.158819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-645462cc-77d9-4c35-ad15-f8ad001aaaff tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.367955 Oct 28 17:43:17.164038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1609492d-fbb8-4e75-b59d-4c34ff31b470 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.813239 Oct 28 17:43:17.165300 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1824/3556] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:16 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:17.192234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1733/3557] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:16 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:17.264031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca9eb23b-7c6d-4dd5-9b73-7fc9553c4841 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f86f550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:17.415387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca9eb23b-7c6d-4dd5-9b73-7fc9553c4841 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.158329 Oct 28 17:43:17.418381 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1825/3558] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:17 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:17.792825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:17.793532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:17.812637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:17.815651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:17.817518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:17.820497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:17.821167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:17.821919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.196647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:18.199525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:18.286725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:18.292008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:18.293702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.294490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:18.298854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:18.300397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.674147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.689346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.693304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.695492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.699910 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c83f3deb-b0a3-43f0-8d8a-8dd329397136 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.909441 Oct 28 17:43:18.703484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1734/3559] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:17 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:18.715027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:18.718155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.718354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:18.724015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:18.733124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:18.733464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:18.735264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.736194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:18.738910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:18.741941 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f293ec97-e5fb-4f79-bdd3-a80753f00333 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.547480 Oct 28 17:43:18.742440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.743299 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1826/3560] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:18 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:18.763356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c36ceb5-c290-4e4e-9f33-6d5982519ac2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f86f790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:18.895896 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c36ceb5-c290-4e4e-9f33-6d5982519ac2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 0.149933 Oct 28 17:43:18.897200 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1827/3561] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:18 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:18.913508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:18.946748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:18.948513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:18.949323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:18.991836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] Creating event network-changed:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:43:19.033624 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-28a45133-6a73-40fc-9969-bdbc47140343 req-e5d5ac6c-3a2f-4b66-9c18-338fffeb4fb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122573 Oct 28 17:43:19.039926 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1828/3562] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:19.215042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:19.237786 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0e398f9-9e7c-4522-b354-d7653920cee9 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.533143 Oct 28 17:43:19.240030 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1735/3563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:18 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:19.751656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:19.772736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:19.778320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:19.780136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:19.797453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:19.800989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:19.807999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:19.809006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:19.811213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:19.811887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:19.826629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:19.828214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:19.833005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:19.840186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:19.843786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:19.845405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:19.901315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:20.424611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.440121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.441829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.458189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14c56017-3c36-4bdd-9874-4175a1ac9b5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.683571 Oct 28 17:43:20.460595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1736/3564] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:19 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:20.470771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8bd5321-74a5-452b-a8fd-d61d299b2ab2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752873bb80>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:20.653172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.672497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.676467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:20.679962 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44e14181-b61d-4c0c-acad-d1f9700fe304 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.956671 Oct 28 17:43:20.683711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1829/3565] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:19 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:20.698783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:20.699429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:20.719010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:20.721231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:20.722137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:20.728035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:20.730129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:20.732273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:21.429099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:21.441770 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2648b8f7-1667-4a48-a604-1d202fe0c842 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 0.751956 Oct 28 17:43:21.445014 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1830/3566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:20 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:21.500069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:21.500951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:21.517363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:21.518948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:21.520130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:21.521713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:21.523271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:21.524335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:21.711758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:21.727530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:21.733173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:21.751162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e495851-5749-40f5-887f-c12a0a860052 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.257007 Oct 28 17:43:21.765300 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1831/3567] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:21 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:21.792484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:21.796993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:21.812686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:21.813237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:21.818113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:21.824806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:21.826822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:21.828341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:22.642455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:22.666021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:22.669966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:22.672658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a64566cc-e911-4b25-ad1a-b72dd5ab1e8e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.905995 Oct 28 17:43:22.676324 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1832/3568] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:21 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:22.693935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b006730-d94a-4793-8568-4403474c1098", "name": "network-vif-plugged", "status": "completed", "tag": "52ace948-d479-4172-9543-c5f0ea41304b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:22.731164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:22.739596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:22.744393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:22.783426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] Creating event network-vif-plugged:52ace948-d479-4172-9543-c5f0ea41304b for instance 2b006730-d94a-4793-8568-4403474c1098 on n-h1-860864-13 Oct 28 17:43:22.794678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9cca064e-4c20-4eff-9679-fd1db986badb req-a733df9e-5f82-44d9-a782-0346f9d9f31b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109586 Oct 28 17:43:22.802718 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1833/3569] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:22.821297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:22.822860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:22.832691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:22.833546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:22.834213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:22.835746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:22.836375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:22.836968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:24.172171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:24.189438 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3ecaf89-acfd-4922-ade5-e023c8604270 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1315 microversion: 2.1 time: 1.384048 Oct 28 17:43:24.190340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1834/3570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:22 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1315 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:24.757121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1732170496", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:25.923155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8bd5321-74a5-452b-a8fd-d61d299b2ab2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1411 microversion: 2.1 time: 5.461004 Oct 28 17:43:25.929561 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1737/3571] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:20 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1411 bytes in 5467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:25.943272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:25.944791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:25.952743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:25.969838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:25.971869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:25.973398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:25.975440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:25.976889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:25.979181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:26.053452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:43:26.114803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.126204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.133180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.147787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18206e62-f114-4f60-a1fe-eebe218204e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.216452 Oct 28 17:43:26.148395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1738/3572] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:25 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:26.163498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:26.164410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:26.192127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:26.195662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:26.198263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:26.199177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:26.200895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:26.201608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:26.942055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.957170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.966977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:26.969148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e629fd3a-c2d3-49cf-8692-c2f321250553 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.817230 Oct 28 17:43:26.970668 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1739/3573] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:26 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:26.984243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:26.986248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:27.001787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.004004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.004583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.005383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.008139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.008891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.117240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:43:27.118588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:43:27.120319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:43:27.121026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:43:27.121654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:43:27.149303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.150084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.153788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.154622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.155098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.157971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.206554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:43:27.213819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:43:27.232184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:43:27.236001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:43:27.341990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d65f31f-0896-45e7-ba9c-671558e28eb3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.150037 Oct 28 17:43:27.356297 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1835/3574] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:43:27.386422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e929ff91-55cb-4463-bbdd-52b11371a959 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524bec430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:27.426642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:27.442631 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89a5a0ee-a0cc-4ed9-9670-cfe582bc8851 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1502 microversion: 2.1 time: 0.469521 Oct 28 17:43:27.444459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1740/3575] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:26 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1502 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:27.458957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:27.459605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:27.481821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e929ff91-55cb-4463-bbdd-52b11371a959 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1420 microversion: 2.1 time: 0.131353 Oct 28 17:43:27.491395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1836/3576] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:27 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:27.491547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.491668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7304aed-6278-45e9-acbb-a6b1790f8a48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:27.491668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7304aed-6278-45e9-acbb-a6b1790f8a48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:27.492594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.492594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.495091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.496207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.496827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.603861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7304aed-6278-45e9-acbb-a6b1790f8a48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:27.615279 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7304aed-6278-45e9-acbb-a6b1790f8a48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1193 microversion: 2.1 time: 0.131111 Oct 28 17:43:27.615814 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1837/3577] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:27 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1193 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:27.637101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:27.637645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:27.644706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.645195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.645636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.646348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:27.646804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:27.647232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:27.739246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:27.760302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:27.765148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:27.798946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aec92bb7-1be0-46f4-8109-742b7f51b6fc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.352580 Oct 28 17:43:27.810873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1741/3578] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:27 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:27.822430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09d5b71d-61c4-44c4-8fc1-aadba89c0fdc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751faee160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:27.915156 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-09d5b71d-61c4-44c4-8fc1-aadba89c0fdc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 200 len: 1420 microversion: 2.1 time: 0.108701 Oct 28 17:43:27.916986 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1742/3579] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:43:27 2022] GET /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:27.937221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ede1157-74e3-4854-afe7-961459c04edc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75286ddaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:28.082847 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.network.security_group_api [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Removing security group e6a11152-51a0-4ff5-b5ed-5b459464de2d from port 52ace948-d479-4172-9543-c5f0ea41304b Oct 28 17:43:28.835419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-822b7a32-8bb0-42d9-bc00-486a47dccf22 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098/action" status: 202 len: 0 microversion: 2.1 time: 1.201237 Oct 28 17:43:28.836751 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1838/3580] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:43:27 2022] POST /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098/action => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:43:28.843220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:28.844079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:28.857496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:28.858994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:28.860738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:28.866215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:28.870365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:28.871000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.380170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.409699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.416665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.422304 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-222f03c0-c41b-48a2-94e5-03702c3ba4ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.583922 Oct 28 17:43:29.425410 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1839/3581] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:28 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:29.442329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:29.443624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:29.464107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.468312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.469480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.470568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.480206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.480947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.589175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.617008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9da81c9a-ff42-46ec-be61-88a776004bde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1245 microversion: 2.1 time: 0.188941 Oct 28 17:43:29.620308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1840/3582] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:29 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1245 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:29.639985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba10a9f6-a302-49e1-a55b-27a2a85729cf", "name": "network-vif-unplugged", "status": "completed", "tag": "ceee59ac-9eb1-45e3-b567-06a2085fb44a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:29.660033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.660517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.660943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.716088 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] Creating event network-vif-unplugged:ceee59ac-9eb1-45e3-b567-06a2085fb44a for instance ba10a9f6-a302-49e1-a55b-27a2a85729cf on n-h2-860864-13 Oct 28 17:43:29.730692 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-bfceb299-8754-48c2-9547-f1130c502cdc req-a291a3a2-0782-405c-ad1b-e0b9b0110324 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106411 Oct 28 17:43:29.737279 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1841/3583] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:29.751240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:29.751968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:29.778193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.778871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.785462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.786641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.787496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.788174 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ede1157-74e3-4854-afe7-961459c04edc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 204 len: 0 microversion: 2.1 time: 1.855390 Oct 28 17:43:29.788760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.789209 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1743/3584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:27 2022] DELETE /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 0 bytes in 1858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:43:29.795009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:29.795770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:29.823180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.831853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.836667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.839519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.844622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.847646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.891182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.909308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.911135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:29.918668 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-409352c5-3cb7-4e0e-98af-8d5ed0ab6623 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.180026 Oct 28 17:43:29.920132 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1842/3585] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:29 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:29.925164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b006730-d94a-4793-8568-4403474c1098", "tag": "52ace948-d479-4172-9543-c5f0ea41304b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:29.938239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:29.939802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:29.940459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:29.962188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] Creating event network-changed:52ace948-d479-4172-9543-c5f0ea41304b for instance 2b006730-d94a-4793-8568-4403474c1098 on n-h1-860864-13 Oct 28 17:43:29.975035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f1e5c2ac-7f4e-419c-a449-0414b5c29b95 req-9b448f86-de8a-4214-a355-d54f7a95cd41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052006 Oct 28 17:43:29.983455 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1843/3586] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:29.993989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:29.999079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:30.031081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.032583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.035175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.044223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.045635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.048598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.112870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:43:30.136745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:30.151395 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e2981de-cbca-4d31-9b33-2cd939f73110 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1460 microversion: 2.1 time: 0.359495 Oct 28 17:43:30.154228 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1744/3587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:29 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1460 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:30.182839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:30.183952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:30.200142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.202971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.205696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.208895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.211677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.212451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.327092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29121bec-4ec2-436b-b8f9-822218d8884d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 204 len: 0 microversion: 2.1 time: 0.339664 Oct 28 17:43:30.329290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1844/3588] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:43:29 2022] DELETE /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:43:30.454806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:30.455831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:30.473475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.473905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.476381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.477207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:30.477683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:30.479235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:30.738975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:30.752671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05a3d03e-303c-4ce3-856e-a811932130a0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.573654 Oct 28 17:43:30.754305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1745/3589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:30 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:30.773441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2012757131", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:30.850814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:43:31.134498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:31.155206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:31.159475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:31.160617 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88fa96e2-2c44-4f6a-99cb-43f196b260d7 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.711562 Oct 28 17:43:31.171766 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1845/3590] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:30 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:31.178788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:31.179722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:31.188147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:31.189205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:31.189868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:31.190846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:31.191499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:31.192105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:31.620637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:31.630055 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36f85cbb-bd48-4de7-b04a-e81d8c7ff22c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.455791 Oct 28 17:43:31.652374 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1846/3591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:31 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:31.661446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:31.662408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:31.669727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:31.670493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:31.671152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:31.672081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:31.672733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:31.673379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:31.981287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:31.991725 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88f6563d-11d2-4aad-aba6-068636366464 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.337796 Oct 28 17:43:31.992324 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1847/3592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:31 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:31.999307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:32.000183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:32.027136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.043837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.043837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.044341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.044893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.045313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.297004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:32.315078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:32.321144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:32.337092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f8dd910-45eb-4053-9f08-3d9a0d36b44f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.341682 Oct 28 17:43:32.339619 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1848/3593] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:31 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:32.356235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:32.357393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:32.367340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:43:32.367340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:43:32.367827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:43:32.368200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:43:32.369395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:43:32.373324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.375244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.376440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.377963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.381043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.381747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.388503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.389252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.389863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.390762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.391563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.392182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.418801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:32.426758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:43:32.434682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:43:32.449464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:43:32.452129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:43:32.513849 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-730ef033-c9a3-4d2e-a07b-c75aa9dad3fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757638 Oct 28 17:43:32.515325 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1746/3594] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:43:32.520355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:32.521253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:32.529060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.529832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.530523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:32.531454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:32.532098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:32.532711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.028239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.042612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.053386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.055459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e187be58-de73-4581-b635-c94df08c22bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.538918 Oct 28 17:43:33.057965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1747/3595] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:32 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:33.071273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d859c05b-1a1a-4020-af5c-6274dd6137d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:33.079483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d859c05b-1a1a-4020-af5c-6274dd6137d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:33.093710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.102451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e5d7955-729b-4145-88b6-05144b3eb8fb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.761587 Oct 28 17:43:33.103618 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1849/3596] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:32 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:33.145861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:33.146482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:33.154160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:33.164166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.164657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.167729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.168539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.169007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.170793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.219643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d859c05b-1a1a-4020-af5c-6274dd6137d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.231588 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d859c05b-1a1a-4020-af5c-6274dd6137d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1208 microversion: 2.1 time: 0.170416 Oct 28 17:43:33.232189 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1748/3597] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:33 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:33.241869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:33.242894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:33.250940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.251711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.253567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.254468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.255095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.255732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.485273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.501341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4683d400-81f6-4e0e-baaf-3f80914919b4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.371689 Oct 28 17:43:33.501952 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1850/3598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:33 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:33.527271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:33.527923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:33.540623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.541126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.548717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.550161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.550523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.550713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.551307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.566631 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a284717f-101d-4bc4-9a68-f6b49a0a4e71 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.330747 Oct 28 17:43:33.569947 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1749/3599] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:33 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:33.718095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13049028-8c1f-4a4a-b3bf-d44f80e5aa62", "tag": "9fc0fafc-68f3-4e18-bb32-eff5d5cca3be"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:33.751167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:33.752594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:33.753359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:33.753920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.769811 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] Creating event network-changed:9fc0fafc-68f3-4e18-bb32-eff5d5cca3be for instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 on n-h2-860864-13 Oct 28 17:43:33.779165 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-01823b37-0e9e-4173-b060-236bc5e50cdf req-d2c5d6b5-de64-4655-ad15-078222b32694 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066518 Oct 28 17:43:33.780674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1750/3600] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:33.781594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.783223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:33.794179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fec3d82e-f70d-4edb-a62c-5729e6c1cc6f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.274576 Oct 28 17:43:33.794955 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1851/3601] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:33 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:33.889734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-96981962", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "433988cf-7d9a-4f57-bc43-869692e1a0af"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:34.013357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] validate_networks() for [('433988cf-7d9a-4f57-bc43-869692e1a0af', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:43:34.085917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:34.086967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:34.100831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:34.105348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:34.106150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:34.107177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:34.107935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:34.108669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:35.184964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:35.195238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:35.208644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:35.209987 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b306e39-0ae5-4759-9067-b57f8d54c81f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 1.128566 Oct 28 17:43:35.248345 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1852/3602] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:34 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:35.251339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:35.262453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:35.289937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:35.291318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:35.291962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:35.295039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:35.295751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:35.297021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:35.775922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:35.789196 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ac9291e-5ac8-4e21-9b91-90cd82e68fbc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1260 microversion: 2.1 time: 0.538745 Oct 28 17:43:35.792146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1853/3603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:35 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1260 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:35.803956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:35.804790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:35.830764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:35.831916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:35.832736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:35.833983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:35.839250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:35.845338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:36.575775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:43:36.575775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:43:36.575775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:43:36.576457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:43:36.576903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:43:36.598244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:36.599266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:36.600360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:36.609374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:36.610057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:36.610302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:36.683999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:43:36.697805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Getting quotas for user d12fcd7fffa34fc3ab6e8ce817967baf and project c7010927433b45f8a54537e2c753cb04. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:43:36.727799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:43:36.730425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:43:36.797570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e036ea1e-40be-4ce7-bd75-4975f9d6393f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.912357 Oct 28 17:43:36.805842 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1751/3604] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:43:36.811959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:36.813552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:36.841702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:36.843067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:36.843921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:36.847300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:36.848729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:36.851652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:37.006199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:37.020102 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-614943dd-72b7-4793-ba88-46013698235f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 1.224473 Oct 28 17:43:37.025667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1854/3605] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:35 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:37.037249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba10a9f6-a302-49e1-a55b-27a2a85729cf", "name": "network-vif-deleted", "tag": "ceee59ac-9eb1-45e3-b567-06a2085fb44a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:37.061687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:37.065127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:37.065813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:37.080816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:37.082452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] Creating event network-vif-deleted:ceee59ac-9eb1-45e3-b567-06a2085fb44a for instance ba10a9f6-a302-49e1-a55b-27a2a85729cf on n-h2-860864-13 Oct 28 17:43:37.083567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:37.090302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-67f165f9-6793-405c-8edb-996c7c24e71a req-4fce9ad0-f051-4b18-8ce7-97cffa73face service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062981 Oct 28 17:43:37.095816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1855/3606] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:37.099408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:37.100871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:37.102258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:37.104229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:37.112455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:37.113289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:37.113955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:37.114891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:37.115608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:37.116286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:37.118384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe48f531-678f-4a54-b9c3-5711a3ae3383 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.310687 Oct 28 17:43:37.125281 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1752/3607] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:36 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:37.140203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8016afcb-b77d-47da-9743-7444b19c5987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:37.140998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8016afcb-b77d-47da-9743-7444b19c5987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:37.193429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:37.609245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8016afcb-b77d-47da-9743-7444b19c5987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:37.614483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:37.616511 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8016afcb-b77d-47da-9743-7444b19c5987 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1213 microversion: 2.1 time: 0.490099 Oct 28 17:43:37.633248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1753/3608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:37 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1213 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:37.666872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:37.671042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:37.694745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:37.697458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:37.702287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:37.706744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:37.711170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:37.716564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:38.102776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:38.122663 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9825495-4de0-4270-b400-68dea0e18f24 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1266 microversion: 2.1 time: 0.478461 Oct 28 17:43:38.126580 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1754/3609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:37 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1266 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:38.135214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:38.154570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:38.201199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:38.203201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:38.205802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:38.212492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:38.213316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:38.214014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:38.887820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:38.906581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:38.908131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:38.909360 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08cbb0bb-9621-4a2f-8b97-20b52dcebb23 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 1.812139 Oct 28 17:43:38.914332 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1856/3610] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:37 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:38.924481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:38.925116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:38.942478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:38.944175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:38.947609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:38.951078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:38.951871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:38.955053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.270260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:39.288260 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4085b5f-a4e8-4610-b6e7-115d8a34a132 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 1.160025 Oct 28 17:43:39.292316 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1755/3611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:38 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:39.302873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:39.306042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:39.321933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.324085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.324885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.329480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.330177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.330850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.370196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:39.389864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:39.392283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:39.399247 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34277fe1-a2fd-4ec1-891a-03c576228f3f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.483660 Oct 28 17:43:39.427312 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1857/3612] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:38 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:39.437449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:39.439764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:39.456150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.456940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.457604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.458893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.460847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.461499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.645764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:39.662882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a711b278-3976-48f5-b806-7d2f07721a6a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1283 microversion: 2.1 time: 0.367180 Oct 28 17:43:39.670706 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1756/3613] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:39 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1283 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:39.938882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:39.939637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:39.963293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.966247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.966649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.969851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:39.973268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:39.975197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:39.995965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:40.010372 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97c9ebec-9f3f-4d2b-835b-e75bbb328f06 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.577101 Oct 28 17:43:40.026392 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1858/3614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:39 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:40.315265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:40.316305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:40.340863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:40.345196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:40.345700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:40.350727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:40.352733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:40.354794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:40.835205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:40.854331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-539745f0-1fcb-4675-8215-263c10afe6d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.543590 Oct 28 17:43:40.858782 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1859/3615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:40 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:40.865947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:40.868244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:40.886053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:40.888782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:40.889677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:40.892147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:40.893997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:40.895436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:40.978507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.019814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.022093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.032364 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-440dead5-2cf8-49b5-a952-7ca92e553a53 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 1.097560 Oct 28 17:43:41.033160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1757/3616] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:39 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:41.070257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:41.077322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:41.102314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.103690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.105568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:41.107852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.109215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.111898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:41.292247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.308249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.312260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.327645 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8713019b-51bf-4f3f-8ed3-bd833f6c75f1 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.466487 Oct 28 17:43:41.330322 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1860/3617] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:40 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:41.335552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:41.336755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:41.361721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.363700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.365151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:41.372536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.377073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.377997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:41.436294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.444332 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ecead9d-8411-472f-a78a-56a37efb135a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.382156 Oct 28 17:43:41.451842 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1758/3618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:41 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:41.859494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:41.868448 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50cef24b-6ce4-492f-8e7d-d2ebd530c531 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.536709 Oct 28 17:43:41.882100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:41.883014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:41.885922 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1861/3619] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:41 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:41.900301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.903006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.903795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:41.904871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:41.907192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:41.907956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.063557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:42.064548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:42.077789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.078684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.082872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.085483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.086250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.090313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.200624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.210604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b38dab98-5068-4401-ada5-fd2669547526 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.332416 Oct 28 17:43:42.214443 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1759/3620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:41 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:42.380983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:42.381939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:42.399063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.400400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.401118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.402101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.402795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.403720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.617159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.637195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.639251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.647819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84430009-a9d4-4cf0-a25d-261d2f535c67 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.281986 Oct 28 17:43:42.666643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1760/3621] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:42 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:42.679033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:42.680429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:42.687026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.687973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.688669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.689655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:42.690931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:42.691649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:42.938432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.954044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.957477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:42.960009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e603aaa-385d-4505-beb3-7b224615641d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.900117 Oct 28 17:43:42.968824 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1862/3622] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:42 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:42.975346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f01c9d9-840c-41cb-9e8a-b4b878743221", "tag": "09bab76f-82c4-4011-92aa-1bf4181657d5"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:43.050280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.054763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.057564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.099687 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] Creating event network-changed:09bab76f-82c4-4011-92aa-1bf4181657d5 for instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 on n-h2-860864-13 Oct 28 17:43:43.115976 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-24474473-53c9-49f0-a086-b1ce3e69d40c req-4d0f4114-fb27-4d62-a7a0-b9420f766ba0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145454 Oct 28 17:43:43.123505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1863/3623] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:43.132415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:43.136145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:43.144894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.146001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.147484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.148549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.160314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.162750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.354424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:43.384655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b39ad353-137b-4e02-88e0-5dbc73123098 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.714277 Oct 28 17:43:43.387840 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1761/3624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:42 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:43.492962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:43.509456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-94e22fed-6407-4cd1-87a8-737d7a11fc13 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.383892 Oct 28 17:43:43.511296 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1864/3625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:43 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:43.534002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:43.536401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:43.564512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.568783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.573025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.578998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.581370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.582804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.756741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "8e04acb9-0d66-4306-96e6-722988ad0615"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:43.802781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.804565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.805423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.842230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] Creating event network-vif-plugged:8e04acb9-0d66-4306-96e6-722988ad0615 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:43.858551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c9524fda-9d34-46ca-864e-c23587d90201 req-e25e396b-c555-4e04-8ef9-ad2313baedf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.467727 Oct 28 17:43:43.859785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1762/3626] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:43.871017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:43.871992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:43.888354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.890991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.892215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:43.897137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:43.897838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:43.898626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.108284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.124812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.126867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.129333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.136461 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1769fd33-807f-43ab-83c3-a2a38c5dd26f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.623753 Oct 28 17:43:44.137042 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1865/3627] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:43 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:44.155313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5236247-2167-4d53-a57a-7277f1c66c48", "tag": "d4ada3f6-9b80-484e-8bf0-f62b8a255477"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:44.166862 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5dd71cf0-b424-4b5e-9baf-f9e8aa04f749 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.303071 Oct 28 17:43:44.169707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1763/3628] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:43 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:44.186437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.186953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.187431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.189026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:44.190206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:44.207264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.208770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.210390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.211388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.212344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.213028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.235231 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] Creating event network-changed:d4ada3f6-9b80-484e-8bf0-f62b8a255477 for instance b5236247-2167-4d53-a57a-7277f1c66c48 on n-h1-860864-13 Oct 28 17:43:44.246707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0caca55f-7912-4dc0-b6e7-69b8978521ad req-1cb359cb-9e5d-4336-a1b3-503c56d27cfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104469 Oct 28 17:43:44.250405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1866/3629] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:44.413097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:44.413793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:44.431064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.432474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.433161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.435280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.436048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.437985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.866793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.882172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.892259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.894761 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5c5179a-1f17-4544-a2a9-663828844c45 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.720372 Oct 28 17:43:44.898979 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1764/3630] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:44 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:44.921577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:44.922464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:44.928999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.929483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.929916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.930609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:44.931099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:44.932105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:44.948635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:44.959854 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f924e2d8-4515-4659-9160-0f8c2112a508 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.550861 Oct 28 17:43:44.966846 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1867/3631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:44 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:45.139771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:45.157710 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9bba89f2-610b-47e3-9239-9d562af6f039 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.254163 Oct 28 17:43:45.158643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1765/3632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:44 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:45.164073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:45.164694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:45.176605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.177441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.177885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.178623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.179085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.179547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.183393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:45.217279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:45.223701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:45.231078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.231985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.232813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.234556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.235696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.236399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.332269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:45.342005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:45.350476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:45.360304 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37886655-7284-402d-82ae-c6a03c23d1b7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.163697 Oct 28 17:43:45.385190 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1766/3633] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:45 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:45.409490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:45.421602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d71b8212-78dd-462a-a503-27332077bc6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.261297 Oct 28 17:43:45.438254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1868/3634] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:45 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:45.925241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:45.925852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:45.935133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.935960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.936610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.937514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:45.938201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:45.938804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:45.997373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:45.998073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:46.015674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.016586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.017300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.018349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.028739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.029448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.302857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.316948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.317483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.319107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.326360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2cd1a7b4-9564-46b0-a968-7c6347cffa1d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.402420 Oct 28 17:43:46.335410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1767/3635] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:45 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:46.336277 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b39e79f0-38f4-492b-ab99-23deef1a8b21 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.335266 Oct 28 17:43:46.336634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:46.340046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:46.340206 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1869/3636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:45 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:46.350968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:46.356162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.358006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.359235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.362152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.363119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.364620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.394234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:46.394927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:46.401791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.402309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.402754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.411487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.412156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.412670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.520771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.534822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.537519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.554657 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02595477-39bc-44f6-b37c-64b756c9f456 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.164666 Oct 28 17:43:46.555267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1870/3637] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:46 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:46.566773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:46.570938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:46.590177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.590697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.591129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.593099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:46.593797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:46.594673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:46.632039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.642190 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-93e54e17-1806-4bbd-b35b-10fa12b74baf tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.313480 Oct 28 17:43:46.643002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1768/3638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:46 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:46.765376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:46.775677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5499f162-7f73-4a5c-86c9-aa8de5a621f9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.216273 Oct 28 17:43:46.776442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1871/3639] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:46 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:47.386257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:47.387820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:47.388251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:47.390108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:47.403485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:47.410158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:47.410664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:47.411102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:47.412488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:47.413095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:47.413607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:47.414340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:47.414795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:47.415878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:47.420197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:47.420753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:47.421201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:47.616254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:48.350950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.357350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.386482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-785a933b-2a7b-4625-8911-7b7c530c40a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 1.018948 Oct 28 17:43:48.391013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1769/3640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:47 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:48.399800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.404680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.412868 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-feccb208-d55b-4d34-ae74-9de2eb9ff437 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 1.031302 Oct 28 17:43:48.413381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:48.414263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:48.415265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1872/3641] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:47 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:48.436411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:48.438459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:48.444431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.447879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.449437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.453966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.454723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.456343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.463698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.464309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.464831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.465927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.467165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.470032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.563244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.589751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.592103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.600692 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-73f13f6d-8d06-4ce1-9c12-9b0a519af92c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1537 microversion: 2.91 time: 0.205197 Oct 28 17:43:48.602591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1770/3642] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:48 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:48.624677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:48.628431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:48.640431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.641985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.642341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.643074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.643557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.643988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.653909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:48.909251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.923744 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cae47597-4c45-41c7-b389-bec99abcbc7d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.506477 Oct 28 17:43:48.924964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1873/3643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:48 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:48.930727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "fcd454a0-1272-40ad-b466-feba429913b5"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:48.947268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:48.948168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:48.948628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:48.949632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:48.958134 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8196ab0-9e66-4d6f-92b4-1d6cbff373a5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.352755 Oct 28 17:43:48.958720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1771/3644] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:48 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:48.961275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] Creating event network-vif-plugged:fcd454a0-1272-40ad-b466-feba429913b5 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:48.974737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-77679538-9357-471a-bd0e-da090951e68b req-19cb6223-2a31-4ccb-a549-156749ac258f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048194 Oct 28 17:43:48.980255 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1874/3645] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:49.413516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:49.416594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:49.424414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.425864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.426470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.427909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.428538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.429161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.441928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:49.442634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:49.454110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.454604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.455042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.457814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.458286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.458717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.757396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.769577 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e930ad6c-3d11-402d-9af8-3b4caf2eb004 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.361609 Oct 28 17:43:49.770168 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1772/3646] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:49 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:49.772581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.777505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:49.779118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:49.786445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.786936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.787462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.788105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.788561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.789009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.789861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.795164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.796414 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad54d8f9-783d-4f08-826c-69aa58a0501d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.358958 Oct 28 17:43:49.802558 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1875/3647] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:49 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:49.880056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.890617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.892503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:49.899127 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-410d552d-cff6-4404-9602-9b34454b8365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1537 microversion: 2.91 time: 0.127459 Oct 28 17:43:49.900961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1773/3648] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:49 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1537 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:49.948641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:49.949256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:49.955513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.956208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.957011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.957866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.958687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.959419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:49.985436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:49.986753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:49.997246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:49.997735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:49.999738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:50.001112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:50.001762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:50.002900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:50.249172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:50.260798 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edb3b166-3ef9-472e-bfd1-b13e0fc98c49 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.316527 Oct 28 17:43:50.261773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1876/3649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:49 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:50.268040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:50.282262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-568ff20a-b70f-4b8d-ad9e-34b9b84188fa tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.301568 Oct 28 17:43:50.284726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1774/3650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:49 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:50.793907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:50.795333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:50.802354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:50.803272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:50.804224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:50.804816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:50.805673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:50.806542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:50.826174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:50.827578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:50.841645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:50.842403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:50.842849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:50.843763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:50.844237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:50.844663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.222889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.231906 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e157d35-26fc-4d2d-b037-e940c768d5ad tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.442688 Oct 28 17:43:51.234683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1877/3651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:50 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:51.239551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:51.240357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:51.263243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.264311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.265422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.268886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.270482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.270958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.352964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.374546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.377964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.380965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a929cb8c-0981-4822-93e1-de525121207c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.560625 Oct 28 17:43:51.383954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1775/3652] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:50 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:51.391605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "227cc944-f0ea-411e-9ecf-6429793f35a0"}, {"server_uuid": "13049028-8c1f-4a4a-b3bf-d44f80e5aa62", "name": "network-vif-plugged", "status": "completed", "tag": "9fc0fafc-68f3-4e18-bb32-eff5d5cca3be"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "631384cb-f1f9-45fb-a90b-2db7fc6373cd"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "5284497a-6c0c-4edf-850e-e36915f72749"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "e9c4923c-4e52-4880-812a-744639bff60d"}, {"server_uuid": "b5236247-2167-4d53-a57a-7277f1c66c48", "name": "network-vif-plugged", "status": "completed", "tag": "d4ada3f6-9b80-484e-8bf0-f62b8a255477"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:51.406082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.406610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.407311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.413120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.425859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.428613 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:227cc944-f0ea-411e-9ecf-6429793f35a0 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:51.428818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.429471 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:9fc0fafc-68f3-4e18-bb32-eff5d5cca3be for instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 on n-h2-860864-13 Oct 28 17:43:51.430046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:631384cb-f1f9-45fb-a90b-2db7fc6373cd for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:51.430633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:5284497a-6c0c-4edf-850e-e36915f72749 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:51.432574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:e9c4923c-4e52-4880-812a-744639bff60d for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:51.434203 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] Creating event network-vif-plugged:d4ada3f6-9b80-484e-8bf0-f62b8a255477 for instance b5236247-2167-4d53-a57a-7277f1c66c48 on n-h1-860864-13 Oct 28 17:43:51.439400 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da937661-fba1-4dda-ba45-f6934d794895 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1480 microversion: 2.91 time: 0.203568 Oct 28 17:43:51.440215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1878/3653] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:51 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1480 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:51.454118 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3695f65b-a51a-4646-80f6-2e92e1594a77 req-73a4c0ef-90da-47c4-ac57-56a871c61222 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.068675 Oct 28 17:43:51.455062 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1776/3654] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:51.456311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:51.459101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:51.473523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:51.475070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:51.477055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.478807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.479567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.481109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.481843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.482527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.495916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.497721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.500118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.502103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.503240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.504177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.846234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.849711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:51.858982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10f5d037-80d4-4ba8-ac11-60b448f5cb8c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.402410 Oct 28 17:43:51.859802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f068e0e-ef19-4ef1-a86d-b7b443ec38c9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.417843 Oct 28 17:43:51.860239 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1777/3655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:51 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:51.865138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:51.868178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:51.873097 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1879/3656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:51 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:51.875182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.875920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.876578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.877504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:51.878056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:51.878574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:51.934279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860864-13". {{(pid=120568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 17:43:52.018693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20ac7d66-037a-4151-9a21-64ac8cd97bd8 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action" status: 202 len: 0 microversion: 2.91 time: 0.156884 Oct 28 17:43:52.022988 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1778/3657] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:43:51 2022] POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:43:52.028958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:52.029872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:52.038317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.038874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.039612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.041110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.041785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.042426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.116478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.131628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.133777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.141586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2b15cb4-89c9-4234-b779-b9051e998286 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1488 microversion: 2.91 time: 0.117252 Oct 28 17:43:52.150971 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1880/3658] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:52 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1488 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:52.258441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:52.259649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:52.267548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.268015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.268317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.269406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.270128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.270562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.409806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:52.410489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:52.418917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.419727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.420355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.425854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.427944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.429651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.452273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.464096 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc36b4cc-b642-4b53-94e2-6917503c07e7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.209534 Oct 28 17:43:52.464887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1779/3659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:52 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:52.699707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.713486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.717377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:52.718594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e900e765-b430-485f-b8de-1ae7ae48fb4c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.313200 Oct 28 17:43:52.719184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1881/3660] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:52 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:52.885743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:52.886643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:52.895318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:52.896596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:52.899078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.902119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.903537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.904719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.905431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.906325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.917518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.917902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.925348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:52.926819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:52.936765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:52.937268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.230019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.248660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-35c2f0d2-46b1-4369-bad6-4373511f07c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1293 microversion: 2.1 time: 0.367366 Oct 28 17:43:53.251093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1780/3661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:52 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:53.262483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:53.264407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:53.270420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.279571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.281485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.282494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc02e52a-9ec9-4d7b-813c-69d38082be9e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1308 microversion: 2.1 time: 0.391056 Oct 28 17:43:53.283437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.285512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.286614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.288751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.299732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1882/3662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:52 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1308 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:43:53.408352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.419751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.433671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.443179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-799cc983-6f0e-454f-b0b1-1e8139259d88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1488 microversion: 2.91 time: 0.190255 Oct 28 17:43:53.443980 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1781/3663] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:53 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1488 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:53.483901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-plugged", "status": "completed", "tag": "f907d2df-6958-4d4c-8e76-5f6e901369f6"}, {"server_uuid": "9f01c9d9-840c-41cb-9e8a-b4b878743221", "name": "network-vif-plugged", "status": "completed", "tag": "09bab76f-82c4-4011-92aa-1bf4181657d5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:53.496820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.497598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.498226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.513643 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Creating event network-vif-plugged:f907d2df-6958-4d4c-8e76-5f6e901369f6 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:43:53.514157 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] Creating event network-vif-plugged:09bab76f-82c4-4011-92aa-1bf4181657d5 for instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 on n-h2-860864-13 Oct 28 17:43:53.520725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-91d49f88-767a-4ae6-bf2f-945a85aa58b5 req-c97dc580-911e-4f06-ba13-b9cf3b61650a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042042 Oct 28 17:43:53.521334 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1782/3664] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:43:53.528652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:53.529420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:53.530350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Calling method '.version_select at 0x7f751faf7940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:53.532161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.532879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.533565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.536750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.537294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.537737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.538435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.538886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.539330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.550664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.551245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.551883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.570715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.572106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.572709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.587816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9ed57ec3-cb97-4625-94e8-4375ff5f1cb1 tempest-PortsAdminExtendedAttrsTestJSON-1759398913 tempest-PortsAdminExtendedAttrsTestJSON-1759398913-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.256101 Oct 28 17:43:53.589535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1883/3665] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:43:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:43:53.748805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:53.749648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:53.760803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.761309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.761745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.762456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:53.763293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:53.763881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:53.892259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:53.907772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85066a3a-e9b1-4090-966c-5b81a153e71a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.385001 Oct 28 17:43:53.908361 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1783/3666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:53 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:54.064553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.074666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.076136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.077365 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed20de88-c664-4593-a291-b42350bbdb4f tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.335548 Oct 28 17:43:54.077921 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1884/3667] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:53 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:43:54.273050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:54.273664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:54.280105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.280604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.281061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.282094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.282791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.283720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.308677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:54.309777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:54.317161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.317890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.318429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.319861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.321224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.322511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.342899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:54.732942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.741011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.745796 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9df81286-9f05-4c6d-bc8f-fbbe2aab536f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1475 microversion: 2.1 time: 0.476461 Oct 28 17:43:54.746489 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1784/3668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:54 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:54.750317 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fdd5dc08-b454-4688-ab3d-af0db3fc1c83 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1489 microversion: 2.1 time: 0.447273 Oct 28 17:43:54.753510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:54.754400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1885/3669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:54 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1489 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:54.764677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:54.778977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:54.779156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.779663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.780150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.781197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.781844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.782922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.786504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:54.790559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:54.792806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:54.839684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Going to try to stop instance {{(pid=120567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:43:54.894056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.918236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.926342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:54.951831 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b224b14-7ed8-4b77-bc7b-c777a79e4e65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.203905 Oct 28 17:43:54.963852 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1785/3670] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:54 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:54.968689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5eb8d6f-23bd-49b3-83d4-9552036e2744 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48/action" status: 202 len: 0 microversion: 2.1 time: 0.191501 Oct 28 17:43:54.977263 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1886/3671] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:43:54 2022] POST /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:43:54.986907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:54.988590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:54.989929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:54.992259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:55.000200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.001132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.001919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.002955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.004048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.004791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.029303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.029833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.030403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.030984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.031479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.031896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.333192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:55.336659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:55.354757 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8096e7ad-316f-40c6-a033-a12494ee7d57 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.373527 Oct 28 17:43:55.358130 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a5469d0-3373-444d-9ede-086dffde3341 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1313 microversion: 2.1 time: 0.392785 Oct 28 17:43:55.358946 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1887/3672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:54 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:55.359737 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1786/3673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:54 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:55.386172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:55.392725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:55.403441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.403811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-287788927", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:55.404279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.404880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.406121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:55.406748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:55.407704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:55.608647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:43:55.922339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:55.932616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:55.937477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:55.938785 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-730ee024-26a8-46ad-92d6-5ac8af21d5f9 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1874 microversion: 2.32 time: 0.577646 Oct 28 17:43:55.939690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1888/3674] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:55 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1874 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:55.996151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:56.006161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:56.018314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.032883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.033344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.034183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.034696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.035216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.314961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:56.326700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:56.331205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:56.349271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-81e61e5a-7fa0-4b93-9f0f-ab3bd452e19b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.361552 Oct 28 17:43:56.376937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1889/3675] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:55 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:56.405661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:56.410268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:56.426490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.426992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.432484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.433551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.434123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.437505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.757429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:43:56.758419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:43:56.760554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:43:56.761205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:43:56.761856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:43:56.787713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.788206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.788643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.789360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.790519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.791596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.834030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:43:56.845173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:43:56.851059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:56.865003 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7fad21e-0ada-4dcb-b118-79cb8f26a950 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.478131 Oct 28 17:43:56.865611 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1890/3676] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:56 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:56.877301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:43:56.887089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:56.888019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:56.896399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.897276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.909756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:56.911961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:43:56.912153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:56.914817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:56.916297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:57.076755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b113ceb-df20-4a0c-b37f-252df33080e6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714333 Oct 28 17:43:57.090399 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1787/3677] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:43:57.105949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:57.108052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:57.128186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:57.128687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:57.143963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:57.144795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:57.145341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:57.146071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:57.173227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:57.653872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:57.709737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-266cd831-5ac6-4078-80b7-c97f62f2637b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1501 microversion: 2.1 time: 0.828800 Oct 28 17:43:57.710343 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1891/3678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:56 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1501 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:57.735746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44317e8c-eb8a-4cdb-bb1a-c4ed34ca5086 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:57.736237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44317e8c-eb8a-4cdb-bb1a-c4ed34ca5086 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:57.740243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:43:57.758639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-44317e8c-eb8a-4cdb-bb1a-c4ed34ca5086 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:43:57.803943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:57.828514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:57.830525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:57.835294 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71e70baf-d8d5-4226-a044-4dfe22fcc3bd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2828 microversion: 2.32 time: 0.743506 Oct 28 17:43:57.848810 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1788/3679] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:57 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2828 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:57.868084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:57.868084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:57.876812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:57.879887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:57.880903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:57.882295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:57.883190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:57.885150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:57.994823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:58.016582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:58.019647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:58.048213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7581e3af-11bf-45fa-8731-c64eee16d4e5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.197619 Oct 28 17:43:58.049090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1789/3680] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:57 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:58.060819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:58.061902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:58.075280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.089482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.090068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.090872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.092054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.092499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.267525 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1182e6a-7363-4ef0-9ec3-ae7d8e7458be tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221/action" status: 202 len: 0 microversion: 2.1 time: 0.216736 Oct 28 17:43:58.268490 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1790/3681] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:43:58 2022] POST /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:43:58.294473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:58.295141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:58.296916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.scheduler.client.report [None req-44317e8c-eb8a-4cdb-bb1a-c4ed34ca5086 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Deleted allocations for instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 Oct 28 17:43:58.311118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.314155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.316405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.317901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.319116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.320877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.323008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44317e8c-eb8a-4cdb-bb1a-c4ed34ca5086 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9" status: 204 len: 0 microversion: 2.1 time: 0.596407 Oct 28 17:43:58.325373 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1892/3682] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:43:57 2022] DELETE /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:43:58.335221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:58.337863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:58.351044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.351831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.352262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.356174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.359124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.363667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.603780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0094253-0f57-4424-97a2-58494d4d69d1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.333521 Oct 28 17:43:58.604679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1791/3683] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:43:58 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd/os-interface => generated 1831 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:58.609916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:58.610702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:58.646612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.649640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.657765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:58.658776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:58.663721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:58.664387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.161277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:59.177111 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9044535c-ded3-4756-a9ce-cff47b110be3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.849824 Oct 28 17:43:59.195159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1893/3684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:58 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:59.212872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:59.217309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:59.234713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.235308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.235870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.238500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.239069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.239789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.275103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 HTTP/1.1 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '13168ae2-16e9-4c78-ab02-f3d6f4a141e9'} Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:43:59.281910 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:43:59.286731 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:43:59.287257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:59.295227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:43:59.296764 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e0b509f-6f31-4afe-b80d-c0762ed492c9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9" status: 404 len: 111 microversion: 2.1 time: 0.100399 Oct 28 17:43:59.297650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1894/3685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:59 2022] GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:43:59.302604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:59.305422 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0103b2c-edd4-4d97-8705-edf0c5e369a7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1486 microversion: 2.1 time: 0.697831 Oct 28 17:43:59.315569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:59.325184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1792/3686] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:58 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1486 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:43:59.338540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.343453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:59.344549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.345477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.346423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:59.356245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.359836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.360848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.361485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.362191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.369355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.370368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.371979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.372590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.441450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'flavor' on Instance uuid 9f01c9d9-840c-41cb-9e8a-b4b878743221 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:43:59.630145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:59.663142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:59.667934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:43:59.699768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ead51686-d2b8-4442-8659-900226bd3cb9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.400769 Oct 28 17:43:59.730999 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1895/3687] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:43:59 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:43:59.736364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-794918708", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:43:59.922759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e5d0419-4295-4c30-8fd7-35dd49b0b322 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221/action" status: 202 len: 0 microversion: 2.1 time: 0.590801 Oct 28 17:43:59.927221 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1793/3688] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:43:59 2022] POST /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:43:59.943503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:43:59.948670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:43:59.978635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.980176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.982350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:43:59.986045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:43:59.987981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:43:59.989299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:00.015128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:44:00.696791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:00.709982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-408f39ce-4955-4d6a-89aa-8347b6b04c98 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1492 microversion: 2.1 time: 0.778186 Oct 28 17:44:00.712042 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1794/3689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:43:59 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1492 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:00.737041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:00.749896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:00.770436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:00.771516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:00.772037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:00.772758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:00.773271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:00.780407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:01.797529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:44:01.798716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:44:01.799408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:44:01.800002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:44:01.800593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:44:01.819678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:01.820603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:01.821060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:01.822496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:01.824704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:01.829166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:01.887422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:44:01.899949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:44:01.923752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:01.941574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:44:01.948746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10f6e684-6074-4f35-9d85-be5db309f387 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 1.218951 Oct 28 17:44:01.952679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1795/3690] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:00 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:01.955105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:44:01.960026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:01.982512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:02.000745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:02.016911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:02.027324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d43a1cd1-c895-4f55-974b-552d371a8158 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.294728 Oct 28 17:44:02.028684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1896/3691] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:44:02.036082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:02.037140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:02.037610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:02.038046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:02.048898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "tag": "227cc944-f0ea-411e-9ecf-6429793f35a0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:02.099302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:02.101276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:02.102131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:02.162233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] Creating event network-changed:227cc944-f0ea-411e-9ecf-6429793f35a0 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:44:02.186607 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4488e7c6-9925-4ff1-971a-5fdf9e712ff3 req-dacb3479-468a-467c-b326-3416693bc6f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156306 Oct 28 17:44:02.190594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1897/3692] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:02.217075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:02.222169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:02.235544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:02.237996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:02.238732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:02.240715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:02.240829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:02.241172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:02.261575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:02.318276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:02.326150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:02.377352 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-903afe6d-e131-4d02-8a0b-5c8d6cf31a9c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.420993 Oct 28 17:44:02.401336 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1796/3693] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:01 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:02.414760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99c19bdd-1bbd-48f0-bce0-101254c4c946 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:02.419488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99c19bdd-1bbd-48f0-bce0-101254c4c946 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:02.654110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99c19bdd-1bbd-48f0-bce0-101254c4c946 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:02.662539 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99c19bdd-1bbd-48f0-bce0-101254c4c946 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1220 microversion: 2.1 time: 0.259768 Oct 28 17:44:02.671206 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1797/3694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:02 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1220 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:02.792372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:02.818743 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f64c08c4-8dd4-47c9-9b3b-da681bb4ec57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1513 microversion: 2.1 time: 0.606622 Oct 28 17:44:02.819515 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1898/3695] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:02 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1513 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:02.979740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:02.981331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:02.992897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.000148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.000911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.003334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.004025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.005905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.388117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:03.404611 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df6d1e07-3a5c-42fd-bcf2-da6811d51314 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.430379 Oct 28 17:44:03.414194 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1798/3696] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:02 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:03.427011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:03.427882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:03.445013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.445753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.446908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.448031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.449050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.449610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.655619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:03.667481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:03.668930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:03.685038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4b7f173-5182-45c6-a1ce-83598150f1c3 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.265294 Oct 28 17:44:03.686123 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1899/3697] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:03 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:03.716282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:03.717214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:03.738321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.738885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.739385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.743149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.743804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.746613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.847873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:03.849500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:03.865455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.867569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.868830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:03.872345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:03.874002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:03.876235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:04.112829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.124726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d8b8f04-dd9b-4c82-b7e4-ed5dd6cca844 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1216 microversion: 2.1 time: 0.426867 Oct 28 17:44:04.126216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1799/3698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:03 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1216 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:04.377140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.389707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c1786da-fa6e-4968-ad05-d15a21d3ff87 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1513 microversion: 2.1 time: 0.545547 Oct 28 17:44:04.407519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1900/3699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:03 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:04.433483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:04.433483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:04.449439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:04.450055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:04.452577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:04.453546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:04.455703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:04.456766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:04.722425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:04.723504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:04.732871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.750363 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a46c8dfd-60f0-4f1e-ba7d-8666912d7a19 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.320327 Oct 28 17:44:04.753563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:04.755700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1800/3700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:04 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:04.756647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:04.757271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:04.761048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:04.766748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:04.767520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:04.947220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.964395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.966418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:04.973294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0be73b4c-73cd-4e11-b5b7-75de087405ed tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.257192 Oct 28 17:44:04.974667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1901/3701] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:04 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:05.158273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:05.158873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:05.161044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f01c9d9-840c-41cb-9e8a-b4b878743221", "name": "network-vif-plugged", "status": "completed", "tag": "09bab76f-82c4-4011-92aa-1bf4181657d5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:05.168429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:05.183155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.183687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.184127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.185007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.185466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.185894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.190791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.191273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.201584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.240408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] Creating event network-vif-plugged:09bab76f-82c4-4011-92aa-1bf4181657d5 for instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 on n-h2-860864-13 Oct 28 17:44:05.252387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-835ecd9c-300b-4454-babf-5a7bc9e8cb94 req-e048258a-2533-40df-9c7b-3cc62c68daae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103562 Oct 28 17:44:05.257021 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1801/3702] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:44:05.318114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:05.328954 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-109512fd-108a-4120-9ebd-0d18076ac534 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1272 microversion: 2.1 time: 0.178085 Oct 28 17:44:05.359412 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1902/3703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:05 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:05.423061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:05.423995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:05.437480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.438998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.440605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.442541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.443209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.445737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.684398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:05.704009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92267762-9999-4d4c-a2fc-c95cc8f9c39f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1513 microversion: 2.1 time: 0.281875 Oct 28 17:44:05.704733 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1802/3704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:05 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:05.785192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:05.787646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:05.804677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.807538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.809425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:05.812026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:05.812807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:05.816117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.005251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:06.006010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:06.023828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.025302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.026048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.026998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.027717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.028396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.218459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.233668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.235667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.242867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2cfbf49a-bbca-45a2-a407-54a0e3964bf5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.241335 Oct 28 17:44:06.244318 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1803/3705] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:06 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:06.297604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.315730 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85ae801e-a22f-49af-9623-afb7c489793d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.541047 Oct 28 17:44:06.317178 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1903/3706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:05 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:06.366138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:06.367043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:06.376549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.377632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.378564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.379629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.380649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.381307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.416087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:06.490762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.503085 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28e22cb8-6091-426e-b4af-4bc74a9c42b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1272 microversion: 2.1 time: 0.141182 Oct 28 17:44:06.504160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1804/3707] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:06 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:06.730263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:06.730618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:06.739613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.740458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.742092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.743692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:06.748187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:06.749152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:06.752351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:06.955007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:06.971627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f36526c-50ee-4f7c-9097-a7885d9902b5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.247598 Oct 28 17:44:06.972819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1904/3708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:06 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:07.276811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:07.277491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:07.279304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:07.291956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.292769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.293424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.294672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.295304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.296325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.348654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:07.349534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:07.377196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.377196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.378012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.378533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.378845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.382329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.413315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:07.427219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:07.433616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:07.447534 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69728dd5-8d67-484e-ac27-6a1c938a72a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.175582 Oct 28 17:44:07.471650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1805/3709] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:07 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:07.529365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:07.529990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:07.543824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.545596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.546466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.549305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:07.551918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:07.552777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:07.591749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:07.599743 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c9866ec-2e2a-4f8a-809f-752846c52aa8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.261086 Oct 28 17:44:07.614265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1905/3710] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:07 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:07.676414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:07.693131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b998b9af-3a62-4ac0-ab62-a1805c735366 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1272 microversion: 2.1 time: 0.168064 Oct 28 17:44:07.694054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1806/3711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:07 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:08.012817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:08.016581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:08.032093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.033876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.035089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.036197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.037370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.038592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.450470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.469436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0fc64573-b5fc-4067-ab55-f33b56f24fe4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.469982 Oct 28 17:44:08.485808 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1906/3712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:07 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:08.489268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:08.490448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:08.508087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.510581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.512715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.513593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.518189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.518877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.622458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.635860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:08.636778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:08.637815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.641180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.646396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.650599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.651113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.652280 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54ccdcc1-e79d-47b6-bd52-e97d7325648a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.167243 Oct 28 17:44:08.653345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.654077 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1807/3713] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:08 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:44:08.655137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.655930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.722744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:08.723730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:08.732534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.733369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.734052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.735114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:08.735750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:08.736334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:08.873696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.882302 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cf94bb82-fbe6-47de-bec5-063f82ce3833 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1272 microversion: 2.1 time: 0.163932 Oct 28 17:44:08.882996 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1808/3714] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:08 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:08.916774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:08.929048 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8eb5d74-4a44-4ab2-afb9-00cce2276807 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.305553 Oct 28 17:44:08.930338 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1907/3715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:08 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:09.499265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:09.499999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:09.510653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.511143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.511604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.512508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.513125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.513724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.674259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:09.685092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:09.685755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:09.694923 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eee15475-a0c0-42eb-ae94-4136c0d842e5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.199580 Oct 28 17:44:09.699626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.700118 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1809/3716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:09 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:09.700792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.701465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.702357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.702969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.703585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.794298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:09.809665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:09.811446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:09.834442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47e20b7f-2ec7-4d7e-b8f1-141afa6264fe tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.153767 Oct 28 17:44:09.835697 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1908/3717] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:09 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:09.910009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:09.910852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:09.923339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.923856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.924290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.925205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.925823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.926517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.958974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:09.960176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:09.975048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.975933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.983593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:09.983593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:09.983593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:09.983593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:10.021188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:10.031620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-029502fd-bfee-41e9-879d-2ec213655f4a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1278 microversion: 2.1 time: 0.125333 Oct 28 17:44:10.036264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1810/3718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:09 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:10.225128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:10.238366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-468df050-f589-4c92-bdc5-9e76ce847fca tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.285161 Oct 28 17:44:10.262103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1909/3719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:09 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:10.730782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:10.731576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:10.746103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:10.746852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:10.747668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:10.748637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:10.749346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:10.750239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:10.873471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:10.874668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:10.886481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:10.887243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:10.887923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:10.888943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:10.889751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:10.890388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:11.016548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.032809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.033709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.046569 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4730c769-b374-4fdc-a052-838565da6e7a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.179399 Oct 28 17:44:11.049965 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1910/3720] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:10 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:11.065479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:11.067681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:11.073271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.077386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:11.078608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:11.079233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:11.080132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:11.081171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:11.082250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:11.084019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0999a18a-0a2f-4dda-9963-7cfa61c43160 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.357469 Oct 28 17:44:11.085423 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1811/3721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:10 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:11.166566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.176611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b3a9f5f-9e95-4722-aeba-3d6d3283b7e2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1278 microversion: 2.1 time: 0.123443 Oct 28 17:44:11.178113 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1911/3722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:11 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:11.268396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:11.269761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:11.278208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:11.279330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:11.280519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:11.281488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:11.282624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:11.283773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:11.796642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:11.808849 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-813c2304-b8ea-448c-85f9-f7c40bdea231 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.547390 Oct 28 17:44:11.809430 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1812/3723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:11 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:12.081895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:12.083240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:12.088869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:12.090780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:12.104810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.107664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.108528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.109976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.111820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.120198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:12.120818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:12.125599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.133246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.139589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.142692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.145591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.147488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.152604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.284188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:12.301407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:12.304365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:12.313058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-228671e2-bec0-4c32-9410-595e22bab3bc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.235218 Oct 28 17:44:12.314497 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1912/3724] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:12 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:12.321148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:12.322914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:12.330803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.331766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.332667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.333663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.334346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.335200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.662824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:12.673188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:12.693629 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e95367a-5a35-48da-af33-1eeb64cd42b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.579449 Oct 28 17:44:12.695037 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1813/3725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:12 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:12.792932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:12.801370 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abec7b13-6651-46b8-970a-a16e5a687009 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.485497 Oct 28 17:44:12.808777 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1913/3726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:12 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:12.833289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:12.838480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:12.870249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.876213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.877173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:12.881623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:12.885181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:12.886819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:13.355071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:13.356870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:13.375540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:13.376340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:13.376783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:13.379381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:13.379867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:13.380302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:13.733864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:13.748582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:13.750436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:13.761901 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dde3c7c5-8376-48c2-8519-f0d1a3106d5c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.419172 Oct 28 17:44:13.768740 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1914/3727] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:13 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:13.780411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:13.781092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:13.792561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:13.793053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:13.793492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:13.794192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:13.799241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:13.799919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:14.022382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.039073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d58fc9a-da61-4f09-ab24-95cc55a9257b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 1.209579 Oct 28 17:44:14.043384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1814/3728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:12 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:14.055010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:14.058260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:14.084467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:14.086395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:14.090033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:14.094382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:14.096513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:14.098366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:14.198314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.212802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85b274ee-2dbb-464d-9c58-2003f9115307 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.442363 Oct 28 17:44:14.213528 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1915/3729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:13 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:14.461952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.474898 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-decad9d9-bcf4-43ff-b925-0ffaccd584cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.430068 Oct 28 17:44:14.477151 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1815/3730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:14 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:14.798804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:14.799540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:14.816288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:14.816957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:14.818005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:14.818854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:14.819401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:14.823866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:14.968781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.981557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.983151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:14.990639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab03d12c-df74-48b1-91ce-87fa7d034fe0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1533 microversion: 2.91 time: 0.196395 Oct 28 17:44:14.991319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1916/3731] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:14 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1533 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:15.023359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:15.024013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:15.031409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.039221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.042783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.043570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.045214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.049472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.068994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:15.071868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:15.083467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.085997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.087299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.088877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.089547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.090738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.244382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lazy-loading 'services' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:44:15.277836 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-574ba9a9-04e3-44f4-b3ac-119434ce381e tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1940 microversion: 2.91 time: 0.257941 Oct 28 17:44:15.301285 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1816/3732] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:15 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1940 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:15.577133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6280f8-3265-46c3-82f0-321a9f9722e5", "tag": "1e8dfa6f-357f-4d27-9e01-cd02e9895a49"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:15.589495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.590274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.591264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.614334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] Creating event network-changed:1e8dfa6f-357f-4d27-9e01-cd02e9895a49 for instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 on n-h1-860864-13 Oct 28 17:44:15.642620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-494468b4-3749-4e9a-8569-f1c8a1a5aeb4 req-30f6e2de-0ba4-42d5-b5a3-c6e789242030 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336704 Oct 28 17:44:15.646048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1817/3733] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:15.653896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:15.656065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:15.666050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.666869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.667570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.668812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.669672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.670405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.672772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:15.682788 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0f818f9-fda3-4719-9465-88ddefba77de tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.619063 Oct 28 17:44:15.693829 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1917/3734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:15 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:15.703857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:15.704556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:15.741539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.742453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.743237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.744462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:15.745083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:15.745768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:15.795214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lazy-loading 'flavor' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:44:15.952465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:16.124102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.140645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ae5526c-af6f-45bc-83ca-5534510fdcb2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.492898 Oct 28 17:44:16.154954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1818/3735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:15 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:16.170697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:16.172064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:16.180549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.181467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.182277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.183302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.184067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.184820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.242496 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe31a57a-1096-4fa4-bb97-de6305ed99cb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action" status: 202 len: 0 microversion: 2.91 time: 0.543200 Oct 28 17:44:16.244451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1918/3736] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:44:15 2022] POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:44:16.276962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:16.279471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:16.297887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.304429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.305166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.306664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.307402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.308163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.499143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.513643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.519913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.526840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:16.539608 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4349f7ed-9469-4d57-b929-815ed158740d tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.275179 Oct 28 17:44:16.541917 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1919/3737] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:16 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:16.633614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.646264 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b20aedd2-c4fb-4637-9619-27979ad1e135 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.482603 Oct 28 17:44:16.648088 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1819/3738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:16 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:16.720707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:16.721316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:16.735747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.736257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.736696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.737408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:16.737864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:16.738321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:16.967435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:16.983743 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ee9c4b6-6c85-43f8-ae67-78f97a42b228 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.266759 Oct 28 17:44:16.985403 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1920/3739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:16 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:17.171692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:17.172458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:17.187062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.187660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.190228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.191005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.194241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.194928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.578132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:17.587738 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9add6cc9-e65d-4d15-9c7e-9a663261a332 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.420196 Oct 28 17:44:17.591712 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1820/3740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:17 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:17.599642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:17.600249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:17.620800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.621771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.622495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.623539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.624172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.624782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.630260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:17.691439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Calling method '.version_select at 0x7f751f719790>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:17.693439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.693932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.694358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.708007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:17.717502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.717975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.718629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.719145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:17.720731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:17.729648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e5aef50-c0c7-4627-a3ce-3ec1717ad17b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.133070 Oct 28 17:44:17.729648 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1821/3741] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:17 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:17.733776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:17.734632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:17.736955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.737615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.738202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.741912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.742514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.743084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.744073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:17.744750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:17.745409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:17.745882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ea7c9fd-f832-48da-91bc-49342d40017e tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1703743530-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.258746 Oct 28 17:44:17.746837 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1921/3742] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:44:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:44:17.981785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:17.990305 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-365c8581-b4a7-4b71-8402-154933074e67 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.260440 Oct 28 17:44:17.996255 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1822/3743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:17 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:18.009795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:18.011219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:18.028440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.029071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.029679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.030395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.030847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.031271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.403862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:18.415214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ade4e46-454b-43ff-bee2-23b5bde51a6e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.409910 Oct 28 17:44:18.416136 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1922/3744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:18 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:18.617699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:18.618990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:18.632280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.632776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.633220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.633980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.634421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.634848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.760448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:18.761067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:18.769991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.770732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.772318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.774434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:18.775115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:18.775771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:18.913372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:18.935697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:18.938802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:18.957463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cd33026-369e-4d7f-a583-83c0a21f1597 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.200855 Oct 28 17:44:18.958076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1923/3745] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:18 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:44:19.017808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:19.019282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:19.027972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:19.035079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:19.035750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:19.037255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:19.040729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:19.041474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:19.096664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:19.124135 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9c562d3-ac0c-40bc-a1d3-516d54432230 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.503070 Oct 28 17:44:19.124893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1823/3746] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:18 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:19.440939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:19.441665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:19.453091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:19.453616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:19.454089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:19.454830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:19.464801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:19.465422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:19.489023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:19.500663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3e58fc1-3629-48ec-a170-e5e915df6701 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.486828 Oct 28 17:44:19.502621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1924/3747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:19 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:19.756867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:19.770994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53364fe4-28b4-45c8-8a9f-498090e3af23 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.333895 Oct 28 17:44:19.795731 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1824/3748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:19 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:19.995204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:19.996161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:20.005450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.010238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.010953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.011918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.012573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.013181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.152034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:20.153924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:20.175396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.176229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.178015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.197212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.197867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.201605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.204512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:20.219161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:20.220940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:20.232838 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3955001f-dc84-453e-bba6-eea2d8bc4489 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.242399 Oct 28 17:44:20.239648 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1925/3749] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:19 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:20.526859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:20.527404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:20.535745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.536247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.536709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.537388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.537848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.538278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.761711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:20.775244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a48b15d7-7a6d-4f8e-b4c2-b193dd1ad812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.629767 Oct 28 17:44:20.775873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1825/3750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:20 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:20.806643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:20.807572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:20.815883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.816392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.817227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.818142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:20.818602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:20.819030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:20.967243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:20.975413 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c020e11a-fac5-4559-8a19-72bf320b9905 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.452620 Oct 28 17:44:20.991712 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1926/3751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:20 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:21.220030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:21.230123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0efc30d6-1da2-471b-aeab-2cec7002b1bc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.431498 Oct 28 17:44:21.243446 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1826/3752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:20 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:21.276739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:21.277409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:21.295952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:21.296688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:21.297823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:21.298801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:21.299796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:21.300449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:21.398256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:21.407706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:21.409801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:21.415849 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c726b263-cd17-4677-bbad-dd4c8d7c6fa5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.144001 Oct 28 17:44:21.417128 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1927/3753] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:21 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:21.801022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:21.802178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:21.812812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:21.813702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:21.815743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:21.817001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:21.818308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:21.818988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:21.998203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:21.999276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:22.007065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.007998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.008725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.009687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.010416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.011080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.710926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:22.725899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-93f95105-4705-447f-9cb9-11b32cb877b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.928731 Oct 28 17:44:22.729034 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1827/3754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:21 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:22.737867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:22.738595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:22.746861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.747704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.748329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.750603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.751415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.752282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.763074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:22.775745 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c6f7f96-104f-456a-9f6f-bed76521dc29 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.780450 Oct 28 17:44:22.779816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1928/3755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:21 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:22.791240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:22.801298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:22.808951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.809373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.809823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.810591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:22.811076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:22.811503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:22.946237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:22.965202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:22.981318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:22.987219 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e2b0498-8f84-4f87-a6fa-aabd4f51da16 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.206073 Oct 28 17:44:22.988028 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1929/3756] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:22 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:22.994078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6280f8-3265-46c3-82f0-321a9f9722e5", "name": "network-vif-plugged", "status": "completed", "tag": "1e8dfa6f-357f-4d27-9e01-cd02e9895a49"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:23.003852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:23.004587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:23.005201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:23.017768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] Creating event network-vif-plugged:1e8dfa6f-357f-4d27-9e01-cd02e9895a49 for instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 on n-h1-860864-13 Oct 28 17:44:23.025472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-bbd19d8c-691f-475f-bad4-fc4f9f50ed6e req-c3d26cbb-ee72-4be9-a606-30ad6266c381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036008 Oct 28 17:44:23.026585 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1930/3757] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:23.275783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:23.287675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d2ec4c5-5863-41c2-9d6a-2486d5aeccb0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.557327 Oct 28 17:44:23.289468 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1828/3758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:22 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:23.759343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:23.760563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:23.768297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:23.769089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:23.769380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:23.770275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:23.770849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:23.771601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:23.804852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:23.807502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:23.815166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:23.815913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:23.816536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:23.817577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:23.818206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:23.818839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:24.179205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.189629 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2021ca4b-ca49-4717-901b-6f873034ba23 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.436832 Oct 28 17:44:24.200259 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1931/3759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:23 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:24.214567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:24.215648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:24.223934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:24.224933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:24.225389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:24.226273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:24.228072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:24.228800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:24.251070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.266485 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f841090b-4bd3-4f94-a4f3-79051ed466ac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1320 microversion: 2.1 time: 0.467521 Oct 28 17:44:24.268221 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1829/3760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:23 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:24.314529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:24.315211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:24.323109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:24.323960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:24.324571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:24.325462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:24.325924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:24.326354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:24.370941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.380648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.382312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.389119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d96cab5e-d535-4c09-a7ac-2b7498cf5a42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.184765 Oct 28 17:44:24.389936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1932/3761] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:24 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:24.733763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:24.749071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c94514e4-ee36-4420-9de3-e64e44ceee7e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1499 microversion: 2.1 time: 0.438751 Oct 28 17:44:24.749878 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1830/3762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:24 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1499 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:25.218901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:25.220599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:25.230462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.231031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.231732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.233350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.234066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.234702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.293048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:25.294054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:25.302343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.302957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.304138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.304945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.305687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.306115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.791575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:25.796685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:25.801820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6924293b-75ba-4ee5-ba24-3969ed6ae3b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1501 microversion: 2.1 time: 0.513417 Oct 28 17:44:25.802578 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1831/3763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:25 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1501 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:25.810605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:25.812634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:25.820660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.822389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.823171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.824681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.825637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.826423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9dd13473-38f6-45ea-8c6c-420ffcbedb8f tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1505 microversion: 2.1 time: 0.611206 Oct 28 17:44:25.826857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.827554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1933/3764] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:25 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:25.853816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:25.854678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:25.865895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.866393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.866824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.867562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.868085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.868487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.938219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:25.946671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:25.948262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:25.953380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-179eab2a-aa3d-4eb5-a671-5e0154873b9a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.149615 Oct 28 17:44:25.954088 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1832/3765] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:25 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:25.958519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:25.959110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:25.966207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.966701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.967140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:25.967876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:25.968328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:25.968753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.232332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:26.242354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ae5c9bf-dbdc-401b-9909-2e4ead5ece41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 200 len: 1476 microversion: 2.1 time: 0.400231 Oct 28 17:44:26.244169 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1934/3766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:25 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:26.267535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1815936423"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:26.270776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:26.277263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.277870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.278538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.279541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.280048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.280542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.298818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:26.315794 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f503430d-c2f8-4e4f-94ae-c85c5ba5c6d5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1501 microversion: 2.1 time: 0.360074 Oct 28 17:44:26.317229 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1833/3767] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:25 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:26.339658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:26.340163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:26.348280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.348965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.349405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.350420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.351080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.351720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.381750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:44:26.466598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:26.497717 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61fe8f85-bd02-45cf-a531-f7b08704af72 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 204 len: 0 microversion: 2.1 time: 0.161048 Oct 28 17:44:26.498359 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1834/3768] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:44:26 2022] DELETE /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:44:26.523467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:26.523467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:26.533935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.535995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.536455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.537472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.537612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.538056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.539192 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6942660a-b541-4231-b88f-4b44d93d7ce4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48/action" status: 202 len: 0 microversion: 2.1 time: 0.276935 Oct 28 17:44:26.540337 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1935/3769] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:26 2022] POST /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:44:26.564378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5933b5ee-6ab7-4b89-8af1-612daa366c8e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7121f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:26.657609 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5933b5ee-6ab7-4b89-8af1-612daa366c8e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.109524 Oct 28 17:44:26.658623 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1936/3770] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:26 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:26.750226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:26.759830 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf6f2e75-6728-4438-9245-81848b9ae8c5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1507 microversion: 2.1 time: 0.253407 Oct 28 17:44:26.760425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1835/3771] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:26 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:26.858887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:26.859696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:26.866446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.866872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.867321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.868297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.868786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.869212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.982854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:26.983478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:26.989453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.990161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.990821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.991556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:26.992217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:26.992701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:26.998209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:27.061347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:27.071578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2742e8d4-892d-453b-98d9-a7ff2f5181d0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1505 microversion: 2.1 time: 0.216994 Oct 28 17:44:27.072332 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1937/3772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:26 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:27.082254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:27.091025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:27.092613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:27.097626 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df18707a-9b8c-4f69-beb8-0dacf21efe42 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.118668 Oct 28 17:44:27.098217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1836/3773] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:26 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:44:27.674151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb5463c9-a085-43a9-a383-d69a91de0c43 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524481af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:27.737586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb5463c9-a085-43a9-a383-d69a91de0c43 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.067765 Oct 28 17:44:27.738260 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1938/3774] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:27 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:27.783487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:27.784099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:27.791064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:27.791587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:27.792028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:27.792725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:27.793177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:27.793599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:27.996899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.006871 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-640258b0-d292-453d-ab3f-cc98673aee7e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1507 microversion: 2.1 time: 0.227245 Oct 28 17:44:28.008980 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1837/3775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:27 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:28.095769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:28.096483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:28.104683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.107158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.107846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.108913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.109577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.110924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.131257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:28.133408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:28.142740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.143644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.144413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.146210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.146984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.148003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.286754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.298618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.302548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.313522 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b31d8e17-26bc-4b21-aaa2-18ce3446bd88 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.189127 Oct 28 17:44:28.328373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1838/3776] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:28 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:28.390375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.400586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa15396a-e782-4c65-889a-f5afd4ba4b61 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 200 len: 1508 microversion: 2.1 time: 0.309251 Oct 28 17:44:28.401183 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1939/3777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:28 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:28.423138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:28.423761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:28.432449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.433036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.433537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.434301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.434812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.435579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.669981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.678397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a4ce967-acec-4c69-babb-16cbce0883a6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.259114 Oct 28 17:44:28.696218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1839/3778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:28 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:28.705542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:28.706153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:28.716226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.716714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.717162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.717868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:28.718321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:28.718736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:28.753363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b367b3e-5c54-42dc-86ba-47f165f82ed7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f769820>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:28.807385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b367b3e-5c54-42dc-86ba-47f165f82ed7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.057741 Oct 28 17:44:28.808284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1840/3779] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:28 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:28.976359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:28.987334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f01c9d9-840c-41cb-9e8a-b4b878743221", "name": "network-vif-unplugged", "status": "completed", "tag": "09bab76f-82c4-4011-92aa-1bf4181657d5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:29.007479 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd36a3ee-8728-4246-8a4b-de6349598c6c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.305591 Oct 28 17:44:29.008004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1940/3780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:28 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:29.012711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:29.020739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.021406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.021858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.034194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.034778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:29.057559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.057689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.058114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.058894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.059298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.059779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.066306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] Unable to find a host for instance 9f01c9d9-840c-41cb-9e8a-b4b878743221. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:44:29.077485 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-65d9a912-ee87-42a2-a8b5-06da03bd3b3c req-39186ef6-23de-4e6b-8255-4581505d7dca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.093871 Oct 28 17:44:29.082703 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1841/3781] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 17:44:29.097603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.099054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:29.120680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.121673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.122120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.123013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.123509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.124121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.329202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.361865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3da1fd66-3c52-4e83-8916-a6bca1c3378c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 200 len: 1465 microversion: 2.1 time: 0.276714 Oct 28 17:44:29.368805 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1842/3782] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:29.389477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6280f8-3265-46c3-82f0-321a9f9722e5", "name": "network-vif-deleted", "tag": "1e8dfa6f-357f-4d27-9e01-cd02e9895a49"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:29.402161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.403038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.404365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.421139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] Creating event network-vif-deleted:1e8dfa6f-357f-4d27-9e01-cd02e9895a49 for instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 on n-h1-860864-13 Oct 28 17:44:29.426126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.428187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b8918f90-5653-4c47-a3e1-74ea5eb0e01d req-8c8e9cff-1491-44e4-8e3b-233a40155252 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057467 Oct 28 17:44:29.429813 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1843/3783] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:29.438932 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9f67d27-2744-4567-b29f-c1f1f3b91356 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.410029 Oct 28 17:44:29.444830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1941/3784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:29.455449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.458437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:29.473919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.474833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:29.477631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.478273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.480660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.481751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.483265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.483574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.484084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.484645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.485252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.486569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.487471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.488074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.640886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.672031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.674476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.686106 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c58defe0-d7fc-40f8-82ee-45a18ff19e38 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.253392 Oct 28 17:44:29.688577 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1844/3785] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:29.722983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:29.732995 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd02d32d-8a6a-402a-aa25-12097950d6c8 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.263859 Oct 28 17:44:29.734589 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1942/3786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:29.759192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:29.766575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.767174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.767784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.796096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:44:29.824269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b87ad3d8-5039-40ea-9e05-68a8b3eeffd5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f774af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.859034 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6dc35e74-1ba3-458a-b6be-93b1ddf2b297 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.104624 Oct 28 17:44:29.860716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1845/3787] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:29 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:44:29.872038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:29.872940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:29.873424 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b87ad3d8-5039-40ea-9e05-68a8b3eeffd5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.053052 Oct 28 17:44:29.874191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1943/3788] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:29.882948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.884487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.885328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:29.886219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:29.886874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:29.887517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:30.089130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:30.102491 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6376439b-7805-4c91-8d45-d164183e7c0b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.236145 Oct 28 17:44:30.103753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1846/3789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:29 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:30.390670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:30.391279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:30.400397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:30.401402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:30.402098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:30.403476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:30.404099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:30.405584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:30.424525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 HTTP/1.1 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0e6280f8-3265-46c3-82f0-321a9f9722e5'} Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:44:30.426825 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:44:30.433035 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:30.435005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:44:30.436230 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23a46281-40ee-4cb0-8945-e3dbb4f1ca85 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 404 len: 111 microversion: 2.1 time: 0.049550 Oct 28 17:44:30.437175 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1944/3790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:30 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:44:30.451185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d847bd49-8191-45ef-b602-29e29fc46c84 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: .version_select at 0x7f751f6cca60>, body: {"keypair": {"name": "tempest-key-1676417571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMPnrwecYS2krto/QGtj6n71AZSC/PsT8iETQKVYkStE7/871L0nAqm2zGhW5Z0sjnydDkgIOLMMRD7fbBFhEF+0wcEeJpqFyeRskj/PfYBG2kGJ6jqD3OlpL7knTTL/Q=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:30.483697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d847bd49-8191-45ef-b602-29e29fc46c84 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:44:30.495645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d847bd49-8191-45ef-b602-29e29fc46c84 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:44:30.532220 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d847bd49-8191-45ef-b602-29e29fc46c84 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.084626 Oct 28 17:44:30.533542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1847/3791] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:44:30 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:30.544180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c23587c-b3b1-4a28-9663-f8fb317987cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '.version_select at 0x7f751f774e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:30.548144 n-d-860864-13 devstack@n-api.service[120567]: WARNING oslo_db.sqlalchemy.utils [None req-9c23587c-b3b1-4a28-9663-f8fb317987cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:44:30.565830 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c23587c-b3b1-4a28-9663-f8fb317987cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.025687 Oct 28 17:44:30.577797 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1945/3792] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:44:30 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:30.720513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:30.721273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:30.735564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1728522742", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-key-1676417571", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:30.740622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:30.742837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:30.743431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:30.744535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:30.746316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:30.750174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:30.831965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:44:30.939297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:30.951175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:30.953978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:30.964703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3209fdef-71d9-4f4f-ab2f-a32b2ec4825f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.248473 Oct 28 17:44:30.965556 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1848/3793] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:30 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:30.970788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e306940-a9fb-4842-9c7e-eccde8c60636 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6cc790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:31.029504 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e306940-a9fb-4842-9c7e-eccde8c60636 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.062531 Oct 28 17:44:31.030346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1849/3794] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:30 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:31.134392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:31.135410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:31.145313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.145934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.146519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.147771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.148326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.148975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.486398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:31.497495 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a7be2f28-07c7-4648-98e0-11db7c251e85 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.371530 Oct 28 17:44:31.498197 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1850/3795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:31 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:31.505442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb7224fc-6b41-4c63-a8de-d3b108e5e35b"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:31.508748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:31.519491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.520627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.521523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.522921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.523796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.524466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.824250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:44:31.824750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:44:31.825841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:44:31.826340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:44:31.826825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:44:31.852792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.853611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.854121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.855097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:31.855663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:31.856344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:31.879245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:44:31.887247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:44:31.893316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aee9abd4-8e92-4204-8061-651e26e91721 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392129 Oct 28 17:44:31.900234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1851/3796] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:44:31 2022] POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:31.902892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:44:31.905505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:44:32.002734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:32.003477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:32.022244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:32.025385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:32.027212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:32.028329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:32.029097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:32.030581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:32.052644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f7f0d2b-511e-4e56-b191-0b010308752b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312301 Oct 28 17:44:32.053366 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1946/3797] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:44:32.059360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-31d88cce-501e-4a57-9bf8-66d8afb4a241 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75245b2820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:32.186963 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-31d88cce-501e-4a57-9bf8-66d8afb4a241 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.132422 Oct 28 17:44:32.187711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1947/3798] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:32 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:32.205749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-357b7bdc-5372-45a5-b07b-549327e7d91c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:32.206585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-357b7bdc-5372-45a5-b07b-549327e7d91c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:32.213548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:32.231783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:32.236764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:32.259320 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-845e0d48-e323-41f8-bfec-2702de86a094 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.258152 Oct 28 17:44:32.272544 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1852/3799] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:31 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:32.522691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:32.525414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:32.535276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:32.536073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:32.536688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:32.538356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:32.539270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:32.540641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:33.186655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-357b7bdc-5372-45a5-b07b-549327e7d91c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:33.199959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-357b7bdc-5372-45a5-b07b-549327e7d91c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1229 microversion: 2.1 time: 0.999956 Oct 28 17:44:33.200570 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1948/3800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:32 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1229 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:33.211683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5236247-2167-4d53-a57a-7277f1c66c48", "name": "network-vif-plugged", "status": "completed", "tag": "d4ada3f6-9b80-484e-8bf0-f62b8a255477"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:33.246004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:33.246775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:33.247435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:33.267136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] Creating event network-vif-plugged:d4ada3f6-9b80-484e-8bf0-f62b8a255477 for instance b5236247-2167-4d53-a57a-7277f1c66c48 on n-h1-860864-13 Oct 28 17:44:33.275183 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a548ca39-3d24-4ec4-a208-41fbe2bb27f0 req-807bd6a6-8382-4dcd-84b1-596facc737d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073024 Oct 28 17:44:33.277676 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1949/3801] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:33.286001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25b65e86-d16b-4755-8b9f-5ef5c3d33983 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f799ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:33.357738 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25b65e86-d16b-4755-8b9f-5ef5c3d33983 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.077078 Oct 28 17:44:33.370096 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1950/3802] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:33 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:33.376306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:33.377756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:33.387414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:33.388211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:33.388986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:33.390854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:33.391616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:33.392216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:33.496068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:33.515740 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4e5530a-3c20-465c-81bd-d1a09be74271 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.997952 Oct 28 17:44:33.521804 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1853/3803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:32 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:33.630428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:33.644804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:33.647901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:33.671270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-618719ca-0744-42b9-b035-918aebdbfc95 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.297799 Oct 28 17:44:33.672425 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1951/3804] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:33 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:34.236271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:34.236976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:34.254929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.257534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.258837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.260191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.261966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.265528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.378233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eec407e6-d830-4a5d-82e8-e4a86809c9cd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7005e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:34.423709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:34.427202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:34.438692 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9452966b-07e9-4724-9a05-d634acd1fbf8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1287 microversion: 2.1 time: 0.206129 Oct 28 17:44:34.441961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1854/3805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:34 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:34.482283 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eec407e6-d830-4a5d-82e8-e4a86809c9cd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.108028 Oct 28 17:44:34.482283 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1952/3806] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:34 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:34.550402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:34.551237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:34.561092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.570365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.571278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.572470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.574589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.574945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.708677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:34.709302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:34.733544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.733955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.734630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.735593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:34.736220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:34.736834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:34.934454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:34.943630 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3324515-2630-4301-9a74-ab5b130e163b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.399920 Oct 28 17:44:34.950759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:34.958866 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1855/3807] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:34 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:34.963036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:34.970467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:34.983217 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df21bd71-2fd3-4fff-9139-f836cf71f559 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.279295 Oct 28 17:44:34.994355 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1953/3808] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:34 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:44:35.467616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:35.468574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:35.487122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:35.487656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:35.488097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:35.488806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:35.491006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:35.491494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:35.498372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c31798de-2034-43c3-9aec-bc6a09f2131e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6c69d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:35.586266 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c31798de-2034-43c3-9aec-bc6a09f2131e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.093635 Oct 28 17:44:35.588149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1954/3809] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:35 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:35.691204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:35.711197 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cfcb2154-1c69-42d1-a2e7-5eecb39b787a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1287 microversion: 2.1 time: 0.246575 Oct 28 17:44:35.713847 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1856/3810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:35 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:35.971211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:35.972851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:35.989968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:35.992786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:35.993947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:35.994717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:35.997902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:36.000599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:36.017538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:36.018058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:36.043182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:36.046634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:36.051025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:36.054976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:36.058454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:36.061036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:36.381239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:36.425065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:36.426630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:36.442583 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a66557c4-da3b-4c21-b753-2f31f45129b9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.428638 Oct 28 17:44:36.466889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1857/3811] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:36 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:36.608809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a885054-4953-46f9-991a-ba09f2765d33 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7528683040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:36.699558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a885054-4953-46f9-991a-ba09f2765d33 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.093103 Oct 28 17:44:36.702044 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1858/3812] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:36 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:36.716857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:36.744612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:36.745472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:36.758313 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-452f9401-c764-46b7-b13c-a091ded7cef6 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.786811 Oct 28 17:44:36.774695 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1955/3813] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:35 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:36.783478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:36.785818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:36.787822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:36.790144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:36.791767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:36.793001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:37.221319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:37.234361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-015ef2df-532e-4cae-a166-bd3e6ddf81a3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.495951 Oct 28 17:44:37.240113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1859/3814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:36 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:37.487455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:37.488116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:37.501718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:37.502236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:37.502666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:37.503398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:37.503866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:37.504302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:37.691681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:37.701462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:37.717618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-387c9016-5510-4258-8768-80c2d9499989 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75286834c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:37.729378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:37.749421 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4041c957-1bc3-44d3-b614-2a252223bc65 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.265832 Oct 28 17:44:37.753363 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1956/3815] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:37 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:37.790704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:37.792099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:37.796900 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-387c9016-5510-4258-8768-80c2d9499989 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.083003 Oct 28 17:44:37.800246 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1860/3816] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:37 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:37.826912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:37.833736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:37.838142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:37.842108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:37.842754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:37.845962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:38.263247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:38.264028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:38.276762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:38.288546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:38.289050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:38.289857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:38.290336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:38.290773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:38.565490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:38.585068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98c4eda0-f6ea-49fe-a780-b8cbdc279e8d tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.801060 Oct 28 17:44:38.590040 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1957/3817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:37 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:38.784974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:38.787265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:38.803501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:38.809739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:38.810928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:38.816718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:38.817673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:38.818891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:38.819619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:39.034155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:39.044296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-96d5a8a7-0e41-4f65-9f87-ad4945913826 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.787138 Oct 28 17:44:39.051305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1861/3818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:38 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:39.084104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be172d37-7755-4ab3-b8cc-6a8d93dde18f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7bc700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:39.099990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:39.150671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:39.168534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:39.193703 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e0fa022-1e4f-4b45-8f72-3a15a9b81be2 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.412709 Oct 28 17:44:39.200331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1958/3819] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:38 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:39.209785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565a0b8e-e4e4-4ce5-8465-b4b9d446ea18", "tag": "88ccb651-d408-405c-b106-9a27e290824d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:39.221196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be172d37-7755-4ab3-b8cc-6a8d93dde18f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.168428 Oct 28 17:44:39.228484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:39.229223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:39.229837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:39.231579 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1862/3820] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:39 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:39.246380 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] Creating event network-changed:88ccb651-d408-405c-b106-9a27e290824d for instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 on n-h2-860864-13 Oct 28 17:44:39.256275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ed234358-dcd2-45f8-b192-614725b6be2c req-2f52ee29-bc30-4e06-b5cd-ae13eb38eccb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054641 Oct 28 17:44:39.260174 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1959/3821] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:39.623158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:39.624719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:39.653380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:39.656456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:39.657326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:39.658268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:39.660018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:39.662713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:40.077790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:40.079189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:40.094718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:40.099331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:40.100273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:40.101198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:40.105586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:40.106025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:40.347992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:40.366694 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5a1c74f-fb57-4e6a-8027-d43b4e1f3610 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1681 microversion: 2.1 time: 0.749793 Oct 28 17:44:40.371481 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1863/3822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:39 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1681 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:40.391730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:40.393340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:40.419865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:40.423269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:40.426313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:40.429166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:40.430013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:40.432328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:40.514689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:40.540072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:40.549146 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-543dbff8-5bda-494c-9a53-e4197e2f15b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.475634 Oct 28 17:44:40.558353 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1960/3823] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:40 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:40.563500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12729773-5f72-44dd-8166-7bc3f790833e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f774ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:40.594438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:40.608230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:40.615784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:40.637227 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9fb9e94c-3882-4d8c-bd7b-326b0bf95abb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.264268 Oct 28 17:44:40.639668 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1864/3824] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:40 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:40.678878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-12729773-5f72-44dd-8166-7bc3f790833e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.118454 Oct 28 17:44:40.679548 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1961/3825] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:40 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:41.397503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:41.401394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:41.412010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.415286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.416713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.419959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.430008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.431311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.581927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:41.582530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:41.595090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.599835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.608968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.612329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.612989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.613618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.681623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:41.700037 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f28fdc6-4459-4523-b1b3-56274632cea4 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1658 microversion: 2.1 time: 0.309757 Oct 28 17:44:41.719172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1865/3826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:41 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1658 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:41.731955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:41.732951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:41.741124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.742056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.742819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.743919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:41.744644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:41.745314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:41.876608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:42.077342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:42.100439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:42.126660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:42.141114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:42.152882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53ffc0fd-40b9-4db0-8351-296cd33de1ab tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.570526 Oct 28 17:44:42.157891 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1962/3827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:41 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:42.168138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0084aa9-8292-4ea2-b7ae-6e270a777c3b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.447347 Oct 28 17:44:42.174847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abd9cf03-17a3-46bb-b935-ebe72e64b1fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f780670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:42.188265 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1866/3828] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:41 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:42.208715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:42.224838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:42.239230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:42.240236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:42.263565 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abd9cf03-17a3-46bb-b935-ebe72e64b1fb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.103151 Oct 28 17:44:42.278157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1963/3829] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:42 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:42.310518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Going to try to start instance {{(pid=120568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 17:44:42.395719 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76ab355d-7b7b-41c6-86c7-f1aea91c4d04 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.206002 Oct 28 17:44:42.396721 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1867/3830] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:42 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:44:42.412354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:42.415113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:42.428218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:42.429069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:42.429936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:42.431090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:42.435533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:42.436287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:42.808916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:42.823899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1850869d-63ad-43f0-b030-40b30ae7eb0e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1667 microversion: 2.1 time: 0.418287 Oct 28 17:44:42.826355 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1964/3831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:42 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:43.182995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:43.184360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:43.202037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:43.208075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:43.208673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:43.209396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:43.209604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:43.210065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:43.210464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:43.210596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:43.220779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:43.223770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:43.225712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:43.227514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:43.230178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:43.231987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:43.232699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:43.240149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:44.016583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:44.036332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:44.066821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:44.066821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f98a999b-a63a-4278-973e-a59b95a9b44e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.852972 Oct 28 17:44:44.066821 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1965/3832] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:43 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:44.067464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b0e1084-b216-4a79-814f-3859a4bed967 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6f83a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:44.151469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b0e1084-b216-4a79-814f-3859a4bed967 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.090390 Oct 28 17:44:44.152690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1966/3833] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:44 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:44.158502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:44.159619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:44.169059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:44.170390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:44.171199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:44.172239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:44.172976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:44.173964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:44.312133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:44.327127 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5ba813e-b79f-444b-891e-65e02aa9bedd tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 1.147497 Oct 28 17:44:44.346588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1868/3834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:43 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:44.572885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:44.585799 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1bb07523-1300-4e74-ab6f-948e2cbfbc46 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1667 microversion: 2.1 time: 0.431408 Oct 28 17:44:44.589708 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1967/3835] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:44 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1667 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:45.090706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:45.091657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:45.109037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.111969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.116585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.118205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.124119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.127092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.168106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2df9a44-cf68-4582-8c1d-b07eec2f2ec2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f712430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:45.252258 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2df9a44-cf68-4582-8c1d-b07eec2f2ec2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.084691 Oct 28 17:44:45.254752 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1968/3836] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:45 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:45.274923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:45.287444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:45.289362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:45.297606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04cf8973-06dc-48e3-8861-cb64c5123699 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.214908 Oct 28 17:44:45.298962 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1869/3837] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:45 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:45.358242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:45.361975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:45.388127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.392031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.392719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.393647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.394293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.396554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.614615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:45.615165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:45.621828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.628740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.629519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.630537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:45.631190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:45.631822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:45.903529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:45.916688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7518a475-c31e-4a64-b79f-341323c5189b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.562703 Oct 28 17:44:45.920897 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1969/3838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:45 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:46.041187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.057631 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cefef92d-766e-440d-9199-47c4d9244317 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.444582 Oct 28 17:44:46.061105 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1870/3839] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:45 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:46.084116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:46.085659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:46.099781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.100587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.101235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.102929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.105136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.107955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.111773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:46.112471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:46.124575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.126698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.129665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.132037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.134755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.136852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.568265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.577952 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90df57e2-b24d-4a12-9af5-219a75b42469 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.498623 Oct 28 17:44:46.601539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1970/3840] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:46.609274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1b08911-2007-45bc-8f76-d5a80c69664d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7f80d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:46.703790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1b08911-2007-45bc-8f76-d5a80c69664d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.104491 Oct 28 17:44:46.710886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.722960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1971/3841] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:46.724593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.731226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:46.732794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.733776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:46.735235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49f8cebc-0cf1-4dec-9706-1c009cafa551 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2946 microversion: 2.32 time: 0.629630 Oct 28 17:44:46.737417 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1871/3842] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2946 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:46.743723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.745487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.746636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.747574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.748224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.748839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.774243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:46.774827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:46.789559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.792201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.792842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.794624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:46.796392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:46.797268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:46.948598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.964902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.969773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:46.985123 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36033e1b-b707-4768-b04d-7c2ebc228310 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.260725 Oct 28 17:44:46.987132 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1972/3843] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:47.002117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:47.002885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:47.010571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.011061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.011537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.012344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.012803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.013231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.168435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:47.180393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eaeef049-e42b-4a49-9951-b067b8b26b2a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.424717 Oct 28 17:44:47.181617 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1872/3844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:47.191420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:47.192572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:47.200442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.203045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.203711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.204622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.205411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.206563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.234576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:47.241022 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3d5bb0d-58ef-4347-a0a2-4e1e4fd4bfc1 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.252491 Oct 28 17:44:47.242018 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1973/3845] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:44:46 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd/os-interface => generated 1831 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:47.248031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:47.248942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:47.273849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.274775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.276810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.278832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:47.280056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:47.280674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:47.922934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:47.942823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-828f6a37-a405-4fce-91e7-6cb1deae1339 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.758139 Oct 28 17:44:47.979081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1873/3846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:47 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:47.981471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565a0b8e-e4e4-4ce5-8465-b4b9d446ea18", "name": "network-vif-plugged", "status": "completed", "tag": "88ccb651-d408-405c-b106-9a27e290824d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:48.019227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.030163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.031305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.045625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] Creating event network-vif-plugged:88ccb651-d408-405c-b106-9a27e290824d for instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 on n-h2-860864-13 Oct 28 17:44:48.051647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-46f3741a-6de3-434f-97d5-618b35c7d679 req-0b0a8256-f600-4bb2-aecf-edf2fea5378b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075215 Oct 28 17:44:48.052945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1874/3847] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:48.059408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-249e501c-9bf0-4114-8041-c9b8f6a122ee tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75286838b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:48.085446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:48.096200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99484e80-04b6-4532-8def-77b71b5dd404 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.852072 Oct 28 17:44:48.101863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1974/3848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:47 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:48.109165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:48.115427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:48.141044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.143786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.145208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.148232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.148977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.150768 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-249e501c-9bf0-4114-8041-c9b8f6a122ee tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.093195 Oct 28 17:44:48.152201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1875/3849] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:48 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:48.154810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.157738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:48.158591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:48.166063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.166705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.167257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.168280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.168714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.169255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.304622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:48.320167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:48.320167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:48.327538 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51cd31a6-45b4-4dbc-9f93-d30afa2c43f7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.223811 Oct 28 17:44:48.328254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1975/3850] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:48 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:48.441911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:48.454040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eea1aa84-185b-43ef-ace2-bbf75d9812ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.300241 Oct 28 17:44:48.462087 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1876/3851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:48.491091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:48.491971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:48.502814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.503713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.504429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.505819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.506591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.507310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.539750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'flavor' on Instance uuid 6e49131a-4de5-4a84-b9a4-47ba09b70dae {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:44:48.697392 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17adbb8c-e718-40ab-b47f-a4a7f6401faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.213166 Oct 28 17:44:48.712091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:48.713125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:48.717616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1976/3852] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:48 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:44:48.721487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.722783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.723948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.725810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:48.726581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:48.727590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:48.981795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:48.983185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:49.018410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.019757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.020494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.028476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.029874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.033577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.105130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:49.125852 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bdff5d77-c19f-41c3-ab5a-c003429b5c11 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1679 microversion: 2.1 time: 0.419046 Oct 28 17:44:49.139413 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1877/3853] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:48 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1679 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:49.167070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afb3e0db-e63c-4b2b-8ad1-5338ad9d297e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6ec160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:49.252308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-afb3e0db-e63c-4b2b-8ad1-5338ad9d297e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.089063 Oct 28 17:44:49.261390 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1878/3854] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:49 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:49.359190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:49.378803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:49.398137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.399471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.400144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.401072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.401731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.402358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.473124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'flavor' on Instance uuid bb15caad-abcb-4a6d-aab2-c3a26a33e47c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:44:49.575297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:49.587706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b73aa66-f1c4-4493-b230-e103d3154204 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1329 microversion: 2.1 time: 0.614712 Oct 28 17:44:49.588927 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1977/3855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:48 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1329 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:49.596339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:49.598643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:49.615214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.618843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.619544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.620450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.621105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.622990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.910645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:49.920911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:49.922721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:49.933507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-68d6d489-904f-42fd-af7e-628a34d1b9fc tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/action" status: 200 len: 32 microversion: 2.1 time: 0.584870 Oct 28 17:44:49.935126 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1879/3856] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:49 2022] POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/action => generated 32 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:44:49.956310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02ecd4f5-5ea2-4bbb-85c4-abb3030fb02f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.365896 Oct 28 17:44:49.958142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:49.960875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:49.962605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1978/3857] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:49 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:49.979413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.980303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.981134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:49.982140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:49.983618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:49.984296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:50.153820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:50.154518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:50.169458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:50.170097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:50.171843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:50.172662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:50.173894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:50.175352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:50.955748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:50.969444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdad17c7-27ca-4d6d-bb07-584183f47138 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 1.022884 Oct 28 17:44:50.997207 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1880/3858] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:49 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:51.009628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f464470a-3931-45f4-8c71-3eb0f008cad0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6d68b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:51.084715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:51.096821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b6f13cf-7d64-4b19-a14f-e784282ac0ef tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1662 microversion: 2.1 time: 0.945625 Oct 28 17:44:51.099795 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1979/3859] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:50 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1662 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:51.105002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f464470a-3931-45f4-8c71-3eb0f008cad0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.099670 Oct 28 17:44:51.110511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:51.110676 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1881/3860] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:51 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:51.127472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:51.134364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:51.135198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:51.139462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.147536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.148183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.149786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.151712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.151851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.152204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.152639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.153340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.153784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.153957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.157808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.349821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:51.378521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:51.380257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:51.391052 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22b7b98f-6ccd-4dc1-a2fa-76f1ae3cfb50 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.269298 Oct 28 17:44:51.416470 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1882/3861] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:51 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:51.421699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:51.422233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:51.428638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.429127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.429562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.430803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.431476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.432100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.531920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bebb33b1-c9f5-4b04-bf0b-dc3307b964ee tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action" status: 202 len: 0 microversion: 2.1 time: 0.113225 Oct 28 17:44:51.550244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1883/3862] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:44:51 2022] POST /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:44:51.574997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:51.577926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:51.589051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.590250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.591742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.592730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.593978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.594678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.763800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:51.783180 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45aac00a-257a-4d51-9c7e-bd2970c1112d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1510 microversion: 2.1 time: 0.675542 Oct 28 17:44:51.784665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1980/3863] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:51 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1510 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:51.815088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:51.816288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:51.825151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.827738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.828491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:51.829630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:51.830888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:51.831677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.061878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.071531 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65c5edd9-ce59-4283-a233-36225aa660c1 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1668 microversion: 2.1 time: 0.517629 Oct 28 17:44:52.076252 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1884/3864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:51 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1668 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:52.106247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:52.107218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:52.110651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:52.115523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.116184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.116729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.117592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.118153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.118688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.366757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.385563 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2395040-b4c1-49f9-9968-50d4f06f81c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1510 microversion: 2.1 time: 0.570158 Oct 28 17:44:52.386743 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1981/3865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:51 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1510 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:52.394780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acb6336c-05ea-4d82-a129-43b58e47ba96 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7749d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:52.456765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-acb6336c-05ea-4d82-a129-43b58e47ba96 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.068521 Oct 28 17:44:52.457847 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1982/3866] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:52 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:52.464058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:52.464784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:52.471735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.472620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.473225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.474229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.474854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.475504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.526862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.533378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:44:52.536407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60d10251-9e43-4b24-9d48-3f40ab569f9c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.442491 Oct 28 17:44:52.561883 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1885/3867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:52 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:52.569095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:52.573784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:52.583266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:52.589967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.591464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.592671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.593532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.599087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.599638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.671090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b6f41aa5-0829-4160-bfa6-fba2b022f5b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 204 len: 0 microversion: 2.1 time: 0.211696 Oct 28 17:44:52.673679 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1983/3868] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:44:52 2022] DELETE /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:44:52.684386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:52.685337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:52.693229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.694213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.695063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.696763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:52.697477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:52.698163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:52.782717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.792578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.805226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.815509 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e3b7fbf-f80e-4486-a996-1abe6f77251e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1560 microversion: 2.91 time: 0.252200 Oct 28 17:44:52.816376 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1886/3869] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:52 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1560 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:52.971123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:52.981063 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bac8a942-e9f9-4d7b-bec6-43d33feae1c8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1516 microversion: 2.1 time: 0.302883 Oct 28 17:44:52.988291 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1984/3870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:52 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:53.107352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:53.110613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:53.118262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.119016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.119681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:53.120588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.121199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.121812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:53.366778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:53.385321 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-edc9b36d-360f-4fca-8857-17201d365a5b tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1668 microversion: 2.1 time: 0.285499 Oct 28 17:44:53.386476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1887/3871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:53 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:53.474235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a23657b9-adff-4cbd-b515-a1baf6389205 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f683a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:53.560239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:53.561384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:53.571742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.574870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.575317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:53.576078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.576554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.576989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:53.670297 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a23657b9-adff-4cbd-b515-a1baf6389205 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1412 microversion: 2.1 time: 0.197283 Oct 28 17:44:53.681447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1985/3872] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:53 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1412 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:53.848310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:53.849146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:53.863090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.863794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.864342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:53.865655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:53.866412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:53.870093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:54.040532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.054371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.063416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.077192 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-055a0d36-ffbe-4f55-adba-e67b4bc33d0e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.233737 Oct 28 17:44:54.091529 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1986/3873] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:53 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:54.105406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:54.111912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:54.128718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:54.129519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:54.130130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:54.131040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:54.136268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:54.136980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:54.217825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.234840 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d81287c2-8fad-45cd-8218-8c9dd0481d68 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.671710 Oct 28 17:44:54.237601 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1888/3874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:53 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:54.411322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:54.412574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:54.438089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:54.440078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:54.442081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:54.443202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:54.446728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:54.448860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:54.599086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.615537 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-607d2020-cdf8-4c87-b0f7-f7b45f5edd78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 200 len: 1516 microversion: 2.1 time: 0.518744 Oct 28 17:44:54.616944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1987/3875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:54 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 1516 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:54.690680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76f86571-a16c-408b-a517-5abf0903fa53 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6c65e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:54.965126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:54.973546 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f702c09b-0d37-4a92-bac5-19a503f6e147 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.567326 Oct 28 17:44:54.987805 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1889/3876] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:54 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:55.003293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:55.008849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:55.032989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.037257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.039764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:55.040765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.045115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.045846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:55.498140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:55.502034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:44:55.517256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9aeb0cf-7a2a-450e-8238-655b9e5f0faa tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1671 microversion: 2.1 time: 0.517635 Oct 28 17:44:55.518471 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1890/3877] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:54 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1671 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:55.525476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:55.526986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:55.537538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.540695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.545402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:55.546432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.547077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.549222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:55.670494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:55.685532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:55.689295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:55.714609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89704a93-1c1c-4a0e-b20b-c33a6e1b73cc tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.189145 Oct 28 17:44:55.715596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1891/3878] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:55 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:55.732561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:55.734610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:55.746933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.752015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.752807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:55.753816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:55.754517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:55.755456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:56.221446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:56.233627 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53519692-0910-4086-8832-eab83a8b2a6e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.516516 Oct 28 17:44:56.234610 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1892/3879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:55 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:56.241155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:56.244314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:56.270523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:56.271139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:56.271614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:56.272623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:56.273082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:56.273615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:56.355922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:44:56.370226 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Working on deleting snapshot 55969f4d-81cb-435d-970a-d5df83e30dbd from shelved instance... Oct 28 17:44:57.547278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Doing local delete in cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) {{(pid=120568) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 17:44:57.548775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.549429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.550031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.550620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 17:44:57.559597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] deallocate_for_instance() {{(pid=120568) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 17:44:57.568712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76f86571-a16c-408b-a517-5abf0903fa53 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1421 microversion: 2.1 time: 2.882643 Oct 28 17:44:57.569303 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1988/3880] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:54 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1421 bytes in 2885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:44:57.589035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:57.589937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:57.597376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.598064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.598733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.599514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.600302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.601032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.620094 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 HTTP/1.1 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '565a0b8e-e4e4-4ce5-8465-b4b9d446ea18'} Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:44:57.623184 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:44:57.628024 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:44:57.632004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:44:57.633162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca2d0937-19a8-4c5c-8de8-5e0b087b5373 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 404 len: 111 microversion: 2.1 time: 0.062944 Oct 28 17:44:57.637667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1989/3881] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:57 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:44:57.644223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565a0b8e-e4e4-4ce5-8465-b4b9d446ea18", "name": "network-vif-deleted", "tag": "88ccb651-d408-405c-b106-9a27e290824d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:57.657380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.658184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.659941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.674359 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] Creating event network-vif-deleted:88ccb651-d408-405c-b106-9a27e290824d for instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 on n-h2-860864-13 Oct 28 17:44:57.680343 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4ccda905-4417-4fc2-9310-d1cd92d31b1b req-ed2f7ffb-d206-4899-b3ba-c4ce6c535c76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039525 Oct 28 17:44:57.681649 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1990/3882] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:44:57.687323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:57.688327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:57.695017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.695883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.696589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.698210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.698929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.700052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.824635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:57.835485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:57.839396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:57.845223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48c371f4-2261-4e66-9ff5-fbe7d89f257a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.161992 Oct 28 17:44:57.846431 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1991/3883] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:44:57 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:44:57.851095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:57.852012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:44:57.860213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.861470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.862514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:57.863619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:44:57.864794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:44:57.865521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:44:58.203399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:44:58.218034 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5906642b-ff23-4242-bf7c-0f660da7456a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.370278 Oct 28 17:44:58.219385 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1992/3884] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:57 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:58.224948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2dbf0d2-911c-41f8-8eda-cd3ae94b494a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6c6e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:58.284785 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2dbf0d2-911c-41f8-8eda-cd3ae94b494a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 200 len: 1421 microversion: 2.1 time: 0.064042 Oct 28 17:44:58.285745 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1993/3885] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:44:58 2022] GET /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:44:58.291043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1618ab9b-dffb-422c-969f-19d071dd6e3b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '.version_select at 0x7f751f6f8dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:58.326863 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1618ab9b-dffb-422c-969f-19d071dd6e3b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-key-1676417571" status: 202 len: 0 microversion: 2.1 time: 0.037169 Oct 28 17:44:58.338176 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1994/3886] 10.222.0.48 () {58 vars in 1209 bytes} [Fri Oct 28 17:44:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1676417571 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:44:58.344367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-949171ac-2f6a-4062-bcf0-968fc9d634fd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6a4dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:44:59.434535 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-949171ac-2f6a-4062-bcf0-968fc9d634fd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 204 len: 0 microversion: 2.1 time: 1.094514 Oct 28 17:44:59.437067 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1995/3887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:44:58 2022] DELETE /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 0 bytes in 1099 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:44:59.442522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1007625383", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:44:59.562518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:44:59.675850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Updating instance_info_cache with network_info: [] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:45:00.186507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54ad3c4e-2365-4146-a651-2942d091241e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 204 len: 0 microversion: 2.1 time: 3.950770 Oct 28 17:45:00.187452 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1893/3888] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:44:56 2022] DELETE /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 0 bytes in 3952 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:00.192200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:00.193040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:00.200429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.201261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.201910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.202826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.203517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.204707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.369426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:00.381938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:00.395613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:00.416398 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8560608-aaed-459a-b988-dcef3f79f2a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.221538 Oct 28 17:45:00.432143 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1894/3889] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:00 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:00.436148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:45:00.437188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:45:00.437867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:45:00.438000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:00.438565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:00.438996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:45:00.439777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:45:00.453448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.457399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.460119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.463561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.463937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.464596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.465043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.465758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.466224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.466656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.467297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.468184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.536775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:00.555418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:00.584983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:45:00.589574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:45:00.704893 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-297ee10a-8bed-428e-a87e-cc36f5b5316d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266515 Oct 28 17:45:00.713848 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1996/3890] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:44:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:45:00.720726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:00.724638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:00.763925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.764753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.767893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.772766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.774130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.775270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.875382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:00.917787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:00.927314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8a532df7-5cc4-4d37-9b12-4a4e2ac415f1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.506484 Oct 28 17:45:00.928920 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1895/3891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:00 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:00.934754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f01c9d9-840c-41cb-9e8a-b4b878743221", "name": "network-vif-deleted", "tag": "09bab76f-82c4-4011-92aa-1bf4181657d5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:00.945255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.946622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.948660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.961898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] Unable to find a host for instance 9f01c9d9-840c-41cb-9e8a-b4b878743221. Dropping event network-vif-deleted {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:45:00.963277 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7f9881ef-7982-4438-bddb-76fa8eccb036 req-f7138fee-3d77-4e8d-84e6-d7bb0106bc65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032402 Oct 28 17:45:00.964424 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1896/3892] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 17:45:00.969410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:00.970301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 9f01c9d9-840c-41cb-9e8a-b4b878743221] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:00.977646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:00.993853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:00.995494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:00.998065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.000645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.001992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.036806 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 HTTP/1.1 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '9f01c9d9-840c-41cb-9e8a-b4b878743221'} Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:01.044368 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. Oct 28 17:45:01.048995 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:01.057404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 404 to user: Instance 9f01c9d9-840c-41cb-9e8a-b4b878743221 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:01.058870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8c8b67b-d6c4-4f1d-a922-1d7fe23403f5 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221" status: 404 len: 111 microversion: 2.1 time: 0.093297 Oct 28 17:45:01.059733 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1897/3893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:00 2022] GET /compute/v2.1/servers/9f01c9d9-840c-41cb-9e8a-b4b878743221 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:45:01.066640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:01.071762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5236247-2167-4d53-a57a-7277f1c66c48", "name": "network-vif-unplugged", "status": "completed", "tag": "d4ada3f6-9b80-484e-8bf0-f62b8a255477"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:01.075540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83279b00-0126-4035-a7f7-1cc8730a1be9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 204 len: 0 microversion: 2.1 time: 0.360012 Oct 28 17:45:01.083121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1997/3894] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:00 2022] DELETE /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:01.093238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5a114d8-e4ba-4170-87bc-74d990f34d44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:01.095468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.096097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5a114d8-e4ba-4170-87bc-74d990f34d44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:01.096249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.097422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.131511 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] Creating event network-vif-unplugged:d4ada3f6-9b80-484e-8bf0-f62b8a255477 for instance b5236247-2167-4d53-a57a-7277f1c66c48 on n-h1-860864-13 Oct 28 17:45:01.149539 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8889b367-aaf0-41a9-8c4a-748c6c1f04ee req-11c96e64-bb99-49ee-aed7-88a9371f50aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084043 Oct 28 17:45:01.153417 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1898/3895] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:01.170522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:01.172594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:01.190916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.191594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.192068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.193046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.193253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.193679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.248751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:01.362331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a5a114d8-e4ba-4170-87bc-74d990f34d44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:01.373309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5a114d8-e4ba-4170-87bc-74d990f34d44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1209 microversion: 2.1 time: 0.288773 Oct 28 17:45:01.397902 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1998/3896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:01 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1209 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:01.406853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-653709002", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:01.465962 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8fe16deb-86fb-41d5-a727-7a24dd0a3338 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 204 len: 0 microversion: 2.1 time: 0.308376 Oct 28 17:45:01.466907 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1899/3897] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:01 2022] DELETE /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:01.472273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:01.472967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:01.491098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.491642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.492143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.492873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.493327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.493760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.561860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:45:01.654902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:01.674695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:01.676179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:01.683100 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6a6454f-f426-4fe1-a8df-d4c987373db6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.214575 Oct 28 17:45:01.684306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1900/3898] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:01 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:01.705636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:01.706528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:01.713930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.714779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.715418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.716291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:01.716911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:01.722586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:01.786876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:02.132406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:02.141661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28c3d2da-4306-4569-a5ec-547e89aade4e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1466 microversion: 2.1 time: 0.456113 Oct 28 17:45:02.160640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1901/3899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:01 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1466 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:02.168463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:02.169112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:02.195016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:02.196240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:02.196684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:02.197391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:02.197845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:02.198303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.256493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.267156 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-340b74f0-9d83-4100-8a5e-ad614a203410 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 1.105305 Oct 28 17:45:03.277102 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1902/3900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:02 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:03.298497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:03.299631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:03.317908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.320993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.322636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.323921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.324657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.325358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.402800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:45:03.403320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:45:03.403716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:45:03.404124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:45:03.404691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:45:03.424155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.424657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.425116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.425843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.432051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.432674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.436255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.448289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-710aa5d7-3359-45d1-bcab-14d605b661ef tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1267 microversion: 2.1 time: 0.154960 Oct 28 17:45:03.468664 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1903/3901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:03 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:03.468664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:03.468664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:03.469942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.470539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.471086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.471931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.472485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.473178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.484904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:03.498232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:03.536408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:45:03.539165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:45:03.630773 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-669fec5a-fd94-4b87-a2e9-2ffaa366275a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.230643 Oct 28 17:45:03.632055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 1999/3902] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:45:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:45:03.638827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:03.639795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:03.648924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.649627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.650270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.651149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:03.651824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:03.652420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:03.686055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.716246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.734978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.754656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-43c75144-8adc-4b31-ba39-3f6d1d873c8a tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.300116 Oct 28 17:45:03.761379 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1904/3903] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:03 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:03.774798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5ec38c1-2f10-4bf2-bc78-3e7b4cb3f298 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:03.776715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5ec38c1-2f10-4bf2-bc78-3e7b4cb3f298 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:03.864832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:03.879267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb7a2076-4380-4187-a271-9c39953c7f16 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1466 microversion: 2.1 time: 0.244988 Oct 28 17:45:03.880493 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2000/3904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:03 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:04.003086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5ec38c1-2f10-4bf2-bc78-3e7b4cb3f298 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:04.022021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5ec38c1-2f10-4bf2-bc78-3e7b4cb3f298 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1207 microversion: 2.1 time: 0.254785 Oct 28 17:45:04.025723 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1905/3905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:03 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1207 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:04.310324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:04.311201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:04.342607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.343643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.344834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.345731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.346998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.347764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.479216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:04.481577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:04.500183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.501901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.505325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.506429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.508934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.509669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.729137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:04.744031 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9dade40-2ef6-4ef6-9c22-5ad8f3b81f2a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1267 microversion: 2.1 time: 0.272180 Oct 28 17:45:04.746647 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1906/3906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:04 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:04.765538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:04.777376 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d93395a-b691-4b96-a880-d9a3e585b294 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.472330 Oct 28 17:45:04.787319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2001/3907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:04 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:04.805916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:04.806533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:04.816419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.816946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.817457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.820863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.824137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.824853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.906337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:04.907227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:04.916219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.917230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.918096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:04.919075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:04.920511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:04.921152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:05.968956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:05.991463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:05.999310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:06.017614 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3492273e-127a-4f3c-b59f-85fbe7be79a7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 1.225286 Oct 28 17:45:06.037756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1907/3908] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:04 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:06.052931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:06.053602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:06.106588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.107273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.109399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.115617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.116196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.118863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.262867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:06.278497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d358dc14-b7cd-42e0-a624-04713e008c29 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1466 microversion: 2.1 time: 1.370795 Oct 28 17:45:06.279629 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2002/3909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:04 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1466 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:06.291335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5236247-2167-4d53-a57a-7277f1c66c48", "name": "network-vif-deleted", "tag": "d4ada3f6-9b80-484e-8bf0-f62b8a255477"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:06.321654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.322256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.322687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.340070 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] Creating event network-vif-deleted:d4ada3f6-9b80-484e-8bf0-f62b8a255477 for instance b5236247-2167-4d53-a57a-7277f1c66c48 on n-h1-860864-13 Oct 28 17:45:06.352954 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5cce027e-5b20-4846-84c9-a66157726f21 req-4cefb75a-048a-43a7-820b-405a53ae9373 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071073 Oct 28 17:45:06.355965 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2003/3910] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:06.361724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:06.371067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:06.390999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.396235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.396938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.398772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.399488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.401945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.478350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:06.492252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6374023d-c516-42df-907f-6cebe7a8eb93 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1265 microversion: 2.1 time: 0.451462 Oct 28 17:45:06.493990 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1908/3911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:06 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:06.503006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:06.504401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:06.514897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.515979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.517335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:06.518258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:06.518949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:06.519723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.126142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.141996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19cf203f-dadc-4132-85c2-3c5dce55bb10 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.645496 Oct 28 17:45:07.166337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1909/3912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:06 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:07.171490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b006730-d94a-4793-8568-4403474c1098", "name": "network-vif-unplugged", "status": "completed", "tag": "52ace948-d479-4172-9543-c5f0ea41304b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:07.197581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.205909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.206557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.232671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] Creating event network-vif-unplugged:52ace948-d479-4172-9543-c5f0ea41304b for instance 2b006730-d94a-4793-8568-4403474c1098 on n-h1-860864-13 Oct 28 17:45:07.241058 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ae2bf46d-9e41-4712-9f3c-32ca8de2d556 req-7be60eef-ec92-41b4-af94-432ec287d159 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073102 Oct 28 17:45:07.245201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1910/3913] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:07.253436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:07.258974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:07.277346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.277999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.279810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.281163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.283656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.285430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.460088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.462790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.471554 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa271e6c-594b-4a7d-a4df-7336ef6af57a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 1.113697 Oct 28 17:45:07.473093 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2004/3914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:06 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:07.476966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.486132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.494309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:07.509386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-840d7b2d-1611-4fe3-99ae-cf2e6bb7aa3c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.256943 Oct 28 17:45:07.510413 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1911/3915] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:07 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:07.517158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:07.527069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:07.532277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:07.549533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.551594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.552840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.561758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.567417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:07.567936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:07.568377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:07.800276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:07.818109 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64cd85c5-012c-4bd0-a042-802418e5e06c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1265 microversion: 2.1 time: 0.297618 Oct 28 17:45:07.819950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1912/3916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:07 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:08.158924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:08.173991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:08.176154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-271b2220-cfaa-4e85-b9ab-08641f32c502 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 200 len: 1466 microversion: 2.1 time: 0.700598 Oct 28 17:45:08.176321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:08.177061 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2005/3917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:07 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 1466 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:08.207213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.213624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.215831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.217330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.231877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.243982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.405441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b006730-d94a-4793-8568-4403474c1098", "name": "network-vif-deleted", "tag": "52ace948-d479-4172-9543-c5f0ea41304b"}, {"name": "network-changed", "server_uuid": "83eb375c-68c9-4b51-99e1-22a2f47257b6", "tag": "e5051401-a528-43c5-99d0-04e6c18c4ea0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:08.423685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.424532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.425452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.446442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Creating event network-vif-deleted:52ace948-d479-4172-9543-c5f0ea41304b for instance 2b006730-d94a-4793-8568-4403474c1098 on n-h1-860864-13 Oct 28 17:45:08.447220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] Creating event network-changed:e5051401-a528-43c5-99d0-04e6c18c4ea0 for instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 on n-h2-860864-13 Oct 28 17:45:08.456554 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-44518856-3d2c-4ad7-b511-e812b968f04c req-c6ca2a6b-7f19-42f3-8e5d-a8228b86b5e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060011 Oct 28 17:45:08.458462 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2006/3918] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:45:08.513153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:08.513153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:08.532586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.533800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.535010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.537091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.540271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.543498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.957176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:08.969165 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-548ce897-b877-4be0-9303-307dab257e4c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1736 microversion: 2.1 time: 0.799550 Oct 28 17:45:08.974595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1913/3919] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:08 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1736 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:08.982276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:08.983678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:08.991344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.993414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.994255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:08.995501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:08.996423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:08.997101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.173972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:09.213916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:09.219200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:09.228702 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81511908-8f4a-43b6-a979-55e34043ada8 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.252329 Oct 28 17:45:09.239975 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1914/3920] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:08 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:09.246578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:09.247404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:09.259789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.264771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.266024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.267267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.268628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.270070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.360179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:09.361495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:09.372655 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43a20ddd-1312-4fd5-83be-dfc0bcedd7ee tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.877650 Oct 28 17:45:09.385744 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2007/3921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:08 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:09.393456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:09.393456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 2b006730-d94a-4793-8568-4403474c1098] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:09.416771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.417289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.417735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.418485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.418945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.419396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.449535 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 HTTP/1.1 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2b006730-d94a-4793-8568-4403474c1098'} Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:09.451927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. Oct 28 17:45:09.457056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:09.462833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 404 to user: Instance 2b006730-d94a-4793-8568-4403474c1098 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:09.464160 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c43ddffd-7d4e-4998-9810-76a5162a9fa7 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098" status: 404 len: 111 microversion: 2.1 time: 0.086468 Oct 28 17:45:09.464972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2008/3922] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:09 2022] GET /compute/v2.1/servers/2b006730-d94a-4793-8568-4403474c1098 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:45:09.478349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:09.480042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:09.487064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:09.498685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eeda0d0b-a3d7-498c-8f58-2a68b9d62148 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1265 microversion: 2.1 time: 0.256406 Oct 28 17:45:09.526309 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1915/3923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:09 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:09.533879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.534416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.534834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.535590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.536054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.536483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.589660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:09.738276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e603f94c-f5a7-437c-a8d9-bee05676b98c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 204 len: 0 microversion: 2.1 time: 0.266931 Oct 28 17:45:09.740765 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2009/3924] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:09 2022] DELETE /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:09.751583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:09.753436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:09.764028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.766409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.767074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:09.768008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:09.768644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:09.769247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.001431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:10.002142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:10.016423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.016926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.018532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.020079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.022727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.023342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.212385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:10.220808 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f997f02-d4f2-4781-ba20-54f20ab0f670 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1507 microversion: 2.1 time: 0.475334 Oct 28 17:45:10.225950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1916/3925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:09 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:10.262250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:10.262972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:10.273918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.274593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.275152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.276095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.276785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.277327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.383816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:10.403633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:10.405397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:10.411535 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e40c687b-d2b8-41b2-b75d-1db3b7a1e3eb tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.154243 Oct 28 17:45:10.412692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1917/3926] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:10 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:10.442196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:10.451026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:10.454247 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98b5aa6d-cc74-4847-811b-6c0c88418ab0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1716 microversion: 2.1 time: 0.457671 Oct 28 17:45:10.455102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:10.457678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2010/3927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:09 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1716 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:10.462647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:10.464062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.464727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.465329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.466200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.466842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.467647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.531625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:10.532488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:10.544511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.551088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.551805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:10.554540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:10.555234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:10.555916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.395922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:11.412007 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d61b8c78-4fff-427c-b2ef-e3f9d10ff7c4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.982581 Oct 28 17:45:11.413679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1918/3928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:10 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:11.419553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:11.420420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:11.426684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.427493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.428183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.429130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.430161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.430869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.497461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:11.508281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-737877b9-08a9-4b0e-9ba1-9b22d51a19b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.979999 Oct 28 17:45:11.508875 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2011/3929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:10 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:11.533949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:11.535271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:11.545518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.548211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.549189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.550321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.550951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.551588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.576763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:11.578505 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Cannot 'detach_volume' instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c while it is in vm_state rescued Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments/eb7224fc-6b41-4c63-a8de-d3b108e5e35b HTTP/1.1 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'detach_volume' instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c while it is in vm_state rescued Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': 'bb15caad-abcb-4a6d-aab2-c3a26a33e47c', 'id': 'eb7224fc-6b41-4c63-a8de-d3b108e5e35b'} Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c while it is in vm_state rescued Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:11.580337 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c while it is in vm_state rescued Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 409 to user: Cannot 'detach_volume' instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c while it is in vm_state rescued {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:11.586524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46f4c0a6-b62e-46fb-8925-e0037b2782cf tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments/eb7224fc-6b41-4c63-a8de-d3b108e5e35b" status: 409 len: 152 microversion: 2.1 time: 0.168531 Oct 28 17:45:11.587460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1919/3930] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:45:11 2022] DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments/eb7224fc-6b41-4c63-a8de-d3b108e5e35b => generated 152 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:45:11.598809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:11.599543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:11.622017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.622613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.623127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.623929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.624445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.624941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.824253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:11.832607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:11.842619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:11.866811 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0470277f-11cc-410e-a8cc-c892d589e77c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.278346 Oct 28 17:45:11.876884 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1920/3931] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:11 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:11.896228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:11.896769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:11.904125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.904896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.906102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:11.907006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:11.907652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:11.908758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.002189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d920df6-bcbd-474e-95a5-f12c4a71660e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/action" status: 202 len: 0 microversion: 2.1 time: 0.123623 Oct 28 17:45:12.002828 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1921/3932] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:45:11 2022] POST /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:45:12.012653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:12.023831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:12.032740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.041286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.044461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.046525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.052148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.054010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.072771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:12.084993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d12a48b1-c15f-40da-a453-77bfa7df4812 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1507 microversion: 2.1 time: 0.561332 Oct 28 17:45:12.085631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2012/3933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:11 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:12.441158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:12.441870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:12.450420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.454473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.455177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.459864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.461211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.461874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.631264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:12.647909 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1320764b-3e22-4a6a-adab-eadbf6be93f8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1724 microversion: 2.1 time: 0.640213 Oct 28 17:45:12.670108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1922/3934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:12 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1724 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:12.676866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:12.677791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:12.687042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.687843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.688728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.689622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:12.690245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:12.690846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:12.984016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:12.993971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10ac201d-b595-44cb-8431-cd813d111f39 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.556682 Oct 28 17:45:13.008889 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2013/3935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:12 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:13.016651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:13.017568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:13.024582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.025294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.025939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.026646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.027273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.027889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.138320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:13.147705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:13.149776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:13.155129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ea17819-e48d-43d7-b1c7-956ab139e7c7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1555 microversion: 2.91 time: 0.144822 Oct 28 17:45:13.167444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2014/3936] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:13 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:13.167444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:13.167444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:13.176004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.176897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.177547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.178504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.179955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.182119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.211496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:13.227667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5f7cea4-e9b6-42f3-81f7-28ea1435a9b6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.555506 Oct 28 17:45:13.239846 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1923/3937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:12 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:13.387087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:13.395494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2df386dd-ee6c-49bb-824e-083e56f9e063 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1507 microversion: 2.1 time: 0.238080 Oct 28 17:45:13.396474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2015/3938] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:13 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:13.599502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8614db0-5443-4ab4-a8d8-1a14d6561e8e", "tag": "e4f7b0ff-4bff-4574-beb3-106d0b136308"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:13.623566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.625306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.626189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.643499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] Creating event network-changed:e4f7b0ff-4bff-4574-beb3-106d0b136308 for instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e on n-h2-860864-13 Oct 28 17:45:13.650661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0f92dc49-711e-4956-8438-fa4417489fd5 req-83928ec8-c507-4cfc-b39f-11a71091696c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073746 Oct 28 17:45:13.651922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1924/3939] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:13.676180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:13.676897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:13.679109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:13.681043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:13.691989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.692858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.693521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.696085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.696789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.697419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.748618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb375c-68c9-4b51-99e1-22a2f47257b6", "name": "network-vif-plugged", "status": "completed", "tag": "e5051401-a528-43c5-99d0-04e6c18c4ea0"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:13.772234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.774169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.774927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.793219 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] Creating event network-vif-plugged:e5051401-a528-43c5-99d0-04e6c18c4ea0 for instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 on n-h2-860864-13 Oct 28 17:45:13.801823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-495c7009-6c1c-4086-9c39-dc8607141d9f req-f45ff503-d054-4138-b76d-47557ec17ae3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057666 Oct 28 17:45:13.805218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1925/3940] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:13.864784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e96e69a-e36f-4e0c-9b39-d984ed83992b", "name": "network-vif-deleted", "tag": "aa725a26-43ac-418f-9a6c-85ebb3c94858"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:13.896281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:13.901467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:13.902236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:13.940867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] Creating event network-vif-deleted:aa725a26-43ac-418f-9a6c-85ebb3c94858 for instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b on n-h2-860864-13 Oct 28 17:45:13.948657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-53eb994c-86b2-4848-92d6-132f4ec7f13e req-035a90eb-8047-4c8e-ac01-b5659de814f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087153 Oct 28 17:45:13.949899 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1926/3941] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:14.019494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:14.028692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:14.029486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:14.039950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.040848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.042074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.044598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.045692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.053115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.202873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:14.217421 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89344e80-df85-460e-a501-af8f8ff8107e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1724 microversion: 2.1 time: 0.545004 Oct 28 17:45:14.221717 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2016/3942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:13 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1724 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:14.241269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:14.242478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:14.257962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.258471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.258919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.266492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.267920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.268475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.416229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:14.426841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:14.429067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:14.444165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60700e2c-baf6-4ea9-a2e7-31dbf88dd9e7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1537 microversion: 2.91 time: 0.220939 Oct 28 17:45:14.445437 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2017/3943] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:14 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:14.462748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:14.465039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:14.474560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.475348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.475976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.476919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.477634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.478393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.548016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:14.557437 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62432b9b-327e-4591-9b2c-bd19d44d0b09 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.538954 Oct 28 17:45:14.571605 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1927/3944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:14 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:14.579129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:14.580023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:14.586574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.587314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.587778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.588486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.589109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.589539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.626868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:14.627344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:14.627818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:14.628446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'fault' on Instance uuid 6e96e69a-e36f-4e0c-9b39-d984ed83992b {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:15.042489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.051139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81330a40-55a5-41f6-ab02-9e4d8d2a9965 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1304 microversion: 2.1 time: 0.478109 Oct 28 17:45:15.051887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1928/3945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:14 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1304 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:15.170061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.178700 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86f3681e-f300-463b-82ce-35abdcdff5c6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.732218 Oct 28 17:45:15.188670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2018/3946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:14 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:15.243652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:15.244648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:15.251348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.252107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.252730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.253820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.254602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.255192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.473364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:15.474041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:15.480713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.481574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.482017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.482733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.483191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.483641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.486926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.513105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4859744e-df3b-47d5-9420-5d2779ccef86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1724 microversion: 2.1 time: 0.272825 Oct 28 17:45:15.527560 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1929/3947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:15 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:15.588622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:15.590186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:15.597281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.598049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.599251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.603345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:15.603984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:15.604765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:15.604897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.615446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.618553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.625226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-19e8f6b6-67c9-427a-86a1-95a622d3b05c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1537 microversion: 2.91 time: 0.155691 Oct 28 17:45:15.626684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2019/3948] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:15 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:15.920392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:15.940057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-372ad262-e8da-4797-bea8-46684ea50332 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.358465 Oct 28 17:45:15.951695 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1930/3949] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:15 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:16.075933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:16.076550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.083481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.083976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.084412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.085141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.086571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.087209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.120533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.120940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.121374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.122020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'fault' on Instance uuid 6e96e69a-e36f-4e0c-9b39-d984ed83992b {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:16.192912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.203086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:16.203716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.203835 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c694375d-b5a7-46b0-acd9-61d7d84b5caf tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1304 microversion: 2.1 time: 0.132067 Oct 28 17:45:16.204726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2020/3950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:16 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:16.210633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.211456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.212056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.212912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.213524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.214101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.487988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.496514 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a4fb334-8880-4ea1-bd79-4c185bfda558 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.297632 Oct 28 17:45:16.507700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1931/3951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:16 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:16.543905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:16.545136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.551321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.551843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.552563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.553577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.554107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.554729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.658935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:16.659886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.667287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.668562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.669107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.669854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.670508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.670939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.793276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.803635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.805948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.811784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76125997-2374-40b5-89ef-ec7e95de51c9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1540 microversion: 2.91 time: 0.157877 Oct 28 17:45:16.812982 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1932/3952] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:16 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1540 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:16.822504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:16.840497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b23e9ad0-a928-4874-80e4-80c970c0ca48 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1724 microversion: 2.1 time: 0.301941 Oct 28 17:45:16.847144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860864-13"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:16.850434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.852861 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2021/3953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:16 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:16.858759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.859520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.860215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.860925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.861589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.862199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.912559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860864-13". {{(pid=120568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 17:45:16.971805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:16.972970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:16.982182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.982957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.983999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.984905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:16.986474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:16.987296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:16.998279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b044bf0-be48-4477-962e-c1eac9c8e7bb tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action" status: 202 len: 0 microversion: 2.91 time: 0.154944 Oct 28 17:45:17.002336 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1933/3954] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:45:16 2022] POST /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:45:17.012265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:17.013035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:17.020653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.021330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.021773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.022661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.023522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.024646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.162628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:17.189425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:17.190881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:17.199145 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6f6b852-3358-41fb-a900-88245bcba1f0 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1548 microversion: 2.91 time: 0.193710 Oct 28 17:45:17.200100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1934/3955] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:17 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:17.229308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:17.239226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:17.253407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.255707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.256266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.257103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.260475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.261042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.345645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.347854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.348562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.350337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'fault' on Instance uuid 6e96e69a-e36f-4e0c-9b39-d984ed83992b {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:17.353940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:17.370775 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6d9ac84-8e36-49cf-8524-caf5f5c8d3be tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1309 microversion: 2.1 time: 0.408807 Oct 28 17:45:17.386370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:17.386769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2022/3956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:16 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:17.449991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:17.473827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5ade3448-85a7-4008-a5fb-e8f80dc48156 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 200 len: 1304 microversion: 2.1 time: 0.249498 Oct 28 17:45:17.475138 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1935/3957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:17 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:17.542295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:17.546571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:17.576879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.577669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.578310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.583912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.584784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.585638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.595047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:17.867697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:17.869123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:17.881859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.882389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.890117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:17.891096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:17.892524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:17.893230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.143498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:18.154625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ca31c78-45e6-4aaf-855e-9076b14678ea tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.638839 Oct 28 17:45:18.155873 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2023/3958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:17 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:18.227779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.228362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.234466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.235434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.236052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.237224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.238054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.238659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.293040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:18.305193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-627b995b-8a2c-462d-813f-0e02cbf8c589 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1730 microversion: 2.1 time: 0.442578 Oct 28 17:45:18.317013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1936/3959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:17 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1730 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:18.331899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.332711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.339849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.340347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.340799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.341513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.341972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.342399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.404208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:18.413410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:18.414989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:18.420383 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-49ab2823-fcc3-40e5-a963-0bdba72013d7 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.198261 Oct 28 17:45:18.421571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2024/3960] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:18 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:18.426606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.427203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.445081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.445600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.446343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.447085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.447576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.447993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.462198 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4d130a2-1855-4f18-957d-e607ba8504ec tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134319 Oct 28 17:45:18.463112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1937/3961] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:45:18 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:45:18.499076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.500006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e96e69a-e36f-4e0c-9b39-d984ed83992b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.509235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.509828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.511133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.512346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.513097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.513631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.531590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b HTTP/1.1 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '6e96e69a-e36f-4e0c-9b39-d984ed83992b'} Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:18.533528 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 404 to user: Instance 6e96e69a-e36f-4e0c-9b39-d984ed83992b could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:18.539325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7db5ee2c-f28f-4efb-80e5-1f7c10f6abfc tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b" status: 404 len: 111 microversion: 2.1 time: 0.040972 Oct 28 17:45:18.541099 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1938/3962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:18 2022] GET /compute/v2.1/servers/6e96e69a-e36f-4e0c-9b39-d984ed83992b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:45:18.544997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.545515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.552504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.552984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.553414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.554715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.555455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.555880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.587573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:18.698705 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4fdde253-71d6-4e03-80d1-f02ca635769a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 204 len: 0 microversion: 2.1 time: 0.157383 Oct 28 17:45:18.700133 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1939/3963] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:18 2022] DELETE /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:18.709061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:18.709663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:18.717491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.717767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.718083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:18.718775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:18.719230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:18.719713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:19.387093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:19.397265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:19.402687 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4810dac-bd9d-47f5-a064-a7cea9d33ea1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1490 microversion: 2.1 time: 0.979547 Oct 28 17:45:19.410774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8636838f-e727-4942-a406-7523fbea84b2 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1494 microversion: 2.1 time: 0.706040 Oct 28 17:45:19.414540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1940/3964] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:18 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1494 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:19.417973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2025/3965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:18 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1490 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:19.429153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:19.430079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:19.459736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:19.460606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:19.461483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:19.463109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:19.463545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:19.465892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:19.466691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:19.468281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:19.516097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:19.516634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:19.517090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:19.517842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:19.526269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:19.526700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:19.967472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:19.985232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:19.986677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:20.004043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c035c193-e571-4848-8d46-a9ee16f7cbb6 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.552750 Oct 28 17:45:20.004918 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2026/3966] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:19 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:20.011153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1007625383", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:20.136246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:45:20.863968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:20.880468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-06fc7d7a-69f1-41d1-b6f5-db40524c7ed4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 1.464002 Oct 28 17:45:20.884386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1941/3967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:19 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:20.902134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0bd4c1-ca80-4362-8d59-d983ead1c152", "name": "network-vif-deleted", "tag": "c4892494-7846-479d-bccf-d582580e9e55"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:20.924368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:20.924855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:20.925288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:20.955032 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] Creating event network-vif-deleted:c4892494-7846-479d-bccf-d582580e9e55 for instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 on n-h2-860864-13 Oct 28 17:45:20.963808 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8c2581e9-145a-482a-aa20-a1aee31c5fa0 req-7ecd6c25-fc12-4ec3-a4f9-6e593c00e6a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076986 Oct 28 17:45:20.964720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1942/3968] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:20.969881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:20.970582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:20.978682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:20.979182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:20.979752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:20.980599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:20.981136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:20.981815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.064460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.065392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.066075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.066755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'fault' on Instance uuid 4b0bd4c1-ca80-4362-8d59-d983ead1c152 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:21.187875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:21.210057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b93caf58-fdeb-4d28-9c13-9b3d06b5e80e tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1304 microversion: 2.1 time: 0.242469 Oct 28 17:45:21.213308 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1943/3969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:20 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:21.223896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:21.224529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:21.240476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.240972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.241414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.245200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.245691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.246128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.757470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:21.785001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:21.786807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:21.796606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5efd968b-ff5d-4b81-be4d-004bf04e9780 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.582209 Oct 28 17:45:21.800968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1944/3970] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:21 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:21.815131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:45:21.817185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:45:21.817739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:45:21.818190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:45:21.818606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:45:21.839144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.843855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.844355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.845166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.845632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.846061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.895433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:21.898800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:21.903131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:21.909963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:21.911225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:21.922158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.925389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.927102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:45:21.928278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.929810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:21.930291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:21.930885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:21.931626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:45:21.984580 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b8f1cc1-bbe9-4617-aa6f-0e586273a0b9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.978287 Oct 28 17:45:21.985745 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2027/3971] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:45:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:45:21.998590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a8eb9f5-12ae-4bd8-8482-2e856a13e908 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:21.999522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a8eb9f5-12ae-4bd8-8482-2e856a13e908 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:22.776768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a8eb9f5-12ae-4bd8-8482-2e856a13e908 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:22.787118 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a8eb9f5-12ae-4bd8-8482-2e856a13e908 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1209 microversion: 2.1 time: 0.792789 Oct 28 17:45:22.799420 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2028/3972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:21 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1209 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:22.812976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:22.813610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:22.835846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:22.843414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:22.844469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:22.845522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:22.846525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:22.847636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:22.932483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:22.933312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:22.937044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:22.937828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lazy-loading 'fault' on Instance uuid 4b0bd4c1-ca80-4362-8d59-d983ead1c152 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:23.108918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:23.118299 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0372c39e-ae2d-4d07-9cc9-c66fe7c26ee3 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 200 len: 1304 microversion: 2.1 time: 0.317752 Oct 28 17:45:23.124573 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2029/3973] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:22 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 1304 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:23.168209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8614db0-5443-4ab4-a8d8-1a14d6561e8e", "name": "network-vif-plugged", "status": "completed", "tag": "e4f7b0ff-4bff-4574-beb3-106d0b136308"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:23.199616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.202595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.203780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.238344 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] Creating event network-vif-plugged:e4f7b0ff-4bff-4574-beb3-106d0b136308 for instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e on n-h2-860864-13 Oct 28 17:45:23.250272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f2cf80c5-dc5e-464e-adba-83f01a6e4f3c req-d33dc01e-cb0b-429e-af95-9ab6b541fdec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104608 Oct 28 17:45:23.254119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2030/3974] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:23.268147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:23.269001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:23.280631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.285809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.286420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.287519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.288337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.290944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.343569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:23.365534 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31de9124-9459-4478-b362-918fc16e6da2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 1.457079 Oct 28 17:45:23.383468 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1945/3975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:21 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:23.584238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:23.677594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:23.682642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:23.695254 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e023fff8-532f-4dd5-8999-2a9d0caee975 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.438324 Oct 28 17:45:23.698787 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2031/3976] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:23 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:23.786679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:23.830251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:23.830549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:23.848021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.850018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.850525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.851599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.853051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:23.853712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.854320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.854637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:23.856156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:23.914869 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] Creating event network-changed:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:45:23.930238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c85c43d2-de60-4075-b3fb-6580e68d89fc req-3c3e258d-21b9-4606-a4df-9ccbf07eda5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145286 Oct 28 17:45:23.934779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1946/3977] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:24.128038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:24.139021 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f1db1d4-5eef-4453-9fbc-7289275d4dde tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1261 microversion: 2.1 time: 0.319174 Oct 28 17:45:24.144867 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2032/3978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:23 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1261 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:24.173653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:24.174582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 4b0bd4c1-ca80-4362-8d59-d983ead1c152] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:24.192824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.193805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.195345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.196494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.197291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.198008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.218416 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 HTTP/1.1 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4b0bd4c1-ca80-4362-8d59-d983ead1c152'} Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:24.221434 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. Oct 28 17:45:24.229030 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:24.233460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 404 to user: Instance 4b0bd4c1-ca80-4362-8d59-d983ead1c152 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:24.234623 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd171b43-7e02-4527-bb5b-5b2b6901e1b0 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152" status: 404 len: 111 microversion: 2.1 time: 0.067030 Oct 28 17:45:24.238729 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1947/3979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:24 2022] GET /compute/v2.1/servers/4b0bd4c1-ca80-4362-8d59-d983ead1c152 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:45:24.244228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:24.244733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:24.254878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.255403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.255861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.256576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.268159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.268956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.305697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:24.392694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:24.393430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:24.420384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.421217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.423003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.426124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.427645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.431143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.494199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-62c8c1ca-f229-4e1c-adef-8eec711be2eb tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 204 len: 0 microversion: 2.1 time: 0.253983 Oct 28 17:45:24.496539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2033/3980] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:24 2022] DELETE /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:24.509256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:24.511497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:24.525529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.529419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.530346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.532277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:24.533954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:24.535176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:24.980952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:24.992704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c5ecb49-bf5d-4859-b9cb-ea71ab70b2b2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.605164 Oct 28 17:45:25.012877 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1948/3981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:24 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:25.020444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:25.021410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:25.030333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:25.031860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:25.032773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:25.034013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:25.034690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:25.035351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:25.175454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:25.188382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2f2f623-92f7-4f9f-8c5e-dbde7fd1412c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1677 microversion: 2.1 time: 0.686140 Oct 28 17:45:25.225126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2034/3982] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:24 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1677 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:25.240703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:25.241242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:25.248803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:25.260646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:25.262323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:25.264491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:25.265305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:25.265971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:25.268649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:25.269350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:25.270883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:25.280243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-baeaa268-7d20-4b1e-b46e-23600739155c tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.263906 Oct 28 17:45:25.281502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1949/3983] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:25 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:25.410009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:25.418674 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78710720-ccbe-43fd-8d0d-d5141bc1a605 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1267 microversion: 2.1 time: 0.191903 Oct 28 17:45:25.419649 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2035/3984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:25 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:25.959101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:25.970744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:25.971540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:25.972461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:25.990943 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] Creating event network-changed:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:45:25.997609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7fba33be-1979-474f-803e-95029cd4e3f2 req-b10a9140-5ee5-4333-b7ba-dd88ad6d0353 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043802 Oct 28 17:45:25.998572 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1950/3985] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:45:26.026320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:26.027326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:26.035161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.036206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.036881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.045156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.046412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.047096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.241194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:26.242567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:26.264900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.265399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.266055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.266951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.268464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.269078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.676391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:26.686552 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-94e71f42-61be-4dcf-b979-bbe27724c9e1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.666877 Oct 28 17:45:26.693987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2036/3986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:26 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:26.700156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:26.703587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:26.737273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.740590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.741256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.744143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.744850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.747006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.909000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:26.925895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3697102c-1620-420a-875d-f789cff24cea tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1677 microversion: 2.1 time: 0.688573 Oct 28 17:45:26.943702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:26.952596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1951/3987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:26 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1677 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:26.953262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:26.956120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:26.959396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:26.961231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:26.970078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.971028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.971745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.973592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:26.973984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e98b848a-47cc-4ae4-b14c-3102ba2f7d90 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.276860 Oct 28 17:45:26.974518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:26.975289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:26.980036 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2037/3988] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:26 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:27.128377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:27.148944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d5f33f5-b44f-4765-a293-38488e0a0668 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1267 microversion: 2.1 time: 0.194002 Oct 28 17:45:27.149507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1952/3989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:26 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:27.715059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:27.716865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:27.724782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:27.725552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:27.726498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:27.727766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:27.728398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:27.729004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:27.958230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:27.959142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:27.988854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:27.995919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:27.997288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:28.004137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:28.005785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:28.021551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:28.460794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:28.463995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:28.477941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-266243ed-92d9-456f-983b-b985f50e3f1a tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1677 microversion: 2.1 time: 0.520853 Oct 28 17:45:28.494934 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1953/3990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:27 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1677 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:28.499617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:28.508720 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-888c2508-964e-4daa-ab12-19a5ec426f11 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.798339 Oct 28 17:45:28.512041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:28.512660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:28.517780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2038/3991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:27 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:28.525504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:28.526002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:28.526441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:28.527158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:28.527640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:28.528066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:28.528933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:28.531147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:28.546361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:28.550488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:28.551305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:28.552309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:28.552959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:28.553574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.148465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.158535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.169449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.174458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:29.176429 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8dc777f2-a7c9-4947-90be-6134c630655f tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.674005 Oct 28 17:45:29.189079 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1954/3992] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:28 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:29.508097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:29.515570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:29.520818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.531184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:29.531977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:29.532690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.534036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:29.534738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:29.535468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.547274 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f1629f9-735b-48b7-92b5-b25286fcea89 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 1.026034 Oct 28 17:45:29.548840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2039/3993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:28 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:29.555074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:29.556464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:29.569990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:29.570494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:29.570927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.571665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:29.572116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:29.573067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.578467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:29.705626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12fcd7fffa34fc3ab6e8ce817967baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7010927433b45f8a54537e2c753cb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.732419 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e7aebf7-6511-4e4a-9fb8-172bb54fbf57 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 200 len: 1609 microversion: 2.1 time: 0.230096 Oct 28 17:45:29.733764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1955/3994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:29 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 1609 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:29.816333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49131a-4de5-4a84-b9a4-47ba09b70dae", "name": "network-vif-deleted", "tag": "b70853b0-6dbe-4172-bc94-72b961929337"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:29.839017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:29.854950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:29.856872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:29.857549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:29.862130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64ad4cae-d701-40ad-a965-18a61bba8f09 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.312033 Oct 28 17:45:29.865686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2040/3995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:29 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:29.877397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] Creating event network-vif-deleted:b70853b0-6dbe-4172-bc94-72b961929337 for instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae on n-h1-860864-13 Oct 28 17:45:29.885369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-98c116a9-83b4-4fd1-9dc1-b7d63819544a req-89b02822-12a9-4494-bbe9-46db0c964eca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077599 Oct 28 17:45:29.887534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1956/3996] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:30.224936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:30.226660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:30.233707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.234538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.235222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.236347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.237275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.237937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.298104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0", "tag": "1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:30.313649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.314550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.317086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.330154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] Creating event network-changed:1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3 for instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 on n-h1-860864-13 Oct 28 17:45:30.338026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2ec84086-32e1-4459-ba51-ec95a0456c0a req-d182bfdd-62b0-4c90-9acb-10174d231e01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047176 Oct 28 17:45:30.340181 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1957/3997] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:45:30.370589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:30.387066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:30.388949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:30.394696 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ada69e7d-0cb1-441c-b0e2-561c4101ccfa tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.173618 Oct 28 17:45:30.395845 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2041/3998] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:30 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:30.576607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:30.577875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:30.594559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.596116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.598380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.602986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.604951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.607407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.760007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:30.761433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] [instance: 6e49131a-4de5-4a84-b9a4-47ba09b70dae] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:30.778348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.778866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.779318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.780067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.782796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.783279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.808552 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] HTTP exception thrown: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Request method failure captured: Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae HTTP/1.1 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBLIJEI5MRzwcHq7CJ6Fynp53SR7zt_YDoAzXTZ4qYCQwzPiVXo-aOnYgJeNALV4E9SqrYJbapJ5BtnfFQWlP-eJwn0z3YU765w_d2pX3tEwsj9cfzFLL-LECzQ3zMKI9g-U2ffPegyPUa0l2jKae6qqUp5MPYyjheXmmq0AECmwIZ0 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7010927433b45f8a54537e2c753cb04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7010927433b45f8a54537e2c753cb04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7010927433b45f8a54537e2c753cb04"}]}] Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7010927433b45f8a54537e2c753cb04 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-1805089472 Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d12fcd7fffa34fc3ab6e8ce817967baf Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-1805089472-project Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6e49131a-4de5-4a84-b9a4-47ba09b70dae'} Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:30.817894 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. Oct 28 17:45:30.824140 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:30.827862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Returning 404 to user: Instance 6e49131a-4de5-4a84-b9a4-47ba09b70dae could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:30.829046 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7eff6569-b964-46b6-b6ea-d9ede63cec5c tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae" status: 404 len: 111 microversion: 2.1 time: 0.074960 Oct 28 17:45:30.831233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2042/3999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:30 2022] GET /compute/v2.1/servers/6e49131a-4de5-4a84-b9a4-47ba09b70dae => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:45:30.845605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f10cfecb-7250-4211-88a9-d42193b65645 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] Calling method '.version_select at 0x7f75244815e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:30.899133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f10cfecb-7250-4211-88a9-d42193b65645 tempest-ServerActionsTestJSON-1805089472 tempest-ServerActionsTestJSON-1805089472-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118882013" status: 202 len: 0 microversion: 2.1 time: 0.062641 Oct 28 17:45:30.903438 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2043/4000] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:45:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118882013 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:45:30.912763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:30.916331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:30.932267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.932581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.934079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.936240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:30.937059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:30.937783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:30.965303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:30.978564 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be481d0f-c259-42ad-97fd-5160c76e4b61 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.409701 Oct 28 17:45:30.979185 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1958/4001] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:30 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:31.283230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:31.307956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c40e7f8e-371f-4ad1-baa6-09ce7ee3a6df tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.393088 Oct 28 17:45:31.308641 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2044/4002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:30 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:31.437374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:31.438709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:31.447281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:31.448120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:31.457605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:31.458443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:31.459001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:31.459533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:31.565178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:31.577008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:31.579100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:31.585168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7b5c371c-4d55-423d-8b20-5a1fe83cf601 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.160197 Oct 28 17:45:31.586567 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1959/4003] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:31 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:32.011361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:32.012888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:32.020371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:32.023719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.025122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.025727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.036019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.038802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.040818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.300026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:32.308781 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36a8890e-cf36-4a2b-90bf-b5750f34698a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.308400 Oct 28 17:45:32.323275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2045/4004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:31 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:32.331700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:32.332305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:32.339347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.341465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.341913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.342614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.343062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.343516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.614232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:32.615107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:32.624639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.625361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.626103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.627084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:32.627705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:32.628135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:32.783992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:32.883946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:32.893898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:32.896051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:32.907025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2b03106-bf90-4f9e-a283-5c6515cfef60 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.296355 Oct 28 17:45:32.909560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2046/4005] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:32 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:33.075188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:33.097481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f36c697b-4ce2-4523-89dc-ccaf07bd81d4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1307 microversion: 2.1 time: 0.768395 Oct 28 17:45:33.104086 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1960/4006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:32 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1307 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:33.334185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:33.334784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:33.342933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:33.343466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:33.343904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:33.344828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:33.345290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:33.345710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:33.622213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:33.634249 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf9ab686-db28-4cf8-8f45-ddb3eb86de41 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.301425 Oct 28 17:45:33.634885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2047/4007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:33 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:33.938301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:33.939145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:33.947849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:33.948869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:33.949286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:33.951018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:33.951511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:33.952374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.031060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:34.043209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:34.044981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:34.051386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-349e94d8-8836-40d1-ad9d-e11fd98b25a5 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.117213 Oct 28 17:45:34.051984 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1961/4008] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:33 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:34.131357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:34.132215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:34.141555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.142836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.143488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.144430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.144888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.145656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.432515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:34.447479 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a02fd08-96e3-44bf-b4c2-f4d6e18f62d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1487 microversion: 2.1 time: 0.321063 Oct 28 17:45:34.448314 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2048/4009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:34 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1487 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:34.473830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:34.474466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:34.482303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.482786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.483216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.483938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.484387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.484809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.517909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lazy-loading 'flavor' on Instance uuid f8614db0-5443-4ab4-a8d8-1a14d6561e8e {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:34.623224 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0e59fa0-325e-4ac0-ac1b-8e2b0d848d8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.154012 Oct 28 17:45:34.624514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1962/4010] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:45:34 2022] POST /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:45:34.632124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:34.633200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:34.639593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.640385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.641073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.641865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.642538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.643184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.666103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:34.667529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:34.677684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.678493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.679565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.680579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:34.682990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:34.683742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:34.966356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:34.984104 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8d2694e-77cb-45d7-bfca-42799b8bafa5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1495 microversion: 2.1 time: 0.355904 Oct 28 17:45:34.994526 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2049/4011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:34 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1495 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:35.081929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:35.082943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:35.090657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:35.091747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:35.092429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:35.094060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:35.102887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:35.103520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:35.508966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:35.519985 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a8befce-e0cb-4368-a0f1-771793a8d4d2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.863721 Oct 28 17:45:35.521713 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1963/4012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:34 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:35.549754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:35.564731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:35.566207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:35.593391 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-453e448a-c3af-4f47-ab35-b2229e483f30 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.517490 Oct 28 17:45:35.604086 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2050/4013] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:35 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:36.022229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:36.024210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:36.032055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.032654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.033212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.034023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.034577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.035102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.410599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:36.421088 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ab6511a-dd63-4995-9526-95888e0fb25c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1495 microversion: 2.1 time: 0.402699 Oct 28 17:45:36.422542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1964/4014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:36 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1495 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:36.549558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:36.550483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:36.559827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.560317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.560950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.562867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.563640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.564248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.629508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:36.631350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:36.640721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.641476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.642098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.643099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:36.643993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:36.644636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:36.813102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:36.825338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:36.827157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:36.832531 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1b51bee-adf6-4e45-ba73-4ad31da1f590 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.211965 Oct 28 17:45:36.833112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1965/4015] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:36 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:36.916303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:36.928156 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d37e61e-9a6d-45c6-a198-9818f2c9aca1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.382532 Oct 28 17:45:36.929346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2051/4016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:36 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:37.454206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:37.454971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:37.475219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.477016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.477960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:37.480226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.481024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.482282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:37.863671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:37.864945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:37.873166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.874212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.874848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:37.876154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.884891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.885808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:37.904194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:37.926981 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e693d0a-5ae9-47d4-8336-3844e09a27d6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 200 len: 1478 microversion: 2.1 time: 0.481567 Oct 28 17:45:37.927635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1966/4017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:37 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 1478 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:37.955863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1871602092"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:37.958249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:37.965371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.965860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.966290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:37.967001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:37.967493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:37.967906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:38.076889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:38.089329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:38.092170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:38.111401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ece4c7e-b0b1-4fc7-9f9c-7c7628a77379 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1546 microversion: 2.91 time: 0.251600 Oct 28 17:45:38.113194 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2052/4018] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:37 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:45:38.121375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:38.122406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:38.131596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:38.142148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:38.146396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:38.149939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:38.151252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:38.152271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:38.346051 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-defcf020-44fa-4241-95b5-2e54dbb443eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.393176 Oct 28 17:45:38.356384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1967/4019] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:45:37 2022] POST /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:45:38.371893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd53d830-e1d3-4bf0-bce6-16b45d0609d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f675040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:38.464721 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd53d830-e1d3-4bf0-bce6-16b45d0609d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.106640 Oct 28 17:45:38.465797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1968/4020] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:38 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:38.906617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0", "name": "network-vif-plugged", "status": "completed", "tag": "1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:38.932221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:38.933307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:38.933986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:38.949951 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] Creating event network-vif-plugged:1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3 for instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 on n-h1-860864-13 Oct 28 17:45:38.957800 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c92b0a68-03a8-4a26-a02d-22b62f0b75da req-0b6e8169-5b36-4f30-afb2-d14680a3fba7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059982 Oct 28 17:45:38.964384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1969/4021] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:39.058055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.066053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b1efc5e-438c-46b5-be82-6a8d8ac95a6b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.950333 Oct 28 17:45:39.067103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2053/4022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:38 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:39.148735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:39.149429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:39.157316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.159023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.167805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.168569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.169219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.169891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.193498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:39.296920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.320172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.323149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.339516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31bebc06-5c0e-46b5-a254-435b5edb20fd tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1533 microversion: 2.91 time: 0.197551 Oct 28 17:45:39.343067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1970/4023] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:39 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1533 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:39.370170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:39.371205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:39.380211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.380840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.381586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.382772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.383449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.384260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.481726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f575be9a-18d6-482a-aa52-b7376a7c1664 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f638ca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:39.495649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] Lazy-loading 'services' on Instance uuid dfa4f821-f755-4184-98e7-39b7924f2511 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:39.535477 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-358664d3-9a69-477f-b9e9-7043c8b8ce58 tempest-UnshelveToHostMultiNodesTest-1011944424 tempest-UnshelveToHostMultiNodesTest-1011944424-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1940 microversion: 2.91 time: 0.171246 Oct 28 17:45:39.536081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2054/4024] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:39 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1940 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:39.571856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f575be9a-18d6-482a-aa52-b7376a7c1664 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.094936 Oct 28 17:45:39.580849 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1971/4025] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:39 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:39.599847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:39.600302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:39.608076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.608582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.609945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.610872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.611555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.612165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.658105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:39.768463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3acdedd0-5b1a-4f5a-8d8e-118c0453d365 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 204 len: 0 microversion: 2.91 time: 0.172249 Oct 28 17:45:39.768958 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2055/4026] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:45:39 2022] DELETE /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:45:39.778205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:39.778891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:39.793883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.794891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.795602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.796524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:39.798374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:39.798810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:39.888320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.899785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.901544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:39.909726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2133f7aa-c272-4499-af51-394f653dfa2b tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.135674 Oct 28 17:45:39.910674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1972/4027] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:39 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:40.092025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:40.092817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:40.100619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:40.101276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:40.101720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:40.102427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:40.103314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:40.104075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:40.121654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:40.263786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:40.274701 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1523f71a-552a-47fd-9f45-6002f8f64ee4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1309 microversion: 2.1 time: 0.187675 Oct 28 17:45:40.276357 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2056/4028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:40 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:40.587861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef1c75fa-97f8-41ac-870c-8fcf5ded5067 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f638940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:40.650003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef1c75fa-97f8-41ac-870c-8fcf5ded5067 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.066556 Oct 28 17:45:40.651144 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1973/4029] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:40 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:40.939894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:40.940642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:40.943617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:45:40.950731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:40.951264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:40.951729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:40.952455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:40.952918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:40.953352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.063312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:41.073980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:41.075888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:41.081606 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63f0eb83-900d-4283-8c77-3f42fcb0a59e tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.147310 Oct 28 17:45:41.082212 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2057/4030] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:40 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:41.307903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:41.309141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:41.318118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.318614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.319044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.320005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.320657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.321079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.473685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:41.483259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab7172a6-5ae9-430d-b19c-21062b00af58 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1490 microversion: 2.1 time: 0.185639 Oct 28 17:45:41.483898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1974/4031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:41 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1490 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:41.511692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:41.513472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:41.527978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.528929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.529668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.530627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.531316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.532437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.666005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d6e0fbe-c794-4b42-9cbf-9eff51058951 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f638e50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:41.740984 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d6e0fbe-c794-4b42-9cbf-9eff51058951 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.078816 Oct 28 17:45:41.744274 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1975/4032] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:41 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:41.783719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:41.795334 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8c3b62c-42cf-4d3d-9c15-94313bf46b83 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1490 microversion: 2.1 time: 0.292879 Oct 28 17:45:41.795824 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2058/4033] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:41 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1490 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:41.823876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:41.824653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:41.839755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.840395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.841747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:41.844683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:41.845469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:41.846819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.121421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:42.123628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:42.150958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.152727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.156676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.160173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.163808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.165560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.402619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:42.419315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:42.420863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7d5080241304ed99e731438822e8de7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f57cbb28a73437aa218952540d86298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:42.432511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:42.449544 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b6e7da15-7eb4-4436-bc3a-ecd332b20e35 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1490 microversion: 2.1 time: 0.630538 Oct 28 17:45:42.453369 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1976/4034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:41 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1490 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:42.462171 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cd340bb-0654-4074-b97e-114201c48687 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 200 len: 1539 microversion: 2.91 time: 0.351899 Oct 28 17:45:42.465545 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2059/4035] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:42 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 1539 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:45:42.479185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:42.480241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:42.495731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.496541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.498640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.501265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.501883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.502697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.568012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:42.761519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44596571-afc4-4cc7-ba97-cda147e52032 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75285fb1f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:42.763444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cce2fc70-99f9-4b27-8d74-cde83136a2d6 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 204 len: 0 microversion: 2.1 time: 0.290239 Oct 28 17:45:42.767157 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1977/4036] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:42 2022] DELETE /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:42.776471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:42.777600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:42.789601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.794479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.796267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.797235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:42.799236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:42.800219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:42.822902 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44596571-afc4-4cc7-ba97-cda147e52032 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.067301 Oct 28 17:45:42.823998 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2060/4037] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:42 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:43.430482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:43.443499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b77bd37-f39b-4b12-a38a-20b0915432ec tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1496 microversion: 2.1 time: 0.674473 Oct 28 17:45:43.446420 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1978/4038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:42 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1496 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:43.493471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:43.494266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] [instance: dfa4f821-f755-4184-98e7-39b7924f2511] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:43.509595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:43.513608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:43.514441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:43.518480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:43.519867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:43.520567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:43.541671 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] HTTP exception thrown: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Request method failure captured: Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 HTTP/1.1 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSFNFEBkn3SLZdpQBk_9nNP3ZblJBRg64FYKuKh2yvZegS3Tgte7nH_IVPJk0gtJAy0wy9N1K0bVirdW0uHiWHUgAS5MlmKPEFjeZ5Tp_6wl6wXI0QEDptjCv9fpp6OrLilTvsCe_zd-RP6k_l820CPEGBJGUsHoAaLnm8AoYLxGNk Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.91 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9f57cbb28a73437aa218952540d86298 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-754528487 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f57cbb28a73437aa218952540d86298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f57cbb28a73437aa218952540d86298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f57cbb28a73437aa218952540d86298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f57cbb28a73437aa218952540d86298"}]}] Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-754528487 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9f57cbb28a73437aa218952540d86298 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-754528487 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-UnshelveToHostMultiNodesTest-754528487-project Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b7d5080241304ed99e731438822e8de7 Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-754528487-project Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'dfa4f821-f755-4184-98e7-39b7924f2511'} Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:43.544632 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. Oct 28 17:45:43.549360 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:43.552716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] Returning 404 to user: Instance dfa4f821-f755-4184-98e7-39b7924f2511 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:43.554464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c38c701-7272-4332-a8e0-057f68e2e8e9 tempest-UnshelveToHostMultiNodesTest-754528487 tempest-UnshelveToHostMultiNodesTest-754528487-project] 10.222.0.48 "GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511" status: 404 len: 111 microversion: 2.91 time: 0.065268 Oct 28 17:45:43.556125 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2061/4039] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:45:43 2022] GET /compute/v2.1/servers/dfa4f821-f755-4184-98e7-39b7924f2511 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:45:43.840154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fada95b-0523-465c-8407-aaf503384ae0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f61e1f0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:43.908550 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fada95b-0523-465c-8407-aaf503384ae0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.073457 Oct 28 17:45:43.920100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1979/4040] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:43 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:44.418775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8614db0-5443-4ab4-a8d8-1a14d6561e8e", "name": "network-vif-plugged", "status": "completed", "tag": "e4f7b0ff-4bff-4574-beb3-106d0b136308"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:44.446456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:44.449468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:44.451912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:44.471665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:44.472354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:44.477312 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] Creating event network-vif-plugged:e4f7b0ff-4bff-4574-beb3-106d0b136308 for instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e on n-h2-860864-13 Oct 28 17:45:44.484492 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0c39c4a9-3914-4c8f-a105-d1a6eaa82555 req-385e700c-4dc0-4da7-90a0-2154d61fc757 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073288 Oct 28 17:45:44.485735 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2062/4041] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:44.493068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:44.493361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:44.498916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:44.500061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:44.500553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:44.501192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:44.889316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:44.899793 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b288c1f-b152-4ed2-a663-e699d513e964 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1496 microversion: 2.1 time: 0.433788 Oct 28 17:45:44.900384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1980/4042] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:44 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1496 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:44.930632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e98bce1-6495-458e-bae6-6a93d8b3526a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f8f2f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:45.024220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e98bce1-6495-458e-bae6-6a93d8b3526a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.101768 Oct 28 17:45:45.025665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2063/4043] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:44 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:45.927574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:45.928267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:45.956158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:45.957521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:45.961191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:45.962699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:45.971943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:45.981334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:46.045981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-231f5ff6-8835-4589-85c7-ccc7948c6bc7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6f8c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:46.179165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-231f5ff6-8835-4589-85c7-ccc7948c6bc7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.141857 Oct 28 17:45:46.186769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2064/4044] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:46 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:47.204434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-594e27ec-255c-4653-8ea6-42e345fb3ccd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75286549d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:47.338811 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-594e27ec-255c-4653-8ea6-42e345fb3ccd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.140362 Oct 28 17:45:47.340680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2065/4045] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:47 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:47.391409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0", "name": "network-vif-deleted", "tag": "1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:47.418398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:47.418992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:47.419473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:47.448759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] Creating event network-vif-deleted:1fb2f8b1-6f5f-49a9-8190-fc52cc2197a3 for instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 on n-h1-860864-13 Oct 28 17:45:47.461077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-13fe8110-68bc-4887-8988-55d7e4951e38 req-5b77d584-9a03-40fd-82b8-d0cd4751393b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072618 Oct 28 17:45:47.463417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2066/4046] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:45:47.976528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:47.988812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63fbc0f1-a90e-4f94-be63-713211e7c729 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 200 len: 1496 microversion: 2.1 time: 2.064055 Oct 28 17:45:47.989760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1981/4047] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:45 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 1496 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:48.357915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f123e14c-6774-4fe6-8660-e143f4e8e432 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7f8940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:48.421065 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f123e14c-6774-4fe6-8660-e143f4e8e432 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.069168 Oct 28 17:45:48.422344 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2067/4048] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:48 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:49.019097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:49.019838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:49.055804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.057517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.058246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:49.066897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.068936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.070989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:49.105047 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 HTTP/1.1 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0'} Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:49.107601 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:45:49.117540 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:45:49.123912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:49.125378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b97ae71a-708d-4a3b-875a-445507ecabac tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 404 len: 111 microversion: 2.1 time: 0.110946 Oct 28 17:45:49.126783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1982/4049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:49 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:45:49.136248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:49.136947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:49.158349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.158884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.159339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:49.166446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.167055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.167660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:49.280515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:45:49.438727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38925591-90df-4905-8828-ea6c2a89101c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6ec3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:49.544307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ae822c5-dcdf-43a6-b49b-52a231142ec3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 204 len: 0 microversion: 2.1 time: 0.412815 Oct 28 17:45:49.545974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2068/4050] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:45:49 2022] DELETE /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:45:49.559437 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38925591-90df-4905-8828-ea6c2a89101c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.123138 Oct 28 17:45:49.564856 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1983/4051] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:49 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:49.573225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:49.578193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:49.591746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.592948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.594898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:49.596624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:49.598920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:49.599654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:50.095617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:50.113339 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-33ca249b-beae-49cc-9437-ba48d98a9a8e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1496 microversion: 2.1 time: 0.554159 Oct 28 17:45:50.121864 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2069/4052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:49 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1496 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:50.578518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9202053-a475-40bb-abc2-3ef4b686d9d1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f61eee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:50.648090 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9202053-a475-40bb-abc2-3ef4b686d9d1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.074242 Oct 28 17:45:50.656228 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1984/4053] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:50 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:51.161428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.162361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:51.183615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:51.186667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:51.188564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:51.190389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Action: 'create', calling method: .version_select at 0x7f751f7f8f70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:51.191134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:51.192937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:51.193551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:51.230730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Getting quotas for project f2eb755d83d54486ad8202135b62127b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:51.238034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Getting quotas for user 2757218721254a0da28cb04240ffe79c and project f2eb755d83d54486ad8202135b62127b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:51.302953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Getting quotas for project f2eb755d83d54486ad8202135b62127b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:51.309534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Getting quotas for user 2757218721254a0da28cb04240ffe79c and project f2eb755d83d54486ad8202135b62127b. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:51.328990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3335a10d-07f5-4fea-bf17-601fd72fb2a6 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.385817 Oct 28 17:45:51.331014 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2070/4054] 10.222.0.48 () {62 vars in 1214 bytes} [Fri Oct 28 17:45:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:45:51.362739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16fcc069-3c2a-4e60-a135-696158bfee7d tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.416892 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16fcc069-3c2a-4e60-a135-696158bfee7d tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.072531 Oct 28 17:45:51.417487 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2071/4055] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Oct 28 17:45:51 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:45:51.439586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7986e71-cb5b-455c-96a2-762c59a529f8 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.473117 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7986e71-cb5b-455c-96a2-762c59a529f8 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334" status: 200 len: 235 microversion: 2.64 time: 0.047617 Oct 28 17:45:51.481541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2072/4056] 10.222.0.48 () {60 vars in 1304 bytes} [Fri Oct 28 17:45:51 2022] GET /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334 => generated 235 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:45:51.489495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d04842b-ea08-486f-8707-fd0e9f5f08a7 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.563503 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d04842b-ea08-486f-8707-fd0e9f5f08a7 tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334" status: 204 len: 0 microversion: 2.64 time: 0.080012 Oct 28 17:45:51.564834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2073/4057] 10.222.0.48 () {60 vars in 1307 bytes} [Fri Oct 28 17:45:51 2022] DELETE /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:45:51.577953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8646e15-92d6-4cbe-94e3-52317f658d3a tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.586858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d8646e15-92d6-4cbe-94e3-52317f658d3a tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] HTTP exception thrown: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8646e15-92d6-4cbe-94e3-52317f658d3a tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Request method failure captured: Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334 HTTP/1.1 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVOx7cQFIJkljiQOy01oPg9_hF9QvyAzpoMvR_3v-aUG3bHKVxQWQsoAOWn3z3y3gUuTiwIiYwNu7zCkj2f3g-gW4h8HMyqHtSbKSZa6FuhW_APH_F0kfXwyEE2kglOwomUa4O5YiUXcJ2Sv4xSh039Wvk_hdHvH71E7ICC6iQXz24 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.64 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f2eb755d83d54486ad8202135b62127b Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroup264TestJSON-487106668 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2eb755d83d54486ad8202135b62127b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2eb755d83d54486ad8202135b62127b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2eb755d83d54486ad8202135b62127b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2eb755d83d54486ad8202135b62127b"}]}] Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroup264TestJSON-487106668 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f2eb755d83d54486ad8202135b62127b Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroup264TestJSON-487106668 Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroup264TestJSON-487106668-project Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 2757218721254a0da28cb04240ffe79c Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroup264TestJSON-487106668-project Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f6f9b13d-9def-4619-8f58-f1ba2fe70334'} Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:51.596456 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. Oct 28 17:45:51.604217 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:51.607120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8646e15-92d6-4cbe-94e3-52317f658d3a tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] Returning 404 to user: Instance group f6f9b13d-9def-4619-8f58-f1ba2fe70334 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:51.608694 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8646e15-92d6-4cbe-94e3-52317f658d3a tempest-ServerGroup264TestJSON-487106668 tempest-ServerGroup264TestJSON-487106668-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334" status: 404 len: 117 microversion: 2.64 time: 0.037063 Oct 28 17:45:51.611413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2074/4058] 10.222.0.48 () {60 vars in 1307 bytes} [Fri Oct 28 17:45:51 2022] DELETE /compute/v2.1/os-server-groups/f6f9b13d-9def-4619-8f58-f1ba2fe70334 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:45:51.665648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5f7b14b-e65d-40c8-946e-dd8edf390c94 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751faf7670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:51.755656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5f7b14b-e65d-40c8-946e-dd8edf390c94 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.095363 Oct 28 17:45:51.760241 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2075/4059] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:51 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:51.800136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:51.812988 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f46f82e6-3ae7-4c2e-bcde-1820ee2a5e50 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1496 microversion: 2.1 time: 0.668589 Oct 28 17:45:51.815411 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1985/4060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:51 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1496 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:52.781678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02041c8e-1b7d-46bc-a985-2c118f18c7d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f700160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:52.845360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:52.847179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:52.863346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:52.864418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:52.865206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:52.875010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:52.876879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:52.877645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:52.902033 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02041c8e-1b7d-46bc-a985-2c118f18c7d2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.126612 Oct 28 17:45:52.907666 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2076/4061] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:52 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:53.094536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:53.115005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b11d7a1e-db90-45c9-97ad-33e6041c9cf1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1454 microversion: 2.1 time: 0.275841 Oct 28 17:45:53.122000 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1986/4062] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:52 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1454 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:53.479071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83eb375c-68c9-4b51-99e1-22a2f47257b6", "name": "network-vif-deleted", "tag": "e5051401-a528-43c5-99d0-04e6c18c4ea0"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:53.527517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:53.528368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:53.528987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:53.596795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] Creating event network-vif-deleted:e5051401-a528-43c5-99d0-04e6c18c4ea0 for instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 on n-h2-860864-13 Oct 28 17:45:53.618589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c6546df8-188b-434f-ab43-715a699c693f req-10801918-0dd1-4f62-8270-725b7d6c3119 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144788 Oct 28 17:45:53.622560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2077/4063] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:45:53.925011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d12c6fd8-98cc-491e-af0e-e2604e967e02 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75240b1d30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:54.031119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d12c6fd8-98cc-491e-af0e-e2604e967e02 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.111629 Oct 28 17:45:54.035435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1987/4064] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:53 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:54.149729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:54.150435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:54.184507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:54.185278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:54.185895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:54.186801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:54.187449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:54.188040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:54.248952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:54.249446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:54.258788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:54.259793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lazy-loading 'fault' on Instance uuid 83eb375c-68c9-4b51-99e1-22a2f47257b6 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:45:54.511549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:54.520663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1336ebd-5f18-4d3e-9849-aa80fbe8290d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 200 len: 1299 microversion: 2.1 time: 0.378121 Oct 28 17:45:54.530033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2078/4065] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:54 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 1299 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:55.051687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00fc97ca-c747-4cf5-b6c0-5ffc812e49c7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5dc430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:55.143937 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00fc97ca-c747-4cf5-b6c0-5ffc812e49c7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.097294 Oct 28 17:45:55.145008 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1988/4066] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:55 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:55.556036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:55.557223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:55.572165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:55.577952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:55.579867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:55.583264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:55.587278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:55.587963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:55.624039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 HTTP/1.1 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '83eb375c-68c9-4b51-99e1-22a2f47257b6'} Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:45:55.625740 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:45:55.630406 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b8b3bae-446f-4aca-bc29-709fffef12b8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 404 len: 111 microversion: 2.1 time: 0.075099 Oct 28 17:45:55.658552 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2079/4067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:55 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:45:55.908625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1843610836", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:45:56.023695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:45:56.162031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bc38111-7efd-49de-a6ed-c1ec5733d666 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752524fca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:56.249772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bc38111-7efd-49de-a6ed-c1ec5733d666 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.091900 Oct 28 17:45:56.251122 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2080/4068] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:56 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:57.267567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f133fbeb-013c-4e5e-a1e0-ad6199c4e618 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75285fb310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:57.374571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f133fbeb-013c-4e5e-a1e0-ad6199c4e618 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.112322 Oct 28 17:45:57.380279 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2081/4069] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:57 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:57.982756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:45:57.983328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:45:57.983766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:45:57.984570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:45:57.984739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:45:58.006324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:58.007255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:58.008938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:58.009945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:45:58.011475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:45:58.012585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:45:58.118420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:45:58.139244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:45:58.199216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:45:58.208926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:45:58.390946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-618154dc-1f6e-4c42-910c-28cabec104f1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752524fca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:58.405896 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-510ec939-026f-44ed-8679-46f19c70e209 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501176 Oct 28 17:45:58.413581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1989/4070] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:45:58.434664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65ddde7b-087b-4565-8598-4a2fef0b3f0e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:58.437728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65ddde7b-087b-4565-8598-4a2fef0b3f0e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:45:58.552791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-618154dc-1f6e-4c42-910c-28cabec104f1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.166501 Oct 28 17:45:58.553433 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2082/4071] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:58 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:45:59.123189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65ddde7b-087b-4565-8598-4a2fef0b3f0e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:45:59.134193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65ddde7b-087b-4565-8598-4a2fef0b3f0e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1209 microversion: 2.1 time: 0.714767 Oct 28 17:45:59.142726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1990/4072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:45:58 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1209 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:45:59.571838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-010f960c-0faf-435c-a97b-d60a32bc6844 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75245b2820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:45:59.674868 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-010f960c-0faf-435c-a97b-d60a32bc6844 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.107684 Oct 28 17:45:59.681159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2083/4073] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:45:59 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:00.159164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:00.159793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:00.169266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:00.177934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:00.193804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:00.194203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:00.196456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:00.199263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:00.201290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:00.463161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:00.492338 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15542c97-8c0f-4480-87b9-44f7717f138d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1261 microversion: 2.1 time: 0.316472 Oct 28 17:46:00.495212 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1991/4074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:00 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1261 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:00.693876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a709f73c-3be6-483a-a0d0-b3cd77ae1da0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f6f8c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:00.802178 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a709f73c-3be6-483a-a0d0-b3cd77ae1da0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.114200 Oct 28 17:46:00.803069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2084/4075] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:00 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:01.518080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:01.518694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:01.535543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:01.551001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:01.553020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:01.557726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:01.562793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:01.563246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:01.817122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:01.823588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f80c4032-0199-4e9b-8246-e9cfde569fd6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75251e8d30>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:01.856315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:01.874478 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5272573-f835-48e0-96cb-f2dde99f1e9e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1267 microversion: 2.1 time: 0.360436 Oct 28 17:46:01.876779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1992/4076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:01 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:01.920365 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f80c4032-0199-4e9b-8246-e9cfde569fd6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.103884 Oct 28 17:46:01.921732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2085/4077] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:01 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:02.912285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:02.915506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:02.941140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ccc7c057-eb28-4b9e-8b1c-67eaede6b54c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa9bb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:02.948561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:02.950115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:02.950700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:02.954413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:02.955140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:02.955719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:03.048737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ccc7c057-eb28-4b9e-8b1c-67eaede6b54c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.108200 Oct 28 17:46:03.056926 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2086/4078] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:02 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:03.175316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:03.197379 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-397da0b2-1c2d-49d6-a78f-01503f0d6ee2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1267 microversion: 2.1 time: 0.289903 Oct 28 17:46:03.200001 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1993/4079] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:02 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:04.071215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45e8dbdf-13e6-4228-823a-96694b61c92c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75245b2ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:04.149310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45e8dbdf-13e6-4228-823a-96694b61c92c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.084807 Oct 28 17:46:04.151166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2087/4080] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:04 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:04.229524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:04.231168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:04.264606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:04.266655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:04.269959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:04.281077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:04.287649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:04.291418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:04.554580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:04.567192 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d26be22-d70c-4de2-a226-ce9889d0a7e5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1267 microversion: 2.1 time: 0.342825 Oct 28 17:46:04.568044 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1994/4081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:04 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:05.168936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc5028c0-9f31-47ff-87e6-201cad3d9e1d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa9be50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:05.270230 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc5028c0-9f31-47ff-87e6-201cad3d9e1d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.107603 Oct 28 17:46:05.271460 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2088/4082] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:05 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:05.594413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:05.596017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:05.619335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:05.620343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:05.622418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:05.626320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:05.626957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:05.627248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:06.286705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5e76be2-78f8-4125-8085-d2f198a0a6b7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524c69e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:06.300958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:06.304157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:06.399075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5e76be2-78f8-4125-8085-d2f198a0a6b7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.113880 Oct 28 17:46:06.400536 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2089/4083] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:06 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:06.427206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:06.430973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:06.448139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a337a91b-5c70-4eaa-a580-30122fc6b9c2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.860188 Oct 28 17:46:06.451807 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1995/4084] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:05 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:07.419027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8f5bb2d-ebfd-4476-afcd-c08d679fc3f1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751faf7940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:07.484867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:07.486100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:07.495756 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8f5bb2d-ebfd-4476-afcd-c08d679fc3f1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.082841 Oct 28 17:46:07.496717 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2090/4085] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:07 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:07.506494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:07.511574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:07.512243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:07.514038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:07.516446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:07.518188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:08.074152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:08.513821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2e837cf-0dcc-4894-a9b2-2faa855391b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75245721f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:08.598401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2e837cf-0dcc-4894-a9b2-2faa855391b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.090527 Oct 28 17:46:08.599647 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2091/4086] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:08 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:08.784272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:08.798730 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8c19fd3-eabd-4fc9-b4b3-f4fde488ce48 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 1.321439 Oct 28 17:46:08.801963 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1996/4087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:07 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:08.864911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:08.865410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:08.886177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:08.886611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:08.887064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:08.887838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:08.888289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:08.888721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:09.171683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'services' on Instance uuid bb15caad-abcb-4a6d-aab2-c3a26a33e47c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:09.319252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c5e423-391d-43bf-9988-7b60672e1551", "tag": "3b0375bc-6c12-4375-932b-bd984eecc16d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:09.330322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:09.333116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:09.334111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:09.335280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:09.363983 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] Creating event network-changed:3b0375bc-6c12-4375-932b-bd984eecc16d for instance 83c5e423-391d-43bf-9988-7b60672e1551 on n-h1-860864-13 Oct 28 17:46:09.390585 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1f1ab712-eef3-44c8-8f8e-40e3c77a5165 req-cd8bb540-f96f-4b2a-933a-0e2c9c0657c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061330 Oct 28 17:46:09.394889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1997/4088] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:09.434906 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7f4ebc5-a4eb-40c8-94d0-a96cd336172c tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments/eb7224fc-6b41-4c63-a8de-d3b108e5e35b" status: 202 len: 0 microversion: 2.1 time: 0.574608 Oct 28 17:46:09.452033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2092/4089] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:46:08 2022] DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments/eb7224fc-6b41-4c63-a8de-d3b108e5e35b => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:46:09.464456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:09.471862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:09.493595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:09.495121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:09.497915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:09.498984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:09.514769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:09.515236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:09.617565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-830dbee2-30af-4a47-9ed1-77616f6d9c6b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7b6c10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:09.702579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c30ce2ec-87c4-4f68-876b-f2d6858fd591 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.246848 Oct 28 17:46:09.703915 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1998/4090] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:09 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:09.721309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-830dbee2-30af-4a47-9ed1-77616f6d9c6b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.107174 Oct 28 17:46:09.733915 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2093/4091] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:09 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:09.829157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:09.831828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:09.858863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:09.859383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:09.868365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:09.869342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:09.869828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:09.870269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:10.343247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:10.356430 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a24af75-e148-4710-8e31-47682a2480e0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.533545 Oct 28 17:46:10.376842 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 1999/4092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:09 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:10.717438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:10.726041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:10.739286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-795f4387-28b2-4e79-83c2-33d73500ee88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5e15e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:10.750920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:10.757843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:10.759739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:10.761383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:10.763213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:10.766200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:10.847425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87246866-bd2b-44bc-a1af-1994be9ac1c9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135696 Oct 28 17:46:10.850910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2094/4093] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:10 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:10.864497 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-795f4387-28b2-4e79-83c2-33d73500ee88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.129655 Oct 28 17:46:10.872329 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2000/4094] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:10 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:11.397052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:11.398960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:11.423108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:11.425353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:11.427320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:11.431386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:11.432565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:11.433225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:11.867838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:11.872078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:11.901668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:11.907992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:11.913969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:11.919117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:11.919883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:11.922964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:12.071744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf852b77-480d-490e-a1b5-3115a9cabed7 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210100 Oct 28 17:46:12.080998 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2001/4095] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:11 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:12.092421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f0ce5df-62cd-4c61-86c2-a23774e79901 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5e1dc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:12.183697 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f0ce5df-62cd-4c61-86c2-a23774e79901 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.101067 Oct 28 17:46:12.184624 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2002/4096] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:12 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:12.367737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:12.383610 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ba37c7b-434c-427e-a1b5-ade50db5a8b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 1.001081 Oct 28 17:46:12.403588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2095/4097] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:11 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:13.088259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:13.091389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:13.109394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:13.109951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:13.111076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:13.113692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:13.114181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:13.117015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:13.210331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e0baf74-4ed6-4a3f-9d22-f7076741e61b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7b6280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:13.258309 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f7b4fc5-40e4-4976-8089-227a8f3780f5 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176222 Oct 28 17:46:13.263564 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2003/4098] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:13 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:13.313473 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e0baf74-4ed6-4a3f-9d22-f7076741e61b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.112416 Oct 28 17:46:13.314055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2096/4099] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:13 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:13.417925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:13.418543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:13.434712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:13.435213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:13.441628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:13.442436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:13.442920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:13.454201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:14.176485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:14.188481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b72d64a-bd93-474d-a37f-f2964b338273 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.774844 Oct 28 17:46:14.205061 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2004/4100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:13 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:14.273104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:14.283394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:14.330916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ebf536ac-f7a5-4f1d-b4a6-75428a111c94 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5d9ca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:14.363193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:14.368080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:14.368843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:14.370071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:14.375806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:14.376518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:14.420870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ebf536ac-f7a5-4f1d-b4a6-75428a111c94 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.094587 Oct 28 17:46:14.431664 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2005/4101] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:14 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:14.515534 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b159d5fa-ba93-4168-b7f7-a54c469332e1 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248467 Oct 28 17:46:14.525220 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2097/4102] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:14 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:15.218132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:15.221848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:15.237703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:15.240645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:15.243467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:15.246287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:15.249708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:15.250358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:15.445794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c13803f-fc1d-4ca8-98a8-4e53ade4ab80 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa9bb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:15.537054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c13803f-fc1d-4ca8-98a8-4e53ade4ab80 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.097192 Oct 28 17:46:15.539805 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2098/4103] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:15 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:15.559995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:15.571035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:15.606270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:15.610678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:15.612851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:15.617152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:15.617951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:15.620848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:15.730342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af8c2051-4933-47ef-8b50-ddead01deebb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189142 Oct 28 17:46:15.734577 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2099/4104] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:15 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:15.862148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:15.894097 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-528c5b08-a88e-4658-b41c-0e82e23c042c tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.680972 Oct 28 17:46:15.906548 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2006/4105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:15 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:16.556340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-768c09ad-4cdf-43fb-97cd-e9607ffe6233 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa9b550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:16.682787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-768c09ad-4cdf-43fb-97cd-e9607ffe6233 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.132711 Oct 28 17:46:16.683984 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2100/4106] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:16 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:16.750835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:16.753646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:16.782732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:16.783236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:16.783709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:16.784431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:16.784891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:16.785320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:16.930782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:16.931612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:16.950899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:16.951434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:16.951880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:16.952608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:16.953073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:16.953174 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf3c01e8-194e-4945-ab1c-aca756be76f3 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200643 Oct 28 17:46:16.958364 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2007/4107] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:16 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:16.971308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:17.699279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a9864e2-3808-4a26-bb1f-33f43692e633 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f602ee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:17.784165 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a9864e2-3808-4a26-bb1f-33f43692e633 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1438 microversion: 2.1 time: 0.089538 Oct 28 17:46:17.784939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2008/4108] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:17 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:17.970883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:17.975267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:17.994492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:17.995236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:17.998823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:17.999957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:18.000591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:18.003957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:18.130501 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e37aa719-0149-486b-8423-6b8bec354a7e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167047 Oct 28 17:46:18.131948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2009/4109] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:17 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:18.343955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:18.359564 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4cd9f25c-47b0-4ca3-af9b-6414b2dbb9c7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 1.433322 Oct 28 17:46:18.362812 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2101/4110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:16 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:18.800565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5870ef91-c5e1-4e33-aae6-2f40d6f7984f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5e19d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:18.901791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5870ef91-c5e1-4e33-aae6-2f40d6f7984f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1447 microversion: 2.1 time: 0.100430 Oct 28 17:46:18.902480 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2010/4111] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:18 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:18.920364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9403ff13-62b8-4d63-ab7e-45c90cbbf852 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524602af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:19.023468 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9403ff13-62b8-4d63-ab7e-45c90cbbf852 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 200 len: 1447 microversion: 2.1 time: 0.109082 Oct 28 17:46:19.025924 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2102/4112] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:18 2022] GET /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:19.051949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1322dcb4-8f9d-4f37-b0b3-98d919853c28 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f626430>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:19.155762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:19.158243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:19.181285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:19.181787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:19.200507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:19.201805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:19.204078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:19.207146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:19.394200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-518306df-a747-4b22-8a2a-756622e81afb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247809 Oct 28 17:46:19.439179 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2103/4113] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:19 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:19.470282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:19.470906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:19.526946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:19.527921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:19.530170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:19.549225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:19.551763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:19.556603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:20.082092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:20.104011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25c2283e-5af1-47b3-91aa-ee5c104664d4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.656236 Oct 28 17:46:20.107628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2104/4114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:19 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:20.451069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:20.455297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:20.476935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:20.477459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:20.479618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:20.482442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:20.483860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:20.487241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:20.598711 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4fbdd82-a7a2-4977-acb0-700eb2720004 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153767 Oct 28 17:46:20.613413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2105/4115] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:20 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:20.639742 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1322dcb4-8f9d-4f37-b0b3-98d919853c28 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 204 len: 0 microversion: 2.1 time: 1.603296 Oct 28 17:46:20.640816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2011/4116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:19 2022] DELETE /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 0 bytes in 1605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:20.650173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:20.651035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:20.659312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:20.669062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:20.669537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:20.670290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:20.670748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:20.671176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:20.791851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:21.066266 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8bdf75c5-be9a-4ac6-a98f-2542f0e27257 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 204 len: 0 microversion: 2.1 time: 0.420536 Oct 28 17:46:21.067119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2106/4117] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:20 2022] DELETE /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:21.131339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:21.135398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:21.156299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:21.156814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:21.157263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:21.157981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:21.158950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:21.168086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:21.312351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1812030679", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:21.448057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:46:22.191822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:22.205922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f87de4e9-6f7c-4a7d-abd6-e7c7445003ba tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 1.079982 Oct 28 17:46:22.206516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2012/4118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:21 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:22.227076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:22.260596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:22.269153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.279469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.280373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.281791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.282470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.283208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.337690 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bbe7d3de-d4e7-46a3-aa2f-1f1a8f3a0cb9 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124937 Oct 28 17:46:22.339002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2013/4119] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:46:22 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:46:22.528036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:22.541094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:22.565827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.566888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.591853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.592952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.593624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.594834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.638592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:46:22.639103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:46:22.639556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:46:22.639970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:46:22.640389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:46:22.649270 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Cannot 'reboot' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.656963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.659285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.659766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.660520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action HTTP/1.1 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 28 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: {"reboot": {"type": "HARD"}} Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'reboot' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8612034c-4542-491d-b7fe-8b10221332ac', 'body': {'reboot': {'type': 'HARD'}}} Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8612034c-4542-491d-b7fe-8b10221332ac in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:46:22.660745 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.664884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.665519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.665519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.667316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 409 to user: Cannot 'reboot' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:22.687558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-96ab5055-3262-492f-b396-8703bcef04ad tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action" status: 409 len: 145 microversion: 2.1 time: 0.153757 Oct 28 17:46:22.697970 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2014/4120] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:46:22 2022] POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action => generated 145 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:46:22.706638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:22.712875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:22.733558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:22.739500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.742063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.742734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.743736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:22.744406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:22.745032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:22.760858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:22.806355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:46:22.811536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:46:22.838578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Cannot 'rebuild' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action HTTP/1.1 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 65 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'rebuild' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8612034c-4542-491d-b7fe-8b10221332ac', 'body': {'rebuild': {'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6'}}} Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8612034c-4542-491d-b7fe-8b10221332ac in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:46:22.840578 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued Oct 28 17:46:22.843673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:22.847013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 409 to user: Cannot 'rebuild' instance 8612034c-4542-491d-b7fe-8b10221332ac while it is in vm_state rescued {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:22.848098 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-106eb997-2408-4d07-86bf-ed8e0e68a50e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action" status: 409 len: 146 microversion: 2.1 time: 0.145667 Oct 28 17:46:22.865911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2015/4121] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:46:22 2022] POST /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac/action => generated 146 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:46:23.002664 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b47db28d-6ff0-4350-a01a-8ca391b02adc tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694488 Oct 28 17:46:23.011106 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2107/4122] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:46:23.014689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:23.024922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:23.074680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.075655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.078527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.080690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.083843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.086846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.175008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:23.386447 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-380f0a86-0b82-40a2-8cbe-58172314b788 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 204 len: 0 microversion: 2.1 time: 0.379827 Oct 28 17:46:23.387065 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2108/4123] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:23 2022] DELETE /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:23.404030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c5e423-391d-43bf-9988-7b60672e1551", "name": "network-vif-plugged", "status": "completed", "tag": "3b0375bc-6c12-4375-932b-bd984eecc16d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:23.411083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: .version_select at 0x7f751f5e15e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1602530230", "policies": ["affinity"]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:23.422430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.422928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.423389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.454544 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] Creating event network-vif-plugged:3b0375bc-6c12-4375-932b-bd984eecc16d for instance 83c5e423-391d-43bf-9988-7b60672e1551 on n-h1-860864-13 Oct 28 17:46:23.471152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d0f901ef-3b31-4349-9886-e77e6a128099 req-6532c621-276e-411a-9760-54baed1aeb06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082629 Oct 28 17:46:23.472309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2109/4124] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:23.486644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-486a00b6-71b8-4470-a5e9-81d16f0c46c1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:23.486835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:23.500249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-486a00b6-71b8-4470-a5e9-81d16f0c46c1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:23.500776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:23.619976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-486a00b6-71b8-4470-a5e9-81d16f0c46c1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:23.620841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:23.628577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-486a00b6-71b8-4470-a5e9-81d16f0c46c1 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1208 microversion: 2.1 time: 0.154552 Oct 28 17:46:23.629175 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2110/4125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:23 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:23.633700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:23.640699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:23.647919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:23.659809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.660317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.660749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.665610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.666314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.666899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.674816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ced073c-22aa-4203-8c05-8479df831e42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.806319 Oct 28 17:46:23.675866 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2016/4126] 10.222.0.48 () {60 vars in 1174 bytes} [Fri Oct 28 17:46:22 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:23.697969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:23.703001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:23.721046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.721802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.722733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:23.725654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:23.728354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:23.728821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:24.285382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:24.310049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8e46481-3cf4-4942-9b2d-397dc052f87e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1690 microversion: 2.1 time: 0.630879 Oct 28 17:46:24.320818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2017/4127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:23 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1690 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:24.337141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: .version_select at 0x7f751f5d90d0>, body: {"server_group": {"name": "tempest-server-group-284015311", "policies": ["affinity"]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:24.380144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:24.388219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:24.472642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:24.478915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:24.491536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b23edd51-0575-4819-b265-1149c05b4a23 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.855192 Oct 28 17:46:24.492230 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2111/4128] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:23 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:24.602754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:24.609129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:24.623854 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81118747-911c-497c-99e3-0ccd39c0be42 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.301640 Oct 28 17:46:24.636010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: .version_select at 0x7f751f7b6c10>, body: {"server_group": {"name": "tempest-server-group-284015311", "policies": ["affinity"]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:24.640798 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2018/4129] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 17:46:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:24.654113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:24.654975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:24.669868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:24.672678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:24.673345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:24.674295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:24.676412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:24.678904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:24.682360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:24.699830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:24.789218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:24.799866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:24.816112 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c9ca7f7a-7124-4f4d-8bdb-638077f1f7cb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.183954 Oct 28 17:46:24.824420 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2112/4130] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 17:46:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:24.829326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e49ccf2-58fa-4d89-83e0-301623a02fe5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:24.872505 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e49ccf2-58fa-4d89-83e0-301623a02fe5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2c2aab29-39a8-4121-a50d-182b097e9358" status: 204 len: 0 microversion: 2.1 time: 0.046456 Oct 28 17:46:24.873307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2113/4131] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:24 2022] DELETE /compute/v2.1/os-server-groups/2c2aab29-39a8-4121-a50d-182b097e9358 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:24.888403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b0d5443-77e7-4aa6-9e67-833fc092c9fb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:24.920072 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b0d5443-77e7-4aa6-9e67-833fc092c9fb tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.042119 Oct 28 17:46:24.924405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2114/4132] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:46:24 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:24.939040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7c1bd5a-5750-402d-92f7-8871b133c865 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:24.986780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:25.001750 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7c1bd5a-5750-402d-92f7-8871b133c865 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/e5e62d30-8465-4ccd-bd3d-660d2736600f" status: 204 len: 0 microversion: 2.1 time: 0.071742 Oct 28 17:46:25.004351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2115/4133] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:24 2022] DELETE /compute/v2.1/os-server-groups/e5e62d30-8465-4ccd-bd3d-660d2736600f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:25.016938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edc370e1-4d2e-41e8-a936-4c7a6547d5dd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:25.019155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:25.047286 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edc370e1-4d2e-41e8-a936-4c7a6547d5dd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037863 Oct 28 17:46:25.050981 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2116/4134] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:46:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:25.052828 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4fd0f49-fc41-471b-80d1-9528bc90d4d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1260 microversion: 2.1 time: 0.397226 Oct 28 17:46:25.068492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: .version_select at 0x7f7524137c10>, body: {"server_group": {"name": "tempest-server-group-471517626", "policies": ["affinity"]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:25.072614 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2019/4135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:24 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1260 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:25.110972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:25.117791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:25.196184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:25.203523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:25.219925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-139fab8f-f619-4614-843f-7e7bd74e5807 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.159897 Oct 28 17:46:25.221168 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2117/4136] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 17:46:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:25.233139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad7898c6-f69c-4f8d-8149-3ec5be56bd0c tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:25.271593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:25.335123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad7898c6-f69c-4f8d-8149-3ec5be56bd0c tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/c79ec1ea-bbbc-47c1-a699-f463890fff87" status: 204 len: 0 microversion: 2.1 time: 0.106321 Oct 28 17:46:25.338722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2020/4137] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:25 2022] DELETE /compute/v2.1/os-server-groups/c79ec1ea-bbbc-47c1-a699-f463890fff87 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:25.338994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:25.338994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:25.345959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2c5cc5d7-c3c9-4f4b-9236-a03bfba0bb8e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:25.380010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:25.382735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:25.383289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:25.384090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:25.384562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:25.386186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:25.447106 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2c5cc5d7-c3c9-4f4b-9236-a03bfba0bb8e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.103630 Oct 28 17:46:25.455037 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2021/4138] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:46:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:25.460740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: .version_select at 0x7f751f6594c0>, body: {"server_group": {"name": "tempest-server-group-1671636935", "policies": ["anti-affinity"]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:25.566821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:25.587884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:25.725874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:25.735842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_groups'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:25.772993 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-16858c6c-fc78-472c-836f-c67bfe7f389f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.315691 Oct 28 17:46:25.773612 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2022/4139] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 17:46:25 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:25.784304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:25.784909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:25.819999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:25.820645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:25.821023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:25.823267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:25.823761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:25.824191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:26.419691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:26.441101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17c258ea-5e87-4564-955f-0523ee21cd44 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 0.649862 Oct 28 17:46:26.442305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2023/4140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:25 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:26.447548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-758e9166-9144-41a9-88d7-2be0a9653b83 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:26.559874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-758e9166-9144-41a9-88d7-2be0a9653b83 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a034e42c-3fc2-430e-9267-9c9c1bbef6fb" status: 204 len: 0 microversion: 2.1 time: 0.116369 Oct 28 17:46:26.560783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2024/4141] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:26 2022] DELETE /compute/v2.1/os-server-groups/a034e42c-3fc2-430e-9267-9c9c1bbef6fb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:26.569068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:26.580427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:26.620989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:26.621575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:26.622030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:26.624895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:26.628913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:26.629386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:26.705880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:26.718793 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40eadb41-6edb-4c6a-a35a-0e59ef3cc4aa tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1690 microversion: 2.1 time: 1.386502 Oct 28 17:46:26.719422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2118/4142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:25 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1690 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:26.731161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8614db0-5443-4ab4-a8d8-1a14d6561e8e", "name": "network-vif-deleted", "tag": "e4f7b0ff-4bff-4574-beb3-106d0b136308"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:26.758239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:26.760094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:26.762132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:26.790602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] Creating event network-vif-deleted:e4f7b0ff-4bff-4574-beb3-106d0b136308 for instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e on n-h2-860864-13 Oct 28 17:46:26.797007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6687aabd-3cd4-4332-95c1-a83b0377acb0 req-cbe1fb07-3aeb-4d33-8245-cd17d63aff32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074752 Oct 28 17:46:26.798219 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2119/4143] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:26.805563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bc60c71-b0d7-4242-9e03-b4bb6c397d7e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:26.819808 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bc60c71-b0d7-4242-9e03-b4bb6c397d7e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018639 Oct 28 17:46:26.834852 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2120/4144] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:46:26 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:26.898435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:26.901366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:26.917035 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-367b0d34-b169-4933-94f0-7346bb2bf843 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1266 microversion: 2.1 time: 0.354105 Oct 28 17:46:26.917794 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2025/4145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:26 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:26.933763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-313840310", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f0996632-d91b-429c-9bfd-65bd4111c44d"}]}, "os:scheduler_hints": {"group": "d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:27.071301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] validate_networks() for [('f0996632-d91b-429c-9bfd-65bd4111c44d', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:46:27.479851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:27.480485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:27.501157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:27.501649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:27.502082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:27.503086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:27.503566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:27.503992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:28.455052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:28.475354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05346122-499e-4b59-8c13-815cc4cc6db9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1309 microversion: 2.1 time: 1.006061 Oct 28 17:46:28.476000 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2026/4146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:27 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1309 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:28.505139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:28.506299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:28.520692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:28.521178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:28.533461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:28.534367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:28.535981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:28.536439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:29.521259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:29.538723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9962597-7b5c-4acc-84b0-7960616b6b21 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1690 microversion: 2.1 time: 1.050486 Oct 28 17:46:29.539333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2027/4147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:28 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1690 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:29.546217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:29.546824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:29.560355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:29.562015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:29.562466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:29.563189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:29.563658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:29.564080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:29.942242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:46:29.944172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:46:29.944808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:46:29.945367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:46:29.945956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:46:29.986624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:29.987355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:29.987964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:29.988887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:29.989495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:29.990172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:30.012092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:30.018475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:30.034025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:46:30.037879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:46:30.092672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120567) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 17:46:30.138108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_group_members'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:30.153205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_group_members'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:30.225795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for project 2ecc34c781974e03bd346903804e3993. Resources: {'server_group_members'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:30.232392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Getting quotas for user 7efda51ed7ca4c3cab30a4ce54f8102b and project 2ecc34c781974e03bd346903804e3993. Resources: {'server_group_members'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:30.322030 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed736c41-e09d-456b-ab9f-15b8b24e8bf5 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.406191 Oct 28 17:46:30.335042 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2121/4148] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:46:30.348742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:30.349364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:30.369875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:30.370385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:30.378805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:30.378805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:30.380374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:30.380577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:30.714288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:30.728994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18e7782f-68e7-4db6-a942-5d50007a5017 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 1.188532 Oct 28 17:46:30.733344 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2028/4149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:29 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:30.739387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9570f752-cc0b-4929-b184-0c66580b6eb2 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:30.740726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9570f752-cc0b-4929-b184-0c66580b6eb2 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:31.061502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9570f752-cc0b-4929-b184-0c66580b6eb2 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:31.076795 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9570f752-cc0b-4929-b184-0c66580b6eb2 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1212 microversion: 2.1 time: 0.339303 Oct 28 17:46:31.079244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2029/4150] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:30 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1212 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:31.092268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:31.093968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:31.124842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.125391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.136316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.137677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.138507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.139938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.717475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:31.728314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eebac09e-556f-418b-9680-94f8bbb77efd tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1622 microversion: 2.1 time: 0.647629 Oct 28 17:46:31.728894 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2030/4151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:31 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1622 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:31.761139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:31.761760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:31.763668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:31.773870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.774882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.776240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.777969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.778794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.779520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.780037 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-52e6e100-efca-41b2-b028-d149477a784d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1491 microversion: 2.1 time: 1.440964 Oct 28 17:46:31.798016 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2122/4152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:30 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1491 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:31.804277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:31.807261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:31.815309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.816032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.816900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.817769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.818451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.822760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.912981 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3378779-168b-4903-84e1-21b63da082a4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "PUT /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1086 microversion: 2.1 time: 0.112509 Oct 28 17:46:31.913810 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2123/4153] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:46:31 2022] PUT /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1086 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:31.935300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:31.936199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:31.943030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.944143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.944752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:31.945475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:31.945932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:31.946552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.473495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:32.485532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2634218-d05e-458a-ae08-ee754493d051 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1512 microversion: 2.1 time: 0.554149 Oct 28 17:46:32.488663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2124/4154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:31 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:32.499160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:32.504326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:32.514916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:32.516496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-93ae081e-46b2-41b9-b56e-024e9f352151 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 0.761009 Oct 28 17:46:32.535351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.536354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2031/4155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:31 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:32.537068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.541436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.542258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.542748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.543941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.552179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:32.553936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:32.575074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.575840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.578437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.579795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.580530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.592763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.689407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:32.711541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e8c0430-78f4-43a6-8b30-92ee1f9ad172 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1270 microversion: 2.1 time: 0.221034 Oct 28 17:46:32.715894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2125/4156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:32 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:32.738806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb15caad-abcb-4a6d-aab2-c3a26a33e47c", "name": "network-vif-deleted", "tag": "fc34153e-3fdb-448b-90b5-399fae6648a3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:32.775950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.781965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.782751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.815780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] Creating event network-vif-deleted:fc34153e-3fdb-448b-90b5-399fae6648a3 for instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c on n-h1-860864-13 Oct 28 17:46:32.834991 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3fc0f915-36b7-41ce-9931-5057658e039b req-e4985413-947f-4635-9282-c36b4c0f6987 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115337 Oct 28 17:46:32.836197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2126/4157] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:32.844475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:32.849508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:32.873695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.874279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.875256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.876023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.876486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.898734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:32.953792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:32.970104 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4526cae1-27c5-48f5-9ad9-01a50fbe3424 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1512 microversion: 2.1 time: 0.431943 Oct 28 17:46:32.979524 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2032/4158] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:32 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:32.996010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:32.997015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:32.997671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.004714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:33.005225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:33.010948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid bb15caad-abcb-4a6d-aab2-c3a26a33e47c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:33.015416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.016158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.016360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.017123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.017545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.017933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.079600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:33.227450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:33.236641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0dc91aa0-ce13-4b9e-9b7c-d8319960c838 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 204 len: 0 microversion: 2.1 time: 0.236303 Oct 28 17:46:33.237523 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2033/4159] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:32 2022] DELETE /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:33.241445 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f0520dd-8000-4f99-b01e-cc8fcca2356b tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1335 microversion: 2.1 time: 0.402994 Oct 28 17:46:33.242499 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2127/4160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:32 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1335 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:33.249375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:33.250123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:33.261288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.261837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.262279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.269047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.269620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.270965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.544037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:33.544650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:33.556883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.562341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.562825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.563615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:33.564091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:33.571779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:33.988875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:33.998621 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-21fd3f02-cdb3-421c-970c-07ed4dca36e3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1518 microversion: 2.1 time: 0.754338 Oct 28 17:46:34.012102 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2034/4161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:33 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1518 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:34.030449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:34.059756 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43f659e5-fbed-4474-81bb-a55a297eb78d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 0.518354 Oct 28 17:46:34.076644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2128/4162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:33 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:34.088733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:34.089630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:34.096415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:34.100063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.101491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.101942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.102684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.103419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.103858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.323690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:34.341044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8581dd7-fe02-4f31-bf77-1f3e7fb29299 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1270 microversion: 2.1 time: 0.261668 Oct 28 17:46:34.342016 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2129/4163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:34 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:34.351275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:34.352062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:34.379119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.381176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.383485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.384261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.384718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.386160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.467342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.469367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.470164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.471026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid bb15caad-abcb-4a6d-aab2-c3a26a33e47c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:34.593201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4373545b-a650-477d-b6e4-5555728270df tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Action: 'create', calling method: .version_select at 0x7f751f6380d0>, body: {"keypair": {"name": "tempest-keypair-1712977641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmjU1ozwUHetTfcnhqjGCHH9dvBJaSyjBzDVHywDcvqU+LXKqLxY6eVoBRlVSd8JzMhnMTYaiWiBhUXL+7DJFDp30NsxhMS/+4CFAZO/PmItxEYfGOtd7nz3JeenLSv8g=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:34.641944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4373545b-a650-477d-b6e4-5555728270df tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for project 5354fd8b351d40639670ad813ab61d87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:34.653289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:34.661488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4373545b-a650-477d-b6e4-5555728270df tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for user 5013ed8c6ca14b4e9ad3cf4d9d883196 and project 5354fd8b351d40639670ad813ab61d87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:34.663799 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e3383f9-3836-49a6-a944-ebb9c509e854 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 200 len: 1335 microversion: 2.1 time: 0.319901 Oct 28 17:46:34.664547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2130/4164] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:34 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 1335 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:34.710179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4373545b-a650-477d-b6e4-5555728270df tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.696238 Oct 28 17:46:34.715877 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2035/4165] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:46:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:34.887534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01019c89-4971-4a51-a38e-af888c97ae29", "tag": "db41eb4e-8872-4ddf-9365-c425333dbb29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:34.898806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:34.899404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:34.899957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:34.933837 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] Creating event network-changed:db41eb4e-8872-4ddf-9365-c425333dbb29 for instance 01019c89-4971-4a51-a38e-af888c97ae29 on n-h2-860864-13 Oct 28 17:46:34.954746 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ef155d0b-7813-4845-ab02-2d2ea35f6915 req-22b8c59d-1c1f-41aa-82c4-ba10a32f8a38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077267 Oct 28 17:46:34.956828 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2131/4166] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:35.039635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:35.040864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:35.056789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.057590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.058247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:35.059532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.061131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.065792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:35.092568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:35.093279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:35.105533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.115749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.117030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:35.117813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.118287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.118722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:35.871991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:35.885635 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01b61f00-c838-46c1-9dff-11e48f6c7ce7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 0.796254 Oct 28 17:46:35.887030 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2132/4167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:35 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:35.895054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:35.896417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:35.908085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.910058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.910756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:35.912426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:35.913730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:35.914384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:36.299147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:36.334878 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a4eecf8-2a12-45ee-a6a7-f05ccd27e5da tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 200 len: 1518 microversion: 2.1 time: 1.299885 Oct 28 17:46:36.338797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2036/4168] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:35 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 1518 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:36.353139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:36.372566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: bb15caad-abcb-4a6d-aab2-c3a26a33e47c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:36.386827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:36.387804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:36.388453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:36.389356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:36.390018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:36.394895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:36.416599 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c HTTP/1.1 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'bb15caad-abcb-4a6d-aab2-c3a26a33e47c'} Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:36.430331 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. Oct 28 17:46:36.433871 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:36.444188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 404 to user: Instance bb15caad-abcb-4a6d-aab2-c3a26a33e47c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:36.445101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ffceb4b-9f92-4375-a42c-b59565730bd2 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c" status: 404 len: 111 microversion: 2.1 time: 0.104967 Oct 28 17:46:36.445896 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2037/4169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:36 2022] GET /compute/v2.1/servers/bb15caad-abcb-4a6d-aab2-c3a26a33e47c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:36.464633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-925bcb08-dba4-45e7-bf89-a50f968b3e90 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '.version_select at 0x7f751f6024c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:36.498648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:36.507440 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97da01e8-73a1-432f-a580-1d3a3bb58386 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 0.618814 Oct 28 17:46:36.508043 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2133/4170] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:35 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:36.528158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-925bcb08-dba4-45e7-bf89-a50f968b3e90 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292873078" status: 202 len: 0 microversion: 2.1 time: 0.067362 Oct 28 17:46:36.528753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2038/4171] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:46:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292873078 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:46:36.909992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:36.912150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:36.933424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:36.937618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:36.940505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:36.941521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:36.942318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:36.944583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.110811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c5e423-391d-43bf-9988-7b60672e1551", "name": "network-vif-deleted", "tag": "3b0375bc-6c12-4375-932b-bd984eecc16d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:37.125056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.125858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.126853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.150708 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] Creating event network-vif-deleted:3b0375bc-6c12-4375-932b-bd984eecc16d for instance 83c5e423-391d-43bf-9988-7b60672e1551 on n-h1-860864-13 Oct 28 17:46:37.156697 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8a853bfc-bc3a-4f54-8940-13d3b2d8e223 req-a9f6ea8c-beda-42d4-a79b-051c2ffb69ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052992 Oct 28 17:46:37.157937 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2039/4172] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:37.319706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8516e7-e998-4485-a5f9-7eebddca2803", "tag": "f9d34d5c-8954-40ad-b062-3c553b1de691"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:37.369934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.370441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.370884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.440737 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] Creating event network-changed:f9d34d5c-8954-40ad-b062-3c553b1de691 for instance da8516e7-e998-4485-a5f9-7eebddca2803 on n-h1-860864-13 Oct 28 17:46:37.452538 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-78a106ff-5ecd-4812-a400-b015ca24cc74 req-a18a44b2-77dd-416d-be18-53c9b8b8c085 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144957 Oct 28 17:46:37.460324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2040/4173] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:37.475646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:37.476354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:37.483340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.484081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.484546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.485253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.486850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.487276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.533728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 HTTP/1.1 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '83c5e423-391d-43bf-9988-7b60672e1551'} Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:37.535605 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:37.541809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:37.543330 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4e147a0-8f1b-49de-957b-637ba088043e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 404 len: 111 microversion: 2.1 time: 0.078175 Oct 28 17:46:37.544086 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2041/4174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:37 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:37.561532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:37.562601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:37.576502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.577432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.578023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:37.579855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:37.580479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:37.581053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:38.309356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:38.324264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9a446ef-efbc-4b62-ac8e-263a8a3a5ec6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 1.418492 Oct 28 17:46:38.327508 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2134/4175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:36 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:38.348419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-31786730", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:38.468834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] validate_networks() for [('8c52cda6-f3c2-4f98-8721-9efe9e8fc6ff', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:46:38.972804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:38.987342 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-456d1cf0-0c19-45cb-8494-be4d02395557 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 1.430580 Oct 28 17:46:38.992480 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2042/4176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:37 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:39.363633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:39.374803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:39.383672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:39.394609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:39.396964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:39.398327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:39.406342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:39.407217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:39.408183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:40.001328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:40.061735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:46:40.062159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:46:40.063036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:46:40.063648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:46:40.064230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:46:40.096102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:40.098538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:40.100793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:40.101803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:40.102451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:40.104340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:40.164882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:40.185723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Getting quotas for user fd95f30a1f1744daa2f29130fc8db8e2 and project d7658345c4fb468ebaf149ddccef8cc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:40.227028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:46:40.240886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:46:40.400692 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e6f49a7-8da8-4ee6-928e-b796e331c449 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069486 Oct 28 17:46:40.407976 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2135/4177] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:46:40.421682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:40.431486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:40.433164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:40.447161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:40.448004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:40.448611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:40.449762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:40.450370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:40.453886 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c41c84be-4df6-42bf-b30f-8307794101ce tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 1.104256 Oct 28 17:46:40.455048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2043/4178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:39 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:40.460119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-615e4adb-2112-4e0d-90d6-d1e3fdf244b2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:40.468026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-615e4adb-2112-4e0d-90d6-d1e3fdf244b2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:40.468200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:40.634681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-615e4adb-2112-4e0d-90d6-d1e3fdf244b2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:40.648976 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-615e4adb-2112-4e0d-90d6-d1e3fdf244b2 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1207 microversion: 2.1 time: 0.192434 Oct 28 17:46:40.677991 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2044/4179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:40 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1207 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:40.865549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:40.878905 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3f39cee3-6724-42c0-942e-f5bb8fd1ea11 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 0.463425 Oct 28 17:46:40.879683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2136/4180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:40 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:41.249395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-328960797", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "39e69887-562e-4206-b076-9169546c7e9e"}], "security_groups": [{"name": "tempest-securitygroup--2035406837"}], "key_name": "tempest-keypair-1712977641", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:41.480298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:41.480933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:41.501257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:41.501807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:41.502266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:41.504830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:41.506270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:41.507479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:41.553569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:41.591578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] validate_networks() for [('39e69887-562e-4206-b076-9169546c7e9e', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:46:42.007997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:42.019451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-500730ef-5249-4a05-be86-42caef93d2fa tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 0.544905 Oct 28 17:46:42.032133 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2137/4181] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:41 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:42.044142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:42.045118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:42.055221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:42.055985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:42.056604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:42.057747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:42.058579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:42.059158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:42.575981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:42.586382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29b485d9-7539-4154-b62c-b036effcff78 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1259 microversion: 2.1 time: 0.546990 Oct 28 17:46:42.593713 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2138/4182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:42 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1259 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:42.605742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:42.610347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:42.626709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:42.642478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:42.643192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:42.644076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:42.644666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:42.645338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:43.198826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:43.206891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-11096f89-db02-4389-b314-921173c0d858 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 0.608921 Oct 28 17:46:43.214119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2139/4183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:42 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:43.236773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01019c89-4971-4a51-a38e-af888c97ae29", "name": "network-vif-plugged", "status": "completed", "tag": "db41eb4e-8872-4ddf-9365-c425333dbb29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:43.252536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:43.257328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:43.257902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:43.287336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] Creating event network-vif-plugged:db41eb4e-8872-4ddf-9365-c425333dbb29 for instance 01019c89-4971-4a51-a38e-af888c97ae29 on n-h2-860864-13 Oct 28 17:46:43.301533 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-98ac49ae-e3c4-42f7-9e77-75286143a6d9 req-69475cdc-6016-45d7-99f3-1b0bf68b70e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085621 Oct 28 17:46:43.305675 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2140/4184] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:43.323708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:43.325741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:43.343084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:43.348181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:43.348716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:43.350194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:43.350934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:43.351691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.087928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:44.097417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7105eab0-de77-42fd-a3f2-eb2422cffe32 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 0.790189 Oct 28 17:46:44.102123 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2141/4185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:43 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:44.113747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:46:44.114258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:46:44.114625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:46:44.115673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:46:44.116295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:46:44.121300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:44.123793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:44.134196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.134702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.135134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.135881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.137245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.137927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.138354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.139446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.143908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.145829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.146568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.147663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.196533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for project 5354fd8b351d40639670ad813ab61d87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:46:44.226948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for user 5013ed8c6ca14b4e9ad3cf4d9d883196 and project 5354fd8b351d40639670ad813ab61d87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:46:44.282005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:46:44.285205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:46:44.346784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:44.368846 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f035c00-25c7-486d-9936-d8b37df5a60e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1265 microversion: 2.1 time: 0.263120 Oct 28 17:46:44.371956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2142/4186] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:44 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:44.383107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:44.387329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:44.390002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a673142-388c-469f-a54f-33e31dfe5c7c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.144714 Oct 28 17:46:44.393630 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2045/4187] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:46:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:46:44.401465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.406521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.410074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.411080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a37dbaf-4119-4b57-a69d-e5b68fcc8f04 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:44.411426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:44.412305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a37dbaf-4119-4b57-a69d-e5b68fcc8f04 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:44.414335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:44.417168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:44.538671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a37dbaf-4119-4b57-a69d-e5b68fcc8f04 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:44.550454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a37dbaf-4119-4b57-a69d-e5b68fcc8f04 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1241 microversion: 2.1 time: 0.148423 Oct 28 17:46:44.551233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2046/4188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:44 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:44.855626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:44.867255 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bf74d9c-a885-4e77-91d7-bdd474fd0b36 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 0.493965 Oct 28 17:46:44.873107 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2143/4189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:44 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:45.137307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:45.137943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:45.179523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:45.180325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:45.180782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:45.185241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:45.185744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:45.186190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:45.394426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:45.395637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:45.418975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:45.435317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:45.435915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:45.436774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:45.437468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:45.438707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.104755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:46.147089 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64a045c2-2356-401a-aba5-ead2d60b6462 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.738668 Oct 28 17:46:46.151159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2144/4190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:45 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:46.179928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:46.185667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:46.198458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:46.198952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:46.199550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.200268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:46.200894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:46.201469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.278806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:46.292508 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84c6619f-eb63-4b5d-be59-ccbfab3f5c88 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1308 microversion: 2.1 time: 1.165897 Oct 28 17:46:46.303479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2047/4191] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:45 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1308 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:46.317680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8516e7-e998-4485-a5f9-7eebddca2803", "name": "network-vif-plugged", "status": "completed", "tag": "f9d34d5c-8954-40ad-b062-3c553b1de691"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:46.329355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:46.329938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:46.330379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.359127 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] Creating event network-vif-plugged:f9d34d5c-8954-40ad-b062-3c553b1de691 for instance da8516e7-e998-4485-a5f9-7eebddca2803 on n-h1-860864-13 Oct 28 17:46:46.372931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3fa87bb5-123b-4ee2-990d-a06bb8dcc44d req-a169017c-9577-4b56-b7f5-c18426c1f4e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077768 Oct 28 17:46:46.378786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2048/4192] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:46.403141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:46.412844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:46.421260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:46.421768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:46.422214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.422937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:46.423393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:46.423834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:46.501518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:46.515463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a6aec0c-6ae1-4106-a561-bf9c48a6b784 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1293 microversion: 2.1 time: 0.362831 Oct 28 17:46:46.516271 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2145/4193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:46 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:46.965320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:46.972663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:46.978874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5bcb8614-3e1e-405b-9c11-404a37321643 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1312 microversion: 2.1 time: 0.598145 Oct 28 17:46:46.991419 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2049/4194] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:46 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:47.173419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:47.174036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:47.192661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.193877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.194321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.195038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.195516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.195940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.329498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:47.330870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:47.339772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.340526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.341111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.341963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.343161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.343781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.771077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:47.781596 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2eb25f64-aadd-444d-a6d4-e7ddb7ca2004 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 200 len: 1488 microversion: 2.1 time: 0.459080 Oct 28 17:46:47.783201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2050/4195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:47 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:47.799725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:47.800373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:47.809805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:47.810311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.810514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.810961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.811711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.819214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.819771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.826371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8df9be1-dd95-4226-9e32-74e54da4d36d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.652287 Oct 28 17:46:47.827889 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2146/4196] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:47 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:47.868525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1240332899"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:47.877465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:47.897932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.898768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.901648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:47.902821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:47.903292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:47.907969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.120772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:48.136706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66af6432-29c6-4e1b-b4c1-45506479d301 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1299 microversion: 2.1 time: 0.352288 Oct 28 17:46:48.151401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2051/4197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:47 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1299 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:48.151401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:48.151401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:48.162959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.165977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.166457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.167183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.167680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.168115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.343524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2484a29a-6ce1-4c72-adb1-ef09a56569c4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29/action" status: 202 len: 0 microversion: 2.1 time: 0.504787 Oct 28 17:46:48.344208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2147/4198] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:46:47 2022] POST /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:46:48.357188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a21e665-12cd-4589-8b65-c48ce50a3a91 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752469cee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:48.418160 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a21e665-12cd-4589-8b65-c48ce50a3a91 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.065621 Oct 28 17:46:48.418709 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2148/4199] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:48 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:48.663838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:48.678755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86ddb58d-8717-4f2f-b364-465148317d85 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1495 microversion: 2.1 time: 0.539978 Oct 28 17:46:48.695451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2052/4200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:48 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1495 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:48.710860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:48.746021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.compute.server_groups [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Querying cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) for 1 instances {{(pid=120567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 17:46:48.746861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.750153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.750458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.778928 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-318c0f78-9921-47e8-a7a4-59ddf5f3439f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4" status: 200 len: 222 microversion: 2.1 time: 0.075270 Oct 28 17:46:48.779504 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2149/4201] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:46:48 2022] GET /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4 => generated 222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:48.794337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:48.795168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:48.809138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.810576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.811342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.812348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.812951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.814427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.854204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:48.854937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:48.858453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:48.868654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.869397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.869573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:48.878934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:48.881486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:48.881966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.050973 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d757b53-5acd-4dbe-a095-6a620b5eb759 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 204 len: 0 microversion: 2.1 time: 0.262701 Oct 28 17:46:49.055602 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2053/4202] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:48 2022] DELETE /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:49.061144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5782b2cf-24c4-4700-854d-037cbf38f54a", "tag": "9ef051bb-1844-479a-b23d-4023cc65f434"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:49.072152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.072855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.073436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.086125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] Creating event network-changed:9ef051bb-1844-479a-b23d-4023cc65f434 for instance 5782b2cf-24c4-4700-854d-037cbf38f54a on n-h1-860864-13 Oct 28 17:46:49.091908 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8f125363-2483-4f91-b102-bb75efc18160 req-d8dc43e1-400c-4937-a66f-6a15b6545dd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034674 Oct 28 17:46:49.092680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2054/4203] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:49.098857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:49.100108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:49.106768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.107645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.108223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.109059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.109771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.110344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.485001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:49.493259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b86c7f2-5f83-4f05-8b54-857efeb8dd30 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1501 microversion: 2.1 time: 0.399154 Oct 28 17:46:49.494287 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2055/4204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:49 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1501 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:49.518830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:49.526572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:49.544343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.545182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.546149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.547084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.547858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.548483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.551035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:49.569591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab6e3d99-a5e7-49ff-9825-1707665a3d54 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.720507 Oct 28 17:46:49.570200 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2150/4205] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:48 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:49.593495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6fa62a0-3d3c-40ca-9f72-53556ffb3331 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524a919d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:49.656157 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6fa62a0-3d3c-40ca-9f72-53556ffb3331 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.069728 Oct 28 17:46:49.657008 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2151/4206] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:49 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:49.663704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:49.664484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:49.672125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.673632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.674536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.675507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.676176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.676830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.712370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:49.845408 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-016f1d5f-3280-45f6-9e45-71c77feaedba tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 204 len: 0 microversion: 2.1 time: 0.186188 Oct 28 17:46:49.846630 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2152/4207] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:49 2022] DELETE /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:49.859389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:49.860371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:49.861555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:49.868360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c6d253dd-acdc-4156-9e15-70c1ce193859 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.353330 Oct 28 17:46:49.869363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.870016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.870854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.871788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:49.872401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:49.872984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:49.887620 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2056/4208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:49 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:50.135795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:50.208947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=44 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:50.472979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:50.483887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4753e547-2a96-4365-af4c-87301b97c8eb tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1507 microversion: 2.1 time: 0.632903 Oct 28 17:46:50.484473 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2153/4209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:49 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:50.527144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:50.528429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:50.539419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:50.540267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:50.541000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:50.542045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:50.542627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:50.543766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:50.596212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:50.596826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:50.604551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:50.605040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:50.605902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:50.607400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:50.607400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:50.607400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:50.614334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:51.283436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:51.293032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-12747106-388a-4291-a9cf-f0f915464329 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.700634 Oct 28 17:46:51.293921 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2154/4210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:50 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:51.309085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:51.312406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b453d30e-eeff-4ac9-b944-4cbf29351bd7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524620670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:51.335277 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-94e47230-fbeb-458f-9f9a-b14675aedcfd tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1501 microversion: 2.1 time: 0.818687 Oct 28 17:46:51.338681 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2057/4211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:50 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1501 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:51.351871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:51.352501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:51.366915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:51.367324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:51.367834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:51.368545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:51.368995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:51.377336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:51.378721 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b453d30e-eeff-4ac9-b944-4cbf29351bd7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.083523 Oct 28 17:46:51.379303 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2155/4212] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:51 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:51.507047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:51.508304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:51.515886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:51.516786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:51.517449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:51.518406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:51.519078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:51.519734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:51.744636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:51.756386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8cf5103b-3404-49ce-8139-5cd7c6512f5b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.415648 Oct 28 17:46:51.763040 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2058/4213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:51 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:51.859123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:51.905972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b73c9ced-410b-4268-a19c-7ffa1de8f15e tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1507 microversion: 2.1 time: 0.397008 Oct 28 17:46:51.922386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2156/4214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:51 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:51.922386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8516e7-e998-4485-a5f9-7eebddca2803", "name": "network-vif-deleted", "tag": "f9d34d5c-8954-40ad-b062-3c553b1de691"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:51.947269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:51.947269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:51.947269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:51.973513 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] Creating event network-vif-deleted:f9d34d5c-8954-40ad-b062-3c553b1de691 for instance da8516e7-e998-4485-a5f9-7eebddca2803 on n-h1-860864-13 Oct 28 17:46:51.993531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7032745c-9671-41a9-864f-bf8bfd7dcc5d req-bc8219be-4863-408e-8cac-71701058abb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079633 Oct 28 17:46:51.994158 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2157/4215] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:52.121416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53932c26-fc07-49e1-a386-ed0e935144ef", "tag": "df1997ea-e198-48be-909f-a7f39dde1cb1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:52.149953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.150497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.150964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.181101 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] Creating event network-changed:df1997ea-e198-48be-909f-a7f39dde1cb1 for instance 53932c26-fc07-49e1-a386-ed0e935144ef on n-h2-860864-13 Oct 28 17:46:52.186358 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-22a16808-b47e-4c90-b574-5388ecdfd5f5 req-b8d3e71b-4fa2-4125-bea8-432242b1ddd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069556 Oct 28 17:46:52.186963 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2158/4216] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:46:52.219772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.220272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:52.228852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.229543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.230128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.230989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.231715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.232289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.263992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:46:52.317181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.317903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:52.331659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.332398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.333017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.333921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.336336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.336927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.430670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0357f660-88c1-40be-a8c6-3bfcf0dbe93e tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 204 len: 0 microversion: 2.32 time: 0.659844 Oct 28 17:46:52.431933 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2059/4217] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:46:51 2022] DELETE /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:46:52.442553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.445674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:52.460667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.463528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.464865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.468261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.470892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.471344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.608231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:52.637021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:52.638858 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59cde4bf-dec8-44a6-9640-3b25c4cdc52f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1459 microversion: 2.1 time: 0.205558 Oct 28 17:46:52.650834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2060/4218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:52 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1459 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:52.651122 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1848ba38-c86c-4d93-a474-3b1ac2082e5a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.334785 Oct 28 17:46:52.664110 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2159/4219] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:52 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:52.668640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a67d126-919e-4ab3-b2b2-129669335124 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524034700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.671581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.672199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:52.680174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.680668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.681673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.682494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.683167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.684034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.753255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a67d126-919e-4ab3-b2b2-129669335124 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.107603 Oct 28 17:46:52.754435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2061/4220] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:52 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:52.789249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:52.790027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:52.800474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.801255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.801911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:52.803616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:52.804307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:52.804846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.034084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.048662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.050128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.051444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-746ccfe7-1c33-4896-b5fb-031893cf1830 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2952 microversion: 2.32 time: 0.386254 Oct 28 17:46:53.059033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2160/4221] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:46:52 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2952 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:46:53.081468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:53.082381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:53.092848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.095339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.097155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.098038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.100974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.101735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.188901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.199137 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a18c772b-dc7b-496a-8066-91e559e007ba tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.414196 Oct 28 17:46:53.199757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2062/4222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:52 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:53.228637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.237850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c8c90ab-9c4d-4366-9ea2-3fbbabb5e1f0 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1465 microversion: 2.1 time: 0.177049 Oct 28 17:46:53.239152 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2161/4223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:53 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1465 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:53.668793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:53.668793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:53.673831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:53.675256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:53.687574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.690584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.691068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.691675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.692536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.693121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.694065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.694799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.695927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.697032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.697732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.699849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.773633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:53.776466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:53.776926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:53.779065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lazy-loading 'fault' on Instance uuid da8516e7-e998-4485-a5f9-7eebddca2803 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:53.866536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7efda51ed7ca4c3cab30a4ce54f8102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ecc34c781974e03bd346903804e3993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.883652 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ce8bf9d-98d0-42d8-8f93-acff3059f74b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 200 len: 1302 microversion: 2.1 time: 0.219747 Oct 28 17:46:53.884245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2063/4224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:53 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 1302 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:53.888879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ace5bf1-dde4-4be3-81bb-3d62e75c44d9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f65b280>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:53.945000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:53.952262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ace5bf1-dde4-4be3-81bb-3d62e75c44d9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.066455 Oct 28 17:46:53.952858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2ad4b0c-50b2-4485-8f63-6438c87a53b1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.282780 Oct 28 17:46:53.953040 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2064/4225] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:53 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:53.953444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2162/4226] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:53 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:54.029399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8612034c-4542-491d-b7fe-8b10221332ac", "name": "network-vif-deleted", "tag": "5215cb8e-aa0b-4220-bf05-719c80e8be35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:54.041972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.042460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.043106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.057369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] Creating event network-vif-deleted:5215cb8e-aa0b-4220-bf05-719c80e8be35 for instance 8612034c-4542-491d-b7fe-8b10221332ac on n-h2-860864-13 Oct 28 17:46:54.062808 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-59fe95a1-ba0d-49cc-ae82-cd4ad45bd515 req-ae639a24-0773-4ac2-9e30-c2478dad5b08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038104 Oct 28 17:46:54.063435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2065/4227] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:54.089657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.091543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:54.099712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.100443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.101740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.103585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.103585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.104313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.220373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:54.227712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.228890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:54.248844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.249362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.249943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.250673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.251140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.251607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.261173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:54.340445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:54.352016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:54.360813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:54.365368 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-58fff3ec-7b8e-4198-8a6b-08c529bfddca tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2952 microversion: 2.32 time: 0.279430 Oct 28 17:46:54.366589 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2163/4228] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2952 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:46:54.386640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.387692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:54.395381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.396619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.397150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.397946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.398498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.399019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.543918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:54.588424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:54.602662 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f7c69cc-f525-4028-b7fe-0e5a25eed5d8 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1465 microversion: 2.1 time: 0.232887 Oct 28 17:46:54.603921 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2164/4229] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:54.611139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01019c89-4971-4a51-a38e-af888c97ae29", "name": "network-vif-plugged", "status": "completed", "tag": "db41eb4e-8872-4ddf-9365-c425333dbb29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:54.632641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.633840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.634759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.655090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] Creating event network-vif-plugged:db41eb4e-8872-4ddf-9365-c425333dbb29 for instance 01019c89-4971-4a51-a38e-af888c97ae29 on n-h2-860864-13 Oct 28 17:46:54.680098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ad903ea1-8b65-4371-9fd4-0f5cc1c8c1e0 req-43c745e7-f85c-4c29-8446-c7ec52ea782a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074137 Oct 28 17:46:54.680802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:54.683024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2165/4230] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:54.691056 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-995382ab-1b29-4195-9c88-f76fcf31df5d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.471634 Oct 28 17:46:54.696054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2066/4231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:54.909798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.910706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:54.917737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.918223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.918687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.919395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.919851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.920273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.934128 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 HTTP/1.1 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'da8516e7-e998-4485-a5f9-7eebddca2803'} Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:54.935812 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa20ec44-0504-4718-84d5-acf91aa158f0 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 404 len: 111 microversion: 2.1 time: 0.032110 Oct 28 17:46:54.939922 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2166/4232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:46:54.949827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.968821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95589e10-4326-4f7f-b940-6f28b2646f70 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524d7b700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.969674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_groups [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Querying cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) for 1 instances {{(pid=120568) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 17:46:54.970680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:54.971344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:54.972015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:54.985383 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8663083f-8ad7-4efd-b570-867b3b5f75da tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.039499 Oct 28 17:46:54.986260 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2067/4233] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:54.991483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:54.992636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.005484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.006171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.006789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.007698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.008696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.009284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.025450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95589e10-4326-4f7f-b940-6f28b2646f70 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.060385 Oct 28 17:46:55.025965 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2167/4234] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:55.030622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.048697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.compute.server_groups [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Querying cell 344a014f-e9f4-4420-b7d8-3807d7aceda4(cell1) for 1 instances {{(pid=120567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 17:46:55.049425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.049905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.050336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.061974 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37b276eb-baed-44ac-b5c3-453c47d57f89 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4" status: 200 len: 184 microversion: 2.1 time: 0.034942 Oct 28 17:46:55.063148 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2168/4235] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:46:55 2022] GET /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4 => generated 184 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:55.077036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.078027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.087175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.088937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.089531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.091171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.091811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.092400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.109573 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 HTTP/1.1 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'da8516e7-e998-4485-a5f9-7eebddca2803'} Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:55.111149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e8685cf-273e-43bb-b79d-91eaa0ed0372 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 404 len: 111 microversion: 2.1 time: 0.040541 Oct 28 17:46:55.117519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2169/4236] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.123904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.124821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] [instance: da8516e7-e998-4485-a5f9-7eebddca2803] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.132048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:55.133807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.134501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.136192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.136192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.136901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.137613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.153790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 HTTP/1.1 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'da8516e7-e998-4485-a5f9-7eebddca2803'} Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.157204 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. Oct 28 17:46:55.160755 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.162562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance da8516e7-e998-4485-a5f9-7eebddca2803 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.163699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17ff2adf-2733-4457-84c0-c2772d2d0c45 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803" status: 404 len: 111 microversion: 2.1 time: 0.043737 Oct 28 17:46:55.164799 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2170/4237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:55 2022] GET /compute/v2.1/servers/da8516e7-e998-4485-a5f9-7eebddca2803 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.174693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.174964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1754b633-d0b5-45d3-b6e3-4f3508b5bd7f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.183728 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1754b633-d0b5-45d3-b6e3-4f3508b5bd7f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1754b633-d0b5-45d3-b6e3-4f3508b5bd7f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-server-groups/a034e42c-3fc2-430e-9267-9c9c1bbef6fb HTTP/1.1 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a034e42c-3fc2-430e-9267-9c9c1bbef6fb'} Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.185495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. Oct 28 17:46:55.189323 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.189656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be6beb6b-11ad-40ad-95a4-92a879b10356 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.198865 Oct 28 17:46:55.189656 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2068/4238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:54 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:55.191089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1754b633-d0b5-45d3-b6e3-4f3508b5bd7f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance group a034e42c-3fc2-430e-9267-9c9c1bbef6fb could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.193194 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1754b633-d0b5-45d3-b6e3-4f3508b5bd7f tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a034e42c-3fc2-430e-9267-9c9c1bbef6fb" status: 404 len: 117 microversion: 2.1 time: 0.023475 Oct 28 17:46:55.194895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2171/4239] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/os-server-groups/a034e42c-3fc2-430e-9267-9c9c1bbef6fb => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.208207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89e5981f-c624-4774-9995-28ed132da920 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.214655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-89e5981f-c624-4774-9995-28ed132da920 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89e5981f-c624-4774-9995-28ed132da920 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-server-groups/c79ec1ea-bbbc-47c1-a699-f463890fff87 HTTP/1.1 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c79ec1ea-bbbc-47c1-a699-f463890fff87'} Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.216951 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89e5981f-c624-4774-9995-28ed132da920 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance group c79ec1ea-bbbc-47c1-a699-f463890fff87 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89e5981f-c624-4774-9995-28ed132da920 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/c79ec1ea-bbbc-47c1-a699-f463890fff87" status: 404 len: 117 microversion: 2.1 time: 0.017303 Oct 28 17:46:55.224529 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2069/4240] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/os-server-groups/c79ec1ea-bbbc-47c1-a699-f463890fff87 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.228563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15e81a9b-70b5-41c4-84ff-592d0319550b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.235816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-15e81a9b-70b5-41c4-84ff-592d0319550b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15e81a9b-70b5-41c4-84ff-592d0319550b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-server-groups/e5e62d30-8465-4ccd-bd3d-660d2736600f HTTP/1.1 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e5e62d30-8465-4ccd-bd3d-660d2736600f'} Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.237345 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15e81a9b-70b5-41c4-84ff-592d0319550b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance group e5e62d30-8465-4ccd-bd3d-660d2736600f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.242017 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15e81a9b-70b5-41c4-84ff-592d0319550b tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/e5e62d30-8465-4ccd-bd3d-660d2736600f" status: 404 len: 117 microversion: 2.1 time: 0.015210 Oct 28 17:46:55.243902 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2172/4241] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/os-server-groups/e5e62d30-8465-4ccd-bd3d-660d2736600f => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.249309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9913e17f-99b8-4a7d-87d0-ffddd4fde774 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.259589 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9913e17f-99b8-4a7d-87d0-ffddd4fde774 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] HTTP exception thrown: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9913e17f-99b8-4a7d-87d0-ffddd4fde774 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Request method failure captured: Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/os-server-groups/2c2aab29-39a8-4121-a50d-182b097e9358 HTTP/1.1 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBVu8BZ8tHjA5Hj1miDaOeX0ywyWY3662vX_F4wvrQ9RJa5EKziNJ9G5OmpD_aFCngqYjmJcu294-aqUvdBnEmPC0IzbojHiwMeHXW0eUSJovQwS3zJuxYk9Q9Yd-pfhmuQ_JZoMiAylrZfqampo58atTxF1iE2q__elDwa83XW-jjw Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ecc34c781974e03bd346903804e3993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ecc34c781974e03bd346903804e3993"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ecc34c781974e03bd346903804e3993"}]}] Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2ecc34c781974e03bd346903804e3993 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerGroupTestJSON-1675307724 Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7efda51ed7ca4c3cab30a4ce54f8102b Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerGroupTestJSON-1675307724-project Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2c2aab29-39a8-4121-a50d-182b097e9358'} Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.261229 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9913e17f-99b8-4a7d-87d0-ffddd4fde774 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Returning 404 to user: Instance group 2c2aab29-39a8-4121-a50d-182b097e9358 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9913e17f-99b8-4a7d-87d0-ffddd4fde774 tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/2c2aab29-39a8-4121-a50d-182b097e9358" status: 404 len: 117 microversion: 2.1 time: 0.018009 Oct 28 17:46:55.264725 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2070/4242] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/os-server-groups/2c2aab29-39a8-4121-a50d-182b097e9358 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:55.272802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f049441e-7271-4d40-9d3e-bd2a27db975e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.333690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f049441e-7271-4d40-9d3e-bd2a27db975e tempest-ServerGroupTestJSON-1675307724 tempest-ServerGroupTestJSON-1675307724-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4" status: 204 len: 0 microversion: 2.1 time: 0.064903 Oct 28 17:46:55.334706 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2173/4243] 10.222.0.48 () {58 vars in 1266 bytes} [Fri Oct 28 17:46:55 2022] DELETE /compute/v2.1/os-server-groups/d6a3d3dd-3132-4fd3-aa23-57f6d8b4bfa4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:46:55.395513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.396666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.405489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.406801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.407525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.409102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.409718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.416568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.629320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.630254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.634667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.640770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.641265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.641702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.642422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.643034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.643548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.669575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.673462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.675794 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8bf769e-d135-4ada-b43e-f6fa72d45bf8 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2952 microversion: 2.32 time: 0.285427 Oct 28 17:46:55.676367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2071/4244] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:46:55 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2952 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:46:55.695384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.696672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.697124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.697625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid 8612034c-4542-491d-b7fe-8b10221332ac {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:55.719917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:55.721121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:55.734492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.734990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.738154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.739755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:55.740242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:55.740688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:55.759323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.768565 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b72c476-5470-4b6b-b902-bab497f44d92 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1311 microversion: 2.1 time: 0.145343 Oct 28 17:46:55.772474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2174/4245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:55 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:55.933914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:55.953042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fd27728-1355-4539-8b9c-f103edfd515b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.237566 Oct 28 17:46:55.953664 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2072/4246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:55 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:56.042858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6c0785a-bedb-4388-bcc0-fb617c432153 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524bc5160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:56.093036 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6c0785a-bedb-4388-bcc0-fb617c432153 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.055177 Oct 28 17:46:56.094135 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2175/4247] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:56 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:56.215440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:56.216161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:56.226332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.226861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.227351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.228387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.229137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.229570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.399318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:56.414195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-25eb284e-7669-4281-a982-6e7c65253ea7 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.203798 Oct 28 17:46:56.430501 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2073/4248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:56 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:56.709889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:56.711062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:56.733424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.734201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.735973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.737291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.737957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.738724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.796047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:56.796751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:56.810104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.812545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.813066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.827280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.834342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.837355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.885876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:56.886506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:56.887099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:56.887835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid 8612034c-4542-491d-b7fe-8b10221332ac {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:56.996458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.021269 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a508cde7-7a2c-4f8c-aa09-f7c47048dc04 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1311 microversion: 2.1 time: 0.229119 Oct 28 17:46:57.023642 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2074/4249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:56 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:57.041483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:57.042115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:57.049939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:57.050640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:57.051239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:57.052408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:57.053121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:57.053860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:57.143944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.157886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.159327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.160656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-988541a8-29d8-434a-898e-0653f32235ce tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2952 microversion: 2.32 time: 0.459131 Oct 28 17:46:57.162613 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2176/4250] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:46:56 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2952 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:46:57.167946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba18fc7d-2761-4766-b8ca-6aed0637aa3d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f7f8820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:57.225167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba18fc7d-2761-4766-b8ca-6aed0637aa3d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.061244 Oct 28 17:46:57.226192 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2177/4251] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:57 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:57.269208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.280400 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb90f20f-d486-49da-97c6-b4e0be58891e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.254859 Oct 28 17:46:57.281801 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2075/4252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:57 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:57.439835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:57.441441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:57.451177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:57.451825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:57.452274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:57.454271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:57.454954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:57.455910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:57.481537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5782b2cf-24c4-4700-854d-037cbf38f54a", "name": "network-vif-plugged", "status": "completed", "tag": "9ef051bb-1844-479a-b23d-4023cc65f434"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:46:57.496446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:46:57.501995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:57.502749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:57.504947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:57.546175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] Creating event network-vif-plugged:9ef051bb-1844-479a-b23d-4023cc65f434 for instance 5782b2cf-24c4-4700-854d-037cbf38f54a on n-h1-860864-13 Oct 28 17:46:57.556486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e823d698-a82f-4b4d-8478-0527c3b35d02 req-cf886538-1401-4384-ada4-49409bf7117c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079264 Oct 28 17:46:57.557378 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2076/4253] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:46:57.741310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:57.760270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-368d7e8c-95b0-4199-8e94-cf08b39122a9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 0.327019 Oct 28 17:46:57.783253 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2178/4254] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:57 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:46:58.049614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:58.050302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:58.074927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.076288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.077811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.078722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.081415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.082021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.157065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.163798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.165997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.167212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid 8612034c-4542-491d-b7fe-8b10221332ac {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:46:58.191675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:58.192820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:58.199417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.215797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.216525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.217817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.240938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.243226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.472532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:58.485367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2be08716-d70a-4216-84ad-0603214e758d tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 200 len: 1311 microversion: 2.1 time: 0.442317 Oct 28 17:46:58.486691 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2077/4255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:58 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 1311 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:58.499403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca17eefd-0b49-4b1d-9801-94ed6671d988 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75287df670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:58.596172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca17eefd-0b49-4b1d-9801-94ed6671d988 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.102419 Oct 28 17:46:58.597566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2078/4256] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:58 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:58.602597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:58.612113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:58.624007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.632910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.632910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:58.633803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:58.634432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:58.634989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.330428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:59.340095 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70419c71-75b2-41c1-9076-ef106e6e6707 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.741103 Oct 28 17:46:59.341081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2079/4257] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:58 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:59.346176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:59.346894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:59.371284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.372055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.372739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.374941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.376565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.377266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.618034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:59.658930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:59.676189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:46:59.698095 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd44cf54-1369-42b7-8840-9bbe9559b2e6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2952 microversion: 2.32 time: 1.499178 Oct 28 17:46:59.703000 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2179/4258] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:46:58 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2952 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:46:59.721063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:59.725214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 8612034c-4542-491d-b7fe-8b10221332ac] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:59.753821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.755991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.757312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.758540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.759394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.760135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.795849 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac HTTP/1.1 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8612034c-4542-491d-b7fe-8b10221332ac'} Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:59.798383 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:46:59.801955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 404 to user: Instance 8612034c-4542-491d-b7fe-8b10221332ac could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:46:59.802442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-539b1a39-6af3-407d-a97a-e26600924766 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac" status: 404 len: 111 microversion: 2.1 time: 0.097761 Oct 28 17:46:59.804299 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2180/4259] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:59 2022] GET /compute/v2.1/servers/8612034c-4542-491d-b7fe-8b10221332ac => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:46:59.813270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0326c7a-c5a0-45ef-8d8c-241014c81582 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752469c5e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:59.892387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0326c7a-c5a0-45ef-8d8c-241014c81582 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.086647 Oct 28 17:46:59.894513 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2181/4260] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:46:59 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:46:59.904830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:46:59.907724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:46:59.919609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.921055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.921806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.923589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:46:59.925579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:46:59.926406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:46:59.971708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:47:00.087110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:00.174884 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7b0d3c0-45cf-4a3c-86ae-d508087a6e41 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 204 len: 0 microversion: 2.1 time: 0.278577 Oct 28 17:47:00.176460 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2182/4261] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:46:59 2022] DELETE /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:47:00.195761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:00.199201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:00.214230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:00.214899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:00.215486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:00.216221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:00.221610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:00.222349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:01.191737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:01.248930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88616f0a-b930-41d1-8571-13c54fae500f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1307 microversion: 2.1 time: 1.905143 Oct 28 17:47:01.253306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2080/4262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:46:59 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1307 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:01.273607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:01.275958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:01.316960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:01.321701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:01.323507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:01.327768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:01.329134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:01.330896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:01.511819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:01.528343 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-763778d8-3d96-4520-8683-a4a745a5824f tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 1.346508 Oct 28 17:47:01.528950 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2183/4263] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:00 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:01.545813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:01.546503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:01.573156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:01.573656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:01.574093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:01.581955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:01.584682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:01.587584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:02.682196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:02.691812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a02e7fe4-92a4-4602-9988-dcc71141fb0d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 1.433366 Oct 28 17:47:02.708624 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2081/4264] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:01 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:02.719951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "e9c4923c-4e52-4880-812a-744639bff60d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:02.737752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:02.746573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:02.747063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:02.747575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:02.750498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:02.758732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:02.765702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3ddb4e9-3b31-43dd-8326-11f8d5e095ea tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2931 microversion: 2.32 time: 1.233702 Oct 28 17:47:02.766533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2184/4265] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:01 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2931 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:02.776098 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] Creating event network-vif-unplugged:e9c4923c-4e52-4880-812a-744639bff60d for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:02.778713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55e9e400-f706-48e1-864d-cc7b3fd44d35 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75244374c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:02.792057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a4238d19-47a7-448b-a4b9-9508f263ab91 req-e0a27877-aa67-4dbc-800c-58f59b796cc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075619 Oct 28 17:47:02.794135 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2082/4266] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:02.807287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:02.808006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:02.823211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:02.827333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:02.828000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:02.828972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:02.831112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:02.832452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:02.860232 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55e9e400-f706-48e1-864d-cc7b3fd44d35 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.092443 Oct 28 17:47:02.861158 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2185/4267] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:02 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:02.872716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:02.879253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:02.896251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:02.905468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:02.908779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:02.913513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:02.916739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:02.921274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.162874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:03.174595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d4e7f01-53b8-49bb-a419-9f24172fd2d9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1488 microversion: 2.1 time: 0.376661 Oct 28 17:47:03.175485 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2083/4268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:02 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1488 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:03.207804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-961780322"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:03.210397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:03.233957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.234459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.234904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.235676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.236132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.236560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.345152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:03.368769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-485deb4b-aaba-49dc-8da8-6e40e97a9932 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.505665 Oct 28 17:47:03.374981 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2186/4269] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:02 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:03.498593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-134de39a-ba0b-4dee-86a8-1e52b5e6c096 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "PUT /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1074 microversion: 2.1 time: 0.295206 Oct 28 17:47:03.519663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2084/4270] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:47:03 2022] PUT /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1074 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:03.524967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:03.526506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:03.540622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.542024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.542718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.546932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.547719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.548376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.722602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:03.724947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:03.736773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.743896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.747159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.750838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:03.751847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:03.755910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:03.996346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:04.006780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-441f1a15-93a0-4f2c-95f0-ae6ee0c83100 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1500 microversion: 2.1 time: 0.485669 Oct 28 17:47:04.015157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2187/4271] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:03 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:04.026250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:04.030321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:04.049614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:04.050184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:04.053149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:04.056435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:04.058743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:04.060471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:04.310142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:04.326442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd79834b-6c04-481c-a661-b8d744077bbd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.603565 Oct 28 17:47:04.327142 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2085/4272] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:03 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:04.340412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-747b9ca7-465c-4755-978a-60b5ee07e342 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fae4310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:04.447195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-747b9ca7-465c-4755-978a-60b5ee07e342 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.118573 Oct 28 17:47:04.451836 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2086/4273] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:04 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:04.463941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:04.464565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:04.496780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:04.497349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:04.497800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:04.498648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:04.499118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:04.499632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:04.550268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:04.950929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:04.978619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:04.983713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:04.987315 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-974bde46-4eea-439d-b9fb-06ec2fd582fb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2910 microversion: 2.32 time: 0.970780 Oct 28 17:47:04.991084 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2188/4274] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:04 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2910 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:05.008848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:05.012065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:05.013560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:05.032453 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfac3836-f4fa-46c6-8fe4-3af873551d79 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1500 microversion: 2.1 time: 0.579235 Oct 28 17:47:05.033916 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2087/4275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:04 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1500 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:05.036667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.037862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.038318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.040153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "8e04acb9-0d66-4306-96e6-722988ad0615"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "fcd454a0-1272-40ad-b466-feba429913b5"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "227cc944-f0ea-411e-9ecf-6429793f35a0"}, {"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "f907d2df-6958-4d4c-8e76-5f6e901369f6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:05.043627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.044151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.044603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.051875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.052684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.053360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.081116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Creating event network-vif-unplugged:8e04acb9-0d66-4306-96e6-722988ad0615 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:05.081928 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Creating event network-vif-unplugged:fcd454a0-1272-40ad-b466-feba429913b5 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:05.082781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Creating event network-vif-unplugged:227cc944-f0ea-411e-9ecf-6429793f35a0 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:05.084358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] Creating event network-vif-unplugged:f907d2df-6958-4d4c-8e76-5f6e901369f6 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:05.093813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c3375c03-4e93-4f5b-85a2-2b56e350e659 req-4d1dd1f5-c24a-48e1-8c9d-af5139a15909 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.058222 Oct 28 17:47:05.095109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2088/4276] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:05.101366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:05.118469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.121705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.122437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.182527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:47:05.271629 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66367ba4-7bea-4e6d-835a-d4aab981f5cf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "POST /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a/action" status: 202 len: 0 microversion: 2.1 time: 0.173612 Oct 28 17:47:05.276600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2089/4277] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:47:05 2022] POST /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:47:05.300282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:05.305690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:05.321993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.322771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.325866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:05.332528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.333612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.334781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.335434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.339642 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9964d224-abe9-433f-babc-fa07c3897b86 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.346182 Oct 28 17:47:05.340506 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2189/4278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:04 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:05.366338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:05.368836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:05.391349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.394708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.395295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.399219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:05.400046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:05.401323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:05.799957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:05.812611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:05.835794 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f53c6c2-4b86-4603-95cf-6e4dc30f2bcc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.485126 Oct 28 17:47:05.844532 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2190/4279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:05 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:05.844986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ecaa619a-292a-4612-a405-776846211425 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.561229 Oct 28 17:47:05.845944 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2090/4280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:05 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:05.869380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a69d2dc8-6f54-40cb-aade-abc1458136b5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524b89040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:05.934553 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a69d2dc8-6f54-40cb-aade-abc1458136b5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.085692 Oct 28 17:47:05.937396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2191/4281] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:05 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:06.018857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:06.019544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:06.036821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.038283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.040740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.042962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.043548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.061903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.370841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:06.373846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:06.402565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.406038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.412348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.414079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.415798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:06.416117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.417054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.431637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:06.436623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:06.439025 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d217f8a-58c8-4cff-a9be-b831748805ef tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2910 microversion: 2.32 time: 0.424726 Oct 28 17:47:06.440770 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2091/4282] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:06 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2910 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:06.726982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:06.752931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6289c98b-2b1d-4ed8-8b3d-3114da18ae15 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1522 microversion: 2.1 time: 0.387680 Oct 28 17:47:06.753748 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2192/4283] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:06 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:06.781772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-deleted", "tag": "fcd454a0-1272-40ad-b466-feba429913b5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:06.794294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.797105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.797920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.825019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] Creating event network-vif-deleted:fcd454a0-1272-40ad-b466-feba429913b5 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:06.832846 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6b209284-f412-4800-be8d-1cd58c3c8b0c req-6e545eee-58f1-4c7c-b86a-f580b9a1f8bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056727 Oct 28 17:47:06.835635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2092/4284] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:06.871141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:06.872199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:06.893008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.894341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.894968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.898929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.899512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:06.899933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.901659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.903269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:06.931325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.939942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.946735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:06.948355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:06.952150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:06.954244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:07.450145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:07.461813 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff044102-8780-4ccc-a0cc-6742ac0fed89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.598654 Oct 28 17:47:07.466313 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2193/4285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:06 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:07.479545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f83f020-96b7-4ae6-b0ae-9f2fbbd51125 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752420ec10>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:07.610394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f83f020-96b7-4ae6-b0ae-9f2fbbd51125 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.140299 Oct 28 17:47:07.629656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2194/4286] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:07 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:07.650949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "631384cb-f1f9-45fb-a90b-2db7fc6373cd"}, {"server_uuid": "53932c26-fc07-49e1-a386-ed0e935144ef", "name": "network-vif-plugged", "status": "completed", "tag": "df1997ea-e198-48be-909f-a7f39dde1cb1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:07.658449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:07.675149 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c20a6ad-6c41-43a9-9489-663c82396c0a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.791094 Oct 28 17:47:07.677540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2093/4287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:06 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:07.714827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:07.715473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:07.734076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:07.734575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:07.735006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:07.757895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:07.759812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:07.760477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:07.765707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:07.767981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:07.768614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:07.789272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Creating event network-vif-unplugged:631384cb-f1f9-45fb-a90b-2db7fc6373cd for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:07.790124 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] Creating event network-vif-plugged:df1997ea-e198-48be-909f-a7f39dde1cb1 for instance 53932c26-fc07-49e1-a386-ed0e935144ef on n-h2-860864-13 Oct 28 17:47:07.827140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-dce94229-21a0-434a-9e33-d3a85ebd7139 req-dfb7905f-d69b-43c1-9550-8598ab88c80e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.195011 Oct 28 17:47:07.832194 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2195/4288] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:07.851695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:07.855292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:07.878857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:07.883914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:07.888387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:07.890465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:07.891186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:07.893449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.050418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.054462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.057648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.061827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lazy-loading 'fault' on Instance uuid 63353499-8d0b-4b38-98d1-0a8a047ac115 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:47:08.200556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:08.220824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:08.236886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:08.238699 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4e088bd-287c-42ed-a2c6-f60d89dc8c19 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2750 microversion: 2.32 time: 0.539567 Oct 28 17:47:08.248456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2094/4289] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:07 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2750 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:08.291906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498c3bcb751a435cac9703a0ff8a6361', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c8393105434854a4e3f16340409957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:08.300719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88b6b9a2-434b-4f42-a8a8-930125b01e8a tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 200 len: 1311 microversion: 2.1 time: 0.465800 Oct 28 17:47:08.308196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2196/4290] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:07 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 1311 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:08.494313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:08.495152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:08.510524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.512658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.513643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.515664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.516942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.518141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.653318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-727800ef-e268-4384-b50b-341b99aac4dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524b89670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:08.741157 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-727800ef-e268-4384-b50b-341b99aac4dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.092438 Oct 28 17:47:08.743592 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2197/4291] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:08 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:08.758925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:08.759609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:08.781409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.781915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.782374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.783087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.783581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.784008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.857056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:08.871408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9dade0d4-07e8-4013-8ba6-a2a718834e7b tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.382218 Oct 28 17:47:08.880731 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2095/4292] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:08 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:08.917439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63353499-8d0b-4b38-98d1-0a8a047ac115", "name": "network-vif-deleted", "tag": "b21b1fa8-d2ee-43b5-93ba-26690d768c32"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:08.941031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:08.945666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:08.948220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:08.975687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] Creating event network-vif-deleted:b21b1fa8-d2ee-43b5-93ba-26690d768c32 for instance 63353499-8d0b-4b38-98d1-0a8a047ac115 on n-h1-860864-13 Oct 28 17:47:08.982183 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8b69eff6-ccaa-4c90-a625-76fbe12d20df req-ebbb72c3-1aa7-4f96-a5d0-5ec39c319d3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073618 Oct 28 17:47:08.983202 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2096/4293] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:09.041528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:09.055247 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-defa5509-f951-440e-9c62-a03862366da5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.309048 Oct 28 17:47:09.056794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2198/4294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:08 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:09.283148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:09.284170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:09.296487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.298065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.298771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:09.299887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.300500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.301074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:09.340878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:09.341528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] [instance: 63353499-8d0b-4b38-98d1-0a8a047ac115] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:09.349126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.350217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.351050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:09.351952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.352473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.352980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:09.376014 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] HTTP exception thrown: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Request method failure captured: Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 HTTP/1.1 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQtdtZV6tKJwMlu3VBNtBIqas272YKW8w3AsSvvKRaxC0D_pFod7MDyx0vkSyce-aKWeqcifwOnfMaC3c_ESfiXfybkr12meWsuhv_aTmEuypfV7eUVqU2ArPqPvbeIu1gIfVCHIzpKrQkcjB906E5WPuz1h82Fgg5WetkAMHYNrNA Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2c8393105434854a4e3f16340409957"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2c8393105434854a4e3f16340409957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2c8393105434854a4e3f16340409957"}]}] Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: e2c8393105434854a4e3f16340409957 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-197517249 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 498c3bcb751a435cac9703a0ff8a6361 Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-197517249-project Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '63353499-8d0b-4b38-98d1-0a8a047ac115'} Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:09.377547 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] Returning 404 to user: Instance 63353499-8d0b-4b38-98d1-0a8a047ac115 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a18ed56-e0c5-460e-a0b1-c101a568a768 tempest-ServerRescueNegativeTestJSON-197517249 tempest-ServerRescueNegativeTestJSON-197517249-project] 10.222.0.48 "GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115" status: 404 len: 111 microversion: 2.1 time: 0.044350 Oct 28 17:47:09.383605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2199/4295] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:09 2022] GET /compute/v2.1/servers/63353499-8d0b-4b38-98d1-0a8a047ac115 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:09.763088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fdfc892-ea0d-41e8-9316-517a6a8f3db0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752478d0d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:09.783713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:09.806210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:09.813815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:09.818815 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce763851-ec25-47be-ae11-5b62b6cd2492 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2750 microversion: 2.32 time: 0.538817 Oct 28 17:47:09.820597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2097/4296] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:09 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2750 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:09.845551 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fdfc892-ea0d-41e8-9316-517a6a8f3db0 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.090118 Oct 28 17:47:09.847271 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2200/4297] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:09 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:09.913035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:09.913647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:09.921077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.921868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.922565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:09.923492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:09.924101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:09.924966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:10.084720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:10.085739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:10.108118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:10.109515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:10.110240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:10.111170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:10.111934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:10.112797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:10.479236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:10.506495 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a844039d-38b9-445a-9c2e-4b47c1be46fd tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1367 microversion: 2.1 time: 0.600084 Oct 28 17:47:10.507784 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2098/4298] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:09 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:10.541355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:10.554983 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4dccf772-7b24-4e33-990d-08add2881aa9 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.478415 Oct 28 17:47:10.556385 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2201/4299] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:10 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:10.856167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:10.860671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:10.862028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-195323d2-fc1b-49a8-8393-a0ddcf306288 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75243b94c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:10.873080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:10.874256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:10.874884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:10.896075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:10.898175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:10.898979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:10.991634 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-195323d2-fc1b-49a8-8393-a0ddcf306288 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.133391 Oct 28 17:47:10.994226 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2202/4300] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:10 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:11.066641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-deleted", "tag": "8e04acb9-0d66-4306-96e6-722988ad0615"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:11.089746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:11.090518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:11.091178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:11.115821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] Creating event network-vif-deleted:8e04acb9-0d66-4306-96e6-722988ad0615 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:11.121962 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a49ba6a1-4431-45a0-9c01-eb1093a5e5e5 req-b54da445-f4ac-4c38-a3a5-c30a484742fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059000 Oct 28 17:47:11.124011 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2203/4301] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:47:11.534779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:11.535775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:11.548678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:11.557562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:11.558332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:11.558938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:11.559422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:11.559868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:11.644366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:11.661534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:11.662998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:11.669904 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5ee1d63c-0e10-46d1-9c6b-48782cb891eb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2658 microversion: 2.32 time: 0.821648 Oct 28 17:47:11.675800 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2099/4302] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:10 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2658 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:11.688219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:11.689135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:11.715869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:11.718047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:11.721979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:11.725715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:11.729128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:11.731253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:12.097570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:12.110339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-356bc477-0d42-4390-93e3-3d8dcf0cf7d1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.432760 Oct 28 17:47:12.126336 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2100/4303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:11 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:12.131988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65616f7c-bbfa-4172-a483-6e0807053043 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75286dd8b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:12.173695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:12.182196 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a9851252-1406-4f6e-9ee7-a578876af28a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1556 microversion: 2.1 time: 0.651774 Oct 28 17:47:12.191832 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2204/4304] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:11 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1556 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:12.206508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:12.207248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:12.214913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:12.215648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:12.216242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:12.217123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:12.217733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:12.218302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:12.238204 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65616f7c-bbfa-4172-a483-6e0807053043 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.120649 Oct 28 17:47:12.238813 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2101/4305] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:12 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:12.391354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fd970d2-7c47-4b6b-ba67-039cdd7576a0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188208 Oct 28 17:47:12.399806 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2205/4306] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:47:12 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:12.709769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:12.711723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:12.720477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:12.722779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:12.723616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:12.724836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:12.725755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:12.726575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:13.087904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:13.106495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:13.108376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:13.109601 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53fedec7-89d9-4a30-9419-7017dd44f636 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2544 microversion: 2.32 time: 0.406342 Oct 28 17:47:13.110250 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2102/4307] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:12 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2544 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:13.154510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:13.155479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:13.165205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:13.166386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:13.167477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:13.170356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:13.171391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:13.172013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:13.254057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-362bad99-719f-472f-9234-dd973e348e43 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752873bf70>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:13.319975 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-362bad99-719f-472f-9234-dd973e348e43 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.069545 Oct 28 17:47:13.328394 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2103/4308] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:13 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:13.691798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-deleted", "tag": "227cc944-f0ea-411e-9ecf-6429793f35a0"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:13.711785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:13.718229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:13.718880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:13.735394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] Creating event network-vif-deleted:227cc944-f0ea-411e-9ecf-6429793f35a0 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:13.763885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-37245cae-6ce1-40db-87d0-c2b1532830fc req-0d9b3747-8b4a-4757-9171-8fa821217696 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075828 Oct 28 17:47:13.764757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2104/4309] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:47:13.794631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:13.803298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:13.815205 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48c12465-e4a8-4780-a275-e1d244c4ae24 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 0.676134 Oct 28 17:47:13.817975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2206/4310] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:13 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:14.146319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:14.147043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:14.159993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:14.160519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:14.161687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:14.162573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:14.167012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:14.168407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:14.340657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ea561e5-ae1a-47a1-bc46-8f78f1fe9650 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752442be50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:14.435215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ea561e5-ae1a-47a1-bc46-8f78f1fe9650 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.101087 Oct 28 17:47:14.437087 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2207/4311] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:14 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:14.846464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:14.847142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:14.883134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:14.888729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:14.889197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:14.895978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:14.901285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:14.901886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:15.243681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:15.266147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:15.268267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:15.270753 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c859a907-54f5-492f-8abe-9daa8402b9de tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2258 microversion: 2.32 time: 1.128897 Oct 28 17:47:15.272148 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2105/4312] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:14 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2258 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:15.452966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c20ce53a-2ba2-4d7c-a09b-4d9b44e6d855 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f5f33a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:15.541667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c20ce53a-2ba2-4d7c-a09b-4d9b44e6d855 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.093306 Oct 28 17:47:15.542249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2106/4313] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:15 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:15.963873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:15.977685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b385329c-4af9-4e2b-8a09-7d8da903cecb tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 1.139377 Oct 28 17:47:15.991912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2208/4314] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:14 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:16.222890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-deleted", "tag": "f907d2df-6958-4d4c-8e76-5f6e901369f6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:16.251542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53932c26-fc07-49e1-a386-ed0e935144ef", "tag": "df1997ea-e198-48be-909f-a7f39dde1cb1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:16.259892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:16.262924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:16.264592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:16.274320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:16.287841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:16.288643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:16.299336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] Creating event network-vif-deleted:f907d2df-6958-4d4c-8e76-5f6e901369f6 for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:16.311258 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e992f9b6-966f-4bf4-8322-b61c91c5a21d req-6fd0d2cb-14a3-49bd-982d-1a9620c7c9a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091968 Oct 28 17:47:16.312519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2107/4315] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:16.325259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] Creating event network-changed:df1997ea-e198-48be-909f-a7f39dde1cb1 for instance 53932c26-fc07-49e1-a386-ed0e935144ef on n-h2-860864-13 Oct 28 17:47:16.349488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c145b520-1158-4865-8903-13a687683c8a req-d95853b0-7129-4b91-8d24-15092c41e966 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102498 Oct 28 17:47:16.356705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:16.357698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:16.367046 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2209/4316] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:16.381901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:16.385177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:16.389162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:16.390094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:16.390720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:16.391304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:16.558195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f45c3dce-1423-454a-bc62-0ab5259cc5fe tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524b89e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:16.574927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:16.589896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:16.595755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:16.597023 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-27feee59-5aee-4c78-b90c-8cab89ada0cd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 2031 microversion: 2.32 time: 0.282786 Oct 28 17:47:16.600802 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2108/4317] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:16 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 2031 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:16.667448 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f45c3dce-1423-454a-bc62-0ab5259cc5fe tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.113275 Oct 28 17:47:16.683740 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2210/4318] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:16 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:17.006650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:17.007285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:17.020483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:17.021037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:17.023942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:17.028634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:17.038436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:17.039265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:17.073724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:17.628250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:17.628983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:17.647452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:17.647958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:17.648390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:17.649106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:17.663908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:17.667218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:18.000472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:18.015738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:18.017779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:18.023313 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c0ebc49-4ebb-4bfb-81b8-288f031574da tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.396934 Oct 28 17:47:18.025197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2211/4319] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:17 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:18.044496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e0a34491-80ea-4e00-97b5-e6c5eebe25f7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752448f310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:18.175864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e0a34491-80ea-4e00-97b5-e6c5eebe25f7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.148382 Oct 28 17:47:18.177301 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2212/4320] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:18 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:18.366340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c4ff7e-552f-40df-9cbd-e349ffd5cdbd", "name": "network-vif-deleted", "tag": "631384cb-f1f9-45fb-a90b-2db7fc6373cd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:18.401495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:18.403120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:18.403747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:18.435187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] Creating event network-vif-deleted:631384cb-f1f9-45fb-a90b-2db7fc6373cd for instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd on n-h2-860864-13 Oct 28 17:47:18.446979 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-685800f2-6218-4079-b516-554ad63805ce req-d5e79cec-488e-4d69-abc7-5320b274f716 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089068 Oct 28 17:47:18.452839 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2213/4321] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:19.054853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:19.055605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:19.071359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:19.071978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:19.072483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:19.073263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:19.076738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:19.077273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:19.700896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:19.717948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:19.736468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:19.737710 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5380063-2154-4a3b-a042-546c0c54f1fe tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.687858 Oct 28 17:47:19.738275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2214/4322] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:19 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:47:19.753368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-061ef73f-0bdc-4e01-9ebe-e973478f0c89 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752448f280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:19.815733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:19.833489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92997ca4-c378-4ffa-a3f0-9f03ce41ac42 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1510 microversion: 2.1 time: 2.829422 Oct 28 17:47:19.834521 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2109/4323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:17 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1510 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:19.886085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-061ef73f-0bdc-4e01-9ebe-e973478f0c89 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.143779 Oct 28 17:47:19.886681 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2215/4324] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:19 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:20.772064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:20.773405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:20.798961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:20.799783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:20.803618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:20.806851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:20.808580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:20.810088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:20.865403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:20.866606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:20.881144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:20.881878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:20.882720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:20.883910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:20.884517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:20.885105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:21.105733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:21.118997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:21.121089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:21.122553 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64fae990-b058-402d-8b3b-9b04191a90cf tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.357973 Oct 28 17:47:21.141777 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2110/4325] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:20 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:21.157001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc3d3888-29f9-4fb0-b8a7-28fb845d9ee2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752877a040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:21.214812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bc3d3888-29f9-4fb0-b8a7-28fb845d9ee2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.070426 Oct 28 17:47:21.215596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2111/4326] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:21 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:21.453435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:21.470556 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43b2fd98-cb11-4538-aace-03f917b125f4 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1487 microversion: 2.1 time: 0.612601 Oct 28 17:47:21.471538 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2216/4327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:20 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1487 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:21.498336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1220521342"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:21.501258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:21.509295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:21.510011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:21.510592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:21.511478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:21.512100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:21.512666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:21.631344 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1135c356-3660-495b-803d-d39eb7ef2d25 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "PUT /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1061 microversion: 2.1 time: 0.136845 Oct 28 17:47:21.633109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2112/4328] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:47:21 2022] PUT /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1061 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:21.657048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:21.657661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:21.680190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:21.680715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:21.681166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:21.681914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:21.682369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:21.682793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:22.157527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:22.159042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:22.181809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:22.183331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:22.184356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:22.185853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:22.187423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:22.188833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:22.487138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:22.506302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:22.508445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:22.513285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-046a46dd-249f-4322-8563-eab705893685 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.358239 Oct 28 17:47:22.515674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2113/4329] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:22 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:47:22.525063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:22.533969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53f09207-8d83-46a4-88da-eca7fd29e60a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa50d30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:22.540023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bee157a-2359-4e1e-8464-f8bacb5c6a7f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1488 microversion: 2.1 time: 0.886828 Oct 28 17:47:22.540616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2217/4330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:21 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1488 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:22.576223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:22.576852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:22.594527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:22.595412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:22.596341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:22.598812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:22.599517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:22.600564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:22.616371 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53f09207-8d83-46a4-88da-eca7fd29e60a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.099165 Oct 28 17:47:22.617541 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2114/4331] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:22 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:23.237000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:23.266216 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72d64746-acb3-4de3-add2-a330d8223cc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1488 microversion: 2.1 time: 0.701016 Oct 28 17:47:23.298294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:23.298947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:23.304624 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2218/4332] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:22 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1488 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:23.316277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.317392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.318187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.319208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.320137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.320795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.378842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:47:23.546132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:23.547525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:23.563178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.566319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.569792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.572272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.575414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.577282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.600466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-11f2b9da-c3a4-4d7e-b8b9-f16d61bc9213 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 204 len: 0 microversion: 2.1 time: 0.307756 Oct 28 17:47:23.605640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2115/4333] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:23 2022] DELETE /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:47:23.619651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:23.620355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:23.636594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.637093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.637527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.641871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:23.642462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:23.642810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:23.884299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:23.903656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:23.912578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:23.913823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b7b4747-2a38-4a86-885f-75012bee7d5b tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.372208 Oct 28 17:47:23.923400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2219/4334] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:23 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:47:23.936040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c36ba92-266f-4c29-8e56-f16134e21173 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524a91310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:24.049909 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c36ba92-266f-4c29-8e56-f16134e21173 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.133382 Oct 28 17:47:24.059233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2220/4335] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:23 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:24.210720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:24.232549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b1ed0ea-fd5f-4b68-a461-c4b2f692db0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1494 microversion: 2.1 time: 0.618799 Oct 28 17:47:24.247454 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2116/4336] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:23 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1494 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:24.946478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:24.948039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:24.967129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:24.974360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:24.975584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:24.979244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:24.983804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:24.985058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:25.071255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28f4550e-4ec2-4043-8bb5-a9d297185242 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524cf70d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:25.165445 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28f4550e-4ec2-4043-8bb5-a9d297185242 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1412 microversion: 2.1 time: 0.097436 Oct 28 17:47:25.168756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2117/4337] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:25 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:25.265247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:25.265853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:25.275517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:25.276029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:25.276445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:25.279428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:25.279900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:25.287934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:25.409212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:25.431717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:25.433083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:25.434330 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e32e0371-94be-47aa-8ad4-ad32eb6afbdb tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.494579 Oct 28 17:47:25.434916 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2221/4338] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:24 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:25.704420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:25.737245 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-471dff1a-a57d-4072-b839-b1bea4fe419b tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1494 microversion: 2.1 time: 0.474652 Oct 28 17:47:25.753863 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2118/4339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:25 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1494 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:26.182376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41305fbc-702e-418b-9987-d76a50cdea84 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524ab9280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:26.249179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41305fbc-702e-418b-9987-d76a50cdea84 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1421 microversion: 2.1 time: 0.070651 Oct 28 17:47:26.249795 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2222/4340] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:26 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:26.267640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a4977bb-cdbc-4f40-8e85-873cd798a0b8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524cf70d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:26.467784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:26.469333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:26.494614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:26.498822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:26.501487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:26.502481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:26.505835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:26.506603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:26.509168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:26.725731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:26.747245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:26.752397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:26.756923 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c823f338-2abc-4294-91b3-1b278e4d8c0c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.294616 Oct 28 17:47:26.757663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2223/4341] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:26 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:27.008897 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a4977bb-cdbc-4f40-8e85-873cd798a0b8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 200 len: 1421 microversion: 2.1 time: 0.745543 Oct 28 17:47:27.011202 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2119/4342] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:47:26 2022] GET /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 1421 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:27.023186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:27.026105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:27.039254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:27.039758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1692957242", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "b87120fe-8377-4fca-80b0-f7ba2afb3a04"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:27.040357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:27.041166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:27.042122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:27.044295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:27.044945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:27.143436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] validate_networks() for [('b87120fe-8377-4fca-80b0-f7ba2afb3a04', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:47:27.492160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:27.500698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1ff3436-9f15-42eb-9143-63528407c1f8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 200 len: 1452 microversion: 2.1 time: 0.488107 Oct 28 17:47:27.505500 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2120/4343] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:27 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 1452 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:27.518145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-755407012", "imageRef": "7555cce7-e641-476e-b490-2c0e84390f39", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:27.651618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:47:28.213659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:28.214707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:28.215200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:28.215640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:28.216055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:28.230243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.230627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.231070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.231893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.232353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.232779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.328026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Getting quotas for project 7b112212257f4f9a9179c168a117ae83. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:47:28.348344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Getting quotas for user d30ee0c7da914379acf0785da329371d and project 7b112212257f4f9a9179c168a117ae83. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:47:28.405543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:47:28.412538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:47:28.569084 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7e06994-0ca0-449d-8dc6-62a86085836c tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808979 Oct 28 17:47:28.579764 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2224/4344] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:47:28.586110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5782b2cf-24c4-4700-854d-037cbf38f54a", "name": "network-vif-deleted", "tag": "9ef051bb-1844-479a-b23d-4023cc65f434"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:28.609544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.614913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.615585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.659493 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] Creating event network-vif-deleted:9ef051bb-1844-479a-b23d-4023cc65f434 for instance 5782b2cf-24c4-4700-854d-037cbf38f54a on n-h1-860864-13 Oct 28 17:47:28.671577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7c6b3a5f-2ba0-417e-9013-60dbe13c8425 req-cb3e9c34-608e-400b-8456-ef243bd6ea20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089676 Oct 28 17:47:28.674974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2225/4345] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:28.693279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:28.696215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:28.714356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.716865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.717504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.724072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.724824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.725544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.889192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:28.921183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:28.931698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:28.938348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c79ce9c6-58f2-4b10-ab7a-8a3c8af71ecd tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.259091 Oct 28 17:47:28.943071 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2226/4346] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:28 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:28.968485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:28.980050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:28.980944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:28.981124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:28.981730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:28.982009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:28.982421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:28.986918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:28.991887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.993318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.994430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:28.995395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:28.996006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:28.996771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.002959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.003474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.003904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.005331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.006035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.006468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.019076 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a HTTP/1.1 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5782b2cf-24c4-4700-854d-037cbf38f54a'} Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.022927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.027337 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.029218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.030802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6bc25d47-2632-4449-875c-fe245283fcc1 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 404 len: 111 microversion: 2.1 time: 0.084294 Oct 28 17:47:29.032769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2227/4347] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:28 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.038646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34127266-def9-468b-a06d-83f50f5233a6 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.039585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34127266-def9-468b-a06d-83f50f5233a6 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.055504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:47:29.076990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:47:29.091591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:47:29.094048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7555cce7-e641-476e-b490-2c0e84390f39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:47:29.167169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f8f776f-7907-46be-9385-10ddab2e0b41 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659688 Oct 28 17:47:29.168010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2121/4348] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:47:29.174291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34127266-def9-468b-a06d-83f50f5233a6 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:29.182845 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34127266-def9-468b-a06d-83f50f5233a6 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1214 microversion: 2.1 time: 0.148750 Oct 28 17:47:29.183565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.184298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.184574 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2228/4349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:29.189790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-04fa66f9-e5bf-404d-a543-38559783619f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.190401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-04fa66f9-e5bf-404d-a543-38559783619f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.194151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.194867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.195796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.196654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.197256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.197832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.232339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a HTTP/1.1 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5782b2cf-24c4-4700-854d-037cbf38f54a'} Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.234055 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.237873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-914d02ac-c3b7-4c38-b82f-9f4f8278ea4d tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 404 len: 111 microversion: 2.1 time: 0.058326 Oct 28 17:47:29.241783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2122/4350] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:29 2022] DELETE /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.254609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.257095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 5782b2cf-24c4-4700-854d-037cbf38f54a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.273513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.274013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.277100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.277928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.278341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.290709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.350813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a HTTP/1.1 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5782b2cf-24c4-4700-854d-037cbf38f54a'} Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.354923 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. Oct 28 17:47:29.359209 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.366065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 5782b2cf-24c4-4700-854d-037cbf38f54a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.368034 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c7bd115-47d5-497e-913b-2cb669192404 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a" status: 404 len: 111 microversion: 2.1 time: 0.124946 Oct 28 17:47:29.372983 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2123/4351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/5782b2cf-24c4-4700-854d-037cbf38f54a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.380051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.380296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.393474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.394314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.399051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.400224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.402441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.405400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.435753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04fa66f9-e5bf-404d-a543-38559783619f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:29.443350 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 HTTP/1.1 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '83c5e423-391d-43bf-9988-7b60672e1551'} Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.445518 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.449606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.450328 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-04fa66f9-e5bf-404d-a543-38559783619f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1207 microversion: 2.1 time: 0.263267 Oct 28 17:47:29.451966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.455923 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-596a5e5d-2e5c-4764-99a5-6621f5e7957e tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 404 len: 111 microversion: 2.1 time: 0.081675 Oct 28 17:47:29.464096 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2124/4352] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:29 2022] DELETE /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.474817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2229/4353] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1207 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:29.484414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.485054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83c5e423-391d-43bf-9988-7b60672e1551] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.496440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.511185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.511743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.512499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.513136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.513720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.549598 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 HTTP/1.1 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '83c5e423-391d-43bf-9988-7b60672e1551'} Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.552348 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. Oct 28 17:47:29.556688 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.559458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83c5e423-391d-43bf-9988-7b60672e1551 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.560962 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e85b9e8-fc00-4961-a97a-aa1e36095650 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551" status: 404 len: 111 microversion: 2.1 time: 0.095693 Oct 28 17:47:29.565519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2125/4354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/83c5e423-391d-43bf-9988-7b60672e1551 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.571322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.571861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.584310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.589791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.592715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.595677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.596069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.596539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.626971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 HTTP/1.1 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0'} Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.629053 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.633350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.635149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.636319 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f6ac439a-9094-4363-b7b4-bb994b6dbe47 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 404 len: 111 microversion: 2.1 time: 0.069658 Oct 28 17:47:29.640873 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2230/4355] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:29 2022] DELETE /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:47:29.653117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.654119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.674038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.674697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.675611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.677983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.679504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.680079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.714233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 HTTP/1.1 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0'} Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.716024 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.720620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29644138-db21-4e03-9889-2a0eac82d05f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0" status: 404 len: 111 microversion: 2.1 time: 0.077595 Oct 28 17:47:29.725180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2126/4356] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/fcbeadc6-e5f9-417a-8b07-8cc87ff2f4c0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.731206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.731320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.739606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.740206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.741416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.742816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.743393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.744610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.761646 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 HTTP/1.1 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '83eb375c-68c9-4b51-99e1-22a2f47257b6'} Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.763864 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.768223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1fd600b0-a8d6-4e17-93eb-6a89eb9cd2b3 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 404 len: 111 microversion: 2.1 time: 0.040238 Oct 28 17:47:29.775308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2231/4357] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:29 2022] DELETE /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.781221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.781832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 83eb375c-68c9-4b51-99e1-22a2f47257b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.803094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.813284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.813761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.814567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.834207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.834824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.916062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 HTTP/1.1 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '83eb375c-68c9-4b51-99e1-22a2f47257b6'} Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:29.917791 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. Oct 28 17:47:29.921625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:29.927937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 83eb375c-68c9-4b51-99e1-22a2f47257b6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:29.929194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-02ff717f-368a-4524-8a20-fd3c7618424a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6" status: 404 len: 111 microversion: 2.1 time: 0.158982 Oct 28 17:47:29.932382 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2127/4358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:29 2022] GET /compute/v2.1/servers/83eb375c-68c9-4b51-99e1-22a2f47257b6 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:29.940639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:29.946585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:29.964463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.965224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.972661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:29.974263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:29.977977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:29.980554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.022023 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 HTTP/1.1 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '565a0b8e-e4e4-4ce5-8465-b4b9d446ea18'} Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.033526 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.037146 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.043106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.044732 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc8c2008-bcdc-4269-a87f-9da935b1d20f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 404 len: 111 microversion: 2.1 time: 0.108106 Oct 28 17:47:30.045998 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2128/4359] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:29 2022] DELETE /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.060992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.069038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.080344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.080997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.081609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.083058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.083702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.084441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.177504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.180850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-272193461", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:30.200524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.204520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.206432 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-715ce3d4-c6e2-4da9-974d-ead4b9b096a6 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.158948 Oct 28 17:47:30.219818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2129/4360] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:30.243617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.246082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.265104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.265819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.267218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.268529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.269244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.270113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.289874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 HTTP/1.1 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '565a0b8e-e4e4-4ce5-8465-b4b9d446ea18'} Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.291954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. Oct 28 17:47:30.295485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.297633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.298920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eedc5d11-7aef-4706-8292-3125352f3e0f tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18" status: 404 len: 111 microversion: 2.1 time: 0.077657 Oct 28 17:47:30.300619 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2130/4361] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/565a0b8e-e4e4-4ce5-8465-b4b9d446ea18 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.311391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.319563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.335212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.335931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.337674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.338502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.339765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.341927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.342377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:30.343257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:30.343961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:30.344802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:30.347033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:30.373556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.375194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.375963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.376715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.388861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.389557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.427276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Getting quotas for project 266abe44e03944648beaf5f0c903aa53. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:47:30.448760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Getting quotas for user 192c1929e15a4c19b7ee87075abcbdcd and project 266abe44e03944648beaf5f0c903aa53. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:47:30.467091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:47:30.473501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:47:30.484500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.497293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6757523-0ad9-40cb-9227-5ba6651117c3 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1210 microversion: 2.1 time: 0.194711 Oct 28 17:47:30.503102 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2131/4362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1210 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:30.509781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.510474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.522922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.523723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.524333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.530632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.531406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.531999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.560054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 HTTP/1.1 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '0e6280f8-3265-46c3-82f0-321a9f9722e5'} Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.565753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.570630 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.573983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.575121 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc9a881b-99ed-4d2c-bfdc-cf01445f7d90 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.758603 Oct 28 17:47:30.576172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e15cbb6b-3a91-4af8-b37a-68ee961fc6b0 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 404 len: 111 microversion: 2.1 time: 0.071889 Oct 28 17:47:30.579149 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2132/4363] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:30 2022] DELETE /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.582723 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2232/4364] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:47:30.592042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.592895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.593622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.605053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 0e6280f8-3265-46c3-82f0-321a9f9722e5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.612553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.614316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.617493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.620202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.620848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.622675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.626892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.627346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.631697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.635241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.635962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.636563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.673286 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 HTTP/1.1 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0e6280f8-3265-46c3-82f0-321a9f9722e5'} Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.678056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. Oct 28 17:47:30.681824 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.684105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 0e6280f8-3265-46c3-82f0-321a9f9722e5 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.685978 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6adc266b-cf42-4b41-9f60-7b899fab65ca tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5" status: 404 len: 111 microversion: 2.1 time: 0.102335 Oct 28 17:47:30.696162 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2233/4365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/0e6280f8-3265-46c3-82f0-321a9f9722e5 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.702458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.703236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.710541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.720683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38278e9a-40dd-41c4-8851-d9c98a130f4b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1203 microversion: 2.1 time: 0.139462 Oct 28 17:47:30.721502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2133/4366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1203 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:30.735683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.737467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.755182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.755976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.756644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.757722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.758468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.759041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.776046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 HTTP/1.1 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '13168ae2-16e9-4c78-ab02-f3d6f4a141e9'} Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.778210 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.781918 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.783621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.784668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71d3632a-8694-45f4-8b87-d1a57f3ac4d8 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9" status: 404 len: 111 microversion: 2.1 time: 0.061883 Oct 28 17:47:30.785936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2134/4367] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:30 2022] DELETE /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.803804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.804423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13168ae2-16e9-4c78-ab02-f3d6f4a141e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.810565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.811054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.811520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.812236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.812691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.813119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.815945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:30.831396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.845475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.847659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:30.847895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 HTTP/1.1 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '13168ae2-16e9-4c78-ab02-f3d6f4a141e9'} Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:30.850316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. Oct 28 17:47:30.854192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:30.854758 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb46cbd0-e271-4782-ab5c-44a9cf71a5d1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 200 len: 1277 microversion: 2.47 time: 0.152226 Oct 28 17:47:30.854849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 13168ae2-16e9-4c78-ab02-f3d6f4a141e9 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:30.854921 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2234/4368] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:30.856038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cb9f0ae9-0c59-4573-85aa-8c4ff3cb70ed tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9" status: 404 len: 111 microversion: 2.1 time: 0.066175 Oct 28 17:47:30.856616 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2135/4369] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:30 2022] GET /compute/v2.1/servers/13168ae2-16e9-4c78-ab02-f3d6f4a141e9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:30.865819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:30.866268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:30.877199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.878027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.878781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.880329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:30.892769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:30.896815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:30.963333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-105316542", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:30.967833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:47:31.059529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:31.060096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:31.061285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:31.061790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:31.062486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:31.109376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.112191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.112898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.114386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.119807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.120557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.195678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Getting quotas for project 266abe44e03944648beaf5f0c903aa53. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:47:31.208681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Getting quotas for user 192c1929e15a4c19b7ee87075abcbdcd and project 266abe44e03944648beaf5f0c903aa53. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:47:31.256276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:47:31.262751 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38b90125-3ad3-46e4-8de2-341d7443a441 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 204 len: 0 microversion: 2.1 time: 0.398734 Oct 28 17:47:31.267555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:47:31.269871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2235/4370] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:30 2022] DELETE /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:47:31.295503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01019c89-4971-4a51-a38e-af888c97ae29", "name": "network-vif-unplugged", "status": "completed", "tag": "db41eb4e-8872-4ddf-9365-c425333dbb29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:31.342469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.344479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.345912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.376625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] Creating event network-vif-unplugged:db41eb4e-8872-4ddf-9365-c425333dbb29 for instance 01019c89-4971-4a51-a38e-af888c97ae29 on n-h2-860864-13 Oct 28 17:47:31.397289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ea70a67c-f576-47bd-81e3-1d32a84467c3 req-d5925b0c-a6ea-4102-8b95-c543902e81b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124542 Oct 28 17:47:31.401745 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2236/4371] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:31.422265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:31.424127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:31.444112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.445975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.447485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.448528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.449616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.452832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.454103 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7e5a40b-c0ee-4cab-826f-612856518c10 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.494950 Oct 28 17:47:31.457810 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2136/4372] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 17:47:31.478764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:31.479392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:31.492029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:31.493332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.493847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.494288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.495006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:31.495482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:31.495908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:31.747086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:31.758179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:31.781665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:31.786135 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47400a9f-1a99-4f93-90ed-51ea8da28d21 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.383233 Oct 28 17:47:31.809330 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2237/4373] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:31 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:31.814889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82f87d15-371c-43fc-98ea-e85a1a5c96e7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:31.833598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-82f87d15-371c-43fc-98ea-e85a1a5c96e7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:32.009948 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82f87d15-371c-43fc-98ea-e85a1a5c96e7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "PUT /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 991 microversion: 2.47 time: 0.183642 Oct 28 17:47:32.011724 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2238/4374] 10.222.0.48 () {62 vars in 1297 bytes} [Fri Oct 28 17:47:31 2022] PUT /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 991 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:47:32.036794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:32.038708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:32.052130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.059268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.060200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:32.063934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.075575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.076343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:32.313408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.336762 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ce81b26-1f10-4aa8-8236-bbde0ab41a91 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1272 microversion: 2.1 time: 0.319823 Oct 28 17:47:32.338490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2239/4375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:32 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:32.382284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.386600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:32.388351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:32.396195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1350b48d-c27d-4f7e-9d7c-131aa092d15a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1481 microversion: 2.1 time: 0.934505 Oct 28 17:47:32.399844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2137/4376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:31 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1481 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.414705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:32.427175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:32.432350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:32.627921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.650267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.660478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.675754 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a70c562-fc44-4b0d-9ead-9ffb8b216657 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1265 microversion: 2.1 time: 0.320186 Oct 28 17:47:32.676678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:32.677865 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2240/4377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:32 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:32.680430 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-551486ee-a27b-40a8-bc9a-f4eac4199f96 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1277 microversion: 2.47 time: 0.263360 Oct 28 17:47:32.681491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2138/4378] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:32 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:32.817314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:32.817946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:32.831410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.832566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.833016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:32.833736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:32.834194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:32.834619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:33.205239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:33.224168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:33.230039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:33.231391 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5843716e-254f-497e-b373-259016dc6195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.418736 Oct 28 17:47:33.243698 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2241/4379] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:32 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:33.368902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:33.369458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:33.390269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:33.398953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:33.402558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:33.404248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:33.404719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:33.409415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:33.423468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:33.424144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:33.438927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:33.445213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:33.446513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:33.454672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:33.460558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:33.462645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.280288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.291669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0941dce5-f8ba-49ab-a308-102da17fb899 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1272 microversion: 2.1 time: 0.927560 Oct 28 17:47:34.314869 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2139/4380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:33 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1272 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:34.328789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:34.329764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:34.345867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.346725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.348909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.350878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.352197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.353783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.485069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.501902 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e472d490-ca4a-45b8-9331-d67d3b51a5b5 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1481 microversion: 2.1 time: 1.083326 Oct 28 17:47:34.502853 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2242/4381] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:33 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1481 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:34.516729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:34.517660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:34.522118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.533075 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b5a1249-f9f9-46ae-b39c-9ad2a8ff4879 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1265 microversion: 2.1 time: 0.216386 Oct 28 17:47:34.533379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.533981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.534512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.534633 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2140/4382] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:34 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:34.536207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.536979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.537625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.552628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:34.555325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:34.581278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.581806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.582320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.583290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.583768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.584200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:34.786290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.798963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.805292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.809160 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-733a0f4f-6adc-4998-850f-1e2c4084c1a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1335 microversion: 2.47 time: 0.304570 Oct 28 17:47:34.810386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2243/4383] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:34 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1335 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:34.918293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1730573837", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:34.946128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.959808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.961904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:34.963353 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8ee0f41-8e10-40c4-83ab-417a5db612b3 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.427668 Oct 28 17:47:34.964451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2141/4384] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:34 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:34.969341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13049028-8c1f-4a4a-b3bf-d44f80e5aa62", "name": "network-vif-deleted", "tag": "9fc0fafc-68f3-4e18-bb32-eff5d5cca3be"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:34.984021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:34.984782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:34.985389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:35.005727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] Creating event network-vif-deleted:9fc0fafc-68f3-4e18-bb32-eff5d5cca3be for instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 on n-h2-860864-13 Oct 28 17:47:35.017541 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-aeb346df-94f7-470c-9584-b77b71cb2cb1 req-d6ba161d-f996-43bc-8dea-94a3abeb6d2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051420 Oct 28 17:47:35.019583 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2142/4385] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:35.022251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] validate_networks() for [('8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:47:35.322350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:35.323491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:35.343627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:35.346452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:35.352511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:35.355639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:35.358853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:35.362239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:35.866460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:35.884097 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c9e97e5-4c83-4fda-a204-23480c82d23a tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.567233 Oct 28 17:47:35.889581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2143/4386] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:35 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:35.908443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:35.913406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:35.935609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:35.944539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:35.945105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:35.950607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:35.951135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:35.953765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:35.980882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:35.981999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:35.982680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:35.983286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:35.984238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:35.997711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.001053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.001766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.005292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.007173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.007942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.052045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Getting quotas for project 77f7154c34f548a187717ba791b177f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:47:36.073161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Getting quotas for user f8ad8e4ad3a345a58ce2dea8c31e83a4 and project 77f7154c34f548a187717ba791b177f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:47:36.120993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:47:36.127274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:47:36.166972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:36.168117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:36.192809 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-383b83ce-6528-406d-bb37-fdb34200072a tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1439 microversion: 2.1 time: 0.295252 Oct 28 17:47:36.208789 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2144/4387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:35 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1439 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:36.214019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:36.225141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:36.243934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.244986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.244986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.245576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.246087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.246557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.356706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f31e8f33-b01e-44db-b337-aa7f182a2a49 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544630 Oct 28 17:47:36.364016 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2244/4388] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:47:36.381845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:36.384636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:36.412275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.417508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.418262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.419243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:36.424298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:36.424538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:36.868712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:36.894953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:36.915922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:36.917139 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9024afad-e222-4ec1-b733-25389cdcadc9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1335 microversion: 2.47 time: 0.551622 Oct 28 17:47:36.917728 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2245/4389] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:36 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1335 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:36.956777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:36.970736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:37.031358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:37.032053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:37.055273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:37.060537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:37.077638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:37.094400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:37.333808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:37.369617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97bcb11c-71b1-4d1d-84ab-2374ff5320b9 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 1.159379 Oct 28 17:47:37.390349 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2145/4390] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:36 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:37.422340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-feb25542-49d1-4f22-80ec-4ece2b68ffd9 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:37.423422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-feb25542-49d1-4f22-80ec-4ece2b68ffd9 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:37.456400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:37.479842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:37.481544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:37.482819 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e2a1d5e-189f-431b-9273-db8eeeb61c09 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.564149 Oct 28 17:47:37.496367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2246/4391] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:36 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:37.513842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:37.515153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:37.551722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:37.560531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:37.561053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:37.561823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:37.562298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:37.562871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:38.185337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-feb25542-49d1-4f22-80ec-4ece2b68ffd9 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:38.198668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-feb25542-49d1-4f22-80ec-4ece2b68ffd9 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1224 microversion: 2.1 time: 0.803906 Oct 28 17:47:38.201212 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2146/4392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:37 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1224 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:38.222713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:38.236589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:38.256888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:38.258458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:38.259602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:38.260588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:38.268245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:38.269031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:38.457741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:38.458348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:38.458714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:38.468126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lazy-loading 'fault' on Instance uuid 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:47:38.909148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:38.928320 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-963ac971-9d0c-4488-97af-be3644d8604f tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 1.425629 Oct 28 17:47:38.929675 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2247/4393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:37 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:38.950858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:38.951977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:38.973511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:38.974051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:38.974566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:38.980852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:38.980985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:38.983540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.348347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd95f30a1f1744daa2f29130fc8db8e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7658345c4fb468ebaf149ddccef8cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.369478 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92217a84-76b3-4eec-a5cd-791d61567418 tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 200 len: 1283 microversion: 2.1 time: 1.164705 Oct 28 17:47:39.370582 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2147/4394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:38 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 1283 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:39.409939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:39.418840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:39.455908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.459138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.460946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.462448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.464979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.466674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.496251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.509155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.522845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.530213 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bb47efe-e360-4297-aedd-244ef5f2caa4 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1335 microversion: 2.47 time: 0.593801 Oct 28 17:47:39.530832 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2248/4395] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:38 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1335 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:39.545413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:39.550006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:39.575937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.577632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.582718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.586208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.586711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.589138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.787110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.816514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.826802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:39.836669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-67f4e1c0-c10b-4686-b3f2-49c88ceae4ab tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.301608 Oct 28 17:47:39.839620 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2249/4396] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:39 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:39.861451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:39.862241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:39.890869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.890869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.890869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:39.894000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:39.895609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:39.897368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.204287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:40.213085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32e15c1d-4d75-4e7a-af9a-1a9617b1914a tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1284 microversion: 2.1 time: 0.371641 Oct 28 17:47:40.220306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:40.225309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2250/4397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:39 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:40.257665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf38f08e-8738-452f-8826-73bc6e36f899 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.858927 Oct 28 17:47:40.267705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2148/4398] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:39 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:40.270822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:40.271735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:40.282853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.286963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.287723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.288716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.289398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.290065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.401366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:40.401366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] [instance: 13049028-8c1f-4a4a-b3bf-d44f80e5aa62] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:40.407842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.418281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.419229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.420894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.423468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.424198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.498131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] HTTP exception thrown: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Request method failure captured: Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 HTTP/1.1 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBS5qLhA2y6BMn0l1joTLrMpusO4ALE61ShcwYZTdaV_yWH7aLf-jcjMY4O_CTScF6DNid893-4RuLJXtpaRW9f5C5jQCE_8qdFvfylXVd9dLnf6EZBaRzYWBd-Fztxeemba_TZhwi9ojDdkfQT7dGmGxDPwKzc83FaNOZWTN9lrNx0 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7658345c4fb468ebaf149ddccef8cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7658345c4fb468ebaf149ddccef8cc6"}]}] Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestJSON-1046809117 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d7658345c4fb468ebaf149ddccef8cc6 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestJSON-1046809117 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: fd95f30a1f1744daa2f29130fc8db8e2 Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestJSON-1046809117-project Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '13049028-8c1f-4a4a-b3bf-d44f80e5aa62'} Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:40.503877 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:40.508756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] Returning 404 to user: Instance 13049028-8c1f-4a4a-b3bf-d44f80e5aa62 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:40.510189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-593c4c7f-64ca-4851-a5f2-afe8b7b1a6bf tempest-ServersTestJSON-1046809117 tempest-ServersTestJSON-1046809117-project] 10.222.0.48 "GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62" status: 404 len: 111 microversion: 2.1 time: 0.118536 Oct 28 17:47:40.514150 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2149/4399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:40 2022] GET /compute/v2.1/servers/13049028-8c1f-4a4a-b3bf-d44f80e5aa62 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:40.524833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3d31cd-79e9-41e2-b7ce-8b60059b33ed", "tag": "92bed01b-4566-4eab-aeb1-8b13e81bd773"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:40.553803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.554686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.556852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.593207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] Creating event network-changed:92bed01b-4566-4eab-aeb1-8b13e81bd773 for instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed on n-h1-860864-13 Oct 28 17:47:40.603540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0578b6e5-95c4-49c6-81d6-7e61fa02e1ee req-37d9b385-9388-4906-b225-b363bc5902e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087500 Oct 28 17:47:40.612654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2150/4400] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:40.620515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:40.624731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:40.636886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.640827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.641491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.642355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:40.643213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:40.653524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:40.902015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:40.913604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:40.918973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:40.924115 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bad6bb0e-b47d-4c8e-a5c6-abe027c2a731 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1356 microversion: 2.47 time: 0.309096 Oct 28 17:47:40.940065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2151/4401] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:40 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1356 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:40.962515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d10c7f7-a2a0-438c-9856-60eee59c3cbb", "tag": "b41b6ace-40e7-4652-94a4-71e8872e33aa"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:41.000148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.001078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.001806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.022111 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] Creating event network-changed:b41b6ace-40e7-4652-94a4-71e8872e33aa for instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb on n-h1-860864-13 Oct 28 17:47:41.031560 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e29abf74-9969-4ca5-aabc-c5091bcf70c5 req-529524a7-0763-4d6a-9b01-f317371c5dae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089644 Oct 28 17:47:41.032722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2152/4402] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:41.041342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:41.042475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.051926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.053147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.054501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.055960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.057896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.059009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.169752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:41.205158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:41.226589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f5732d25-c483-4b1c-9238-bebdb8288023 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.970905 Oct 28 17:47:41.230834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2251/4403] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:40 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:41.257905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:41.260907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.280757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.281536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.282014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.285191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.286204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.286386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.313018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:41.353528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:41.360837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:41.384098 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15f8a53f-4ffe-414f-bfa8-d2ef6459eb0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.334274 Oct 28 17:47:41.390598 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2153/4404] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:41 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:41.400357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:41.400996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.416482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.416991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.417456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.418161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.418640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.419051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.544902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:47:41.544902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:47:41.545327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:47:41.545938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:47:41.546527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:47:41.741750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.748458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.748968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.749412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.750124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.754904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.759278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.817394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92815040-b417-4bab-a927-14a439204627 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "POST /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4/action" status: 202 len: 1078 microversion: 2.47 time: 0.580530 Oct 28 17:47:41.828444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2252/4405] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:47:41 2022] POST /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4/action => generated 1078 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 17:47:41.842002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:41.847576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:41.848967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.856985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.857174 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48375d7c-aaa5-425a-bd68-dfe03c6638bf tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1282 microversion: 2.1 time: 0.465225 Oct 28 17:47:41.857893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2154/4406] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:41 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1282 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:41.868837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.870753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.875278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.875962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.876350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:41.876806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.881626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:41.888931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:41.902669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.903783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.904402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:41.905583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:41.906246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:41.906871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.137349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.151732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.168786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.170809 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3fd06d0-cb1b-4fe6-90b1-9d4fbf6e05d7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.310435 Oct 28 17:47:42.179745 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2155/4407] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:41 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:42.281915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:42.283474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:42.301988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.302875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.303589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.304556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.305300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.306450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.520643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.524347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:42.536699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9711f5a-3efc-457e-bef8-434431f39136 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.706716 Oct 28 17:47:42.537316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2253/4408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:41 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:42.557288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:42.558158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:42.579981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.583077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.583925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.585105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.587284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.587906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.627841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.641281 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5823f736-ac30-4565-8087-a88e480cd205 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.369989 Oct 28 17:47:42.642728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2156/4409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:42 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:42.729556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.742358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.744374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:42.746600 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2fc845d9-2ac9-4868-bc9e-62de6d9e41ed tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.193875 Oct 28 17:47:42.747396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2254/4410] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:42 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:42.883327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:42.884241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:42.905539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.908105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.908533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.911108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:42.914636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:42.916195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:42.956381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:43.203346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:43.204254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:43.218871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.223565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.230874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:43.231860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:43.232137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.236326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.237438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:43.255213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c346afdc-2c21-4ec0-9a70-9e1c9185656b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1282 microversion: 2.1 time: 0.377592 Oct 28 17:47:43.273111 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2157/4411] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:42 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1282 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:43.563898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:43.564524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:43.581194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.582029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.583164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:43.584229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.584864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.585476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:43.797449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:43.814099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:43.815941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:43.818214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1703c175-e126-4e39-8995-f4ef5393c7dc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.620317 Oct 28 17:47:43.823425 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2255/4412] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:43 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:43.828696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:43.840473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:43.862797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.864061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.864679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:43.865584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:43.866223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:43.866811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.198849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:44.211769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be075dd1-8a3c-4277-b5af-8338716d0493 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.651338 Oct 28 17:47:44.214894 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2158/4413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:43 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:44.220521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:44.227958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:44.246297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.252039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.252718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.254417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.256054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.256763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.377194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:44.387210 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38f368ae-de25-44be-88f6-11f4a7e05323 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.562475 Oct 28 17:47:44.396858 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2256/4414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:43 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:44.402161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:44.403050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:44.413395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.420185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.424845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.426006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.426749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.429832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.736986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:44.763780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:44.769286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:44.771340 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f698457-c714-4e80-841b-6e180570dd5d tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.555302 Oct 28 17:47:44.775868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2159/4415] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:44 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:44.851968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:44.856137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:44.871335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.872177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.874767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:44.875948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:44.877485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:44.880715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.048860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:45.062171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:45.065884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:45.067481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3cd61dfe-1678-41c8-a5b3-a124b53413b5 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.219486 Oct 28 17:47:45.086791 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2160/4416] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:44 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:45.240386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:45.241639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:45.252782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.253623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.254183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.254986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.255531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.256151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.662095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:45.672996 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa4dd8f7-6594-4b1a-904f-ae1920e658d3 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 1.274708 Oct 28 17:47:45.673511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:45.673661 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2257/4417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:44 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:45.687747 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e92abe62-8098-4a1b-ab2a-04c946224394 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.451099 Oct 28 17:47:45.701432 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2161/4418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:45 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:45.712453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3af7afe-b1cb-42a6-b746-e705c0ee8862", "tag": "10b3ed24-cd6c-4269-ac63-e807c6d76d57"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:45.719633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:45.723344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:45.746062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.747053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.747763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.750484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.751285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.752438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.753070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.756844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.757886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.806436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] Creating event network-changed:10b3ed24-cd6c-4269-ac63-e807c6d76d57 for instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 on n-h2-860864-13 Oct 28 17:47:45.830032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c1edeeca-dede-4e11-ba3d-5cabae5ac62c req-9f47a607-51b2-4e0c-a9ce-ab2489176a84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140487 Oct 28 17:47:45.832194 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2258/4419] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:45.852240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:45.854267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:45.869914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.874746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.875514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:45.876735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:45.877439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:45.878049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:46.030271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:46.102757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=24 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:46.798442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:46.837928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:46.851848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:46.855873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b66486e6-8a60-4ae4-a05a-4344f38e3a0a tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 1.019845 Oct 28 17:47:46.856483 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2259/4420] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:45 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:46.874449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:46.876464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:46.901072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:46.902023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:46.906838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:46.916608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:46.918124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:46.922167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:47.143243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:47.159108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:47.165937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:47.178820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:47.186567 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e428b4f7-89c7-48c6-bc01-75b952ed7aaf tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 1.473410 Oct 28 17:47:47.188580 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a15d84c-2911-428b-895b-9e9a80598b56 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.329870 Oct 28 17:47:47.189830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2162/4421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:45 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:47.228539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2260/4422] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:46 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:47.240433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:47.241057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:47.244410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:47.245318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:47.265787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:47.269161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:47.270717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:47.273547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:47.278371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:47.279285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:47.280035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:47.283022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:47.283962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:47.288591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:47.296090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:47.296829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.191071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:48.327878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.347203 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-407d38dc-c693-4cdf-bb4d-75c80f55ef40 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 1.145310 Oct 28 17:47:48.367020 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2163/4423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:47 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:48.375981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:48.378196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:48.396920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.398491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.400641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.401666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.402545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.403219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.409953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.426889 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65b56ccf-341a-4552-91bb-c4e265ed463f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 1.204169 Oct 28 17:47:48.429267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2261/4424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:47 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:48.439719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:48.444930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:48.460274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.463074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.463758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.466470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.467280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.471450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.576735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.598094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.600076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b786518922243a5a98472bfc538ed29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67b880bf735045c6867c0b9b685d4ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.603687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f57f04e-360e-42d6-be28-0f399d03b195 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 200 len: 1604 microversion: 2.32 time: 0.234496 Oct 28 17:47:48.605776 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2164/4425] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:48 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:48.610940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:48.612292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:48.618943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.619875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.620547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.621481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:48.622455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:48.623114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:48.822293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.834136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.835713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:48.836930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc625a1b-0d55-4042-80b9-dc3a1ce198ad tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.229804 Oct 28 17:47:48.862377 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2165/4426] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:48 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:49.175290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:49.189406 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f1b1d1c2-aa36-47c3-b12f-39b0377708d1 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.758578 Oct 28 17:47:49.190680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2262/4427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:48 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:49.375019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:49.376936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:49.390278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.390786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.391231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.391990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.392449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.394067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.451689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:49.452300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:49.461399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.463649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.464276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.467273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.467952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.468545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.938890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:49.949547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc845757-59be-45f0-9fbe-87219df9ac5f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.501646 Oct 28 17:47:49.950720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2263/4428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:49 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:49.960062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:49.961005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:49.968230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.969057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.970109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.970915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:49.971645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:49.972166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:49.995764 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] HTTP exception thrown: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Request method failure captured: Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd HTTP/1.1 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQ5q96e9MQxGhEj7bfce2XR5gQBzL51p18ZIfqWPvLo5j9Zndr0b5LwcDCl67GkXT-wWprc1UwXc6rAOZL3rNvJrsW3l-d7E44HY5Wyv_2Gkp4e167d0DoZBH-AAioGKYIjIczhTJNhcekodWG5h60TKnoc-evy2kDvR9M3vaCTx1s Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67b880bf735045c6867c0b9b685d4ecf"}]}] Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6b786518922243a5a98472bfc538ed29 Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '58c4ff7e-552f-40df-9cbd-e349ffd5cdbd'} Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:49.997509 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Returning 404 to user: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:50.002823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-682efa46-0ee7-4dc3-a46e-4d9d9a4e7812 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 404 len: 111 microversion: 2.32 time: 0.046788 Oct 28 17:47:50.007445 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2264/4429] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:49 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:47:50.013525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:50.014416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:50.021885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:50.022370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:50.022802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:50.023531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:50.023981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:50.024400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:50.098846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:50.107246 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1cca1e1e-cb0f-418b-99cc-4ca5a20c6911 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 0.736546 Oct 28 17:47:50.107874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2166/4430] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:49 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:50.113644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90872c77-a33e-4de0-b83e-2301c94c4d3c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '.version_select at 0x7f75246a5e50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:50.120088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:50.137659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:50.139126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:50.146835 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6d97f37-35c6-41f9-a7e5-a472a6ec0ec7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.137123 Oct 28 17:47:50.147451 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2265/4431] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:50 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:50.163290 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90872c77-a33e-4de0-b83e-2301c94c4d3c tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706237274" status: 204 len: 0 microversion: 2.32 time: 0.053413 Oct 28 17:47:50.167755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2167/4432] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706237274 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:47:50.217228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:50.217969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:50.226432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:50.227073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:50.227690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:50.228762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:50.229293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:50.229927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:50.717094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:50.726081 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ebe61763-723e-4458-9eff-d304d16162dd tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.513107 Oct 28 17:47:50.726667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2266/4433] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:50 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:50.989671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:50.991923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:51.014324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.015090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.016301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.017233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.017842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.018501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.139030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:51.139865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:51.151260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.152211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.153151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.154080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.155474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.156469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.452174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:51.474516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b04292d7-4c6e-470a-9778-d3ee0814d881 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.486927 Oct 28 17:47:51.489164 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2168/4434] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:50 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:51.507087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:51.509308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:51.522223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.523899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.526625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.528818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.529499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.531774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.700489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:51.716893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:51.725400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:51.727648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc35a40a-f338-42b8-877b-039684456364 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.231743 Oct 28 17:47:51.747920 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2169/4435] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:51 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:51.767723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:51.783828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3d31cd-79e9-41e2-b7ce-8b60059b33ed", "name": "network-vif-plugged", "status": "completed", "tag": "92bed01b-4566-4eab-aeb1-8b13e81bd773"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:51.785380 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09564645-bbd7-4f35-89f6-30275e401427 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 0.654357 Oct 28 17:47:51.787457 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2267/4436] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:51 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:51.838807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:51.839617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:51.849828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.851040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.854044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.854593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.855067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.855708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.859549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:51.860247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:51.860829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:51.897480 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] Creating event network-vif-plugged:92bed01b-4566-4eab-aeb1-8b13e81bd773 for instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed on n-h1-860864-13 Oct 28 17:47:51.920998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-eccaa9a2-9d5d-4c5c-85b2-9910a14e151f req-1f6a59c9-90ef-4ed0-985b-74189d1091f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168726 Oct 28 17:47:51.923302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2170/4437] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:52.266162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:52.277821 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f145fbe5-5cea-4186-b2e1-739972c0b474 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.486776 Oct 28 17:47:52.297425 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2268/4438] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:51 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:52.507157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:52.507948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:52.515507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.516241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.516837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.517699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.518169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.518595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.757573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:52.758678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:52.765332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.765858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.766292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.767194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.767693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.768123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.881372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:52.895436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:52.899452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:52.902550 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-537efd8d-7be1-43bc-aa3a-3484ae006aa9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.150818 Oct 28 17:47:52.902705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:52.903978 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2269/4439] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:52 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:52.916581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:52.918087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:52.927098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.928435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.929666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.932466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:52.933744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:52.934636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:52.938801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c0579ac-5cde-4dcb-9ca0-17b917847f9c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.432669 Oct 28 17:47:52.951755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2171/4440] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:52 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:53.298799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:53.305157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:53.306147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:53.311256 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38948643-4397-485c-8486-03032c1304ea tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 0.405893 Oct 28 17:47:53.312120 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2270/4441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:52 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:53.318541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:53.319233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:53.319708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:53.320551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:53.321077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:53.321505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:53.766459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:53.774392 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be1fd183-ced1-425a-bdbb-e31d61ecae38 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.475623 Oct 28 17:47:53.775302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2172/4442] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:53 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:53.930005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:53.930619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:53.950432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:53.951507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:53.951507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:53.952103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:53.952565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:53.952995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:53.965963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3af7afe-b1cb-42a6-b746-e705c0ee8862", "name": "network-vif-plugged", "status": "completed", "tag": "10b3ed24-cd6c-4269-ac63-e807c6d76d57"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:53.989174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:53.989667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:53.990107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:54.012005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] Creating event network-vif-plugged:10b3ed24-cd6c-4269-ac63-e807c6d76d57 for instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 on n-h2-860864-13 Oct 28 17:47:54.017158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7e6fbfa3-76c2-4867-bdbe-69a27a0d247d req-e1062089-76a9-466d-b776-0664291c1a8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054692 Oct 28 17:47:54.018347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2173/4443] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:54.028431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:54.029692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:54.036625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:54.037307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:54.037942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:54.038945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:54.039589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:54.040178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:54.549514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:54.554766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:54.564985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:54.567397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:54.569471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7a6b2a2-7c9f-44d2-b2bc-9a4de08cac0e tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.643837 Oct 28 17:47:54.570129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2271/4444] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:53 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:54.576136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:54.577017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:54.588372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:54.591982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:54.592506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:54.595220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:54.595956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:54.596644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:55.007670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.021802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b609a06-149a-498a-8509-e8f994185b5a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 1.000913 Oct 28 17:47:55.023726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2174/4445] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:54 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:55.030959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:55.031876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:55.041209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:55.042046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:55.043297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:55.044843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:55.045454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:55.046040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:55.168308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.179419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b254bd9f-07d1-478a-9448-783ff870cd1c tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1324 microversion: 2.1 time: 0.607445 Oct 28 17:47:55.180637 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2272/4446] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:54 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:55.417684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.430402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-125a8b7f-be95-45be-b0e6-95f46ecf9873 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1314 microversion: 2.1 time: 0.405334 Oct 28 17:47:55.431656 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2175/4447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:55 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:55.598645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:55.599351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:55.617559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:55.618064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:55.618503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:55.619220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:55.619701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:55.620127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:55.791268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.805309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.806777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:55.808069 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8541e2c-12ba-4a31-aa84-bcdaf503dfe3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.214246 Oct 28 17:47:55.823907 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2273/4448] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:55 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:56.048458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:56.049983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:56.063004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.068961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.074171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.075467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.076396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.077128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.141414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:47:56.204068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:56.204690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:56.216642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.218521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.219049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.222609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.223730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.235595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.551309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:56.561100 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f20f705-e881-4050-9d49-cf6e538fa05b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.517680 Oct 28 17:47:56.562321 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2176/4449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:56 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:56.567598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:56.568545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:56.575079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.575848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.576530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.577925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.578589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.579257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.668198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:56.680341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-06faba24-649f-4cf4-adcb-9482f745e776 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1519 microversion: 2.1 time: 0.480559 Oct 28 17:47:56.682573 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2274/4450] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:56 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:47:56.834497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d9f95c5-abf3-4078-943e-eb5d002779b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-446457592", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d9f95c5-abf3-4078-943e-eb5d002779b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 242 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-446457592", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-446457592', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe'}]}}} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:56.845822 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d9f95c5-abf3-4078-943e-eb5d002779b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d9f95c5-abf3-4078-943e-eb5d002779b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017882 Oct 28 17:47:56.851659 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2275/4451] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:56 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:47:56.854316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:56.864392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:56.872290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.872786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.873222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:56.873978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:56.874437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:56.875197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.053340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:57.084797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:57.095442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:57.096783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-12527d86-fd9f-4035-a293-5b76f8d1aa85 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.246932 Oct 28 17:47:57.112295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2276/4452] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:56 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:57.118773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:57.122747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: 879c4ed7-6d87-48fd-bc97-a374ed94aa20] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:57.132943 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] HTTP exception thrown: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/879c4ed7-6d87-48fd-bc97-a374ed94aa20/metadata HTTP/1.1 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': '879c4ed7-6d87-48fd-bc97-a374ed94aa20'} Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.141240 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 404 to user: Instance 879c4ed7-6d87-48fd-bc97-a374ed94aa20 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddae20a8-a778-4059-923c-473f7bb1465b tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/879c4ed7-6d87-48fd-bc97-a374ed94aa20/metadata" status: 404 len: 111 microversion: 2.1 time: 0.029171 Oct 28 17:47:57.146519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2277/4453] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:47:57 2022] GET /compute/v2.1/servers/879c4ed7-6d87-48fd-bc97-a374ed94aa20/metadata => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:57.202872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b17d6bd-16cb-4dad-b2bb-09dbc20a44b5 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-426378518", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b17d6bd-16cb-4dad-b2bb-09dbc20a44b5 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 498 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-426378518", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-426378518', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe'}]}}} Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:47:57.208102 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b17d6bd-16cb-4dad-b2bb-09dbc20a44b5 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b17d6bd-16cb-4dad-b2bb-09dbc20a44b5 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011180 Oct 28 17:47:57.211670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2278/4454] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:47:57.270749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9bf2e5d1-2418-4f58-956a-03e79e7700b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-282068282", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9bf2e5d1-2418-4f58-956a-03e79e7700b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 499 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-282068282", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-282068282', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe'}]}}} Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:47:57.275066 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.278155 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.281270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9bf2e5d1-2418-4f58-956a-03e79e7700b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.282144 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9bf2e5d1-2418-4f58-956a-03e79e7700b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018808 Oct 28 17:47:57.282747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2279/4455] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:47:57.338230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e90fb61-4722-4f4f-af89-e74b01139bbb tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-78456125", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:57.338455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e90fb61-4722-4f4f-af89-e74b01139bbb tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 752 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-78456125", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-78456125', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe'}]}}} Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:47:57.342990 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:47:57.348976 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:47:57.351212 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.351212 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.351212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e90fb61-4722-4f4f-af89-e74b01139bbb tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.351212 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e90fb61-4722-4f4f-af89-e74b01139bbb tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010280 Oct 28 17:47:57.351212 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2280/4456] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:47:57 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 17:47:57.355456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9459a53-c65c-4630-9b81-cf8bbdfb51db tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1498 microversion: 2.1 time: 0.791711 Oct 28 17:47:57.360146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2177/4457] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:56 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1498 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:57.418007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-116807d8-1eef-4ac9-b0cf-aa8b21d21043 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-545248819", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-116807d8-1eef-4ac9-b0cf-aa8b21d21043 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 1265 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-545248819", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe"}]}} Oct 28 17:47:57.423101 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-545248819', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8ae222cb-6cf6-4ff3-a9f4-4862d9e9fcfe'}]}}} Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.425327 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:47:57.427079 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:47:57.428930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 17:47:57.428930 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.432858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-116807d8-1eef-4ac9-b0cf-aa8b21d21043 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.436925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-116807d8-1eef-4ac9-b0cf-aa8b21d21043 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021923 Oct 28 17:47:57.438060 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2281/4458] 10.222.0.48 () {60 vars in 1148 bytes} [Fri Oct 28 17:47:57 2022] POST /compute/v2.1/servers => generated 2221 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 17:47:57.448554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:57.449069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: 58d6cfda-9883-4573-b0d2-242516157b94] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:57.461434 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] HTTP exception thrown: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/58d6cfda-9883-4573-b0d2-242516157b94/metadata/test2 HTTP/1.1 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '58d6cfda-9883-4573-b0d2-242516157b94', 'id': 'test2'} Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:57.467196 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 404 to user: Instance 58d6cfda-9883-4573-b0d2-242516157b94 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:57.478862 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f143af3d-0280-4d03-9bd5-452a034aab5e tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/58d6cfda-9883-4573-b0d2-242516157b94/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.031408 Oct 28 17:47:57.480125 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2178/4459] 10.222.0.48 () {58 vars in 1281 bytes} [Fri Oct 28 17:47:57 2022] GET /compute/v2.1/servers/58d6cfda-9883-4573-b0d2-242516157b94/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:47:57.493328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:57.493898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:57.500904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.501770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.502437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.504150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.505473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.506055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.537087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:47:57.593810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:57.594496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:57.620261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.621056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.622327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.623002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.623738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.624513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.713802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0adc7b86-9694-4218-ad43-b023696ff16d tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 204 len: 0 microversion: 2.1 time: 0.225804 Oct 28 17:47:57.715231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2282/4460] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:47:57 2022] DELETE /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:47:57.726070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:57.727338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:57.737487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.739312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.740610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:57.742083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:57.742880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:57.743921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:58.193408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:58.201654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8410cbab-3f6e-4e3e-bc06-b425cabac4b0 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1525 microversion: 2.1 time: 0.482410 Oct 28 17:47:58.202622 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2283/4461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:57 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1525 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:58.208432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:58.209745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:58.216164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:58.216937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:58.217594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:58.218548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:58.219218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:58.219880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:58.339169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:58.353178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01460030-3857-4484-a63d-0d5f906756bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.764708 Oct 28 17:47:58.383431 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2179/4462] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:57 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:58.386348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d10c7f7-a2a0-438c-9856-60eee59c3cbb", "name": "network-vif-plugged", "status": "completed", "tag": "b41b6ace-40e7-4652-94a4-71e8872e33aa"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:47:58.401549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:58.402092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:58.403333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:58.425099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] Creating event network-vif-plugged:b41b6ace-40e7-4652-94a4-71e8872e33aa for instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb on n-h1-860864-13 Oct 28 17:47:58.433259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e2d90141-155d-46d2-aed5-77ae7f57eccd req-8de1b799-b93e-4936-808c-eba070d24a2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053450 Oct 28 17:47:58.435685 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2180/4463] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:47:58.450155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:58.460629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:58.469135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:58.470581 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d44da0f6-6a90-4722-a81f-0d2ea4bd6954 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.266645 Oct 28 17:47:58.474501 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2284/4464] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:58 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:47:59.249381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:59.250637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:59.259273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.260067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.260790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.261747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.262466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.263145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.361634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:59.362132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:59.369998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.370790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.371449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.372382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.373053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.373661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.389528 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] HTTP exception thrown: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Request method failure captured: Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd HTTP/1.1 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBQ5q96e9MQxGhEj7bfce2XR5gQBzL51p18ZIfqWPvLo5j9Zndr0b5LwcDCl67GkXT-wWprc1UwXc6rAOZL3rNvJrsW3l-d7E44HY5Wyv_2Gkp4e167d0DoZBH-AAioGKYIjIczhTJNhcekodWG5h60TKnoc-evy2kDvR9M3vaCTx1s Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67b880bf735045c6867c0b9b685d4ecf"}]}] Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 6b786518922243a5a98472bfc538ed29 Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '58c4ff7e-552f-40df-9cbd-e349ffd5cdbd'} Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:59.391716 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.398529 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.400360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Returning 404 to user: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:59.401837 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53695c31-adc3-4eb0-b039-7421b507b704 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 404 len: 111 microversion: 2.32 time: 0.043783 Oct 28 17:47:59.401837 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2285/4465] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:47:59 2022] DELETE /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:47:59.406827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:59.407458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:59.420957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.421779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.422314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.423199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.423903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.424563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.885305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ad8e4ad3a345a58ce2dea8c31e83a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f7154c34f548a187717ba791b177f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:59.900938 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cb14618d-0a3e-44ab-b6b4-53630e229679 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 200 len: 1525 microversion: 2.1 time: 0.667873 Oct 28 17:47:59.902187 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2181/4466] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:59 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 1525 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:59.907108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:59.908084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] [instance: 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:59.920831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.922458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.922702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.924150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:47:59.924761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:47:59.926374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:47:59.937141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:47:59.948169 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bac75442-ec57-48d2-ab3a-5fbd2481e790 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.545232 Oct 28 17:47:59.962294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2286/4467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:47:59 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:47:59.964680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:47:59.964837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] HTTP exception thrown: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.965302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Request method failure captured: Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd HTTP/1.1 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBQ5q96e9MQxGhEj7bfce2XR5gQBzL51p18ZIfqWPvLo5j9Zndr0b5LwcDCl67GkXT-wWprc1UwXc6rAOZL3rNvJrsW3l-d7E44HY5Wyv_2Gkp4e167d0DoZBH-AAioGKYIjIczhTJNhcekodWG5h60TKnoc-evy2kDvR9M3vaCTx1s Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_67b880bf735045c6867c0b9b685d4ecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/67b880bf735045c6867c0b9b685d4ecf"}]}] Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 67b880bf735045c6867c0b9b685d4ecf Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1124470325 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6b786518922243a5a98472bfc538ed29 Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TaggedBootDevicesTest-1124470325-project Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '58c4ff7e-552f-40df-9cbd-e349ffd5cdbd'} Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.971148 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] Returning 404 to user: Instance 58c4ff7e-552f-40df-9cbd-e349ffd5cdbd could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3055e683-ba95-4dec-b521-ad3d8ce33d18 tempest-TaggedBootDevicesTest-1124470325 tempest-TaggedBootDevicesTest-1124470325-project] 10.222.0.48 "GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd" status: 404 len: 111 microversion: 2.32 time: 0.064813 Oct 28 17:47:59.975576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2182/4468] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:59 2022] GET /compute/v2.1/servers/58c4ff7e-552f-40df-9cbd-e349ffd5cdbd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:48:00.007356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3af7afe-b1cb-42a6-b746-e705c0ee8862", "name": "network-vif-deleted", "tag": "10b3ed24-cd6c-4269-ac63-e807c6d76d57"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:00.007584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:00.007959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:00.008412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:00.009135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:00.009598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:00.010026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:00.021443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:00.022034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:00.023522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:00.040630 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] Creating event network-vif-deleted:10b3ed24-cd6c-4269-ac63-e807c6d76d57 for instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 on n-h2-860864-13 Oct 28 17:48:00.046873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b4007d4f-6bf3-4532-b247-8d616e572535 req-277866f0-8446-43e2-801f-579817c10aef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043995 Oct 28 17:48:00.053252 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2183/4469] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:48:00.276813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:00.291648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:00.296235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:00.300145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6dc878e-fc45-4a14-935f-5a3b6d601b11 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.343343 Oct 28 17:48:00.302543 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2287/4470] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:47:59 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:00.931316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:00.932112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] [instance: c3af7afe-b1cb-42a6-b746-e705c0ee8862] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:00.967219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:00.970661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:00.973935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:00.979753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:00.980874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:00.981445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:00.983198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:00.985440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:01.004151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:01.005236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:01.007475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:01.011214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:01.015280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:01.016648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:01.065047 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] HTTP exception thrown: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Request method failure captured: Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 HTTP/1.1 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBW2iOMrWTJFTFNVMVDmxlK8C2QVjVGyV2ysZiij1esk8ZKE76yLTsK-tFKq1aAo5kWrWzv6-ho3Op_J3z4auRG1bBByejhyFtwK_qneCy1B3Kd3XYMT9j1LRJaaWRSYGTjQYUNZaG27Bhw5ue3HalIWXLczjhqL5xZWZvS8fteGkSE Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77f7154c34f548a187717ba791b177f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77f7154c34f548a187717ba791b177f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77f7154c34f548a187717ba791b177f3"}]}] Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 77f7154c34f548a187717ba791b177f3 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1482795174 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f8ad8e4ad3a345a58ce2dea8c31e83a4 Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1482795174-project Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c3af7afe-b1cb-42a6-b746-e705c0ee8862'} Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:01.072503 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] Returning 404 to user: Instance c3af7afe-b1cb-42a6-b746-e705c0ee8862 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-426b9784-275b-4376-b13d-60b6cfa40b76 tempest-ServerMetadataNegativeTestJSON-1482795174 tempest-ServerMetadataNegativeTestJSON-1482795174-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862" status: 404 len: 111 microversion: 2.1 time: 0.150158 Oct 28 17:48:01.076941 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2184/4471] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:00 2022] GET /compute/v2.1/servers/c3af7afe-b1cb-42a6-b746-e705c0ee8862 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:48:01.337177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:01.338109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:01.349907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:01.354036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:01.354824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:01.356039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:01.356650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:01.358461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:01.538945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:01.549275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:01.564143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:01.567058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c878fb28-c9c3-49ad-a3cf-e6ea82be34dd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1307 microversion: 2.1 time: 0.588119 Oct 28 17:48:01.567994 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2288/4472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:00 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1307 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:01.587107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:01.595469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a7ec53e7-915b-4cb2-80f6-3836c53c59e8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.264468 Oct 28 17:48:01.606591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2185/4473] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:01 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:02.590447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:02.591757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:02.613728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:02.614310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:02.614761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:02.617293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:02.618838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:02.619843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:02.622986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:02.623626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:02.639879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:02.646952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:02.648957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:02.651338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:02.655570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:02.658061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.038478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:03.053989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:03.059002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:03.064653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2127bd49-3995-4c0f-baac-2ed60b92a62c tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.444497 Oct 28 17:48:03.065314 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2186/4474] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:02 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:48:03.093899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:03.094405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:03.109710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.113321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.113715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.114461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.114924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.115358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.165291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:03.197172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:03.206103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd3561a4-90ce-4b62-977e-199e6d776d82 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1488 microversion: 2.1 time: 0.619402 Oct 28 17:48:03.212175 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2289/4475] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:02 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1488 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:03.240421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:03.240927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:03.253640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.254394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.254991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.255977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.256594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.260003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.325882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:03.400588 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d123b55f-24fb-48dc-b6ca-34c89fac1654 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 204 len: 0 microversion: 2.1 time: 0.310390 Oct 28 17:48:03.401442 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2187/4476] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:03 2022] DELETE /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:03.420247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:03.420957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:03.435090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.439051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.441745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.443350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.444074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.444681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.616711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:03.633818 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-569e214d-347c-4126-92e2-19e5a701ecd4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 204 len: 0 microversion: 2.1 time: 0.397806 Oct 28 17:48:03.638928 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2290/4477] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:03 2022] DELETE /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:03.655381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:03.661647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:03.675182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.680330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.680903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.684009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:03.684668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:03.687275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:03.905171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:03.944540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e468f0b7-9201-4696-9ea3-527956717983 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1504 microversion: 2.1 time: 0.538371 Oct 28 17:48:03.945232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2188/4478] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:03 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:04.096234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:04.096849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:04.111452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:04.111957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:04.112399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:04.114314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:04.114518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:04.115451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:04.119803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:04.123759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:04.141640 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e29d9617-da0e-403d-8ca9-54871bb52550 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1494 microversion: 2.1 time: 0.501076 Oct 28 17:48:04.142880 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2291/4479] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:03 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1494 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:04.441934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:04.458902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:04.461056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:04.469186 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12c535f7-a145-4e38-b8bd-478cde3191de tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.378117 Oct 28 17:48:04.470328 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2189/4480] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:04 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:04.973930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:04.974646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:04.999427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:04.999933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:05.000654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:05.001384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:05.002059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:05.002458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:05.166035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:05.166646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:05.183008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:05.183545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:05.183990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:05.191407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:05.191927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:05.192379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:06.145681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:06.161992 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b62e3dba-75d0-4181-80b7-1b4c0d4a7418 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1504 microversion: 2.1 time: 1.190933 Oct 28 17:48:06.165118 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2292/4481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:04 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1504 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:06.191753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:06.192668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:06.202498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:06.212440 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f873ced-095b-479c-ba8b-c3e80e3abd5c tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1494 microversion: 2.1 time: 1.049836 Oct 28 17:48:06.217202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:06.218229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:06.218892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:06.219970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:06.220887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:06.221596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:06.225195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2190/4482] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:05 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1494 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:06.358100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:06.368855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:06.373113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:06.376446 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-369d43a9-0c8c-4d15-91fa-f21d21e4eed9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.206911 Oct 28 17:48:06.377678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2293/4483] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:06 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:07.192429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:07.193173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:07.217053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.217847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.218634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.220554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.221418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.223572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.248796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:07.250354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:07.263178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.263961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.264639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.265576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.266330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.266988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.629683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd30ee0c7da914379acf0785da329371d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b112212257f4f9a9179c168a117ae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:07.647810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-556f9c9e-b369-42a9-830b-23f42ec483a4 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 200 len: 1462 microversion: 2.1 time: 0.459869 Oct 28 17:48:07.667484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2191/4484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:07 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 1462 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:07.667484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:07.688176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:07.724653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.725154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.725588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.741325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.741942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.742420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.856246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:07.865695 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8709c8ae-c0dd-4f7e-bfa4-16dca8378646 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1494 microversion: 2.1 time: 0.621173 Oct 28 17:48:07.876076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2294/4485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:07 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1494 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:07.893049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3d31cd-79e9-41e2-b7ce-8b60059b33ed", "name": "network-vif-deleted", "tag": "92bed01b-4566-4eab-aeb1-8b13e81bd773"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:07.920067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:07.926102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:07.930638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:07.981235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] Creating event network-vif-deleted:92bed01b-4566-4eab-aeb1-8b13e81bd773 for instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed on n-h1-860864-13 Oct 28 17:48:07.986801 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-31810ddf-d56d-4a5e-9b95-3acee25e9b7d req-f93ea83b-61c3-4ca7-8d66-34f14b0fe487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100184 Oct 28 17:48:07.988309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2295/4486] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:08.018120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:08.032333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:08.036620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:08.038592 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c25b2721-1b3e-46e6-a616-7132a26fb201 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.381526 Oct 28 17:48:08.056478 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2192/4487] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:07 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:08.686097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:08.686709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] [instance: ba3d31cd-79e9-41e2-b7ce-8b60059b33ed] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:08.711246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:08.713022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:08.716657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:08.719998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:08.720533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:08.720989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:08.754657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] HTTP exception thrown: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Request method failure captured: Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed HTTP/1.1 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBWqJ1PNDF86eLfzuIxyr2twJxzsMSfEdHW8iN8bYtBV3cH_3XUbTBsRSU-nmpVaDmSKdBJEGEkcL0XuTtu1cSO82wys78Sh57P5pdfgiENTFfE-CE9gjxdgzmOEYn86ibRJZI4SUaGZ-rc9abc0gs7IkW1YyIw78TAqQ6W_AV4r_rg Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7b112212257f4f9a9179c168a117ae83 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesActionsTest-665463885 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b112212257f4f9a9179c168a117ae83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7b112212257f4f9a9179c168a117ae83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7b112212257f4f9a9179c168a117ae83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7b112212257f4f9a9179c168a117ae83"}]}] Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesActionsTest-665463885 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7b112212257f4f9a9179c168a117ae83 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesActionsTest-665463885 Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesActionsTest-665463885-project Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d30ee0c7da914379acf0785da329371d Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesActionsTest-665463885-project Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ba3d31cd-79e9-41e2-b7ce-8b60059b33ed'} Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:08.758454 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] Returning 404 to user: Instance ba3d31cd-79e9-41e2-b7ce-8b60059b33ed could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc4b2496-45c8-4d9a-b8b3-49683618a015 tempest-VolumesActionsTest-665463885 tempest-VolumesActionsTest-665463885-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed" status: 404 len: 111 microversion: 2.1 time: 0.081602 Oct 28 17:48:08.762967 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2193/4488] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:08 2022] GET /compute/v2.1/servers/ba3d31cd-79e9-41e2-b7ce-8b60059b33ed => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:48:08.836234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d10c7f7-a2a0-438c-9856-60eee59c3cbb", "name": "network-vif-deleted", "tag": "b41b6ace-40e7-4652-94a4-71e8872e33aa"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:08.869397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:08.875994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:08.876453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:08.907158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:08.907404 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] Creating event network-vif-deleted:b41b6ace-40e7-4652-94a4-71e8872e33aa for instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb on n-h1-860864-13 Oct 28 17:48:08.910903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:08.930277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:08.948643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:08.949449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d22ea3bf-6820-4716-bae5-5a061bd24495 req-5d34f38a-ad21-4922-b14d-d42afe46cf16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.633820 Oct 28 17:48:08.953677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2296/4489] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:08.954992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:08.958208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:08.966164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:08.968182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:09.069608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:09.070576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:09.083685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:09.084487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:09.087488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:09.088713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:09.089350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:09.091557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:09.111580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:09.116901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:09.117516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:09.120198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lazy-loading 'fault' on Instance uuid 0d10c7f7-a2a0-438c-9856-60eee59c3cbb {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:48:09.275830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:09.294800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:09.301079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:09.304086 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f0cf1e0-ba08-4ed0-92fb-0b8e94b2b6a2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1365 microversion: 2.47 time: 0.238438 Oct 28 17:48:09.306392 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2297/4490] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:09 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:48:09.569935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:09.579995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2241fd71-838e-4981-970c-20210f92cca5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 200 len: 1297 microversion: 2.1 time: 0.682747 Oct 28 17:48:09.603645 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2194/4491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:08 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 1297 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:10.335906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:10.337028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:10.354507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:10.355015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:10.355493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:10.356251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:10.361269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:10.361736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:10.504115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:10.524911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:10.526912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:10.528372 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9824a2fe-15e1-4727-a2b9-15bd15af4b0f tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1371 microversion: 2.47 time: 0.198244 Oct 28 17:48:10.529588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2298/4492] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:10 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:10.610905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:10.611754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:10.630425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:10.633080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:10.636124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:10.637053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:10.637643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:10.638206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:10.669101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb HTTP/1.1 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '0d10c7f7-a2a0-438c-9856-60eee59c3cbb'} Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:10.670850 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:48:10.674954 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:10.677017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:10.679268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26afc1f7-9859-4a9e-b311-9a864737539e tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 404 len: 111 microversion: 2.1 time: 0.073516 Oct 28 17:48:10.684410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2195/4493] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:10 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:48:10.693139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bbe77703-dcc1-4e5f-b4df-c66a5b24f5eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75241fa5e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:11.560477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:11.561149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:11.581157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:11.582186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:11.582618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:11.589736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:11.590659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:11.591486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:11.612313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:12.010046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:12.030533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:12.032049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:12.033455 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19f0da9f-bd2c-4878-85c9-fdde23d2aff9 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1371 microversion: 2.47 time: 0.477296 Oct 28 17:48:12.040353 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2196/4494] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:11 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:12.285331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bbe77703-dcc1-4e5f-b4df-c66a5b24f5eb tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 204 len: 0 microversion: 2.1 time: 1.596590 Oct 28 17:48:12.289262 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2299/4495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:10 2022] DELETE /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 0 bytes in 1598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:12.295310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:12.297828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:12.318898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:12.320584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:12.321226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:12.321771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:12.322512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:12.323011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:12.323535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:12.414183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:12.711150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92e0b5ff-14bf-4e42-a27f-01049435d344 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 204 len: 0 microversion: 2.1 time: 0.420182 Oct 28 17:48:12.719762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2197/4496] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:12 2022] DELETE /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:12.898497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1404098186", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "346f0987-cf5a-4721-a163-faa2306dc2c1"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:13.073506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:13.075009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:13.089917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] validate_networks() for [('346f0987-cf5a-4721-a163-faa2306dc2c1', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:48:13.108755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:13.110726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:13.112090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:13.114078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:13.116167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:13.117407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:13.415198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:13.434916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:13.441818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:13.443549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b70c6fd-4dc0-4252-9263-174afca489d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1371 microversion: 2.47 time: 0.383090 Oct 28 17:48:13.449571 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2198/4497] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:13 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:48:14.477385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:14.478934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:14.501385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:14.502939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:14.505881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:14.506743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:14.511628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:14.512289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:14.858108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:14.884282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:14.891663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:14.900672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8830df65-109d-4942-9894-ebbdfb377554 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1371 microversion: 2.47 time: 0.424104 Oct 28 17:48:14.903804 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2199/4498] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:14 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:48:15.274700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:48:15.275242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:48:15.276225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:48:15.276741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:48:15.278194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:48:15.313426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:15.316132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:15.317564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:15.320234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:15.323952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:15.327714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:15.409070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:48:15.421582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Getting quotas for user 39d2c0db440a49139afebe174d07fd3b and project 7600064bf2164216b4578ab570d8a8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:48:15.462363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:48:15.468020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:48:15.644508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78a48ce7-db81-48e0-9c1a-417da7b60904 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759117 Oct 28 17:48:15.648257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2300/4499] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:48:15.662224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b9248fc-e10f-4e83-bbcf-7db20cf81191 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:15.663457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b9248fc-e10f-4e83-bbcf-7db20cf81191 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:15.844677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4b9248fc-e10f-4e83-bbcf-7db20cf81191 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:15.861582 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b9248fc-e10f-4e83-bbcf-7db20cf81191 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1208 microversion: 2.1 time: 0.197752 Oct 28 17:48:15.864144 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2200/4500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:15 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1208 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:15.933968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:15.934931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:15.965015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:15.967531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:15.968221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:15.973487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:15.975196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:15.981402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:16.293740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:16.321417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:16.330809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:16.340278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6e57524-f637-427a-a40c-55190fd77fdc tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1356 microversion: 2.47 time: 0.411324 Oct 28 17:48:16.366004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2301/4501] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:15 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1356 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:16.375799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:16.383005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:16.387065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Searching by: {'deleted': False, 'project_id': '266abe44e03944648beaf5f0c903aa53'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:48:16.407396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:16.410670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:16.418861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:16.419867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:16.420415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:16.420803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:16.721044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:48:16.889272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:16.890234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:16.912478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:16.912987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:16.922237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:16.923284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:16.925986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:16.926664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.061141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:17.099596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.100191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.106587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.155710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:17.175502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:17.175817 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-181800d9-9e0d-4524-b9c3-f3a6f1618688 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1212 microversion: 2.1 time: 0.284751 Oct 28 17:48:17.180104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:17.180769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2302/4502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:16 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1212 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:17.377292 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3221af3-5360-409a-a133-c6c1e661428a tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.005387 Oct 28 17:48:17.378628 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2201/4503] 10.222.0.48 () {60 vars in 1187 bytes} [Fri Oct 28 17:48:16 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:17.418615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:17.420113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:17.434443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.436577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.438947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.442046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.443563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.445504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.535713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:17.762619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9b47a182-8494-46e7-a4e1-0461e68e20d6 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 204 len: 0 microversion: 2.47 time: 0.349377 Oct 28 17:48:17.764937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2303/4504] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:48:17 2022] DELETE /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:48:17.775858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:17.776538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:17.791535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.792837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.798085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.802314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.802843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.806553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.852966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01019c89-4971-4a51-a38e-af888c97ae29", "name": "network-vif-deleted", "tag": "db41eb4e-8872-4ddf-9365-c425333dbb29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:17.879054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:17.879581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:17.880023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:17.953587 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] Creating event network-vif-deleted:db41eb4e-8872-4ddf-9365-c425333dbb29 for instance 01019c89-4971-4a51-a38e-af888c97ae29 on n-h2-860864-13 Oct 28 17:48:17.966335 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1a419060-f62b-4450-8e9a-ccdaf43ee579 req-72254031-d18e-4017-8b73-404fa8b428b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118932 Oct 28 17:48:17.969744 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2304/4505] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:18.205675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:18.206583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:18.209634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:18.229452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:18.234066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:18.236071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:18.237009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:18.238819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:18.240641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64089b3a-2d59-43ba-83e0-6ee73e5853a7 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1362 microversion: 2.47 time: 0.470943 Oct 28 17:48:18.241086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:18.244720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2202/4506] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:17 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:18.259017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:18.259765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:19.152627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:19.164428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-efe0f343-af6a-4988-86c6-725ef50fc80a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1278 microversion: 2.1 time: 0.963374 Oct 28 17:48:19.174294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2305/4507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:18 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1278 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:19.271989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:19.272381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:19.279931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:19.280436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:19.280888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:19.281598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:19.289486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:19.290390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:19.572206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:19.587208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:19.589210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:19.593779 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-139b9195-bfe7-4414-ae54-5efb7d1f71b1 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1362 microversion: 2.47 time: 0.326563 Oct 28 17:48:19.607945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2203/4508] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:19 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:20.207862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:20.209155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:20.219019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:20.222393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:20.224028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:20.226809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:20.227487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:20.228098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:20.591221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:20.608267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09d5e2b1-51ad-471f-877a-fc778281140a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1266 microversion: 2.1 time: 0.404027 Oct 28 17:48:20.609455 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2306/4509] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:20 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:20.626378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:20.626985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:20.640351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:20.640841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:20.641279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:20.644142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:20.644760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:20.645089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:20.735687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:20.736194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:20.736625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:20.738195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lazy-loading 'fault' on Instance uuid c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:48:20.888665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:20.903640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:20.909045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:20.917944 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50142311-4341-41c4-a733-cb9d00663ae2 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 200 len: 1367 microversion: 2.47 time: 0.292077 Oct 28 17:48:20.920920 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2204/4510] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:20 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:21.637978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:21.638656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:21.651871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:21.653913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:21.654639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:21.655418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:21.657373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:21.657832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:21.903754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:21.922504 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-35571f01-4482-4f32-8f2a-7cd841b9e18d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1266 microversion: 2.1 time: 0.288235 Oct 28 17:48:21.923970 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2307/4511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:21 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:21.955310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:21.955962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:21.970076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:21.970600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:21.971047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:21.972431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:21.972897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:21.973347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:22.036267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] HTTP exception thrown: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Request method failure captured: Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 HTTP/1.1 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBWxjrsY730Lpoghtnqmk1oaesQai_2K3vbFT2BVEiKlsa_SiMB-eU8mYB4YGLFoiZMpiuPh2mxof3vQKPH3O8BwobVnbflMjxMQkcIHJZYz5pPdnU88KjCOGY_1xvZV-CktRXwW95OF15nE_5WQZBzbET30qV0TKrt2zxkXEEFbmaw Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 266abe44e03944648beaf5f0c903aa53 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/266abe44e03944648beaf5f0c903aa53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/266abe44e03944648beaf5f0c903aa53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_266abe44e03944648beaf5f0c903aa53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/266abe44e03944648beaf5f0c903aa53"}]}] Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 266abe44e03944648beaf5f0c903aa53 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerShowV247Test-1372200478-project Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 192c1929e15a4c19b7ee87075abcbdcd Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerShowV247Test-1372200478-project Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4'} Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:22.038010 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Returning 404 to user: Instance c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:22.042279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-360671ff-9758-4b62-933d-8a21dfe97552 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4" status: 404 len: 111 microversion: 2.47 time: 0.089895 Oct 28 17:48:22.042859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2205/4512] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:21 2022] GET /compute/v2.1/servers/c91b7f1e-23b1-47c6-8fc7-bf2bf8e29cd4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:48:22.049088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:22.049604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:22.063446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:22.067810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:22.071711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:22.072852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:22.074851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:22.077512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:22.138759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:22.249512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:22.328422 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dfa4ca03-159f-49a2-b52c-bb0a48d9e4d3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 204 len: 0 microversion: 2.47 time: 0.283689 Oct 28 17:48:22.332711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2308/4513] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:48:22 2022] DELETE /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:48:22.339253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:22.340132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:22.350616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:22.351117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:22.351601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:22.372780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:22.373411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:22.373848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:22.705749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:22.715184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:22.735972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:22.738291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63f528bc-20dd-44cb-9852-a115c112d4fa tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 200 len: 1362 microversion: 2.47 time: 0.403243 Oct 28 17:48:22.738870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2206/4514] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:22 2022] GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 1362 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:22.949713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:22.951113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:23.002142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:23.005313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:23.006090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:23.011566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:23.012303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:23.015743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:23.770832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:23.771508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:23.787484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:23.788277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:23.789625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:23.791589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:23.793356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:23.795546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:23.997951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:24.018912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:24.023429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:24.030693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b7d1a554-c6f8-4f80-ad7b-e01cb0a24258 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 200 len: 1362 microversion: 2.47 time: 0.263130 Oct 28 17:48:24.032548 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2207/4515] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:23 2022] GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:24.171615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:24.182147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ec78191-d0f4-4dd0-81ca-bea27e39d603 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.239122 Oct 28 17:48:24.185763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2309/4516] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:22 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:25.061488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:25.062322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:25.083289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:25.083821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:25.084263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:25.084985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:25.089200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:25.090040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:25.188279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:25.190616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:25.191444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:25.191808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lazy-loading 'fault' on Instance uuid 3ef1707d-d492-4e81-8b30-cc79390eb085 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:48:25.214545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:25.216189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:25.228897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:25.230807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:25.232719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:25.233771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:25.236380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:25.236981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:25.400055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:25.447709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:25.878359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:25.924555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:25.936483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '192c1929e15a4c19b7ee87075abcbdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '266abe44e03944648beaf5f0c903aa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:25.942662 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8d79794-9c98-4310-aedf-9c1ffc5e52d8 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 200 len: 1367 microversion: 2.47 time: 0.883871 Oct 28 17:48:25.949550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2208/4517] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:25 2022] GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 1367 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:26.635855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:26.646103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7ace9c9-a2a9-48ec-856f-c52c46634be8 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.436383 Oct 28 17:48:26.649089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2310/4518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:25 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:26.982010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:26.984226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] [instance: 3ef1707d-d492-4e81-8b30-cc79390eb085] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:26.987807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:27.006498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:27.007249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:27.007978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:27.009192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:27.009926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:27.010570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:27.049492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:27.053228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] HTTP exception thrown: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Request method failure captured: Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 HTTP/1.1 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBWxjrsY730Lpoghtnqmk1oaesQai_2K3vbFT2BVEiKlsa_SiMB-eU8mYB4YGLFoiZMpiuPh2mxof3vQKPH3O8BwobVnbflMjxMQkcIHJZYz5pPdnU88KjCOGY_1xvZV-CktRXwW95OF15nE_5WQZBzbET30qV0TKrt2zxkXEEFbmaw Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 266abe44e03944648beaf5f0c903aa53 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/266abe44e03944648beaf5f0c903aa53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/266abe44e03944648beaf5f0c903aa53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_266abe44e03944648beaf5f0c903aa53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/266abe44e03944648beaf5f0c903aa53"}]}] Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 266abe44e03944648beaf5f0c903aa53 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerShowV247Test-1372200478 Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerShowV247Test-1372200478-project Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 192c1929e15a4c19b7ee87075abcbdcd Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerShowV247Test-1372200478-project Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3ef1707d-d492-4e81-8b30-cc79390eb085'} Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:27.064658 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] Returning 404 to user: Instance 3ef1707d-d492-4e81-8b30-cc79390eb085 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:27.070932 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe07dd36-3f70-4810-91c4-3f71980d9cf3 tempest-ServerShowV247Test-1372200478 tempest-ServerShowV247Test-1372200478-project] 10.222.0.48 "GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085" status: 404 len: 111 microversion: 2.47 time: 0.092873 Oct 28 17:48:27.076476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2209/4519] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:26 2022] GET /compute/v2.1/servers/3ef1707d-d492-4e81-8b30-cc79390eb085 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:48:27.670671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:27.671285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:27.682889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:27.683395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:27.683836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:27.684541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:27.684988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:27.685405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:28.327923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:28.338806 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39eb91de-a016-45c5-8f7f-ffc4d009b2d7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 0.671914 Oct 28 17:48:28.341533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2311/4520] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:27 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:28.999919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4", "tag": "d8fed538-534a-4ed1-84cc-4d7b3e960ec6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:29.035139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:29.036093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:29.039239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:29.083241 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] Creating event network-changed:d8fed538-534a-4ed1-84cc-4d7b3e960ec6 for instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 on n-h1-860864-13 Oct 28 17:48:29.102191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e6f15507-4242-471c-8e2b-514b181fd202 req-bd32a054-b759-4db8-8b98-830ca7d58058 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107612 Oct 28 17:48:29.103919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2210/4521] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:29.368879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:29.369786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:29.385411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:29.386705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:29.387342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:29.388398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:29.389307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:29.389899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:29.390732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1728333234", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "6b1c44cb-d254-4ea0-b58e-8cb166dc4d69"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:29.520649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] validate_networks() for [('6b1c44cb-d254-4ea0-b58e-8cb166dc4d69', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:48:30.278525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:30.293161 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97e5598f-70a2-4aaa-b096-ecb078d20746 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 0.929775 Oct 28 17:48:30.298047 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2211/4522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:29 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:31.347923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:31.351335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:31.385987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:31.386856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:31.387525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:31.390074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:31.392456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:31.394163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:32.662664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:48:32.663628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:48:32.664276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:48:32.664840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:48:32.666137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:48:32.668526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:32.676432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:32.682129 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a60bf707-52fc-4054-963a-4bc48c08ded4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.362200 Oct 28 17:48:32.683119 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2212/4523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:31 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:32.686498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:32.686989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:32.695016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:32.695960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:32.696437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:32.696877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:32.741396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Getting quotas for project 78b9da565f6d4d92b7c29ae2b9f6cfc8. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:48:32.748921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Getting quotas for user eb3a9d6c1d0f4c099a78c0257b441332 and project 78b9da565f6d4d92b7c29ae2b9f6cfc8. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:48:32.778079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:48:32.781174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:48:32.903093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a60425f4-0118-4d60-9c40-e96719754af8 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.887286 Oct 28 17:48:32.912289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2312/4524] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:48:32.944123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81a3c79a-5699-4c2a-ad19-1c498b2f5110"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:32.946636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:32.966669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:32.968858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:32.969942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:32.972605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:32.974361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:32.975798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:33.042371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2092714353", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:33.181361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:48:33.182991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:48:33.185081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:48:33.185657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:48:33.186072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:48:33.231675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:33.234470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:33.235118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:33.238197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:33.238982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:33.241078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:33.295421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Getting quotas for project 1d7d988b78024612b01f128770992a6c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:48:33.314359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Getting quotas for user 10533003763d479abd80fed1ec210268 and project 1d7d988b78024612b01f128770992a6c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:48:33.355021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:48:33.363991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:48:33.503602 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-729cbbc6-b296-4a00-b04a-94c7c54d3adb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.818496 Oct 28 17:48:33.504279 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2213/4525] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:48:33.527708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56094b5e-880d-4b72-8fae-08e41b8646da tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:33.529150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56094b5e-880d-4b72-8fae-08e41b8646da tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:33.619137 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0351cda-6ee7-4c37-a255-d3f6e118b9c9 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "POST /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699889 Oct 28 17:48:33.629036 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2313/4526] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:48:32 2022] POST /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:33.644279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:33.645616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:33.927638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:33.937895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:33.945325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:33.948260 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-175f24f4-bcc5-4423-8573-b0330930c60d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1278 microversion: 2.54 time: 0.317451 Oct 28 17:48:33.950542 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2314/4527] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:33 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1278 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:33.963222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:33.966328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:33.981866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:33.990405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:33.991255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:33.992054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:33.993400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:33.994314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:33.995860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:34.012858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56094b5e-880d-4b72-8fae-08e41b8646da tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:34.038608 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56094b5e-880d-4b72-8fae-08e41b8646da tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1228 microversion: 2.1 time: 0.520704 Oct 28 17:48:34.039350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2214/4528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:33 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1228 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:34.984474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:34.985105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:35.003280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:35.003688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:35.011231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:35.012216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:35.012846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:35.013429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:35.648298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:35.663098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:35.677792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1160b874-9864-467c-b4f7-c78aa63b83e5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.722991 Oct 28 17:48:35.680342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2315/4529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:33 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:35.692834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:35.695009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:35.700027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:35.700942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:35.706549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0c89fdf-c8cf-4439-a9ab-de0d1e0cba98 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1274 microversion: 2.54 time: 0.724620 Oct 28 17:48:35.710109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2215/4530] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:34 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1274 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:35.731960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:35.736343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:35.737233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:35.743067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:35.745103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:35.746994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:36.162241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:36.173979 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de5daed3-38cc-49c3-8ae4-29b9aabe75ee tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1280 microversion: 2.1 time: 0.488044 Oct 28 17:48:36.175797 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2316/4531] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:35 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:36.704607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:36.707639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:36.737109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:36.738012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:36.739977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:36.741032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:36.743527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:36.744228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:36.744679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:36.745206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:36.757078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:36.759498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:36.760186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:36.763445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:36.764172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:36.764802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:37.049157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:37.063948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:37.069812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:37.075165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a70f5e5-51f4-4c4b-8802-070ae06d8566 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1336 microversion: 2.54 time: 0.332885 Oct 28 17:48:37.097710 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2317/4532] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:36 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1336 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:37.201553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:37.202185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:37.215918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:37.216415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:37.216850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:37.227256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:37.232036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:37.232777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:37.480015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:37.488810 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-819ee3ec-7c47-4ad9-8ba0-8aaf203d6a2f tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1286 microversion: 2.1 time: 0.290990 Oct 28 17:48:37.499739 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2318/4533] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:37 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1286 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:37.700181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:37.715728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.016128 Oct 28 17:48:37.720731 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2216/4534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:36 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:38.107784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:38.108837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:38.125632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.126144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.126586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.127312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.131231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.131802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.324640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:38.327075 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4005ee08-2706-4512-bb5c-bb7def2cce8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001711 Oct 28 17:48:38.337525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2217/4535] 10.222.0.48 () {56 vars in 886 bytes} [Fri Oct 28 17:48:38 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 17:48:38.539044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:38.540060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:38.552975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.553145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:38.553859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.555892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.558546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.559223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.562082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.571323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:38.578949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:38.585586 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-362c6ed8-00af-4167-a52b-7f1fb3e0d5f9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1336 microversion: 2.54 time: 0.480682 Oct 28 17:48:38.588511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2319/4536] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:38 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1336 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:38.743149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:38.744100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:38.755447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.755967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.756449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.757155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:38.757625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:38.758077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:38.799449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:38.813529 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65800a7d-09f5-40eb-9636-6846a78bbcf1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1286 microversion: 2.1 time: 0.300767 Oct 28 17:48:38.815517 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2218/4537] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:38 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1286 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:39.407087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:39.424127 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bdc78780-a991-4e0a-b05d-0ff9e1d06556 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 0.685642 Oct 28 17:48:39.425505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2320/4538] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:38 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:39.636909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:39.637878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:39.645968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:39.646800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:39.647514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:39.648448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:39.649123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:39.649892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:39.838291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:39.838915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:39.853640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:39.854153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:39.859675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:39.860573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:39.861063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:39.861504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:40.076125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:40.089244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:40.091137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:40.093985 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df2f52b6-baf5-48cd-a732-5b2ae98fd7fb tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1336 microversion: 2.54 time: 0.479141 Oct 28 17:48:40.100472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2219/4539] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:39 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1336 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:40.111240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:40.128348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d169c9d-5f11-410d-a119-091cdb3fc0b1 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1286 microversion: 2.1 time: 0.293636 Oct 28 17:48:40.130177 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2321/4540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:39 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1286 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:40.468693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:40.469792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:40.488940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:40.491087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:40.495762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:40.496816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:40.497489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:40.498148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:41.131678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:41.132291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:41.164439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:41.166786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:41.168844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:41.170025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:41.171169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:41.171955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.156516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:42.167439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ec8fcdd-dfb0-4399-89ae-1d6ff5275ee6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.703493 Oct 28 17:48:42.168154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:42.177019 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2220/4541] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:40 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:42.182980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:42.187463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:42.188553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:42.190001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d21dc29e-b535-4a5d-bf85-d2fabc8c0634 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1357 microversion: 2.54 time: 1.065155 Oct 28 17:48:42.190605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2322/4542] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:41 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1357 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:42.204933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:42.226770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-333f18ce-00c7-4ec3-915e-0f45a6b5a4e8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Action: 'create', calling method: .version_select at 0x7f75241d6ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2052479861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZjHOcGbpp3l2mSX1d0PtktU9aX2jXKxQcp4y1UT9pX2NKYpX2V1aqF9HBzffUh2HG2AmjCiC0ahy6NDgDARPUJpYGVh6/wjQGVJSVkHe81G7lHC7Pw6qbFKboGYR9DCA=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:42.233969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.234848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.235471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.237931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.245244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.245963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.267865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-333f18ce-00c7-4ec3-915e-0f45a6b5a4e8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Getting quotas for project 1d7d988b78024612b01f128770992a6c. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:48:42.282068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-333f18ce-00c7-4ec3-915e-0f45a6b5a4e8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Getting quotas for user 10533003763d479abd80fed1ec210268 and project 1d7d988b78024612b01f128770992a6c. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:48:42.348531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-333f18ce-00c7-4ec3-915e-0f45a6b5a4e8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.126464 Oct 28 17:48:42.349868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2323/4543] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:48:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 17:48:42.380338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2052479861", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:42.385644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:42.403758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.406266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.406751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.409210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.410268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.410617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.577784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:48:42.578207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:48:42.578688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:48:42.579094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:48:42.579535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:48:42.752961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:42.803377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:42.827346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.827877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.828316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.833044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.833585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.834034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:42.849131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:42.906939 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-373c3758-3b2e-4678-8202-467dde8d9917 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "POST /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c/action" status: 202 len: 1140 microversion: 2.54 time: 0.532017 Oct 28 17:48:42.909229 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2324/4544] 10.222.0.48 () {62 vars in 1320 bytes} [Fri Oct 28 17:48:42 2022] POST /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c/action => generated 1140 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 17:48:42.921808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4", "name": "network-vif-plugged", "status": "completed", "tag": "d8fed538-534a-4ed1-84cc-4d7b3e960ec6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:42.954877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:42.960311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:42.961650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:43.060434 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] Creating event network-vif-plugged:d8fed538-534a-4ed1-84cc-4d7b3e960ec6 for instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 on n-h1-860864-13 Oct 28 17:48:43.087971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9b81a659-4bfc-4c8f-ace4-c14f59fc0f60 req-5eee84e0-5f9a-44bf-a8bc-34365a140ade service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176542 Oct 28 17:48:43.088684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2325/4545] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:43.122712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:43.124190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:43.149008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:43.150315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:43.154306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:43.156233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:43.159996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:43.160671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:43.273858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:43.717388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:43.741013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:43.742369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:43.744568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5de0a38-0d17-4d0e-a583-77a956dfe903 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.641205 Oct 28 17:48:43.747933 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2326/4546] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:43 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:43.757521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:43.760621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:43.801940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:43.807252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:43.819106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:43.820265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:43.823345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:43.824132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:43.906436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:43.920964 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6cc07c31-8c2d-4abf-bc58-4ee35051a75c tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 1.742248 Oct 28 17:48:43.925476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2221/4547] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:42 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:44.351018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:44.364614 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-04f4e104-cb51-46fa-8e45-4aa9c74d7962 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 0.614552 Oct 28 17:48:44.367484 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2327/4548] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:43 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:44.717392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb47fbeb-fd49-42f9-8833-5c8c16e7df6e", "tag": "0f119de3-7914-4bd6-bd1c-98d188cabcd9"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:44.722585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:44.724150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:44.744364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:44.745242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:44.745865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:44.769049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] Creating event network-changed:0f119de3-7914-4bd6-bd1c-98d188cabcd9 for instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e on n-h2-860864-13 Oct 28 17:48:44.776612 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6ccffdcb-cfe0-4200-8604-fc9c9234eb10 req-3551b3e8-4776-4209-b5ff-0b7ae107c0a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063120 Oct 28 17:48:44.779736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2222/4549] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:48:44.779929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:44.780551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:44.796940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:44.799012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:44.802011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:44.802813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:44.803274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:44.809238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:44.965773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:44.966962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:45.007783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:45.012589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:45.013687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:45.017223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:45.018757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:45.021505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:45.027614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:45.048741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:45.051600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:45.068592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07a81101-9747-4232-a347-ee7ecdcb6ad8 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.293692 Oct 28 17:48:45.076122 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2328/4550] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:44 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:45.389651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:45.390554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:45.436590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:45.439812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:45.443138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:45.450021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:45.450616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:45.451601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:46.734492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:46.743539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-14cf4012-20a1-4fc5-9639-932d0849b9b3 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1308 microversion: 2.1 time: 1.358956 Oct 28 17:48:46.744922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:46.747973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2329/4551] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:45 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1308 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:46.759190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:46.762858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:46.770601 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f740a44f-35ee-4f42-b5f9-7fcb80f7fae6 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 1.820933 Oct 28 17:48:46.775048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2223/4552] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:44 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:46.781057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:46.786208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:46.786825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:46.787911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:46.788533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:46.789122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:46.943800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:46.955162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:46.961272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:46.962503 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ea8b3c3-2410-43e4-b5b3-26e10725d7cd tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.208465 Oct 28 17:48:46.963079 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2330/4553] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:46 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:47.775501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:47.776763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:47.794825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:47.796094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:47.803296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:47.805432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:47.805841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:47.806614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:47.807093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:47.811814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:47.828267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:47.829889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:47.831166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:47.837325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:47.839430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:47.840090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:48.479719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:48.501268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f512488d-f3ff-486e-b5b1-7c21b33ebda6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1488 microversion: 2.1 time: 0.723387 Oct 28 17:48:48.501948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2224/4554] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:47 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1488 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:48.510697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:48.525152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:48.542270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:48.544858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:48.546835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:48.547782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:48.549678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:48.552194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:48.880669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:48.894891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe7475b9-f022-46ee-b9ba-316fa355a3e4 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 1.096361 Oct 28 17:48:48.895632 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2331/4555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:47 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:48.918395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1555339123"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:48.927893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:48.944178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:48.945679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:48.946731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:48.949095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:48.950233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:48.950899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:48.952223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:48.967345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:48.969164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:48.970565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1dba44ad-2c32-42b7-b1b0-71948c9c6806 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.463770 Oct 28 17:48:48.971943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2225/4556] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:48 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:49.445448 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b55f0560-8b4e-4609-bd49-3280aec347f2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "POST /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.548354 Oct 28 17:48:49.446124 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2332/4557] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:48:48 2022] POST /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 17:48:49.459528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-636aa5aa-e45b-4a73-99bd-39a904eaba51 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75243bcd30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:49.542872 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-636aa5aa-e45b-4a73-99bd-39a904eaba51 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0" status: 200 len: 1412 microversion: 2.1 time: 0.088169 Oct 28 17:48:49.544093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2226/4558] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:48:49 2022] GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:49.562059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9089d0c-99af-447c-9b7d-401f688db656 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75244d1430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:49.635145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d9089d0c-99af-447c-9b7d-401f688db656 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0" status: 200 len: 1412 microversion: 2.1 time: 0.078367 Oct 28 17:48:49.636176 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2333/4559] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:48:49 2022] GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:49.657826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e04e1ce2-d46d-4443-9b54-8537d0017b68 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f752863c4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:49.917105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e04e1ce2-d46d-4443-9b54-8537d0017b68 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0" status: 204 len: 0 microversion: 2.1 time: 0.265819 Oct 28 17:48:49.918285 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2227/4560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:49 2022] DELETE /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:49.925844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:49.926498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:49.928325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7315da6f-25b2-4e92-b272-aadba91f38ba tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751fa4b940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:49.944402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:49.945030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:49.945566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:49.946385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:49.946930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:49.947450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:49.964791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-7315da6f-25b2-4e92-b272-aadba91f38ba tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7315da6f-25b2-4e92-b272-aadba91f38ba tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 HTTP/1.1 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a610f8ac-5a83-4228-986c-ed867b1c30e0'} Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a610f8ac-5a83-4228-986c-ed867b1c30e0 Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 17:48:49.968045 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a610f8ac-5a83-4228-986c-ed867b1c30e0 could not be found. Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:48:49.975525 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:49.988783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7315da6f-25b2-4e92-b272-aadba91f38ba tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:49.994262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7315da6f-25b2-4e92-b272-aadba91f38ba tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0" status: 404 len: 62 microversion: 2.1 time: 0.069841 Oct 28 17:48:49.995359 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2228/4561] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Oct 28 17:48:49 2022] GET /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:48:50.005943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:50.006962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:50.016330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:50.016826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:50.017261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:50.018995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:50.020084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:50.021314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:50.384402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:50.398505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:50.405764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:50.413319 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b561f55d-ea7e-493d-9a1e-f7d7e12777b1 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.416507 Oct 28 17:48:50.417120 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2229/4562] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:49 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:50.440479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:50.441329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:50.466864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:50.467471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:50.468006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:50.468686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:50.469148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:50.469712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:50.643722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:50.651927 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cddca5bd-c6cc-4ff6-b501-ebea402f89bf tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 0.736381 Oct 28 17:48:50.652675 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2334/4563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:49 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:50.856138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:50.872028 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84bb8672-f06d-45eb-9756-1121aade10f4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1500 microversion: 2.1 time: 0.453719 Oct 28 17:48:50.872625 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2230/4564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:50 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1500 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:51.448107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:51.449703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:51.475227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.477771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.479047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:51.484692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.486009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.489368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:51.677926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:51.678701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:51.692149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.692656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.693098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:51.693816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.696046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.696726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:51.774822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:51.792184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:51.800223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:51.804123 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34dc412b-0aa0-4bd4-b79c-87e39b64def7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.363505 Oct 28 17:48:51.808180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2335/4565] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:51 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:51.901723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:51.902498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:51.923262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.923262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.923804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:51.928518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:51.929082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:51.929544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:52.243453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:52.258378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e9d28b5-70f6-471f-9f10-6ff1a350450d tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 0.583109 Oct 28 17:48:52.261369 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2231/4566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:51 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:52.301100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:52.304279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:52.317234 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d27c53b8-8608-4184-9acd-059a419ddb1f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1506 microversion: 2.1 time: 0.423950 Oct 28 17:48:52.319738 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2336/4567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:51 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:52.836596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:52.838749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:52.854829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:52.856918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:52.860288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:52.861072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:52.861702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:52.862579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:52.954595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:52.958167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:52.972231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:52.975985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:52.977329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:52.979606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:52.981832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:52.982455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:53.081388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:53.097229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:53.098694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:53.120676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5dbf9ca6-40e6-420f-bbed-a91e221efb1e tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.289950 Oct 28 17:48:53.122670 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2337/4568] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:52 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:48:53.227837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] HTTP exception thrown: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Request method failure captured: Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments/81a3c79a-5699-4c2a-ad19-1c498b2f5110 HTTP/1.1 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 74 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBV5nbvEmtl4aY3TCULBxQVRMZzyRidAnRZAcHvo96hJaB3yYLu2gTq9zNYoWtOYv1k5BVUxie382xrpPY1jLJZq1EK-IDEmKumeW0XQ3mYoPQg7PHbBXzvobv-S0tg0B_Pia1TU0iVT_cCKHZm92SB72FuYiU7rIPsIvUlAN-iuCNM Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bff5ae02ee9441668df44b4968091bfc Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bff5ae02ee9441668df44b4968091bfc"}]}] Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bff5ae02ee9441668df44b4968091bfc Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesAdminNegativeTest-56179546-project-admin Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7528b0a062fb4761b03db4a139f3ea4d Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesAdminNegativeTest-56179546-project-admin Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: {"volumeAttachment": {"volumeId": "ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6"}} Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: exception: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '53932c26-fc07-49e1-a386-ed0e935144ef', 'id': '81a3c79a-5699-4c2a-ad19-1c498b2f5110', 'body': {'volumeAttachment': {'volumeId': 'ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6'}}} Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. (HTTP 404) (Request-ID: req-eed8d68a-7c1b-4321-b77a-1639f438f6e2) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:48:53.263753 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. Oct 28 17:48:53.280356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:53.287443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:53.287443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:53.287761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Returning 400 to user: Volume ba07667a-ceb9-46f0-bb28-8c66a2e5f9b6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:53.288355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6208cdce-50f3-4bb3-9b4d-5de6c70006dd tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments/81a3c79a-5699-4c2a-ad19-1c498b2f5110" status: 400 len: 107 microversion: 2.1 time: 0.793436 Oct 28 17:48:53.288940 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2232/4569] 10.222.0.48 () {60 vars in 1433 bytes} [Fri Oct 28 17:48:52 2022] PUT /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments/81a3c79a-5699-4c2a-ad19-1c498b2f5110 => generated 107 bytes in 795 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:48:53.317115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:53.317961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:53.318689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:53.319839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:53.323453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:53.324281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:53.351056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:53.351714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:53.365579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:53.366398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:53.368263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:53.376319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:53.377240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:53.378040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.116430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:54.135398 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f2b6539-e8ba-4b55-a6b5-bbbfa51b590a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1506 microversion: 2.1 time: 0.794263 Oct 28 17:48:54.137010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2233/4570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:53 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1506 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:54.138209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:54.144011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:54.144767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:54.153592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.154485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.154713 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6803b403-a5cb-40d3-ad8a-3374bbca1742 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 0.873762 Oct 28 17:48:54.155513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.156585 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2338/4571] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:53 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:54.157504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.158162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.159587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.356711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lazy-loading 'services' on Instance uuid 53932c26-fc07-49e1-a386-ed0e935144ef {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:48:54.542536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ec6fec5-758b-41b3-a47a-e6e0cff0c0fb tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments/81a3c79a-5699-4c2a-ad19-1c498b2f5110" status: 202 len: 0 microversion: 2.1 time: 0.404017 Oct 28 17:48:54.543486 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2234/4572] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:48:54 2022] DELETE /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments/81a3c79a-5699-4c2a-ad19-1c498b2f5110 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:48:54.564319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:54.570355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:54.586318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.586824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.588819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.590162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.592100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.597137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.646300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:54.750060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47fbeb-fd49-42f9-8833-5c8c16e7df6e", "name": "network-vif-plugged", "status": "completed", "tag": "0f119de3-7914-4bd6-bd1c-98d188cabcd9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:54.777104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.779437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.780781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.818443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:54.838217 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] Creating event network-vif-plugged:0f119de3-7914-4bd6-bd1c-98d188cabcd9 for instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e on n-h2-860864-13 Oct 28 17:48:54.839347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:54.844822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:54.846784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55c856b3-e6bd-4109-8873-147740534088 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.300261 Oct 28 17:48:54.866152 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2235/4573] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:54 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:54.874318 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b87d79a2-9b35-4c8e-8b3e-acddeda27a80 req-e5ed6d11-6756-48e0-8a17-8c5efb96d05b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.714928 Oct 28 17:48:54.879720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2339/4574] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:54.883459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:54.887491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:54.900784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.901283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.901715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:54.905950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:54.906457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:54.910865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:55.001697 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e2439a4-cd60-4ed3-956e-3240153fdac0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117650 Oct 28 17:48:55.008925 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2236/4575] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:48:54 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:55.162056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:55.163648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:55.175079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:55.177691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:55.178862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:55.180008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:55.187625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:55.190353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:55.195454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:55.201750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:55.212078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:55.215885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:55.215885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:55.216064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:55.219790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:55.231722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:56.166718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:56.176606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0add4522-5643-4ff0-be22-019a26b2eb92 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1328 microversion: 2.1 time: 0.994357 Oct 28 17:48:56.191973 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2237/4576] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:55 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1328 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:56.209585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:56.216191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:56.219534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:56.222606 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ceb334d-eeaa-4db0-8552-a282a1e42c2a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1506 microversion: 2.1 time: 1.066172 Oct 28 17:48:56.225000 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2340/4577] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:55 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1506 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:56.244947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:56.246836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:56.256351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:56.257087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:56.258057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:56.258714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:56.259020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:56.261414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:56.277602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:56.280645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:56.281363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:56.283868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:56.284611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:56.285255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:56.410479 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08fc3ec7-411b-43f6-9007-096e3462b413 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183609 Oct 28 17:48:56.411081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2341/4578] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:48:56 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:56.483170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:56.500015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:56.506938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:56.511045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bead75a6-8153-4200-b484-4aa738b65f85 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.317262 Oct 28 17:48:56.514415 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2238/4579] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:56 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:57.206169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:57.207309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:57.222813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.224654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.225348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:57.226310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.226989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.227652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:57.237746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:48:57.254690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:57.256254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:57.275889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.278618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.280311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:57.282391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.282983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.285220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:57.919842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:57.930032 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c8e27a8-4f8e-4860-84e8-d033e59c0020 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1528 microversion: 2.1 time: 0.729250 Oct 28 17:48:57.935457 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2342/4580] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:57 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1528 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:57.957385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:57.969439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:57.983317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.988108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.988773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:57.991537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:57.993223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:57.993939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:57.995204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.003062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d71a628a-eca4-4f56-a6a8-3c08f1440a3f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1488 microversion: 2.1 time: 0.756746 Oct 28 17:48:58.009680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2239/4581] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:57 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1488 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:48:58.021670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.023138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:58.040498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.041278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.042716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.047072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.047809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.048469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.094914 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b918dce-ebb9-49c5-970c-f4bce3907a0a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152708 Oct 28 17:48:58.098598 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2343/4582] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:48:57 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:58.113485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.114542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:58.130325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.133733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.136278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.140135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.140831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.141556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.215063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:58.231495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:58.238005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:58.239265 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66257662-f936-4af1-9ae2-3074a5f99b0b tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.228225 Oct 28 17:48:58.256066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2240/4583] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:58 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:58.264398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.265153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:58.273601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.274292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.274900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.275824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.276597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.277190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.338741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:58.534188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2022e886-12cd-4302-a97b-ea54025002bd tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 204 len: 0 microversion: 2.1 time: 0.276139 Oct 28 17:48:58.535516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2241/4584] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:58 2022] DELETE /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:48:58.546523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4", "name": "network-vif-plugged", "status": "completed", "tag": "d8fed538-534a-4ed1-84cc-4d7b3e960ec6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:58.566984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.570207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.570975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.591713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:58.601567 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] Creating event network-vif-plugged:d8fed538-534a-4ed1-84cc-4d7b3e960ec6 for instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 on n-h1-860864-13 Oct 28 17:48:58.605169 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d9369694-620a-4a02-a65f-4b4964d9f900 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1528 microversion: 2.1 time: 0.500740 Oct 28 17:48:58.606263 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2344/4585] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:58 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1528 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:58.622569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e28008ad-3ee7-4da8-b4a8-20259742d4f5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f8429d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.632606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-742f270a-749f-4fef-9b49-be3b580e47dc req-effc3331-25fd-448c-b0f5-dc0a7e4d52de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095415 Oct 28 17:48:58.633439 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2242/4586] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:58.694444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e28008ad-3ee7-4da8-b4a8-20259742d4f5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e28008ad-3ee7-4da8-b4a8-20259742d4f5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 HTTP/1.1 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a610f8ac-5a83-4228-986c-ed867b1c30e0'} Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a610f8ac-5a83-4228-986c-ed867b1c30e0 to delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a610f8ac-5a83-4228-986c-ed867b1c30e0 could not be found. Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.698502 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:48:58.702635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:58.709319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e28008ad-3ee7-4da8-b4a8-20259742d4f5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:58.710349 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e28008ad-3ee7-4da8-b4a8-20259742d4f5 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0" status: 404 len: 62 microversion: 2.1 time: 0.102724 Oct 28 17:48:58.710943 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2345/4587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:58 2022] DELETE /compute/v2.1/images/a610f8ac-5a83-4228-986c-ed867b1c30e0 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:48:58.724093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.725033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:58.735139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.735918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.736569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.737482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.738099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.738717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.780712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:48:58.889607 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.compute.api [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Instance is already in deleting state, ignoring this request Oct 28 17:48:58.893640 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72cd2d21-76ab-412e-addc-6ffd6ec1c94d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 204 len: 0 microversion: 2.1 time: 0.177970 Oct 28 17:48:58.896462 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2346/4588] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:58 2022] DELETE /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:48:58.905918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:58.908267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:58.922701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.925915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.926688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:58.929784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:58.930738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:58.933140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.186434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:59.187019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.208304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.208534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.211306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.212084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.212548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.212981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.264882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] HTTP exception thrown: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Request method failure captured: Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e HTTP/1.1 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBXs4vIK7X_qCtX45WHn1l6JqqT3o0eY6aPKbKZVoiVBJacKQC-ZJGtKKAIjmz3rznuEw3wungbfqG7-ZDHDhBYzYXEu4AwKMHeyuYASp5p8lgs8m5JaUs7lW7t5T-5Jlcrxw-te5g3O7_HyppGSLUYEYxtuvaZmuLNMJQWoymp9ysE Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7c29e4e50e50492780f2bdc5e5bb22f3 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c29e4e50e50492780f2bdc5e5bb22f3"}]}] Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7c29e4e50e50492780f2bdc5e5bb22f3 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1166460917-project Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ac3d6fec9f1d45a599ce91e42819b41b Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917-project Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'cb47fbeb-fd49-42f9-8833-5c8c16e7df6e'} Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:59.269216 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.273987 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.278063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Returning 404 to user: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:59.280083 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64f5f1e1-736e-428d-a5ca-2d0a9fdac901 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 404 len: 111 microversion: 2.1 time: 0.645386 Oct 28 17:48:59.284862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2243/4589] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:58 2022] DELETE /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 111 bytes in 650 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:48:59.295753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:59.298711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.323479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.324260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.324913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.332897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:59.333475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.334587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.335262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.353408 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a441a23-83b4-4b03-8cfd-3694b4bf018d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1494 microversion: 2.1 time: 0.440001 Oct 28 17:48:59.357550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2347/4590] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:58 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1494 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:59.381550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:59.382967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.410597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.413155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.413778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.414893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.416710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.418520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.419855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4519e380-274d-4490-a442-abdc5eee73b7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134398 Oct 28 17:48:59.422930 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2244/4591] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:48:59 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:48:59.432271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:59.435216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.450925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.451616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.452136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.452946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.459793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.461015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.702411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:59.717907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:59.739385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:59.740652 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a89de376-bc6e-4ee5-89d9-fa020e01ce10 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.381662 Oct 28 17:48:59.741423 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2348/4592] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:48:59 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:48:59.828066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:48:59.843827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3024ecff-68ae-4b90-b612-1f63a8684a79 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1528 microversion: 2.1 time: 0.419671 Oct 28 17:48:59.844717 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2245/4593] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:48:59 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1528 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:48:59.879999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Action: 'update', calling method: >, body: {"server": {"name": "cb47fbeb-fd49-42f9-8833-5c8c16e7df6e_new"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:48:59.884039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.892727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.893300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.893746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.894470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.894923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.895350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.911178 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] HTTP exception thrown: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Request method failure captured: Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e HTTP/1.1 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 64 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBXs4vIK7X_qCtX45WHn1l6JqqT3o0eY6aPKbKZVoiVBJacKQC-ZJGtKKAIjmz3rznuEw3wungbfqG7-ZDHDhBYzYXEu4AwKMHeyuYASp5p8lgs8m5JaUs7lW7t5T-5Jlcrxw-te5g3O7_HyppGSLUYEYxtuvaZmuLNMJQWoymp9ysE Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7c29e4e50e50492780f2bdc5e5bb22f3 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7c29e4e50e50492780f2bdc5e5bb22f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7c29e4e50e50492780f2bdc5e5bb22f3"}]}] Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7c29e4e50e50492780f2bdc5e5bb22f3 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917 Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1166460917-project Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ac3d6fec9f1d45a599ce91e42819b41b Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1166460917-project Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "cb47fbeb-fd49-42f9-8833-5c8c16e7df6e_new"}} Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'cb47fbeb-fd49-42f9-8833-5c8c16e7df6e', 'body': {'server': {'name': 'cb47fbeb-fd49-42f9-8833-5c8c16e7df6e_new'}}} Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:48:59.913379 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] Returning 404 to user: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-665bc552-f20d-4133-96bd-7b89acc37b76 tempest-ServersNegativeTestMultiTenantJSON-1166460917 tempest-ServersNegativeTestMultiTenantJSON-1166460917-project] 10.222.0.48 "PUT /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 404 len: 111 microversion: 2.1 time: 0.049165 Oct 28 17:48:59.917098 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2349/4594] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:48:59 2022] PUT /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:48:59.924306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:48:59.924805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:48:59.931171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.931989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.932620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.933518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:48:59.934154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:48:59.934760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:48:59.964553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:49:00.154796 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f792df6f-e194-4773-80f3-f77379d74b6a tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 204 len: 0 microversion: 2.1 time: 0.233486 Oct 28 17:49:00.157276 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2246/4595] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:48:59 2022] DELETE /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:49:00.167244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:00.167920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:00.180932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.181440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.181931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.184106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.184806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.185920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.342219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:00.358107 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc1eef71-3faf-45fe-8f57-d6366011d93b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1534 microversion: 2.1 time: 0.195644 Oct 28 17:49:00.374642 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2350/4596] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:00 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1534 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:00.381144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:00.381845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:00.398039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.398225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.402917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.403869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.404354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.404858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.434562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:00.437133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:00.453214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.453617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.454062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.454786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.456284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.456726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.542507 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78b1d52a-e7d4-4f75-b3cd-1fa178fdc3f3 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111902 Oct 28 17:49:00.543108 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2351/4597] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:49:00 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:00.771899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:00.772896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:00.781097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.781599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.782042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:00.788628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:00.789560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:00.789933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:01.198088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:01.214891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:01.220617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:01.226330 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43da58c9-0961-4835-a718-1a99cd326bca tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.457484 Oct 28 17:49:01.248579 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2352/4598] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:00 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:49:01.389482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:01.390378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:01.399416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:01.412412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:01.413419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:01.415782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:01.418300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:01.418951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:01.676622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:01.701995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce9753a6-a74c-4067-b768-8a13b9398e4a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1494 microversion: 2.1 time: 1.322992 Oct 28 17:49:01.709234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2247/4599] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:00 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1494 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:01.760454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:01.789603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:01.812228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:01.812798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:01.813242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:01.816372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:01.817082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:01.818635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:01.890769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d92f664c-65d3-4744-b05a-ba17c89ea59c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180347 Oct 28 17:49:01.892152 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2248/4600] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:49:01 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:02.254773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:02.255527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:02.271076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.272063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.273006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.273968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.277454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.278198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.333807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:02.352337 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd851f0e-30c1-4087-9c6f-33e36ad3ab3b tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1534 microversion: 2.1 time: 0.969688 Oct 28 17:49:02.353015 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2353/4601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:01 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1534 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:02.556621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:02.573364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:02.578249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:02.580669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-449f091b-eb97-4eb1-bb7e-d8652cdf4d5d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.330522 Oct 28 17:49:02.584265 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2249/4602] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:02 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:02.733543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:02.734178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:02.741876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.742373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.743410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.743550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.743984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.754179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.906017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:02.908998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:02.923263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.924423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.928718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.929722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:02.930436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:02.931022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:02.962191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:03.048881 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-384c9da4-4505-4d62-aead-6bd56f63b3d6 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147863 Oct 28 17:49:03.053513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2250/4603] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:49:02 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:03.172623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4", "name": "network-vif-deleted", "tag": "d8fed538-534a-4ed1-84cc-4d7b3e960ec6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:03.193325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d2c0db440a49139afebe174d07fd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7600064bf2164216b4578ab570d8a8ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:03.199197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:03.201955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:03.202743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:03.206231 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93879c1a-523f-4832-9306-613c187debb4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 200 len: 1452 microversion: 2.1 time: 0.476361 Oct 28 17:49:03.206851 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2354/4604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:02 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 1452 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:03.233696 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] Creating event network-vif-deleted:d8fed538-534a-4ed1-84cc-4d7b3e960ec6 for instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 on n-h1-860864-13 Oct 28 17:49:03.268986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ad212d2e-8b65-4db3-bd3e-4926f2ea373f req-95ac4ff4-d167-4354-b9d7-1de488a0b1ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099961 Oct 28 17:49:03.285901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2251/4605] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:03.386254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:03.387557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:03.401342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:03.402882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:03.405647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:03.408535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:03.409489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:03.416946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:03.616916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:03.617613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:03.630848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:03.633940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:03.634689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:03.637125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:03.639325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:03.646450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:03.886609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:03.899860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:03.901741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:03.902965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad938843-7d7a-4ab6-a2de-e364b586c449 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.293878 Oct 28 17:49:03.932699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2252/4606] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:03 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:04.049455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb3a9d6c1d0f4c099a78c0257b441332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78b9da565f6d4d92b7c29ae2b9f6cfc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:04.058452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab6e860c-9da8-49c8-b649-97901a371737 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 200 len: 1534 microversion: 2.1 time: 0.677911 Oct 28 17:49:04.066354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.069433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.076487 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2355/4607] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:03 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 1534 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:04.092917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.104575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.105283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.108736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.110661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.113089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.202967 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6736871e-d77d-43f1-92ff-95c92390e4ad tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141286 Oct 28 17:49:04.203966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2253/4608] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 17:49:04 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:49:04.232012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.232641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.245879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:04.247350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.247888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.248314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.249029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.249521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.249951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.285093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 HTTP/1.1 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4'} Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.287033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. Oct 28 17:49:04.292021 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.294565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.296329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87db25de-fd10-4368-8a72-75b4e37fdc65 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4" status: 404 len: 111 microversion: 2.1 time: 0.068533 Oct 28 17:49:04.306772 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2356/4609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:04 2022] GET /compute/v2.1/servers/4c8dd1eb-a9d3-421e-8071-d7b92cfebbf4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:04.313995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.315314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.324261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.341330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.341785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.342539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.343000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.343456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.403919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb HTTP/1.1 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '0d10c7f7-a2a0-438c-9856-60eee59c3cbb'} Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.405837 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.410316 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.419571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.421739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3bb0cd01-be89-49fa-9e00-c711800dc0af tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 404 len: 111 microversion: 2.1 time: 0.110679 Oct 28 17:49:04.429601 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2254/4610] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:04 2022] DELETE /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:49:04.434277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.435126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 0d10c7f7-a2a0-438c-9856-60eee59c3cbb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.446657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.459099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.459733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.465533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.466372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.466928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.495950 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb HTTP/1.1 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0d10c7f7-a2a0-438c-9856-60eee59c3cbb'} Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.497954 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. Oct 28 17:49:04.503556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.506727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 0d10c7f7-a2a0-438c-9856-60eee59c3cbb could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.508033 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5480f071-8da2-4a46-867e-fa8d6bc5f6f6 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb" status: 404 len: 111 microversion: 2.1 time: 0.080132 Oct 28 17:49:04.509246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2357/4611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:04 2022] GET /compute/v2.1/servers/0d10c7f7-a2a0-438c-9856-60eee59c3cbb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:04.517191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b345198f-924e-4ab5-bef2-6919866a038d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f75245139d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.562076 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b345198f-924e-4ab5-bef2-6919866a038d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b345198f-924e-4ab5-bef2-6919866a038d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 HTTP/1.1 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: exception: Image not found. Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7555cce7-e641-476e-b490-2c0e84390f39'} Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7555cce7-e641-476e-b490-2c0e84390f39 to delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7555cce7-e641-476e-b490-2c0e84390f39 could not be found. Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.568490 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b345198f-924e-4ab5-bef2-6919866a038d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b345198f-924e-4ab5-bef2-6919866a038d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39" status: 404 len: 62 microversion: 2.1 time: 0.056859 Oct 28 17:49:04.572387 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2255/4612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:04 2022] DELETE /compute/v2.1/images/7555cce7-e641-476e-b490-2c0e84390f39 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:49:04.590345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.602140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.618348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.619102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.620325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.621280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.622249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.623016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.654581 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 HTTP/1.1 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '01019c89-4971-4a51-a38e-af888c97ae29'} Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.657777 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.661677 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.666468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.667841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-921e914f-3c6b-4970-8d05-833975b0b905 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 404 len: 111 microversion: 2.1 time: 0.087856 Oct 28 17:49:04.669196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2358/4613] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:04 2022] DELETE /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:04.678371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.685553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: 01019c89-4971-4a51-a38e-af888c97ae29] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.699439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.701137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.706342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.708900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.713932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.714594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.764785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 HTTP/1.1 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '01019c89-4971-4a51-a38e-af888c97ae29'} Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.766861 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. Oct 28 17:49:04.772579 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.775140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance 01019c89-4971-4a51-a38e-af888c97ae29 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.777949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-895af8c4-eea0-4bbb-a4e1-1ff73567feb2 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29" status: 404 len: 111 microversion: 2.1 time: 0.104839 Oct 28 17:49:04.788547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf42737-3172-49e0-990e-df6c0e740752 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f8a9430>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.795792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2256/4614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:04 2022] GET /compute/v2.1/servers/01019c89-4971-4a51-a38e-af888c97ae29 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:04.801545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1456107402", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "39e69887-562e-4206-b076-9169546c7e9e"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:04.838637 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fcf42737-3172-49e0-990e-df6c0e740752 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf42737-3172-49e0-990e-df6c0e740752 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb HTTP/1.1 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7953a0d4-c9ad-4806-94bc-06dded4e68eb'} Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7953a0d4-c9ad-4806-94bc-06dded4e68eb to delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7953a0d4-c9ad-4806-94bc-06dded4e68eb could not be found. Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.840649 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:49:04.845567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.848617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf42737-3172-49e0-990e-df6c0e740752 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:04.849663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcf42737-3172-49e0-990e-df6c0e740752 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb" status: 404 len: 62 microversion: 2.1 time: 0.065652 Oct 28 17:49:04.853790 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2359/4615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:04 2022] DELETE /compute/v2.1/images/7953a0d4-c9ad-4806-94bc-06dded4e68eb => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:49:04.870323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:04.871323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:04.922726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.924563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.925514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.927391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:04.928498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:04.936176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:04.953770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] validate_networks() for [('39e69887-562e-4206-b076-9169546c7e9e', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:49:04.973696 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e HTTP/1.1 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f8614db0-5443-4ab4-a8d8-1a14d6561e8e'} Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:04.979738 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:04.983737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:04.994550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:05.001561 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0489e74-b8f2-4792-816e-25f389f49c8b tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 404 len: 111 microversion: 2.1 time: 0.142544 Oct 28 17:49:05.008748 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2360/4616] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:04 2022] DELETE /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:05.037241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:05.038323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:05.057224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:05.060307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:05.062664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:05.064054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:05.066036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:05.072644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.146243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:06.163508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:06.183707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:06.187551 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8cb673c2-4ef6-4f0e-afee-e7ca04b3da72 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 1.175622 Oct 28 17:49:06.204713 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2361/4617] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:05 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:06.221589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.224897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: f8614db0-5443-4ab4-a8d8-1a14d6561e8e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:06.278724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.280766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.286067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.298268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.303760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.307002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.365839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e HTTP/1.1 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f8614db0-5443-4ab4-a8d8-1a14d6561e8e'} Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.371567 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. Oct 28 17:49:06.375546 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.380055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance f8614db0-5443-4ab4-a8d8-1a14d6561e8e could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.385164 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41a7d8d8-3dff-4065-95d6-3393bbde32a7 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e" status: 404 len: 111 microversion: 2.1 time: 0.178079 Oct 28 17:49:06.386081 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2362/4618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] GET /compute/v2.1/servers/f8614db0-5443-4ab4-a8d8-1a14d6561e8e => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:06.393901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.399673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] [instance: cb47fbeb-fd49-42f9-8833-5c8c16e7df6e] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:06.418104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.420929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.422880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.425351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.426076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.428682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.456136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] HTTP exception thrown: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Request method failure captured: Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e HTTP/1.1 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBXW67Yzy6I5SB2nb-gRsksVonEELe5-rj6N97erdVUkpQHfznfOLYZLKoDUjfLRaYOkgWCojgUjb45KI1HT-xqtIFYEoENliBJoYMEcihN6IxAEktNPp7ecD977dvrca3EE-zRxZ_kPhq9ZrjzhTKM3nW2gMH19E_2JjRUKQCqdD2Y Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 78b9da565f6d4d92b7c29ae2b9f6cfc8 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-707702258 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/78b9da565f6d4d92b7c29ae2b9f6cfc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/78b9da565f6d4d92b7c29ae2b9f6cfc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_78b9da565f6d4d92b7c29ae2b9f6cfc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/78b9da565f6d4d92b7c29ae2b9f6cfc8"}]}] Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-707702258 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 78b9da565f6d4d92b7c29ae2b9f6cfc8 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-707702258 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-707702258-project Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: eb3a9d6c1d0f4c099a78c0257b441332 Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-707702258-project Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'cb47fbeb-fd49-42f9-8833-5c8c16e7df6e'} Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:49:06.458018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. Oct 28 17:49:06.464252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.466617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] Returning 404 to user: Instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.467760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-872b6135-b360-48df-a1aa-1e4735637d72 tempest-ServersNegativeTestMultiTenantJSON-707702258 tempest-ServersNegativeTestMultiTenantJSON-707702258-project] 10.222.0.48 "GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e" status: 404 len: 111 microversion: 2.1 time: 0.080426 Oct 28 17:49:06.474621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2363/4619] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] GET /compute/v2.1/servers/cb47fbeb-fd49-42f9-8833-5c8c16e7df6e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:06.487212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb47fbeb-fd49-42f9-8833-5c8c16e7df6e", "name": "network-vif-deleted", "tag": "0f119de3-7914-4bd6-bd1c-98d188cabcd9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:06.499933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.501346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.502639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.510239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:06.525861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] Creating event network-vif-deleted:0f119de3-7914-4bd6-bd1c-98d188cabcd9 for instance cb47fbeb-fd49-42f9-8833-5c8c16e7df6e on n-h2-860864-13 Oct 28 17:49:06.534263 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b5c969fd-d923-4ce8-af02-c9927e1989c5 req-036ea3e2-76e4-480c-9ef6-578d4c18ade6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053235 Oct 28 17:49:06.535561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2364/4620] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:06.542683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f41ad87b-a916-4bfd-9a45-17b7b5de5013 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f7524377ca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.577840 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f41ad87b-a916-4bfd-9a45-17b7b5de5013 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f41ad87b-a916-4bfd-9a45-17b7b5de5013 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 HTTP/1.1 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '132e47b6-de6c-48d4-8be5-3d31f76f1941'} Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 132e47b6-de6c-48d4-8be5-3d31f76f1941 to delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 132e47b6-de6c-48d4-8be5-3d31f76f1941 could not be found. Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.600116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:49:06.604428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.611291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f41ad87b-a916-4bfd-9a45-17b7b5de5013 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.612773 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f41ad87b-a916-4bfd-9a45-17b7b5de5013 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941" status: 404 len: 62 microversion: 2.1 time: 0.075834 Oct 28 17:49:06.618242 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2365/4621] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] DELETE /compute/v2.1/images/132e47b6-de6c-48d4-8be5-3d31f76f1941 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:49:06.627740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.629353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:06.643278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.644042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.644642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.652273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.653002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.653713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.737991 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 HTTP/1.1 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b5236247-2167-4d53-a57a-7277f1c66c48'} Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:06.740880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.746726 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.749894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.751542 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f07d75cc-0a79-4964-b35d-b039683b9416 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 404 len: 111 microversion: 2.1 time: 0.130954 Oct 28 17:49:06.753767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2366/4622] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:06 2022] DELETE /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:06.764611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.772608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: b5236247-2167-4d53-a57a-7277f1c66c48] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:06.786325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.790102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.790799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.792912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.793596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.795625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.830930 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 HTTP/1.1 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b5236247-2167-4d53-a57a-7277f1c66c48'} Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.832874 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance b5236247-2167-4d53-a57a-7277f1c66c48 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.839815 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9ae7dba-26f8-4f2d-8702-ced29f722f0a tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48" status: 404 len: 111 microversion: 2.1 time: 0.078706 Oct 28 17:49:06.841199 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2367/4623] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] GET /compute/v2.1/servers/b5236247-2167-4d53-a57a-7277f1c66c48 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:06.846726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ac08cb1-bc5a-407f-8e4e-8c831af5555d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '.version_select at 0x7f751f8dda60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.887197 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5ac08cb1-bc5a-407f-8e4e-8c831af5555d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Image not found. Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ac08cb1-bc5a-407f-8e4e-8c831af5555d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de HTTP/1.1 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: exception: Image not found. Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '871f3df8-2e73-49ec-af08-9f68e51f24de'} Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 871f3df8-2e73-49ec-af08-9f68e51f24de to delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 871f3df8-2e73-49ec-af08-9f68e51f24de could not be found. Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.889541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ac08cb1-bc5a-407f-8e4e-8c831af5555d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Image not found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.894336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ac08cb1-bc5a-407f-8e4e-8c831af5555d tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de" status: 404 len: 62 microversion: 2.1 time: 0.049757 Oct 28 17:49:06.897755 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2368/4624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] DELETE /compute/v2.1/images/871f3df8-2e73-49ec-af08-9f68e51f24de => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:49:06.903186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.904246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:06.915012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.915911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.916925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.918449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:06.919155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:06.919920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:06.942867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf HTTP/1.1 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ba10a9f6-a302-49e1-a55b-27a2a85729cf'} Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:06.946584 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:06.951611 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:06.954663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:06.956691 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d72a5d73-1532-41f5-a405-7e5bf83187b4 tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 404 len: 111 microversion: 2.1 time: 0.057722 Oct 28 17:49:06.960688 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2369/4625] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:06 2022] DELETE /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:06.987577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:06.989025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] [instance: ba10a9f6-a302-49e1-a55b-27a2a85729cf] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:07.010519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.012601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.013424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.015883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.016729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.018444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.046492 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] HTTP exception thrown: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Request method failure captured: Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf HTTP/1.1 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBSDPPI9U1walBXTUEa5-r_CDgDhZM3uHjQoUG_hHX7NopXRMR_hqsVyvv0n8FcVXHkyn38eN1mXzX1VSMBPwqPW9ACxVmpsv3tJUt-14vvv2nJrgeO9fV0gcE1vCv0MDc-tG4uISsXlAszk3s6iwdjLbFuJ8NUNGDR0KW8dztrDU58 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7600064bf2164216b4578ab570d8a8ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7600064bf2164216b4578ab570d8a8ff"}]}] Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ImagesTestJSON-617641183 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7600064bf2164216b4578ab570d8a8ff Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ImagesTestJSON-617641183 Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 39d2c0db440a49139afebe174d07fd3b Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ImagesTestJSON-617641183-project Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ba10a9f6-a302-49e1-a55b-27a2a85729cf'} Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:07.049227 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. Oct 28 17:49:07.053748 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:07.055250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] Returning 404 to user: Instance ba10a9f6-a302-49e1-a55b-27a2a85729cf could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:07.056473 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd337ad3-144c-46e5-b21b-ba02abc0586f tempest-ImagesTestJSON-617641183 tempest-ImagesTestJSON-617641183-project] 10.222.0.48 "GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf" status: 404 len: 111 microversion: 2.1 time: 0.093991 Oct 28 17:49:07.061021 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2370/4626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:06 2022] GET /compute/v2.1/servers/ba10a9f6-a302-49e1-a55b-27a2a85729cf => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:07.222943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:07.223806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:07.241446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.242390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.244247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.263224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.269288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.272793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.515742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:07.537079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:07.538635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:07.543593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-05df705d-7e24-44bf-9e75-17b1bb1426ed tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.327501 Oct 28 17:49:07.562617 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2371/4627] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:07 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:07.695566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:49:07.697147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:49:07.698140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:49:07.698832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:49:07.699454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:49:07.718686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.719944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.721435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.726570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:07.727338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:07.729888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:07.790595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for project 5354fd8b351d40639670ad813ab61d87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:07.806157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Getting quotas for user 5013ed8c6ca14b4e9ad3cf4d9d883196 and project 5354fd8b351d40639670ad813ab61d87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:07.836811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:49:07.847320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:49:07.968171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c170c09-8515-4316-b310-dfca25a763db tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.170996 Oct 28 17:49:07.974378 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2257/4628] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:49:07.986282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-94c5d9a5-b0bd-4402-b395-007e29447cc0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:07.987272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-94c5d9a5-b0bd-4402-b395-007e29447cc0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:08.207798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-94c5d9a5-b0bd-4402-b395-007e29447cc0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:08.223882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-94c5d9a5-b0bd-4402-b395-007e29447cc0 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1218 microversion: 2.1 time: 0.238915 Oct 28 17:49:08.226771 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2372/4629] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:07 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:08.582072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:08.582888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:08.598291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:08.598787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:08.599218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:08.604876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:08.613463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:08.613934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:08.896250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:08.911980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:08.916082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:08.920555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b2a6b375-b7ca-4b90-a66c-386fd0eeeb1c tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1409 microversion: 2.54 time: 0.343130 Oct 28 17:49:08.928346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2258/4630] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:08 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1409 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:09.251803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:09.253566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:09.277852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:09.278657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:09.279405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:09.280415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:09.281170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:09.281951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:09.426768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2060270402", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "a22652fc-ab67-49e4-b3e1-3411cc6fa92b"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:09.490286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:09.509479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1324f14d-cea1-4594-8e39-630bea0af1c7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1222 microversion: 2.1 time: 0.262685 Oct 28 17:49:09.512493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2259/4631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:09 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1222 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:09.556183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] validate_networks() for [('a22652fc-ab67-49e4-b3e1-3411cc6fa92b', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:49:09.956789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:09.958195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:09.971896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:09.983089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:09.983722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:09.984761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:09.991624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:09.994669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:10.177257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:10.190650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:10.205366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:10.211711 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-25fc34ae-cbb1-4af4-a06f-cf267888747d tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1427 microversion: 2.54 time: 0.255534 Oct 28 17:49:10.212797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2260/4632] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:09 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:49:10.536555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:10.537320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:10.564182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:10.565230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:10.569951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:10.573666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:10.583977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:10.586270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:10.869632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:10.881408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-755e2adc-905d-41a0-9be4-7b43fbf93860 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1288 microversion: 2.1 time: 0.350049 Oct 28 17:49:10.883736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2261/4633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:10 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1288 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:11.247735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:11.249199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:11.264579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.266435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.268518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:11.272950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.273672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.274782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:11.555382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:11.566260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:11.586163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:11.587518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22b9668b-39f8-4513-9c08-4049832ab124 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1415 microversion: 2.54 time: 0.345132 Oct 28 17:49:11.598922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2262/4634] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:11 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1415 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:11.855271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:49:11.855847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:49:11.856188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:49:11.856608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:49:11.857017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:49:11.888807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.889324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.889766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:11.890569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.903421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.903878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:11.914373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:11.914985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:11.917085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:11.926881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.927414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.927840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:11.928649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:11.929091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:11.941579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:12.020758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Getting quotas for project 3abb9c807e8b40cfb8491654f126f50e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:12.065208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Getting quotas for user 41ece7cb5eb949c2a8131f6d6f5e7f3c and project 3abb9c807e8b40cfb8491654f126f50e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:12.124301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:49:12.130304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:49:12.260914 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.430673 Oct 28 17:49:12.267794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2373/4635] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:49:12.279329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfabe209-437b-498c-a42b-2721269ae928 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:12.281273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfabe209-437b-498c-a42b-2721269ae928 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:12.310799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:12.342405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad96c1fb-b29c-46bb-a2d6-b49db5ee1d13 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1276 microversion: 2.1 time: 0.431750 Oct 28 17:49:12.342991 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2263/4636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:11 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1276 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:12.626608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:12.631857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:12.685409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:12.685905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:12.686346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:12.687062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:12.704404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:12.705194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:13.146064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:13.164128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:13.165891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:13.167115 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-33f23284-8bb5-4927-8973-463a5e4cc34a tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1415 microversion: 2.54 time: 0.546184 Oct 28 17:49:13.180831 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2264/4637] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:12 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1415 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:49:13.203560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfabe209-437b-498c-a42b-2721269ae928 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:13.217795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfabe209-437b-498c-a42b-2721269ae928 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1217 microversion: 2.1 time: 0.942714 Oct 28 17:49:13.218954 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2374/4638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:12 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1217 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:13.381065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:13.381932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:13.388743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:13.389248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:13.394429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:13.395927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:13.397786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:13.398897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:13.790619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:13.809407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8dc9974-2f1e-409f-8349-018166783194 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1276 microversion: 2.1 time: 0.430440 Oct 28 17:49:13.820453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2265/4639] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:13 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:14.195251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:14.196002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:14.210056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.210646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.210973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.218716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.221837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.222699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.248815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:14.250445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:14.275671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.276178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.276624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.280775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.281270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.281707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.739296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:14.750329 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c3defd8-db95-4716-b226-84a65a0704aa tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1269 microversion: 2.1 time: 0.507196 Oct 28 17:49:14.763395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2266/4640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:14 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1269 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:14.838853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:14.841337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:14.854367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:14.861484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.868918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.869404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.869977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:14.871131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:14.872993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:14.874819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:14.876133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:14.885283 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa4983fa-5e41-4f69-b6cf-ad0957d56c62 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1415 microversion: 2.54 time: 0.689978 Oct 28 17:49:14.891876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2375/4641] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:14 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1415 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:15.772909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:15.780824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:15.782510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:15.788902 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a93f205-14dd-46c4-b2eb-dedb2ba65bb7 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.954333 Oct 28 17:49:15.804599 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2267/4642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:14 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:15.821368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:15.824971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:15.827439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:15.829269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:15.831181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:15.835739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:15.919942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:15.920474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:15.932829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:15.934786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:15.935479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:15.939640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:15.942480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:15.943136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.136332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:16.155269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3a618ba-3be7-49cf-abb6-087872d749c6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1275 microversion: 2.1 time: 0.380635 Oct 28 17:49:16.156412 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2376/4643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:15 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:16.199850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:16.214346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:16.215953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:16.227405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d183f6af-cfc9-4f1e-aa46-321b2ef4a519 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1400 microversion: 2.54 time: 0.308381 Oct 28 17:49:16.240604 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2268/4644] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:15 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1400 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:49:16.261790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8fa11012-a10e-4429-9e8b-e3a4ebf370d4 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '.version_select at 0x7f751f7538b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:16.335718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8fa11012-a10e-4429-9e8b-e3a4ebf370d4 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2052479861" status: 204 len: 0 microversion: 2.54 time: 0.079952 Oct 28 17:49:16.337125 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2377/4645] 10.222.0.48 () {60 vars in 1319 bytes} [Fri Oct 28 17:49:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2052479861 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:49:16.357820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:16.358546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:16.376745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.383514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.384320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.385475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.386187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.386799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.468239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:49:16.577860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:16.753818 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4377ae89-9f8f-437d-8a3c-32e42a7abaa7 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 204 len: 0 microversion: 2.54 time: 0.401191 Oct 28 17:49:16.764186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:16.765515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:16.769139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2269/4646] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:49:16 2022] DELETE /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:49:16.783242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.783995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.786354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.788943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.790557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.791016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.816850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:16.818140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:16.835745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.839143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.839836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:16.841687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:16.866356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:16.868856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:17.310341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:17.335220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:17.339188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:17.342986 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0711607-bd17-4e6c-a72d-6094e0ebdd29 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1406 microversion: 2.54 time: 0.583729 Oct 28 17:49:17.346945 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2378/4647] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:16 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1406 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:17.373169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:17.373705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:17.412146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:17.417468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:17.418134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:17.419882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:17.421878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:17.423164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:17.663641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:17.672108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55ee8034-ac47-48bf-88df-d60e927026ee tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1275 microversion: 2.1 time: 0.324913 Oct 28 17:49:17.672587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2379/4648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:17 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:17.759643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:17.824106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:17.944485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:17.963402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-143bd241-e6ae-4f2e-8f46-baaffcf84544 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 1.153536 Oct 28 17:49:17.964262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2270/4649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:16 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:18.377201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:18.378355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:18.405060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:18.407386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:18.409658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:18.415421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:18.419661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:18.421532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:18.640721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:18.668298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:18.675574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:18.683220 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ee85c72-0f87-43c2-9042-006c2a79e944 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1406 microversion: 2.54 time: 0.310239 Oct 28 17:49:18.684796 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2380/4650] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:18 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:18.697693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:18.698309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:18.712891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:18.713397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:18.713839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:18.714568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:18.715029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:18.715493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:18.940695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:18.951447 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76d483af-6a91-4f63-b2f9-21d3a16d84d6 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1275 microversion: 2.1 time: 0.257406 Oct 28 17:49:18.970788 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2271/4651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:18 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:18.992499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:18.994118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:19.018718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:19.019226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:19.023902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:19.025089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:19.025859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:19.026545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:19.717970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:19.718823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:19.737102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:19.738380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:19.738994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:19.743664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:19.745623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:19.746251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:19.854417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:19.854926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:19.855389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:19.861489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lazy-loading 'fault' on Instance uuid 4204360a-b49e-4611-9ccb-da0ed8a13d2c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:49:20.288418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:20.302283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:20.308506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10533003763d479abd80fed1ec210268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7d988b78024612b01f128770992a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:20.310347 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9274d73-57e4-4233-ae05-0aab2f239bf9 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 200 len: 1411 microversion: 2.54 time: 0.599157 Oct 28 17:49:20.319848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2272/4652] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:19 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 1411 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:49:20.363777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:20.370888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:20.407835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:20.408684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:20.409975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:20.412407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:20.416344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:20.418380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:20.986450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:20.995341 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-be7d796d-8204-4ce4-97d6-0866df8eeb68 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 2.012140 Oct 28 17:49:21.002701 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2381/4653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:18 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:21.352362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:21.362850 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7cd90f12-575d-4721-a4d1-68927ece7b77 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 1.037822 Oct 28 17:49:21.379710 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2273/4654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:20 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:21.397859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:21.402035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] [instance: 4204360a-b49e-4611-9ccb-da0ed8a13d2c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:21.419346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:21.425555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:21.426188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:21.427084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:21.433392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:21.434012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:21.485276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1bb04d6-14a7-4ad3-85a2-d400478320b0", "tag": "c2e6e8e0-5d36-4c86-9104-7c83ea88622f"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:21.507135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:21.508841 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] HTTP exception thrown: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Request method failure captured: Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c HTTP/1.1 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBXvRPU-BRMnPX6Ll2YM7VFAjom_1OBXWWB4bXkEWNygH7ZD9SMioReJ6FGBEN_SKhYR_303YyhYvhIvNbMFEK9YkVZ2QzuuE1zyUvli4ZlfHaTwCdgyPEZJxl5BhkG2CHvPbHbA1FseIva8qLVGwlZlE3xN4q8LiIP2sEckQO9yURM Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.54 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 1d7d988b78024612b01f128770992a6c Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerShowV254Test-115059247 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d7d988b78024612b01f128770992a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1d7d988b78024612b01f128770992a6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1d7d988b78024612b01f128770992a6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1d7d988b78024612b01f128770992a6c"}]}] Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerShowV254Test-115059247 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 1d7d988b78024612b01f128770992a6c Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerShowV254Test-115059247 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerShowV254Test-115059247-project Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 10533003763d479abd80fed1ec210268 Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerShowV254Test-115059247-project Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4204360a-b49e-4611-9ccb-da0ed8a13d2c'} Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:21.510715 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] Returning 404 to user: Instance 4204360a-b49e-4611-9ccb-da0ed8a13d2c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51f12372-cf04-4534-9b2e-e59cc0831eb0 tempest-ServerShowV254Test-115059247 tempest-ServerShowV254Test-115059247-project] 10.222.0.48 "GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c" status: 404 len: 111 microversion: 2.54 time: 0.131198 Oct 28 17:49:21.516284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2274/4655] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:49:21 2022] GET /compute/v2.1/servers/4204360a-b49e-4611-9ccb-da0ed8a13d2c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:49:21.524930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:21.529107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:21.554042 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] Creating event network-changed:c2e6e8e0-5d36-4c86-9104-7c83ea88622f for instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 on n-h1-860864-13 Oct 28 17:49:21.584108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7f21d29f-df68-493e-847a-bc85e6698993 req-4a1e7957-ea3e-4f11-980a-68ed6a779cce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.579734 Oct 28 17:49:21.588294 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2382/4656] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:22.027907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:22.029010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:22.040937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:22.041421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:22.046735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:22.047878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:22.049120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:22.050031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:22.396137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:22.406276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:22.406994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:22.426565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:22.427060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:22.427575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:22.428291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:22.428755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:22.429179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:22.626031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:22.641052 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-439b30b6-6cbc-43f0-8cf3-1bf57e6f2f6c tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.619065 Oct 28 17:49:22.644297 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2275/4657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:22 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:23.210973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:23.218887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:23.234462 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf02eb13-ef74-4f61-a8a0-845d64be5165 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 0.837245 Oct 28 17:49:23.237658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2383/4658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:22 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:23.667661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:23.668256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:23.681735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:23.682239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:23.685290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:23.690155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:23.690804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:23.691512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:24.114291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377393a3-f7b6-435f-a21c-e24bafd52aa6", "tag": "667edda3-fedd-4e29-8d93-b5595b785fbd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:24.132196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:24.140699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:24.141326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:24.171247 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] Creating event network-changed:667edda3-fedd-4e29-8d93-b5595b785fbd for instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 on n-h1-860864-13 Oct 28 17:49:24.182786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b70b1ff8-21c7-4068-befa-9e29bceb88f4 req-b9c4b676-4c75-4766-8fb6-ac0f42d04d98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073429 Oct 28 17:49:24.187616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2384/4659] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:24.261881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:24.262815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:24.281361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:24.285838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:24.287234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:24.288221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:24.290826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:24.291549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:24.673933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:24.687634 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-195b5899-a591-434a-a7ba-324475a5ef89 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 1.025361 Oct 28 17:49:24.688367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2276/4660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:23 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:25.630891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:25.672755 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-84410ebb-cc09-4005-8cbd-90110452905b tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 1.415145 Oct 28 17:49:25.678290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2385/4661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:24 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:25.715481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:25.716280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:25.737478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:25.738542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:25.738968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:25.744088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:25.744803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:25.745406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:26.330782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:26.346148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-794ceff7-1d4d-4ca5-8985-681f5c72d69e tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.635297 Oct 28 17:49:26.348091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2277/4662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:25 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:26.690837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86edf55e-f185-459a-b364-d45cd0c63c7a tempest-ExtensionsTest-931582072 tempest-ExtensionsTest-931582072-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:26.692938 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86edf55e-f185-459a-b364-d45cd0c63c7a tempest-ExtensionsTest-931582072 tempest-ExtensionsTest-931582072-project] 10.222.0.48 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.602662 Oct 28 17:49:26.699873 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2386/4663] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Oct 28 17:49:26 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:26.703985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:26.705366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:26.714830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c62d33f1-6464-4329-8185-eb65c3864f14 tempest-ExtensionsTest-931582072 tempest-ExtensionsTest-931582072-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:26.716690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:26.723497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:26.724194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:26.726482 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c62d33f1-6464-4329-8185-eb65c3864f14 tempest-ExtensionsTest-931582072 tempest-ExtensionsTest-931582072-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.025118 Oct 28 17:49:26.727510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:26.728809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:26.729862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:26.733938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2387/4664] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Oct 28 17:49:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:49:27.375524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:27.376615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:27.377241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:27.387343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-66b24aaa-4def-4d39-a059-7fa6bb93b425 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 0.688744 Oct 28 17:49:27.409106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:27.415986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:27.418537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:27.419592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:27.420296 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2278/4665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:26 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:27.432783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:27.435794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:27.748115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:27.758259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e279559-d9fa-4bfb-8438-a96929473904 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.390933 Oct 28 17:49:27.761815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2388/4666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:27 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:28.421534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:28.422902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:28.433423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:28.439858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:28.444597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:28.445614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:28.446246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:28.446856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:28.787761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:28.788585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:28.797406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:28.799086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:28.799869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:28.801021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:28.801689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:28.802354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:29.951225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:29.964524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ce5324a-202d-45fc-9a34-32a56b2103fc tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 1.547050 Oct 28 17:49:29.966464 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2279/4667] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:28 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:30.057249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:30.067139 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d84cc21-cf2a-454f-bacb-bd6a31f9f303 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 1.285140 Oct 28 17:49:30.072860 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2389/4668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:28 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:30.342589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a25e2e7-13c3-4d94-8c70-539627748ad0 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f752423e1f0>, body: {"keypair": {"name": "tempest-keypair-738787180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJajuZIRsgh3hGJJC/9H9oMX+GpzYTSlH9GtHAbULim4VOxKmFAOy/BqTTl9UAmDFggkPYMq4/CbH72DTk1dyt0dMB+2xEULhsERdBbgSb5x7y8PFDouj9OiQqiA8CAXw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:30.423555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a25e2e7-13c3-4d94-8c70-539627748ad0 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:30.444521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a25e2e7-13c3-4d94-8c70-539627748ad0 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:30.515034 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a25e2e7-13c3-4d94-8c70-539627748ad0 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.547104 Oct 28 17:49:30.515862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2280/4669] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:30.534737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-600dbfce-4a0c-4e1b-a75f-ee097748ed73 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f682f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:30.568825 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-600dbfce-4a0c-4e1b-a75f-ee097748ed73 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-738787180" status: 200 len: 497 microversion: 2.1 time: 0.044012 Oct 28 17:49:30.577352 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2390/4670] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Oct 28 17:49:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-738787180 => generated 497 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:30.584183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1756595-a5b0-413f-bf7e-341cb2d167d7 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f82bdc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:30.616701 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1756595-a5b0-413f-bf7e-341cb2d167d7 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738787180" status: 202 len: 0 microversion: 2.1 time: 0.038781 Oct 28 17:49:30.618309 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2281/4671] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738787180 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:49:30.631116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f84cf714-470e-4b6e-bbe7-364cb2dc24de tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f751f6b71f0>, body: {"keypair": {"name": "tempest-keypair-1361097413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtk96Q05j9Op3GVdHn5JttYH9udwGHmFlfqzHuOQzg6yU6j6moTehaCv5to4tzr7UK+y+fbEBjHmaeILfQ1g+jTG43IZ96eX0IQXG8YLHKaUZksh3Q65cjj7B66B7ANVg=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:30.652573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f84cf714-470e-4b6e-bbe7-364cb2dc24de tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:30.675081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f84cf714-470e-4b6e-bbe7-364cb2dc24de tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:30.718547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f84cf714-470e-4b6e-bbe7-364cb2dc24de tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092296 Oct 28 17:49:30.719091 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2391/4672] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:30.730788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61dd5846-9e82-4962-9e4b-ddf63c2669b9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f82cc10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:30.766406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61dd5846-9e82-4962-9e4b-ddf63c2669b9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361097413" status: 202 len: 0 microversion: 2.1 time: 0.039954 Oct 28 17:49:30.777358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1e47aa4-c3d1-45dc-9928-09132251adca tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f751f6b7670>, body: {"keypair": {"name": "tempest-keypair-1813528505", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:30.778937 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2282/4673] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361097413 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:49:30.814373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1e47aa4-c3d1-45dc-9928-09132251adca tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:30.826396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-e1e47aa4-c3d1-45dc-9928-09132251adca tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:30.849701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:30.896257 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1e47aa4-c3d1-45dc-9928-09132251adca tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.123219 Oct 28 17:49:30.909076 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2392/4674] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:30 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:30.909605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-901af736-f70b-4db3-a212-9a96db283318 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f64cc10>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:30.950871 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-901af736-f70b-4db3-a212-9a96db283318 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813528505" status: 202 len: 0 microversion: 2.1 time: 0.046392 Oct 28 17:49:30.958821 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2283/4675] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813528505 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:49:30.966496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee9e96ad-d9dd-401a-9857-b317bb1d62ec tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f751f6b7a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-406281960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoMLzMOINxmimhNAVrb72aU79QWOjwEtZ+z3cDNoWpZIs4gOZnWRj7ML9TQLrLBHOVeL8aSmXoWEHxMoZ+br4ZMendGiw++8Ar+gKQ78L3WISdCXlVNW4HahW2P7oLCkg=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:30.992393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:30.993209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:31.009822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:31.018131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:31.018876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:31.019889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:31.027688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:31.028530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ee9e96ad-d9dd-401a-9857-b317bb1d62ec tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:31.030268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:31.045844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ee9e96ad-d9dd-401a-9857-b317bb1d62ec tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:31.137236 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee9e96ad-d9dd-401a-9857-b317bb1d62ec tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.174612 Oct 28 17:49:31.148333 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2393/4676] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:31.162262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:31.166256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:31.182340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:31.182845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:31.183289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:31.184035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:31.184490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:31.184920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:31.670760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:31.680342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65296a31-9f79-482a-9484-d8a98708cdbe tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.530574 Oct 28 17:49:31.685533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2394/4677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:31 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:31.693082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c97b34dc-0178-4fd6-a464-b48dc1e1e078 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f751f753ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-749008782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVO5gaByPY2MOzQns9VM/FajxJsBzLDjGIjuJC1Gnp3DK7E2d80+LinXZep4NU34lrNxzCwk30wmxZjUNcs5LWksZT3FPr5iOdsZALs5OofiqAT3bcPTYdgKSA8vXq0YA=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:31.717134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:31.734352 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd08865b-736c-4503-8b06-8c99c497e35c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 0.745344 Oct 28 17:49:31.734910 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2284/4678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:30 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:31.737201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c97b34dc-0178-4fd6-a464-b48dc1e1e078 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:31.744611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c97b34dc-0178-4fd6-a464-b48dc1e1e078 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:31.783241 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c97b34dc-0178-4fd6-a464-b48dc1e1e078 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.095533 Oct 28 17:49:31.783904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2395/4679] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:31.797351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9894c82a-06e4-479e-80e7-e76989e46bd9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Action: 'create', calling method: .version_select at 0x7f751f5c1820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-19463229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKkRAY9G3pMluRaqZJ7Fh1y9Rzyx4NqGfalW98wjyPsivFLVIcuTzQa+nP3FqGd0HV0srh3jyI8l1IgacYsLe+2ngNHI/sjSu32zQWONwUlSoxQrKtndYVXRUZI+zKB4g=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:31.813333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9894c82a-06e4-479e-80e7-e76989e46bd9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:31.818894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-9894c82a-06e4-479e-80e7-e76989e46bd9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Getting quotas for user 2cc7e348964f4139a0fbf84d4c401157 and project 743c24663d0c4b648ed9541d4299d154. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:31.858042 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9894c82a-06e4-479e-80e7-e76989e46bd9 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.064040 Oct 28 17:49:31.867469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2285/4680] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:49:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:31.884403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-20414a0b-a987-4ea6-ad92-91545c0a681d tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f6b7940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:31.895715 n-d-860864-13 devstack@n-api.service[120567]: WARNING oslo_db.sqlalchemy.utils [None req-20414a0b-a987-4ea6-ad92-91545c0a681d tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 17:49:31.915347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb04d6-14a7-4ad3-85a2-d400478320b0", "name": "network-vif-plugged", "status": "completed", "tag": "c2e6e8e0-5d36-4c86-9104-7c83ea88622f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:31.940630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-20414a0b-a987-4ea6-ad92-91545c0a681d tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.067905 Oct 28 17:49:31.956156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2396/4681] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:49:31 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:31.979973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f410e901-a3b1-4c8a-948e-ccbea920717a tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f842820>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:31.988446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:31.991286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:31.995386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:32.024920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] Creating event network-vif-plugged:c2e6e8e0-5d36-4c86-9104-7c83ea88622f for instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 on n-h1-860864-13 Oct 28 17:49:32.031960 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-536450d6-1e39-4669-a28d-529820eb84b5 req-babd06af-8f8a-49be-b2b2-cf69bb6c8ba7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125432 Oct 28 17:49:32.033655 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2286/4682] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:32.036689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f410e901-a3b1-4c8a-948e-ccbea920717a tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-19463229" status: 202 len: 0 microversion: 2.1 time: 0.067737 Oct 28 17:49:32.042708 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2397/4683] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:49:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-19463229 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:49:32.055741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14375f60-8a0f-456e-9020-5cd90eacd710 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f70eee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:32.125486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14375f60-8a0f-456e-9020-5cd90eacd710 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-749008782" status: 202 len: 0 microversion: 2.1 time: 0.081498 Oct 28 17:49:32.126666 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2287/4684] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-749008782 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:49:32.142920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3171263-1201-41e5-b467-6568d2571467 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] Calling method '.version_select at 0x7f751f8705e0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:32.223678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3171263-1201-41e5-b467-6568d2571467 tempest-KeyPairsV2TestJSON-1928150989 tempest-KeyPairsV2TestJSON-1928150989-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-406281960" status: 202 len: 0 microversion: 2.1 time: 0.089641 Oct 28 17:49:32.228293 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2398/4685] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:49:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-406281960 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:49:32.644955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e250bc8b-871f-4141-a4b5-cfdc773da2b5 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Action: 'create', calling method: .version_select at 0x7f751f5c1160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1716517249"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:32.718315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:32.718935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:32.738436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:32.739125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:32.739761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:32.743549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:32.744844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:32.745757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:33.116061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:33.126562 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60935211-eae7-4f63-8d40-692eb58c170a tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1318 microversion: 2.1 time: 0.412215 Oct 28 17:49:33.148820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2399/4686] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:32 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:33.164878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:33.165728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:33.182999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:33.183530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:33.183969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:33.184680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:33.185156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:33.185555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:33.291018 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e250bc8b-871f-4141-a4b5-cfdc773da2b5 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.928671 Oct 28 17:49:33.291835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2288/4687] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Oct 28 17:49:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 932 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 17:49:33.305340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdc7e024-bb2c-4433-a926-385ac662c611 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f5c15e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:33.475679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdc7e024-bb2c-4433-a926-385ac662c611 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.173906 Oct 28 17:49:33.476727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2289/4688] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:33 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:34.154566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:34.155567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:34.170550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:34.173946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:34.175025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:34.178459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:34.179219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:34.181191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:34.425048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:34.437381 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f722b5db-ab80-4b74-a7fb-99b2b348ed16 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 1.286665 Oct 28 17:49:34.446004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2400/4689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:33 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:34.491732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bbc51c4d-df37-4480-b406-8f6310e2acb8 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f6a4550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:34.623441 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bbc51c4d-df37-4480-b406-8f6310e2acb8 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.134540 Oct 28 17:49:34.624831 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2401/4690] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:34 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:34.753106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:34.763682 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbe5f03a-6b94-42af-8b0b-38bfdba48b54 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1508 microversion: 2.1 time: 0.614065 Oct 28 17:49:34.767918 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2290/4691] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:34 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1508 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:35.466351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:35.467077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:35.478299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:35.479046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:35.479511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:35.488354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:35.488848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:35.489287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:35.560574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:35.639395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86468c7a-0bdf-47f9-8dbf-568e7645bc6f tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f814700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:35.791505 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86468c7a-0bdf-47f9-8dbf-568e7645bc6f tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 346 microversion: 2.1 time: 0.156885 Oct 28 17:49:35.792368 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2291/4692] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:35 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:35.806372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f1b7ec5-51b6-4b56-9d47-23b74978588e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Action: 'create', calling method: .version_select at 0x7f75243bc550>, body: {"snapshot": {"volume_id": "a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-908688226"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:36.183341 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f1b7ec5-51b6-4b56-9d47-23b74978588e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.381696 Oct 28 17:49:36.184176 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2292/4693] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Oct 28 17:49:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:36.195774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7482d2bb-28fa-4d18-bf31-2cd8a248be6d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f75243bcd30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:36.250300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:36.264955 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc64c35d-bffd-4e25-842b-81b4c525f1b7 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 0.802772 Oct 28 17:49:36.269414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2402/4694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:35 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:36.352459 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7482d2bb-28fa-4d18-bf31-2cd8a248be6d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.160963 Oct 28 17:49:36.354232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2293/4695] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:36 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:36.366796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f1931c7-b4f7-41c7-9747-913bbabfd370 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f6a4550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:36.483607 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f1931c7-b4f7-41c7-9747-913bbabfd370 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.120883 Oct 28 17:49:36.492066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2403/4696] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Oct 28 17:49:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:36.496905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3cecd94-921e-4710-883c-6cd82188e409 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f64cb80>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:36.596348 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3cecd94-921e-4710-883c-6cd82188e409 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.103683 Oct 28 17:49:36.601315 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2294/4697] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:36 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:37.294300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:37.295285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:37.318415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:37.322449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:37.323105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:37.325057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:37.325766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:37.327708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:37.615081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-735459b5-de6b-4c9c-94c9-1fdcf9d9bbf2 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f7528600160>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:37.714084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-735459b5-de6b-4c9c-94c9-1fdcf9d9bbf2 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.108143 Oct 28 17:49:37.715517 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2295/4698] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:37 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:37.865387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b9f0c188-4765-4c10-95fa-2977c65c8f16"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:37.870553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:37.904635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:37.908115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:37.910660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:37.913757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:37.916563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:37.917978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:37.969593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:37.987784 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d21216a1-54bb-43ab-a7af-5a5b83f9129a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 0.689144 Oct 28 17:49:37.995080 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2404/4699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:37 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:38.085990 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] HTTP exception thrown: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Request method failure captured: Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0/os-volume_attachments/a8d0f2e2-e06a-491a-a649-c68ab6627c04 HTTP/1.1 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 74 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBV5nbvEmtl4aY3TCULBxQVRMZzyRidAnRZAcHvo96hJaB3yYLu2gTq9zNYoWtOYv1k5BVUxie382xrpPY1jLJZq1EK-IDEmKumeW0XQ3mYoPQg7PHbBXzvobv-S0tg0B_Pia1TU0iVT_cCKHZm92SB72FuYiU7rIPsIvUlAN-iuCNM Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: bff5ae02ee9441668df44b4968091bfc Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bff5ae02ee9441668df44b4968091bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bff5ae02ee9441668df44b4968091bfc"}]}] Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: bff5ae02ee9441668df44b4968091bfc Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-56179546 Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesAdminNegativeTest-56179546-project-admin Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7528b0a062fb4761b03db4a139f3ea4d Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesAdminNegativeTest-56179546-project-admin Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: {"volumeAttachment": {"volumeId": "b9f0c188-4765-4c10-95fa-2977c65c8f16"}} Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: exception: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': 'b1bb04d6-14a7-4ad3-85a2-d400478320b0', 'id': 'a8d0f2e2-e06a-491a-a649-c68ab6627c04', 'body': {'volumeAttachment': {'volumeId': 'b9f0c188-4765-4c10-95fa-2977c65c8f16'}}} Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. (HTTP 404) (Request-ID: req-5a29933e-955e-437b-aff5-ea47e54f7947) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:49:38.088790 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. Oct 28 17:49:38.092718 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:38.102347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] Returning 404 to user: Volume a8d0f2e2-e06a-491a-a649-c68ab6627c04 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:38.103807 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03f8da89-f539-4713-9426-4fc3cdc2574d tempest-VolumesAdminNegativeTest-56179546 tempest-VolumesAdminNegativeTest-56179546-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0/os-volume_attachments/a8d0f2e2-e06a-491a-a649-c68ab6627c04" status: 404 len: 109 microversion: 2.1 time: 0.243725 Oct 28 17:49:38.105345 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2296/4700] 10.222.0.48 () {60 vars in 1433 bytes} [Fri Oct 28 17:49:37 2022] PUT /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0/os-volume_attachments/a8d0f2e2-e06a-491a-a649-c68ab6627c04 => generated 109 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:49:38.136863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377393a3-f7b6-435f-a21c-e24bafd52aa6", "name": "network-vif-plugged", "status": "completed", "tag": "667edda3-fedd-4e29-8d93-b5595b785fbd"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:38.176534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:38.177045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:38.179912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:38.257348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] Creating event network-vif-plugged:667edda3-fedd-4e29-8d93-b5595b785fbd for instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 on n-h1-860864-13 Oct 28 17:49:38.271568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-98956cc1-a49e-466b-b3ec-ddda3e9391e1 req-21e24414-2c8c-4a6b-8c4e-4614eb7cbffc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138453 Oct 28 17:49:38.277854 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2405/4701] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:38.729722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f0f6074-527e-451f-b5f2-1f5d5a374b32 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f814e50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:38.820778 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f0f6074-527e-451f-b5f2-1f5d5a374b32 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.096424 Oct 28 17:49:38.822235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2297/4702] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:38 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:39.022287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:39.023126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:39.045060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:39.047520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:39.050743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:39.051697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:39.054172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:39.054684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:39.847403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-063d75b6-7d91-4285-a5ee-b14f24ae9ade tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f75243bcd30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:39.960164 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-063d75b6-7d91-4285-a5ee-b14f24ae9ade tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.129884 Oct 28 17:49:39.960763 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2298/4703] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:39 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:40.127652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:40.159077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ab411ed-ea71-4a98-85d8-f72d9b5273fe tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1317 microversion: 2.1 time: 1.137776 Oct 28 17:49:40.159851 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2406/4704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:39 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:40.995233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0609561e-f2f6-43ac-b055-14b2037529c1 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f5dc670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:41.085205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0609561e-f2f6-43ac-b055-14b2037529c1 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 287 microversion: 2.1 time: 0.105542 Oct 28 17:49:41.086657 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2299/4705] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:40 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:41.098696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b2e05bc-2f13-4e1c-bc74-5e373908c98d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f75286f00d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:41.185874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:41.186487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:41.211069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:41.213840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:41.214750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:41.215572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:41.220645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:41.222882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:41.238823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b2e05bc-2f13-4e1c-bc74-5e373908c98d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 202 len: 0 microversion: 2.1 time: 0.144984 Oct 28 17:49:41.240032 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2407/4706] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 17:49:41 2022] DELETE /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:49:41.252483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ddfbb27-afa5-48b4-bb48-71854c0f430e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f6b7550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:41.365969 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ddfbb27-afa5-48b4-bb48-71854c0f430e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.119641 Oct 28 17:49:41.366757 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2408/4707] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:41 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:41.826234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:42.295687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:42.308280 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8e11137-f5c4-498d-b787-6e0561e8b78a tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1506 microversion: 2.1 time: 1.125913 Oct 28 17:49:42.318670 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2300/4708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:41 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1506 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:42.351590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:42.352819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:42.356380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=16 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:42.378840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0139d725-46ef-4da4-9969-daf1c789885f tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f5dc3a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:42.403265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.417914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.421861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:42.428005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.428656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.431556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:42.465248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0139d725-46ef-4da4-9969-daf1c789885f tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.090718 Oct 28 17:49:42.466426 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2301/4709] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:42 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:42.561785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:42.570298 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abbe3263-63ee-44c8-a923-70c634152c91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/os-instance-actions/req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e" status: 200 len: 313 microversion: 2.1 time: 0.220815 Oct 28 17:49:42.576821 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2409/4710] 10.222.0.48 () {58 vars in 1419 bytes} [Fri Oct 28 17:49:42 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/os-instance-actions/req-29060988-f3a0-4a7d-b4ae-98e5b2c87a5e => generated 313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:42.593891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:42.598831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:42.609834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:42.636606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.645594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.646089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:42.648338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.648907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.649867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:42.812538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:49:42.825884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83a39c60-dd74-447c-8d6a-e73019939671 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "POST /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/action" status: 202 len: 0 microversion: 2.1 time: 0.237557 Oct 28 17:49:42.832543 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2302/4711] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:49:42 2022] POST /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:49:42.840477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:42.841361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:42.855518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.856263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.856862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:42.857800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:42.858451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:42.859063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:43.480297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6942d9f4-4cee-46c3-a36c-4a2ebbff6768 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f58b790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:43.588325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6942d9f4-4cee-46c3-a36c-4a2ebbff6768 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.112599 Oct 28 17:49:43.588839 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2303/4712] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:43 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:43.687057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:43.695532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de33fc8d-9ce9-48ee-9569-0618666b2231 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1508 microversion: 2.1 time: 0.858850 Oct 28 17:49:43.703725 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2410/4713] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:42 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1508 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:44.603009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a65182a-be9f-4e4e-9d1c-c3da7304bb86 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f75241f95e0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:44.676733 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a65182a-be9f-4e4e-9d1c-c3da7304bb86 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.078462 Oct 28 17:49:44.677911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2304/4714] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:44 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:44.720402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:44.721520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:44.744221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:44.744883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:44.747421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:44.748865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:44.752822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:44.754177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:45.529644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:45.530372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:45.548099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:45.553461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:45.554031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:45.554882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:45.560902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:45.561446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:45.722332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:49:45.878054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:45.899723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db783686-f04f-4950-8892-bd2c309ffd91 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1508 microversion: 2.1 time: 1.180816 Oct 28 17:49:45.900885 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2411/4715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:44 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1508 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:45.920599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6bda631-25bc-439e-b71c-2c1e32843e7e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f682e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:45.987660 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6bda631-25bc-439e-b71c-2c1e32843e7e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 200 len: 286 microversion: 2.1 time: 0.084866 Oct 28 17:49:45.989531 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2412/4716] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:45 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:46.084290 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3bcfe926-5643-4873-9d03-af738bc010ed tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 204 len: 0 microversion: 2.1 time: 0.557780 Oct 28 17:49:46.087479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2305/4717] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:45 2022] DELETE /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:49:46.108622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:46.109556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:46.121151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:46.123896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:46.125415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:46.129369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:46.133837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:46.134659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:46.949923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:46.952129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:46.973077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:46.975930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:46.979236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:46.984701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:46.990035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:46.991867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:47.355687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:47.369470 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c08b412-9a5b-45de-9190-f0789f7f2f42 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1514 microversion: 2.1 time: 1.277544 Oct 28 17:49:47.370677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2413/4718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:46 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1514 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:47.400149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92c335ef-cf72-4692-8703-bb07f041ad4d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f75286f0550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:47.483471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-92c335ef-cf72-4692-8703-bb07f041ad4d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] HTTP exception thrown: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92c335ef-cf72-4692-8703-bb07f041ad4d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Request method failure captured: Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 HTTP/1.1 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBYszngeO8iD_CZKketGaMCRJNEoibmB3T3aLiEbHi5BQiu9zS4VTkdHXzouv5DCy5RbM62A-hs0Rn1EvG6OfOZ3RkenvfjwWjlnXO2V6aAofIVhRGzSleOq31DBxF2idUsUvWgzE5HGwfAowkQRijVwK_CuszPSwUF939EzCekIiw8 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/19dbacb637804b99b2f665c32ed960f4"}]}] Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3a42a6eec6164b9280bf1099dc2502b2 Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: exception: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2eb3f5ba-64c5-4889-8b36-0360f6842695'} Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. (HTTP 404) (Request-ID: req-ddfa3d7a-1166-458f-8e71-c31ca4d44c42) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:49:47.500056 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. Oct 28 17:49:47.504266 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:47.516665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92c335ef-cf72-4692-8703-bb07f041ad4d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Returning 404 to user: Snapshot 2eb3f5ba-64c5-4889-8b36-0360f6842695 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:47.522711 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92c335ef-cf72-4692-8703-bb07f041ad4d tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695" status: 404 len: 111 microversion: 2.1 time: 0.145814 Oct 28 17:49:47.524417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2414/4719] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 17:49:47 2022] GET /compute/v2.1/os-snapshots/2eb3f5ba-64c5-4889-8b36-0360f6842695 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:47.537597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ecf58edc-b6ac-4118-a43d-e571ac74cc1e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f664b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:47.726973 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ecf58edc-b6ac-4118-a43d-e571ac74cc1e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 202 len: 0 microversion: 2.1 time: 0.198639 Oct 28 17:49:47.727974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2415/4720] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:49:47 2022] DELETE /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:49:47.738593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a397f950-1418-4e28-88b9-1749160cd207 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f6823a0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:47.808548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:47.820753 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dde943ea-54a2-47c0-bfa1-d861c3da515f tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1508 microversion: 2.1 time: 0.900277 Oct 28 17:49:47.821346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2306/4721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:46 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1508 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:47.919574 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a397f950-1418-4e28-88b9-1749160cd207 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.187014 Oct 28 17:49:47.920366 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2416/4722] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:47 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:48.403599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:48.404231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:48.443226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:48.443817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:48.444262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:48.450504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:48.451567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:48.455043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:48.851090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:48.852502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:48.884887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:48.892719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:48.893564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:48.895104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:48.895638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:48.896079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:49.399074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:49.419152 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-358a854c-b641-40b4-b6fd-33fb513033f2 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1514 microversion: 2.1 time: 1.018752 Oct 28 17:49:49.421622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2307/4723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:48 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1514 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:49.432760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f1bee44-54fc-478a-bb20-422109107cdc tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f752447e310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:49.570920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f1bee44-54fc-478a-bb20-422109107cdc tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.148170 Oct 28 17:49:49.578208 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2308/4724] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:49 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:50.416748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:50.428882 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53ca6453-1509-4cd2-816e-5944b9e40741 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1506 microversion: 2.1 time: 1.582999 Oct 28 17:49:50.433678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2417/4725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:48 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1506 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:49:50.443198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:50.443856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:50.456352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '.version_select at 0x7f751f68a550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:50.466449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:50.477624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.482303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.483381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:50.485769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.487942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.491485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:50.503729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.512823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.513528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:50.519583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.520142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.524758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:50.685597 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da86e9c4-5a8b-4227-adca-02f1e58cfd87 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.234151 Oct 28 17:49:50.694505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2418/4726] 10.222.0.48 () {58 vars in 1296 bytes} [Fri Oct 28 17:49:50 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6/os-instance-actions => generated 611 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:49:50.721872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e574d8c-b2a0-4316-ab36-5212b930169e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751faacdc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:50.884662 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e574d8c-b2a0-4316-ab36-5212b930169e tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.188964 Oct 28 17:49:50.894791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2419/4727] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:50 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:50.902987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:50.909220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:50.937601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.943231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.946515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:50.951203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:50.952358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:50.955845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:51.010109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:51.022077 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62f0837a-687e-45c6-a44c-efa296b45b24 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1472 microversion: 2.1 time: 0.583260 Oct 28 17:49:51.033526 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2309/4728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:50 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1472 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:51.052101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1bb04d6-14a7-4ad3-85a2-d400478320b0", "name": "network-vif-deleted", "tag": "c2e6e8e0-5d36-4c86-9104-7c83ea88622f"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:51.090266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:49:51.120984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:51.124335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:51.124781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:51.166620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] Creating event network-vif-deleted:c2e6e8e0-5d36-4c86-9104-7c83ea88622f for instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 on n-h1-860864-13 Oct 28 17:49:51.190589 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4422e329-9980-42e9-8ef8-e347466a6f4f req-ef77f919-6476-41ab-bcf1-9f81fb9055e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155692 Oct 28 17:49:51.195724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2310/4729] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:51.364311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de749321-f0bb-49f4-83fb-7d52619b787e tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "DELETE /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 204 len: 0 microversion: 2.1 time: 0.467945 Oct 28 17:49:51.379632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:51.380535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:51.381060 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2420/4730] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:49:50 2022] DELETE /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:49:51.396207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:51.397011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:51.398516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:51.399560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:51.404188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:51.404883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:51.903289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f0c16cf-4a6e-4e60-8419-9df755b2f0ae tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f751f682af0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:52.077603 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f0c16cf-4a6e-4e60-8419-9df755b2f0ae tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.178410 Oct 28 17:49:52.085700 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2421/4731] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:51 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:52.091294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:52.092427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:52.125295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:52.125513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:52.126023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:52.126658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:52.127123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:52.127593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:52.279985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:52.290261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:52.290598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:52.291043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:52.291545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lazy-loading 'fault' on Instance uuid b1bb04d6-14a7-4ad3-85a2-d400478320b0 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:49:52.293927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f349f1e9-dc36-4dc1-9da5-ceb7cc1ea85c tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1512 microversion: 2.1 time: 0.921944 Oct 28 17:49:52.295892 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2311/4732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:51 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1512 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:52.500966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:52.514875 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-446b7e32-e930-48fc-aaed-aba54a0cc0b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 200 len: 1308 microversion: 2.1 time: 0.425358 Oct 28 17:49:52.518460 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2422/4733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:52 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:53.092584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-288a0b33-9c97-4b0e-a91d-82d62a355f6a tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f752447eaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:53.259729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-288a0b33-9c97-4b0e-a91d-82d62a355f6a tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 200 len: 345 microversion: 2.1 time: 0.170930 Oct 28 17:49:53.266464 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2312/4734] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:53 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:53.324958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:53.325808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:53.347137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:53.347554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:53.348017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:53.379387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:53.379997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:53.380597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:53.546254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:53.548031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: b1bb04d6-14a7-4ad3-85a2-d400478320b0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:53.566994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:53.576739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:53.577456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:53.578415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:53.579812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:53.582055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:53.624003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] HTTP exception thrown: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Request method failure captured: Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 HTTP/1.1 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBVgr1RQtepF6IYhtKWPDYBCIJl43Tmvy2xP2g5Wa6xlKG0_YJXyp4kK4QJtCEtn9vM-7P9bKko0gVsAoNp35agw5Iary1l-dj1p13TTlFkeOdXELDwKzN1ErezbX1vwJN_jFO_72mwF2fHiWcgPSSlQ6_sM3_MApCE5vBle1nFhCk4 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 5354fd8b351d40639670ad813ab61d87 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5354fd8b351d40639670ad813ab61d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5354fd8b351d40639670ad813ab61d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5354fd8b351d40639670ad813ab61d87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5354fd8b351d40639670ad813ab61d87"}]}] Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 5354fd8b351d40639670ad813ab61d87 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesAdminNegativeTest-1750115486-project Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 5013ed8c6ca14b4e9ad3cf4d9d883196 Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesAdminNegativeTest-1750115486-project Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b1bb04d6-14a7-4ad3-85a2-d400478320b0'} Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:53.630364 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Returning 404 to user: Instance b1bb04d6-14a7-4ad3-85a2-d400478320b0 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-197db8c7-73a8-448a-883a-3fdb3ab6cd17 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0" status: 404 len: 111 microversion: 2.1 time: 0.090576 Oct 28 17:49:53.634679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2313/4735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:53 2022] GET /compute/v2.1/servers/b1bb04d6-14a7-4ad3-85a2-d400478320b0 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:49:54.111523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:54.125778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d39c281a-bfb4-4414-9b28-32bd34ff7695 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1512 microversion: 2.1 time: 0.806621 Oct 28 17:49:54.127088 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2423/4736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:53 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1512 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:54.274574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f253f3a0-2f29-4063-8aab-a03e82de9394 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f7528600ee0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:54.370805 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f253f3a0-2f29-4063-8aab-a03e82de9394 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] HTTP exception thrown: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f253f3a0-2f29-4063-8aab-a03e82de9394 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Request method failure captured: Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea HTTP/1.1 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBYszngeO8iD_CZKketGaMCRJNEoibmB3T3aLiEbHi5BQiu9zS4VTkdHXzouv5DCy5RbM62A-hs0Rn1EvG6OfOZ3RkenvfjwWjlnXO2V6aAofIVhRGzSleOq31DBxF2idUsUvWgzE5HGwfAowkQRijVwK_CuszPSwUF939EzCekIiw8 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/19dbacb637804b99b2f665c32ed960f4"}]}] Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 3a42a6eec6164b9280bf1099dc2502b2 Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: exception: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea'} Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. (HTTP 404) (Request-ID: req-87d8bca3-c84e-4ad5-95ba-b48bb4119d1b) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:49:54.375689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.379862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.384397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f253f3a0-2f29-4063-8aab-a03e82de9394 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Returning 404 to user: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:54.385465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f253f3a0-2f29-4063-8aab-a03e82de9394 tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 404 len: 109 microversion: 2.1 time: 0.115301 Oct 28 17:49:54.386550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2314/4737] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:54 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:54.396870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-797de568-d4a4-49e8-b563-e39374920fef tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f752427a1f0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:54.446331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-797de568-d4a4-49e8-b563-e39374920fef tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] HTTP exception thrown: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-797de568-d4a4-49e8-b563-e39374920fef tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Request method failure captured: Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea HTTP/1.1 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBYszngeO8iD_CZKketGaMCRJNEoibmB3T3aLiEbHi5BQiu9zS4VTkdHXzouv5DCy5RbM62A-hs0Rn1EvG6OfOZ3RkenvfjwWjlnXO2V6aAofIVhRGzSleOq31DBxF2idUsUvWgzE5HGwfAowkQRijVwK_CuszPSwUF939EzCekIiw8 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/19dbacb637804b99b2f665c32ed960f4"}]}] Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3a42a6eec6164b9280bf1099dc2502b2 Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: exception: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea'} Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. (HTTP 404) (Request-ID: req-eb4abf61-e044-4fb8-a638-3c5556728c3a) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:49:54.448986 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.453104 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.458032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-797de568-d4a4-49e8-b563-e39374920fef tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Returning 404 to user: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:54.459121 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-797de568-d4a4-49e8-b563-e39374920fef tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 404 len: 109 microversion: 2.1 time: 0.066640 Oct 28 17:49:54.460213 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2424/4738] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:49:54 2022] DELETE /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:54.469234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-087855d2-9570-46b2-87f0-7023e76a50da tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Calling method '.version_select at 0x7f752447e4c0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:54.528927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-087855d2-9570-46b2-87f0-7023e76a50da tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] HTTP exception thrown: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-087855d2-9570-46b2-87f0-7023e76a50da tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Request method failure captured: Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea HTTP/1.1 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBYszngeO8iD_CZKketGaMCRJNEoibmB3T3aLiEbHi5BQiu9zS4VTkdHXzouv5DCy5RbM62A-hs0Rn1EvG6OfOZ3RkenvfjwWjlnXO2V6aAofIVhRGzSleOq31DBxF2idUsUvWgzE5HGwfAowkQRijVwK_CuszPSwUF939EzCekIiw8 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_19dbacb637804b99b2f665c32ed960f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/19dbacb637804b99b2f665c32ed960f4"}]}] Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 19dbacb637804b99b2f665c32ed960f4 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-60627662 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 3a42a6eec6164b9280bf1099dc2502b2 Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesSnapshotsTestJSON-60627662-project Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: exception: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea'} Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. (HTTP 404) (Request-ID: req-0cda76f6-ec47-4245-b20c-66b3afa09169) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:49:54.531347 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. Oct 28 17:49:54.535884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:49:54.540586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-087855d2-9570-46b2-87f0-7023e76a50da tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] Returning 404 to user: Volume a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:54.541595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-087855d2-9570-46b2-87f0-7023e76a50da tempest-VolumesSnapshotsTestJSON-60627662 tempest-VolumesSnapshotsTestJSON-60627662-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea" status: 404 len: 109 microversion: 2.1 time: 0.077485 Oct 28 17:49:54.542664 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2315/4739] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:49:54 2022] GET /compute/v2.1/os-volumes/a5f9ee0a-7dc0-4ce3-8196-9a635d2bfaea => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:55.168713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:55.171010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:55.194243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:55.195984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:55.199190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:55.202661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:55.206096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:55.208944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:55.532261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ece7cb5eb949c2a8131f6d6f5e7f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abb9c807e8b40cfb8491654f126f50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:49:55.542555 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a06326d2-2e28-4d23-b6e5-2c2e4997a6e8 tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 200 len: 1470 microversion: 2.1 time: 0.381972 Oct 28 17:49:55.551962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2425/4740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:55 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:49:55.680376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377393a3-f7b6-435f-a21c-e24bafd52aa6", "name": "network-vif-deleted", "tag": "667edda3-fedd-4e29-8d93-b5595b785fbd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:55.746857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:55.751841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:55.753064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:55.811927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] Creating event network-vif-deleted:667edda3-fedd-4e29-8d93-b5595b785fbd for instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 on n-h1-860864-13 Oct 28 17:49:55.836211 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-45885944-9dce-43f5-a0e2-56ab6e761d8f req-0605bbcd-fe47-4b90-a165-2f808ffc83ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168107 Oct 28 17:49:55.840278 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2316/4741] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:49:56.577948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:49:56.578681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] [instance: 377393a3-f7b6-435f-a21c-e24bafd52aa6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:49:56.614455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:56.614455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:56.614667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:56.626169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:56.626861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:56.627339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:56.725112 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] HTTP exception thrown: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Request method failure captured: Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 HTTP/1.1 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBYUUK6mna8EUUHs2V_oKXu1bNKWxWJJjqIlF8XgNqgTl6f-FF0_hRH1NhANBAoqSXDsIkvBL2Zs9YRc-jjl7pIUhA9pdq25v01JjZ335PCN34iiv9p2J8t2YgapNTHE7BrzTqoQSkXwSZEQq0Q-CGRj_vmEYveCfuuj-2-FD1RbI6E Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 3abb9c807e8b40cfb8491654f126f50e Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceActionsTestJSON-522662840 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3abb9c807e8b40cfb8491654f126f50e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3abb9c807e8b40cfb8491654f126f50e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3abb9c807e8b40cfb8491654f126f50e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3abb9c807e8b40cfb8491654f126f50e"}]}] Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceActionsTestJSON-522662840 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 3abb9c807e8b40cfb8491654f126f50e Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceActionsTestJSON-522662840 Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceActionsTestJSON-522662840-project Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 41ece7cb5eb949c2a8131f6d6f5e7f3c Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceActionsTestJSON-522662840-project Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '377393a3-f7b6-435f-a21c-e24bafd52aa6'} Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:49:56.726691 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:49:56.731023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] Returning 404 to user: Instance 377393a3-f7b6-435f-a21c-e24bafd52aa6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:49:56.743750 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-acdffeae-3e6c-43dc-a3de-b0404eeb98ac tempest-InstanceActionsTestJSON-522662840 tempest-InstanceActionsTestJSON-522662840-project] 10.222.0.48 "GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6" status: 404 len: 111 microversion: 2.1 time: 0.154255 Oct 28 17:49:56.747009 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2426/4742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:49:56 2022] GET /compute/v2.1/servers/377393a3-f7b6-435f-a21c-e24bafd52aa6 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:49:58.787986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-19408952", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "6077c2ed-a62b-4d06-a667-d69048b9d447"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:49:58.917481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] validate_networks() for [('6077c2ed-a62b-4d06-a667-d69048b9d447', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:49:59.818631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:49:59.820463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:49:59.821162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:49:59.821786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:49:59.822417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:49:59.838360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:59.839303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:59.840009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:59.841004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:49:59.841691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:49:59.842613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:49:59.878158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:49:59.884998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for user ea6781ab0164419ba1fc68626ebeae67 and project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:49:59.901026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:49:59.923204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:50:00.034194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83e364d3-a2fe-47d8-97a6-cd3313681c2d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.798561 Oct 28 17:50:00.049980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07774e2f-4bb9-40e9-b855-bce54377829f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:00.051310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07774e2f-4bb9-40e9-b855-bce54377829f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:00.056418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2317/4743] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:50:00.189737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07774e2f-4bb9-40e9-b855-bce54377829f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:00.197009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07774e2f-4bb9-40e9-b855-bce54377829f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1216 microversion: 2.1 time: 0.151516 Oct 28 17:50:00.207811 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2427/4744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:00 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:01.228255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:01.229200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:01.248417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:01.257290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:01.257909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:01.258668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:01.259155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:01.259653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:01.438614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:01.451829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4c44792-9751-4829-a510-2cd27536a19e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1220 microversion: 2.1 time: 0.228045 Oct 28 17:50:01.454753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2318/4745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:01 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1220 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:02.476832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:02.478781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:02.489902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:02.513971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:02.514473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:02.514910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:02.515665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:02.533617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:02.540983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:02.890171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:02.904923 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4635f232-220d-4a81-8e6b-78ef552bec39 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1274 microversion: 2.1 time: 0.427035 Oct 28 17:50:02.909895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2428/4746] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:02 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1274 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:03.087619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:03.092043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:03.122264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.127521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.128048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:03.128920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.129384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.133256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:03.271859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:50:03.617575 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e11eec0-57b0-4526-a210-ed449930d6b1 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 204 len: 0 microversion: 2.1 time: 0.542684 Oct 28 17:50:03.618811 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2319/4747] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:50:03 2022] DELETE /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:50:03.628362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:03.629166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:03.651239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.652082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.653229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:03.654063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.659616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.662876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:03.712534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:03.938250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:03.939227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:03.949179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.949683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.950180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:03.950898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:03.951271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:03.951735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:04.292925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:04.302526 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99d3969d-4334-4ed8-be4a-f4b6df8ad3f5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1274 microversion: 2.1 time: 0.368823 Oct 28 17:50:04.311783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2320/4748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:03 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:04.736120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:04.747630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-069e2ae3-a862-4a95-8e98-b45147a8ccfc tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1680 microversion: 2.1 time: 1.122067 Oct 28 17:50:04.751606 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2429/4749] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:03 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1680 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:05.335993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:05.336618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:05.350644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:05.353986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:05.354457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:05.362747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:05.366527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:05.367035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:05.773990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:05.774635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:05.788526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:05.789033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:05.789482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:05.790210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:05.790672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:05.791211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:06.691641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:06.704426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d280fc9-3308-4a00-9ef8-7a1ee4c3b03e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 1.372367 Oct 28 17:50:06.705031 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2321/4750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:05 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:06.748200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:06.762497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1848729-38bd-4e2f-88c2-ee525f2738da tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1680 microversion: 2.1 time: 0.990824 Oct 28 17:50:06.767665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2430/4751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:05 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1680 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:07.737863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:07.738476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:07.749757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:07.751665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:07.755434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:07.757290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:07.757861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:07.759604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:07.786847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:07.787490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:07.800695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:07.801763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:07.802310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:07.803150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:07.805107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:07.807189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:08.323485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:08.334359 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e743dfba-f580-4789-abc3-cc276e197f35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1680 microversion: 2.1 time: 0.552469 Oct 28 17:50:08.337042 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2431/4752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:07 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:08.466203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:08.481799 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c18bf805-bf16-412b-b845-bf74199bef31 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 0.754144 Oct 28 17:50:08.483997 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2322/4753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:07 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:08.494360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1963b4e-008c-48ff-86ba-490d7edd61f0", "tag": "207e47e2-79cc-42ff-8884-732f3bb19515"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:08.514681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:08.520247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:08.520947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:08.538839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] Creating event network-changed:207e47e2-79cc-42ff-8884-732f3bb19515 for instance b1963b4e-008c-48ff-86ba-490d7edd61f0 on n-h1-860864-13 Oct 28 17:50:08.564417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-a9576ebd-d7e0-4376-988e-55a0d96006f6 req-3bb92784-6fe4-498c-9bdc-22c5c032b27b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073786 Oct 28 17:50:08.565764 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2432/4754] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:09.363561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:09.364976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:09.384200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:09.385122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:09.385715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:09.387118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:09.388428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:09.389343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:09.512946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:09.513652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:09.515542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:09.525686 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19412398-c60a-4fc9-b942-72d8455cba35 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1612 microversion: 2.1 time: 0.168985 Oct 28 17:50:09.527068 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2323/4755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:09 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1612 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:09.540918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:09.545529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:09.546005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:09.547740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:09.548288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:09.548766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:10.181150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:10.181994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:10.196729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:10.440652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:10.450982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8a85d2c-6e21-40a4-9d38-79ca66c3cee4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 0.946766 Oct 28 17:50:10.451615 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2433/4756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:09 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:10.489611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1140fc00-34c9-42e4-b9cd-1016215c097e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: .version_select at 0x7f751f5dc550>, body: {"keypair": {"name": "tempest-keypair-1232632844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0iTJOB4N5JivWcLb6N5LoP1guouIv6QNZucM3xgohWHqgAMpWynZiGC37dUn5/qFBwZK2P1lUsqoKPkLr1lu3EWOXYW6IzJ+DLOH7ibOWnRHqhRfQolO4zWnBs2NE/Hg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:10.533023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1140fc00-34c9-42e4-b9cd-1016215c097e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:50:10.540191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1140fc00-34c9-42e4-b9cd-1016215c097e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for user d9009e2acd3345f2a5dd2d609685d0aa and project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:50:10.550891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:10.551544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:10.566257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:10.567426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:10.568036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:10.568902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:10.571486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:10.573304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:10.630131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1140fc00-34c9-42e4-b9cd-1016215c097e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.453798 Oct 28 17:50:10.639347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2324/4757] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:50:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 464 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:50:10.651825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53932c26-fc07-49e1-a386-ed0e935144ef", "name": "network-vif-deleted", "tag": "df1997ea-e198-48be-909f-a7f39dde1cb1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:10.725608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:10.733254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:10.733786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:10.796014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] Creating event network-vif-deleted:df1997ea-e198-48be-909f-a7f39dde1cb1 for instance 53932c26-fc07-49e1-a386-ed0e935144ef on n-h2-860864-13 Oct 28 17:50:10.809690 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5658ce29-8c8e-4160-b9fa-a2e3ac740e0a req-9073a896-efa3-4db7-ba4f-93ab72dc44f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167879 Oct 28 17:50:10.810306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2325/4758] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:11.022476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5013ed8c6ca14b4e9ad3cf4d9d883196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5354fd8b351d40639670ad813ab61d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:11.037908 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-288fc3a5-5818-4976-b29b-8cb787f6a943 tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 200 len: 1612 microversion: 2.1 time: 0.489129 Oct 28 17:50:11.039929 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2434/4759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:10 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 1612 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:11.477181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:11.477906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:11.490600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:11.491415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:11.497372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:11.498175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:11.498776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:11.499281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:11.560282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:12.069863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:12.070517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] [instance: 53932c26-fc07-49e1-a386-ed0e935144ef] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:12.092045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:12.092550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:12.092991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:12.100480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:12.102301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:12.104274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:12.170481 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] HTTP exception thrown: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Request method failure captured: Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef HTTP/1.1 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBVgr1RQtepF6IYhtKWPDYBCIJl43Tmvy2xP2g5Wa6xlKG0_YJXyp4kK4QJtCEtn9vM-7P9bKko0gVsAoNp35agw5Iary1l-dj1p13TTlFkeOdXELDwKzN1ErezbX1vwJN_jFO_72mwF2fHiWcgPSSlQ6_sM3_MApCE5vBle1nFhCk4 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 5354fd8b351d40639670ad813ab61d87 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5354fd8b351d40639670ad813ab61d87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5354fd8b351d40639670ad813ab61d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5354fd8b351d40639670ad813ab61d87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5354fd8b351d40639670ad813ab61d87"}]}] Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 5354fd8b351d40639670ad813ab61d87 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1750115486 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesAdminNegativeTest-1750115486-project Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 5013ed8c6ca14b4e9ad3cf4d9d883196 Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesAdminNegativeTest-1750115486-project Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '53932c26-fc07-49e1-a386-ed0e935144ef'} Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:50:12.177798 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. Oct 28 17:50:12.182397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:12.187948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Returning 404 to user: Instance 53932c26-fc07-49e1-a386-ed0e935144ef could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:50:12.189053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93551cd1-1c9f-439b-8126-37281dfb453d tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef" status: 404 len: 111 microversion: 2.1 time: 0.123186 Oct 28 17:50:12.192769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2435/4760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:12 2022] GET /compute/v2.1/servers/53932c26-fc07-49e1-a386-ed0e935144ef => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:50:12.207238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-161072b6-46c7-4e8f-96d1-a2f7c8c42cdf tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] Calling method '.version_select at 0x7f7524c73550>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:12.272992 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-161072b6-46c7-4e8f-96d1-a2f7c8c42cdf tempest-VolumesAdminNegativeTest-1750115486 tempest-VolumesAdminNegativeTest-1750115486-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712977641" status: 202 len: 0 microversion: 2.1 time: 0.075073 Oct 28 17:50:12.274509 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2436/4761] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712977641 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:50:12.798485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:12.808764 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bff700aa-c28a-4d19-a66f-73bad9b3487a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 1.337368 Oct 28 17:50:12.815545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2326/4762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:11 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:13.841982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:13.843727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:13.861598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:13.876048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:13.876048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:13.876048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:13.876048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:13.884019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:15.231547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:15.240892 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1aa80701-1040-4f27-bbca-9088753863a9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 1.405671 Oct 28 17:50:15.244058 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2437/4763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:13 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:16.266638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:16.267271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:16.271319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:16.293002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:16.293504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:16.299436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:16.303671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:16.307139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:16.307940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:16.881836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1963b4e-008c-48ff-86ba-490d7edd61f0", "name": "network-vif-plugged", "status": "completed", "tag": "207e47e2-79cc-42ff-8884-732f3bb19515"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:16.910601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:16.911587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:16.917837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:16.957179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] Creating event network-vif-plugged:207e47e2-79cc-42ff-8884-732f3bb19515 for instance b1963b4e-008c-48ff-86ba-490d7edd61f0 on n-h1-860864-13 Oct 28 17:50:16.977162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-133b4517-4cb1-4e0f-9d58-47259b41b0de req-e192a07c-203f-4842-b6f0-200870bcff34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097975 Oct 28 17:50:16.979983 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2438/4764] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:50:18.432679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:18.476648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9978b86b-3703-4054-add9-6cd7b7a8d964 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 2.196364 Oct 28 17:50:18.493623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2327/4765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:16 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:19.129741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1433363482", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d9c1808-e3ae-4085-94de-277d9e33776c"}], "security_groups": [{"name": "tempest-securitygroup--880815570"}], "key_name": "tempest-keypair-1232632844", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:19.444243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] validate_networks() for [('1d9c1808-e3ae-4085-94de-277d9e33776c', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:50:19.504292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:19.516472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:19.530042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:19.530963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:19.532012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:19.532748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:19.533203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:19.533619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:20.042885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:20.054289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0444e5b8-1544-42e9-bd70-46c5df33f412 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1316 microversion: 2.1 time: 0.554800 Oct 28 17:50:20.054917 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2328/4766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:19 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:21.083402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:21.084070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:21.096185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:21.102077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.102825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.104051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:21.105984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.107820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.109702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:21.449103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:50:21.449626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:50:21.450015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:50:21.450427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:50:21.450841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:50:21.475128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.475645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.476090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:21.476832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.477311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.478906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:21.545176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:50:21.556998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for user d9009e2acd3345f2a5dd2d609685d0aa and project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:50:21.590543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:50:21.594957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:50:21.743734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:21.756639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5ce85b7f-0d9b-4fff-847a-0289a8fae2ea tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.632394 Oct 28 17:50:21.757606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d4f82bb-63f6-4cc9-84e5-56054ab42bcf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1507 microversion: 2.1 time: 0.678684 Oct 28 17:50:21.758875 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2439/4767] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:50:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:50:21.768298 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2329/4768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:21 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1507 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:21.777788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:21.783570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:21.793937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:21.794605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:21.823267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.823986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.826010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:21.831153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:21.832123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:21.835735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:22.307525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:22.333352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:22.341845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:22.348636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe4b0b0c-4c41-4d34-bb68-a44fff1d7c7f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1282 microversion: 2.20 time: 0.573516 Oct 28 17:50:22.350913 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2440/4769] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:21 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1282 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:22.636542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:22.649248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10fe8c8b-b704-459f-a6a6-17ad147200a7 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1507 microversion: 2.1 time: 0.860102 Oct 28 17:50:22.651988 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2330/4770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:21 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1507 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:22.680536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:22.686501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:22.713170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:22.714395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:22.716280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:22.723106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:22.725174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:22.725872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:22.911871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:50:22.916344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:50:22.917778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:50:22.918333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:50:22.918761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:50:23.130009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:23.137869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.138586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.139192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.140240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.140863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.141455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.190988 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87f45cf6-14e3-46af-be50-f0cbb3b816c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "POST /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0/action" status: 202 len: 1109 microversion: 2.1 time: 0.513017 Oct 28 17:50:23.193187 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2441/4771] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:50:22 2022] POST /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0/action => generated 1109 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 17:50:23.212420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:23.213030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:23.251254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.251804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.262527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.266538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.274444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.280307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.380738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:23.381352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:23.395868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.407095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.407797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.408577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:23.409061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:23.409496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:23.732561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:23.754832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:23.761263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:23.770536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-05d77378-0334-4f35-83bd-3a0f1ecde093 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1278 microversion: 2.20 time: 0.386089 Oct 28 17:50:23.771236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2442/4772] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:23 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1278 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:24.065019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:24.111194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9eed20ea-56f8-4587-a148-006d6aea82bf tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.882077 Oct 28 17:50:24.127702 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2331/4773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:23 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:24.801106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:24.801706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:24.817311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:24.817812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:24.818251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:24.818958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:24.820498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:24.820498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:25.081909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:25.099772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:25.101497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:25.104127 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a88f7fd7-41c3-4620-938a-4cc5b3827cbf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1340 microversion: 2.20 time: 0.306929 Oct 28 17:50:25.105161 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2443/4774] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:24 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1340 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:25.136799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:25.137459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:25.155135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:25.155677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:25.156893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:25.157629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:25.160753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:25.161203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:25.628252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:25.641134 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da31920f-6574-4bd5-b385-d45d3dfd6c4c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.508015 Oct 28 17:50:25.641725 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2332/4775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:25 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:26.135001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:26.135768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:26.144119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:26.145073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:26.145577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:26.146494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:26.147218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:26.147744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:26.668597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:26.669216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:26.695613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:26.696212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:26.698545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:26.699918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:26.702448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:26.705118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:27.138495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:27.159289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b3e5854-e997-44ef-ae1d-0437174c739a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.495534 Oct 28 17:50:27.160230 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2333/4776] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:26 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:27.193076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:27.215815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:27.216291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:27.222117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:27.231657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:27.252178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:27.259081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:27.260974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] Creating event network-changed:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:50:27.263439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dbf07af3-4f16-4b99-bfeb-d5fe1a0b3ced tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 1.132309 Oct 28 17:50:27.275155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-46d0c6ab-8f6f-49a9-a50e-49f3ad30f270 req-b7e09b6c-f6be-4b3a-90d4-1d2e5627321d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094043 Oct 28 17:50:27.276551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2444/4777] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:26 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:27.277824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2334/4778] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:28.186625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:28.188201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:28.202516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:28.203925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:28.204882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:28.206058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:28.207482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:28.213830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:28.291661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:28.298753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:28.313535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:28.314685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:28.315238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:28.317307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:28.321492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:28.322070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:29.196611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:29.212494 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c54eb97-68a2-404b-92f9-7f08ec5026ed tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.029739 Oct 28 17:50:29.232099 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2445/4779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:28 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:29.365324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:29.383083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:29.387841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:29.390982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-308354f7-c628-46ac-baff-6e9c3044973e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 1.103990 Oct 28 17:50:29.391735 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2335/4780] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:28 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:30.237360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:30.238908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:30.247964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:30.250741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:30.251698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:30.255862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:30.256521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:30.257135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:30.417498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:30.418244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:30.431487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:30.432580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:30.434458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:30.435439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:30.436523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:30.437222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:31.245571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:31.266591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ad9b652-8e0c-4ef8-a05e-5d184c3bb2c4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.033378 Oct 28 17:50:31.283126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2446/4781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:30 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:31.452531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:31.462309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:31.468646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:31.472429 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-731c905b-35c5-41f7-a13a-82d53e6fd575 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 1.058683 Oct 28 17:50:31.476962 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2336/4782] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:30 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:32.290004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:32.290633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:32.302275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:32.304798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:32.305300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:32.305725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:32.321611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:32.322123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:32.322982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:32.325223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:32.509964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:32.514168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:32.551277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:32.556513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:32.559747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:32.562882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:32.566904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:32.569577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:32.839104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:32.866346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ecb7d95b-95c7-4f52-a8c9-83464c0d2ed9 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.578707 Oct 28 17:50:32.871026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2447/4783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:32 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:33.133840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:33.150597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:33.158194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:33.160645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5e367d0-3133-49d7-b21c-071a1832a54a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 0.655767 Oct 28 17:50:33.178574 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2337/4784] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:32 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:33.897974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:33.899148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:33.922531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:33.936523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:33.944952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:33.945719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:33.948347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:33.951159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:33.953648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:34.023074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:34.195121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:34.196552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:34.211494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:34.214904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:34.217163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:34.219179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:34.220062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:34.221938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:34.755608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:34.803322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:34.818179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:34.819262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50a91239-405e-48c4-9d46-f9dbca14568d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 0.629205 Oct 28 17:50:34.820091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2338/4785] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:34 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:34.848733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:34.892081 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a75c3759-49f1-43e8-a2ee-e123639500fe tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.998687 Oct 28 17:50:34.894570 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2448/4786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:33 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:35.862990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:35.864223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:35.882645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:35.884958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:35.886880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:35.888381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:35.892136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:35.895253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:35.925406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:35.926029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:35.944344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:35.945079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:35.953149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:35.954128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:35.954767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:35.955535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:37.228889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:37.253025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9334a3e3-e0ce-4385-95e7-095f8bb28f82 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.328328 Oct 28 17:50:37.255602 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2449/4787] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:35 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:37.269588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "name": "network-vif-plugged", "status": "completed", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:37.303925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:37.307643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:37.309910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:37.352778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] Creating event network-vif-plugged:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:50:37.381615 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-20718e2f-bd85-4755-bd32-2bcc4a592e2a req-be8f694d-475e-4fad-b73e-3b88e747beb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124245 Oct 28 17:50:37.385033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2450/4788] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:37.420178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:37.436152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:37.448932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:37.453233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14832bed-b6e4-47e2-91c9-6c16b0b6187e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 1.595866 Oct 28 17:50:37.456147 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2339/4789] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:35 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:38.282599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:38.283401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:38.298230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:38.300277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:38.300742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:38.303624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:38.305361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:38.307223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:38.487131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:38.487924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:38.498394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:38.501756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:38.504027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:38.508431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:38.510357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:38.511532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:39.176875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:39.209504 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-936b82a4-fbc3-4c9b-82c8-f79d408a8942 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.931296 Oct 28 17:50:39.211574 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2451/4790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:38 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:39.485424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:39.507341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:39.508767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:39.509919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3f498c2-b8cd-4392-9d06-f17a72019182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1407 microversion: 2.20 time: 1.029974 Oct 28 17:50:39.536680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2340/4791] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:38 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1407 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:40.237044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:40.238187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:40.259148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:40.266519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:40.267172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:40.270846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:40.273668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:40.274434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:40.539389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:40.548122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:40.561126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:40.568424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:40.569172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:40.571696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:40.572366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:40.574309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:40.785659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:40.806329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-025abd5b-c282-42e9-9f6b-f95af9598f50 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.575722 Oct 28 17:50:40.809488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2452/4792] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:40 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:41.018147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:41.029759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:41.039560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:41.042079 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5873685a-b595-4420-b1b8-c2c7425af438 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1599 microversion: 2.20 time: 0.506614 Oct 28 17:50:41.048048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2341/4793] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:40 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1599 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:41.075350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:41.075894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:41.094892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:41.095418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:41.095894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:41.097925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:41.099236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:41.099711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:41.392305 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34bf0c06-adaf-4974-9e7c-aba4aef38d64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.322583 Oct 28 17:50:41.392964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2453/4794] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:50:41 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:50:41.840791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:41.844897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:41.865515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:41.867158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:41.868192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:41.869410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:41.870047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:41.870835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:41.876990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=90 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:42.554804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:42.570044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-497e6c18-762d-4b54-bf59-a72a3d835831 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 0.735619 Oct 28 17:50:42.575943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2342/4795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:41 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:43.281006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-171748698", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "a0cc2d4c-610f-43e0-94f4-94a2a0ca32c7"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:43.490718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] validate_networks() for [('a0cc2d4c-610f-43e0-94f4-94a2a0ca32c7', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:50:43.613866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:43.615194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:43.633370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:43.637319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:43.638227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:43.640843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:43.642383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:43.645278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:44.812830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:44.825147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0a0beec-56c3-427b-87d0-eae104b929dd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.216961 Oct 28 17:50:44.842499 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2343/4796] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:43 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:45.053548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:45.069052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:45.075822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:45.076346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:45.101850 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] Creating event network-changed:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:50:45.107184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c6ff610b-fe3b-4cf0-813e-f4ae6016600b req-033d395b-cc4a-489f-96e8-f36700598a22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057280 Oct 28 17:50:45.108029 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2344/4797] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:50:45.369781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:50:45.370282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:50:45.370655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:50:45.371061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:50:45.377913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:50:45.405616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:45.406120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:45.406552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:45.407299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:45.407771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:45.408198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:45.476997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Getting quotas for project 34df54f9b5e74d0fba43463d5ba2a20c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:50:45.502898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Getting quotas for user 7f41073d894d4aada74c4e66bd420311 and project 34df54f9b5e74d0fba43463d5ba2a20c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:50:45.553860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:50:45.558024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:50:45.657111 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6768d0d6-4b19-4cdd-83e2-5837bd71cf62 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.172315 Oct 28 17:50:45.664387 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2454/4798] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:50:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:50:45.674776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:45.675918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:45.862930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:45.863834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:45.885630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:45.886143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:45.892406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:45.893270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:45.893755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:45.894192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:46.050655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:46.061013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:46.068547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:46.073314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb55f045-6b86-4432-b049-562d747772b7 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1258 microversion: 2.21 time: 0.401476 Oct 28 17:50:46.076290 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2345/4799] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:45 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1258 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:46.517851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b45b9c8-9ac4-4b92-93d2-a62f29404ee4 tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:46.544592 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7b45b9c8-9ac4-4b92-93d2-a62f29404ee4 tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.437486 Oct 28 17:50:46.546583 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2346/4800] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:50:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:47.099754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:47.101550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:47.106985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:47.107795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:47.127625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ddea9266-1d32-4baa-b42e-d0906031e307 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.269595 Oct 28 17:50:47.128235 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2455/4801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:45 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:47.140542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:47.141340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:47.141704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:47.142430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:47.155660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:47.156343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:47.534713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:47.577998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:47.584913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:47.597600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffb2cf64-86d9-4511-a964-263b4ed5db1a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1254 microversion: 2.21 time: 0.495331 Oct 28 17:50:47.607404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2347/4802] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:47 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1254 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:47.896645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1745998691", "imageRef": "ada1b433-00ce-4d41-a2a3-1f8c7d53d2e9", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:47.989452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:50:48.153583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:48.154438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:48.169656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:48.172789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:48.173526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:48.176186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:48.178279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:48.179022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:49.371968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:49.400552 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53f9e641-f82c-413e-ace0-a04116675456 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1514 microversion: 2.1 time: 1.250358 Oct 28 17:50:49.404348 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2348/4803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:48 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1514 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:50:49.425284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:49.426465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:49.431707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] Request method failure captured: Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 143 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZ1Uoj-IH-Wd32dw01b3EEGGMAs8pDsh9a0LaQ-mbDPmlRp2jlMWmIAllEdLrC-Sx5D7G5ZpsznjAnA2ND3hIU8OwSUazziTjNr5QV0SoSvZBpnWnYzx-obGYy1sevCPI7LQEVo3w9ZspwJL1429zxgdBNN23cH4K-nSkZ3owr0jSU Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 289f975f508345dbad11c420e6fd34c2 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-FlavorsV2NegativeTest-802451165 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/289f975f508345dbad11c420e6fd34c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/289f975f508345dbad11c420e6fd34c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_289f975f508345dbad11c420e6fd34c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/289f975f508345dbad11c420e6fd34c2"}]}] Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-FlavorsV2NegativeTest-802451165 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 289f975f508345dbad11c420e6fd34c2 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-802451165 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-FlavorsV2NegativeTest-802451165-project Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: bed8129115c34aba94cf866e01253464 Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-FlavorsV2NegativeTest-802451165-project Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1745998691", "imageRef": "ada1b433-00ce-4d41-a2a3-1f8c7d53d2e9", "flavorRef": "452"}} Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor's memory is too small for requested image. Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1745998691', 'imageRef': 'ada1b433-00ce-4d41-a2a3-1f8c7d53d2e9', 'flavorRef': '452'}}} Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:50:49.433543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:50:49.438988 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39c1664e-06cb-4190-8552-4b734da44a9f tempest-FlavorsV2NegativeTest-802451165 tempest-FlavorsV2NegativeTest-802451165-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.543370 Oct 28 17:50:49.440551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2456/4804] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:50:47 2022] POST /compute/v2.1/servers => generated 93 bytes in 1549 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 28 17:50:49.473865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:49.475174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:49.476945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:49.482905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:49.485670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:49.487237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:50.106781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:50.138661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:50.140892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:50.142562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7af9eed-b703-4650-a39d-e3d6b114c919 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.734002 Oct 28 17:50:50.143780 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2349/4805] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:49 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:50.431758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:50.432515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:50.452632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:50.453128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:50.453566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:50.454312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:50.454738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:50.455164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:50.804955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987e466b-1e6a-47cc-950f-c5236d39b7b8", "tag": "5947a2f6-2bcb-4063-a17f-e5e7b05b5760"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:50.831705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:50.834425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:50.835936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:50.872402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] Creating event network-changed:5947a2f6-2bcb-4063-a17f-e5e7b05b5760 for instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 on n-h2-860864-13 Oct 28 17:50:50.888220 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-28da5f8d-9196-4db3-9594-efa423a241ef req-1e25dab6-dc62-4be7-b72b-46c431ca2d55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087195 Oct 28 17:50:50.896783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2350/4806] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:51.172636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:51.173340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:51.183715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:51.184214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:51.184655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:51.185371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:51.185829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:51.186406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:51.382949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:51.404947 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90b72398-0e66-4d07-9a05-82f97ce65830 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.978341 Oct 28 17:50:51.423663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2457/4807] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:50 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:51.650388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:51.659915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:51.661355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:51.662482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e006e5c-9ae6-42bd-b385-4cd82ba20447 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.495268 Oct 28 17:50:51.672018 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2351/4808] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:51 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:52.439097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:52.439753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:52.458626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:52.459131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:52.459610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:52.460327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:52.461150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:52.461579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:52.690835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:52.691940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:52.704012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:52.704516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:52.706409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:52.707228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:52.710677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:52.711197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:52.725428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:52.736519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78385733-3ea7-4040-91b1-cb22afa5f219 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.300232 Oct 28 17:50:52.737156 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2458/4809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:52 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:52.926296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:52.941200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:52.945290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:52.946906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a362212e-8128-4c44-a01a-2cfd02891a9a tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.260249 Oct 28 17:50:52.964228 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2352/4810] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:52 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:53.766387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:53.768261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:53.777151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:53.777832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:53.778279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:53.779198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:53.780394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:53.781014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:53.958765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:53.972214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5a17f80-b00f-4125-8ff2-f09195cea04e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.215118 Oct 28 17:50:53.973847 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2459/4811] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:53 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:53.979396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:53.980602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:53.999706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:54.000764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:54.002182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:54.003152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:54.004451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:54.005261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:54.179599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:54.190112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:54.192092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:54.193220 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7095c5c-3813-4349-8928-315b417769ac tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.218609 Oct 28 17:50:54.193943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2353/4812] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:53 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:54.634212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1963b4e-008c-48ff-86ba-490d7edd61f0", "name": "network-vif-unplugged", "status": "completed", "tag": "207e47e2-79cc-42ff-8884-732f3bb19515"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:54.651594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:54.655411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:54.655928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:54.683293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] Creating event network-vif-unplugged:207e47e2-79cc-42ff-8884-732f3bb19515 for instance b1963b4e-008c-48ff-86ba-490d7edd61f0 on n-h1-860864-13 Oct 28 17:50:54.689519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-04a8f895-bba1-44e0-af05-aa6f1aae95a4 req-85b93afd-57ea-4786-9b2d-49a13b0b998f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058874 Oct 28 17:50:54.690196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2460/4813] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:55.004402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:55.005920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:55.019879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:55.021808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:55.022486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:55.024747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:55.025868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:55.027382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:55.222192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:55.223669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:55.248035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:55.248483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:55.249678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:55.252667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:55.253112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:55.253546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:55.441401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:55.532387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:55.572080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:55.593698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab306d15-06dc-40d9-a2b4-0cfd3adc5f9e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.595196 Oct 28 17:50:55.604521 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2354/4814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:54 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:55.666452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:55.681302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:55.701243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:55.703185 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-326b8a67-3854-45ff-bbf5-cc66293323ff tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.487737 Oct 28 17:50:55.703815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2461/4815] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:55 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:56.622034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:56.622881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:56.632917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:50:56.644204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:56.645088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:56.645702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:56.646610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:56.647575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:56.648360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:56.735497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:56.747166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:56.767699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:56.772111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:56.772800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:56.775099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:56.781137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:56.781844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:57.191530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:57.203277 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ffce721-285e-4f33-a221-f91c15d978d4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.584846 Oct 28 17:50:57.204321 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2355/4816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:56 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:57.235872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:57.244790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:57.246266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:57.247508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b526ad2d-77f0-4957-a513-ba0192d059e9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.519185 Oct 28 17:50:57.264385 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2462/4817] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:56 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:50:57.493497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1963b4e-008c-48ff-86ba-490d7edd61f0", "name": "network-vif-plugged", "status": "completed", "tag": "207e47e2-79cc-42ff-8884-732f3bb19515"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:50:57.514941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:57.515874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:57.516541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:57.530801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] Creating event network-vif-plugged:207e47e2-79cc-42ff-8884-732f3bb19515 for instance b1963b4e-008c-48ff-86ba-490d7edd61f0 on n-h1-860864-13 Oct 28 17:50:57.543101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0c9f9acb-cc9e-42d1-b9a6-20dce1288471 req-0929ca31-e8e0-4abd-8191-4db95c3363ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054058 Oct 28 17:50:57.544744 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2356/4818] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:50:58.233539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:58.234141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:58.243916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:58.244523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:58.244953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:58.245655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:58.246148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:58.246578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:58.285999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:58.286702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:58.319470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:58.319964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:58.320405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:58.321119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:58.321575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:58.322004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:58.584363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:58.593200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c114db1-0bef-49a4-8a72-768fbb9da511 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1520 microversion: 2.1 time: 0.364012 Oct 28 17:50:58.614006 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2463/4819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:58 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:50:58.662895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:58.682245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:58.697326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:50:58.704448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-342b07e3-4b15-4ed6-9219-7de4443606d3 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.423520 Oct 28 17:50:58.705623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2357/4820] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:58 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:50:59.630700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:59.631385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:59.657501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:59.733933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:50:59.734539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:50:59.747206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:59.747633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:59.748067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:50:59.749301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:50:59.749750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:50:59.750171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:00.501940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:00.509003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:00.518386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:00.533091 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5784f8ee-39e5-4af8-864a-70889cd28073 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1505 microversion: 2.1 time: 0.906373 Oct 28 17:51:00.547912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2464/4821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:50:59 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1505 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:00.549157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:00.562716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9aec57ec-f2ef-4e01-b05a-a9ae399a967f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 0.823340 Oct 28 17:51:00.563603 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2358/4822] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:50:59 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:00.589418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:00.589978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:00.607065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:00.609791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:00.610338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:00.611856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:00.612341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:00.615096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:00.629628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987e466b-1e6a-47cc-950f-c5236d39b7b8", "name": "network-vif-plugged", "status": "completed", "tag": "5947a2f6-2bcb-4063-a17f-e5e7b05b5760"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:00.657586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:00.666273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:00.671586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:00.744472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] Creating event network-vif-plugged:5947a2f6-2bcb-4063-a17f-e5e7b05b5760 for instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 on n-h2-860864-13 Oct 28 17:51:00.761071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c86ad43c-edd6-42da-b45b-a063516c2130 req-946351e1-22ca-46bd-8e57-205ec269a325 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136833 Oct 28 17:51:00.763947 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2359/4823] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:51:01.152480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:01.168290 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b75eecc0-ff1b-43b3-adf9-c9295bb64bd4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 200 len: 1505 microversion: 2.1 time: 0.611380 Oct 28 17:51:01.169089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2465/4824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:00 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:01.197133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:01.198038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:01.207734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:01.208619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:01.209290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:01.210204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:01.212177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:01.213606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:01.362511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:51:01.593536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:01.594293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:01.620344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:01.628146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:01.628857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:01.629757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:01.631994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:01.632616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:01.652969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b167985-874c-4b7d-b997-e02c3b5ad368 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 204 len: 0 microversion: 2.1 time: 0.460521 Oct 28 17:51:01.653871 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2360/4825] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:51:01 2022] DELETE /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:51:01.926453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1271028317", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "6077c2ed-a62b-4d06-a667-d69048b9d447"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:02.073091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] validate_networks() for [('6077c2ed-a62b-4d06-a667-d69048b9d447', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:51:03.059355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:03.102476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:03.117797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:03.119294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e20b0604-bfeb-4a09-ba48-a5a46680e1af tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1358 microversion: 2.21 time: 1.530755 Oct 28 17:51:03.121370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2466/4826] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:01 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1358 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:04.149082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:04.150615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:04.155283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:04.159901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:04.160608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:04.161303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:04.162204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:04.162808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:04.163423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:04.173401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=94 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:05.136286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:05.137279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:05.137912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:05.138672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:05.141467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:05.183831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:05.184341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:05.186606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:05.188938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:05.190041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:05.192165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:05.221604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:05.232433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for user ea6781ab0164419ba1fc68626ebeae67 and project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:05.253696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:51:05.257094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:51:05.462590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-878bb5af-6912-4753-958a-18413bb11b52 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.542871 Oct 28 17:51:05.463698 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2361/4827] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:51:05.674079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:05.690895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:05.696415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:05.718411 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0efe99ef-c6ae-4de7-b2d0-75ff17277727 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1549 microversion: 2.21 time: 1.571534 Oct 28 17:51:05.720486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2467/4828] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:04 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1549 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:05.736153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-220edd89-31a6-4c63-8cc9-46f711eae520 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:05.737054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-220edd89-31a6-4c63-8cc9-46f711eae520 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:06.173574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a48f9f6-aacf-4e19-9aa6-4530b08247af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Action: 'create', calling method: .version_select at 0x7f751f64c790>, body: {"keypair": {"name": "tempest-keypair-1181556629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVQdcShooT6J76oletJ8PtblxAhdqiE54QOANlgPo3Wyz8fYJ8HDMVUh2yKn0mRK1DO6Is5se8FD3U8gB68tWcbwRqSCrCvkSb6CEx+syHBoCT28Bx2GDSFwzsuN+segA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:06.221283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0a48f9f6-aacf-4e19-9aa6-4530b08247af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for project c40b6cd44063465e8170e0c4299e1733. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:06.241149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0a48f9f6-aacf-4e19-9aa6-4530b08247af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for user ad63b71b912d4200bb5601950e0c33ca and project c40b6cd44063465e8170e0c4299e1733. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:06.333986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a48f9f6-aacf-4e19-9aa6-4530b08247af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.861090 Oct 28 17:51:06.334654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2362/4829] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:51:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:06.350556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:06.352412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:06.378513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:06.379082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:06.379665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:06.380385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:06.391533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:06.391841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:06.400790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-220edd89-31a6-4c63-8cc9-46f711eae520 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:06.409249 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-220edd89-31a6-4c63-8cc9-46f711eae520 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1218 microversion: 2.1 time: 0.682773 Oct 28 17:51:06.409863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2468/4830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:05 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1218 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:06.477818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1963b4e-008c-48ff-86ba-490d7edd61f0", "name": "network-vif-deleted", "tag": "207e47e2-79cc-42ff-8884-732f3bb19515"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:06.500405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:06.503700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:06.505640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:06.506701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:06.559184 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] Creating event network-vif-deleted:207e47e2-79cc-42ff-8884-732f3bb19515 for instance b1963b4e-008c-48ff-86ba-490d7edd61f0 on n-h1-860864-13 Oct 28 17:51:06.576537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:51:06.585878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c80ec19e-44af-4e40-b97d-569e1f36b4db req-7a47a596-458c-4ac3-bc73-02b77f61097c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111772 Oct 28 17:51:06.596246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2469/4831] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:06.741165 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c91b1f8-88b2-4a60-81a7-39748cfb03a1 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "DELETE /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 204 len: 0 microversion: 2.21 time: 0.405085 Oct 28 17:51:06.742508 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2363/4832] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:51:06 2022] DELETE /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:51:06.752358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:06.753741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:06.768957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:06.770535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:06.771411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:06.772833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:06.774215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:06.775580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:07.324466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:07.333974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:07.350929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:07.361175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a28c8c4-fa4d-42c7-94b2-14c1d65ea26f tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1555 microversion: 2.21 time: 0.610363 Oct 28 17:51:07.362884 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2470/4833] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:06 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1555 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:07.437830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:07.439175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:07.445491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:07.446054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:07.461665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:07.462979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:07.463779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:07.464701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:07.563708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:07.574039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-495ac744-d2fb-48cf-82d8-25dbf7f0818e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1214 microversion: 2.1 time: 0.141840 Oct 28 17:51:07.574641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2364/4834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:07 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:08.401346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:08.403536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:08.425276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:08.426247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:08.426693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:08.432016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:08.433434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:08.433882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:08.600823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:08.601581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:08.624995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:08.625813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:08.626423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:08.627321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:08.627966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:08.628544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:09.190995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:09.218580 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48610833-427e-4aa4-a3f6-d74c15aad614 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1270 microversion: 2.1 time: 0.623024 Oct 28 17:51:09.234692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2365/4835] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:08 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1270 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:09.533043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:09.581778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:09.590806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:09.595324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23ef370e-9059-42c1-9011-b707746030c9 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1555 microversion: 2.21 time: 1.202755 Oct 28 17:51:09.601316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2471/4836] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:08 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1555 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:10.261801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:10.262419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:10.270547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:10.271037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:10.291692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:10.292994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:10.293367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:10.293809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:10.590596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:10.605259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0b43621-3170-4cd3-a6e3-6082de23e2c3 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1276 microversion: 2.1 time: 0.347084 Oct 28 17:51:10.608132 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2366/4837] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:10 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1276 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:10.626674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:10.628099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:10.641610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:10.643955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:10.646726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:10.647950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:10.648601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:10.649238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:11.592363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987e466b-1e6a-47cc-950f-c5236d39b7b8", "name": "network-vif-deleted", "tag": "5947a2f6-2bcb-4063-a17f-e5e7b05b5760"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:11.633603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:11.634317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:11.634941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:11.676633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] Creating event network-vif-deleted:5947a2f6-2bcb-4063-a17f-e5e7b05b5760 for instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 on n-h2-860864-13 Oct 28 17:51:11.691427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ea0e104d-ada8-4b92-8655-7c9555217d65 req-bad6c0ae-25d3-46d4-8a83-d504fb9300a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104916 Oct 28 17:51:11.692052 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2367/4838] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:51:11.697689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:11.698387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:11.724032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:11.725572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:11.726459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:11.727589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:11.728197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:11.729320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:11.810234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:11.824810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:11.828607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f41073d894d4aada74c4e66bd420311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34df54f9b5e74d0fba43463d5ba2a20c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:11.831022 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-144a21dd-94b6-4ac4-83ab-e9296bb9a838 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 200 len: 1555 microversion: 2.21 time: 1.208866 Oct 28 17:51:11.856477 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2472/4839] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:10 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 1555 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:11.893789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:11.909043 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90b95a73-e6fa-44de-adaf-f233e404f427 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1276 microversion: 2.1 time: 0.215480 Oct 28 17:51:11.913641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2368/4840] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:11 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:12.861237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:12.862435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:12.874200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.874900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.881936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:12.882790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.883305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.883734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:12.908475 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] HTTP exception thrown: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Request method failure captured: Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 HTTP/1.1 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZyly9KFmGTaQ-Qy0Xdw8kgXCpU2a0fNw9evHb6HfC7Q4WXnuWqNxb-NaicSJBFd73KmliSE46iF-TeU2waY3S9qvUnrgrD4wuoraPSqRrTCFJnbZqarLbTwyplzoJOY4f7E0cuW0Krf55WQbGFNhBcIZ3zkylOrhXlgH1puvwd1Kk Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-1215559439", "name": "tempest-ServicesTestJSON-Service-214102041", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34df54f9b5e74d0fba43463d5ba2a20c"}]}] Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7f41073d894d4aada74c4e66bd420311 Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '987e466b-1e6a-47cc-950f-c5236d39b7b8'} Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:51:12.912559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:12.917409 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:51:12.919425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Returning 404 to user: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:51:12.923434 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-682bef66-a632-4867-88e9-40e01df4ea53 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 404 len: 111 microversion: 2.21 time: 0.064109 Oct 28 17:51:12.929442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2473/4841] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:12 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:51:12.939270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '.version_select at 0x7f751f54aaf0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:12.941567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:12.960086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:12.960702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:12.965919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.966648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.967573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:12.968568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.970832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.971471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:12.983348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.985536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.989884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:12.990891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:12.991561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:12.993509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:13.182992 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37c2133f-5650-48bd-a973-c8bb40828f20 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.251591 Oct 28 17:51:13.186879 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2369/4842] 10.222.0.48 () {60 vars in 1337 bytes} [Fri Oct 28 17:51:12 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8/os-instance-actions => generated 611 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:51:13.230905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:13.232449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:13.255672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:13.261695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:13.262596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:13.268480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:13.269342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:13.270027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:13.324010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] HTTP exception thrown: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Request method failure captured: Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 HTTP/1.1 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBZyly9KFmGTaQ-Qy0Xdw8kgXCpU2a0fNw9evHb6HfC7Q4WXnuWqNxb-NaicSJBFd73KmliSE46iF-TeU2waY3S9qvUnrgrD4wuoraPSqRrTCFJnbZqarLbTwyplzoJOY4f7E0cuW0Krf55WQbGFNhBcIZ3zkylOrhXlgH1puvwd1Kk Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-1215559439", "name": "tempest-ServicesTestJSON-Service-214102041", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34df54f9b5e74d0fba43463d5ba2a20c"}]}] Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7f41073d894d4aada74c4e66bd420311 Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '987e466b-1e6a-47cc-950f-c5236d39b7b8'} Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:51:13.337173 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.344167 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.346304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Returning 404 to user: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:51:13.348378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-691b96bc-e717-43eb-bd12-afff963e0ebc tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "DELETE /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 404 len: 111 microversion: 2.21 time: 0.153066 Oct 28 17:51:13.354672 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2370/4843] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:51:13 2022] DELETE /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:51:13.396811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:13.398485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:13.406275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af9749d8-e46c-46d1-b271-b8bb9c78da37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.449866 Oct 28 17:51:13.412629 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2474/4844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:12 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:13.429968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] [instance: 987e466b-1e6a-47cc-950f-c5236d39b7b8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:13.452675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:13.457014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:13.457720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:13.458692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:13.462315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:13.464125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:13.509599 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] HTTP exception thrown: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Request method failure captured: Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 HTTP/1.1 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBZyly9KFmGTaQ-Qy0Xdw8kgXCpU2a0fNw9evHb6HfC7Q4WXnuWqNxb-NaicSJBFd73KmliSE46iF-TeU2waY3S9qvUnrgrD4wuoraPSqRrTCFJnbZqarLbTwyplzoJOY4f7E0cuW0Krf55WQbGFNhBcIZ3zkylOrhXlgH1puvwd1Kk Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-1215559439", "name": "tempest-ServicesTestJSON-Service-214102041", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34df54f9b5e74d0fba43463d5ba2a20c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34df54f9b5e74d0fba43463d5ba2a20c"}]}] Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 34df54f9b5e74d0fba43463d5ba2a20c Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-787717250 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7f41073d894d4aada74c4e66bd420311 Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-InstanceActionsV221TestJSON-787717250-project Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '987e466b-1e6a-47cc-950f-c5236d39b7b8'} Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:51:13.511851 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. Oct 28 17:51:13.516539 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:51:13.525844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] Returning 404 to user: Instance 987e466b-1e6a-47cc-950f-c5236d39b7b8 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:51:13.527179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e8e4acb-c277-473d-b6a1-ab5c1da04060 tempest-InstanceActionsV221TestJSON-787717250 tempest-InstanceActionsV221TestJSON-787717250-project] 10.222.0.48 "GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8" status: 404 len: 111 microversion: 2.21 time: 0.169906 Oct 28 17:51:13.528340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2371/4845] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:13 2022] GET /compute/v2.1/servers/987e466b-1e6a-47cc-950f-c5236d39b7b8 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:51:14.441650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:14.442600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:14.470692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:14.472702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:14.476026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:14.477926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:14.478414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:14.479111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:15.493046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:15.512079 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca1585b1-a325-4374-b5c4-d642ea57eb1f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 1.077095 Oct 28 17:51:15.523647 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2475/4846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:14 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:16.548390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:16.548892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:16.555987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:16.557102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:16.558995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:16.559966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:16.560300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:16.562052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:16.562578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:16.563056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:16.694540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03187cb0-48a1-480e-856c-a38cff96867c", "tag": "ae18c7af-9103-4e0b-9845-be55cd3c1829"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:16.716160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:16.735282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:16.736182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:16.736790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:16.785485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] Creating event network-changed:ae18c7af-9103-4e0b-9845-be55cd3c1829 for instance 03187cb0-48a1-480e-856c-a38cff96867c on n-h2-860864-13 Oct 28 17:51:16.804245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5b41c9ed-e53a-4fa8-b468-9b318c7f32e3 req-d442f0a5-40d4-4c41-9cdf-107a64e95757 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114842 Oct 28 17:51:16.805138 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2476/4847] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:51:17.563102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:17.586972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-463b0b5c-6ad8-4d11-8644-4a74ce18dbf1 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 1.046721 Oct 28 17:51:17.599398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2372/4848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:16 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:18.619963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:18.622037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:18.655516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:18.656400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:18.657130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:18.658086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:18.659259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:18.661335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:19.386567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:19.408099 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2845c6d-2a2e-4755-8166-c45d7bc87cb4 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.797644 Oct 28 17:51:19.411673 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2477/4849] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:18 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:20.440157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:20.441263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:20.458647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:20.465297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:20.466822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:20.470732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:20.473515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:20.474383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:20.480250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:21.434587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:21.445979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7e20ad0-357a-4868-9bd5-2fe267fdc2bb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 1.013228 Oct 28 17:51:21.446599 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2373/4850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:20 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:22.474253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:22.474854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:22.486934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:22.502734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:22.503687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:22.506336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:22.516789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:22.518326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:23.013362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:23.027119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9d04d82-ba58-4c5f-b90b-5df7912af6e6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.556900 Oct 28 17:51:23.028663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2478/4851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:22 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:24.054103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:24.055175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:24.071184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:24.073021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:24.073665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:24.077923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:24.078667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:24.079523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:24.433622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:24.443137 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ddb45580-7adc-4957-b367-45f256472ec5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.393666 Oct 28 17:51:24.447155 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2374/4852] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:24 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:25.473973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:25.476313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:25.495475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:25.499541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:25.500039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:25.503815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:25.504316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:25.509055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:25.990704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:26.003873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-beee1d48-d497-4619-981c-e910f1b922cd tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.537688 Oct 28 17:51:26.008614 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2479/4853] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:25 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:27.034591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:27.036248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:27.045686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:27.047819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:27.049109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:27.050510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:27.051201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:27.051879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:27.149601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03187cb0-48a1-480e-856c-a38cff96867c", "name": "network-vif-plugged", "status": "completed", "tag": "ae18c7af-9103-4e0b-9845-be55cd3c1829"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:27.193012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:27.199007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:27.200036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:27.261861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] Creating event network-vif-plugged:ae18c7af-9103-4e0b-9845-be55cd3c1829 for instance 03187cb0-48a1-480e-856c-a38cff96867c on n-h2-860864-13 Oct 28 17:51:27.280513 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-24299906-b64b-4bf6-b1ce-1dff04a7bb1e req-f743bc27-6969-4cc1-a0d0-4e42ad082a81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136134 Oct 28 17:51:27.281375 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2480/4854] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:51:27.720646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:27.735864 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b849fbd-7d30-4eed-b378-551c6c158003 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.706938 Oct 28 17:51:27.740540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2375/4855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:27 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:28.766150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:28.766849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:28.786687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:28.789306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:28.793070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:28.795730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:28.796397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:28.797669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:29.035501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:29.050948 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f6b9580-881b-47d1-9a51-ac03ea6dd078 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1318 microversion: 2.1 time: 0.289610 Oct 28 17:51:29.058394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2481/4856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:28 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:29.799203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-210216977", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "801e64ed-37da-4d39-a646-aa0c170c9823"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:29.899910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] validate_networks() for [('801e64ed-37da-4d39-a646-aa0c170c9823', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:51:30.080435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:30.081906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:30.098210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:30.098728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:30.101482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:30.103979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:30.104983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:30.105437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:30.943018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:30.979157 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-add6dcf0-aad6-48a3-916c-a755c7e58e09 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1508 microversion: 2.1 time: 0.902379 Oct 28 17:51:30.998145 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2482/4857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:30 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1508 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:31.023630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:31.024244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:31.045003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.045488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.058601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.059602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.059956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.062055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.291529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:31.295398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:31.296820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:31.299083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:31.299734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:31.331648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.332459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.333275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.334227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.336045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.336679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.438074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:31.453411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for user 8d652564d640475fa03c7eecaa808942 and project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:31.510702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:51:31.527907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:51:31.581527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:31.595650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c1b810d-7c4c-497b-876e-00919c84db37 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1508 microversion: 2.1 time: 0.587187 Oct 28 17:51:31.599242 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2483/4858] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:31 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:31.632318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:31.636421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:31.651403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.652802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.654844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.655795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.656913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.658635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.681336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4942a018-9784-42ce-8933-dde0080d517a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282244 Oct 28 17:51:31.686283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2376/4859] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:51:31.922644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b89018b1-aa1f-4dea-ab60-231766894271 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "PUT /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1080 microversion: 2.1 time: 0.291546 Oct 28 17:51:31.923662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2484/4860] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:51:31 2022] PUT /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1080 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:51:31.945117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:31.945856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:31.965490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.970239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.970932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-185997509", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "801e64ed-37da-4d39-a646-aa0c170c9823"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:31.971526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:31.972921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:31.976259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:31.978998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:32.115261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] validate_networks() for [('801e64ed-37da-4d39-a646-aa0c170c9823', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:51:32.581192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:32.619337 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bec77238-130f-408a-8bec-b6c4e28aeb49 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1506 microversion: 2.1 time: 0.674192 Oct 28 17:51:32.630738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2377/4861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:31 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:32.669239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:32.670784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:32.697310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:32.702086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:32.704914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:32.712370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:32.714095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:32.721441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.021847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:34.054143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c246c13a-1606-4834-a66a-a00f8a039b53 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1506 microversion: 2.1 time: 1.411327 Oct 28 17:51:34.059720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2378/4862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:32 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1506 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:34.085737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:34.126847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:34.143032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.144842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.145460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.146345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.147552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.148176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.155278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:34.156746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:34.157746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:34.158599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:34.160213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:34.235726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.236821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.237384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.245862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.250776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.251739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.293885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:34.325186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=42 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:34.422712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:34.455892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for user 8d652564d640475fa03c7eecaa808942 and project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:34.515603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:51:34.521715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:51:34.578595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:34.579029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:34.579549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:34.579953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:34.580362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:34.599490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61a49ee2-50bc-4b18-a044-c52dc9e01f96 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.632408 Oct 28 17:51:34.612653 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2485/4863] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:51:34.756843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:34.792015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:34.807906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.808723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.811865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.816205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.817412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.820602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.931682 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38949428-cbd9-4797-a7f1-0965acda6bad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "POST /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c/action" status: 202 len: 1112 microversion: 2.1 time: 0.849789 Oct 28 17:51:34.940611 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2379/4864] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:51:34 2022] POST /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c/action => generated 1112 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 17:51:34.959658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1301727042", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "451", "networks": [{"uuid": "801e64ed-37da-4d39-a646-aa0c170c9823"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:34.962100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:34.962924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:34.975583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.976461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.977541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:34.981575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:34.983310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:34.984138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:35.178717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] validate_networks() for [('801e64ed-37da-4d39-a646-aa0c170c9823', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:51:36.723083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:36.736870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d6ae0f8-1d76-464f-ab7c-dddc36a44970 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 1.780033 Oct 28 17:51:36.751070 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2380/4865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:34 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:37.769294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:37.769978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:37.789466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:37.789970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:37.790500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:37.791108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:37.791622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:37.792053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:38.645185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:38.658000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ebceb5b-b4dd-4d72-99df-6518927b576f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 0.892448 Oct 28 17:51:38.669891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2381/4866] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:37 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:51:39.223716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:39.224354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:39.224671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:39.225152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:39.225617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:39.245365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:39.248322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:39.250597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:39.253069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:39.253745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:39.255679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:39.297971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:39.311089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Getting quotas for user 8d652564d640475fa03c7eecaa808942 and project 7f91686e79734b2ca3b8f89d436b2e37. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:39.341837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:51:39.344078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:51:39.471834 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab306ce4-5a07-4e9f-a384-4499e257ad19 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.525029 Oct 28 17:51:39.473486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2486/4867] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:51:39.486999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-421954bf-29e7-44f8-804e-04e434604564 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:39.488268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-421954bf-29e7-44f8-804e-04e434604564 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:39.690388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:39.691569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:39.729837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:39.735893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:39.741240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:39.746351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:39.754135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:39.762581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:39.766939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-421954bf-29e7-44f8-804e-04e434604564 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:39.779262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-421954bf-29e7-44f8-804e-04e434604564 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1221 microversion: 2.1 time: 0.297295 Oct 28 17:51:39.783792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2382/4868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:39 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1221 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:40.404243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:40.418559 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f24414d2-50e2-4c55-8e21-52dd5e3ec1b8 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 0.733989 Oct 28 17:51:40.421238 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2487/4869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:39 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:51:40.809813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:40.810450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:40.835035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:40.844246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:40.844666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:40.845413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:40.845864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:40.852324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:41.114149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:41.143965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3fc4f94-4ff5-4a39-bfd6-db7a8c299d6a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1217 microversion: 2.1 time: 0.337590 Oct 28 17:51:41.144612 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2383/4870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:40 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1217 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:41.449484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:41.451075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:41.466686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:41.467651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:41.468306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:41.469435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:41.488666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:41.494026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:42.183961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:42.207276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:42.210111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:42.232571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:42.233501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:42.234234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:42.236177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:42.240407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:42.241088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:42.717864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:42.787518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4164914f-d37a-4238-8a95-ec4774cf0467 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1291 microversion: 2.1 time: 0.616643 Oct 28 17:51:42.807803 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2384/4871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:42 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1291 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:43.049097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:43.066901 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-810f88c7-cb77-4ad8-aae2-d0e0ef44410f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 1.621012 Oct 28 17:51:43.067912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2488/4872] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:41 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:43.819269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:43.820019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:43.833490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:43.835842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:43.836987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:43.839455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:43.840038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:43.843854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:44.002181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:44.012294 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ec12c3b4-e54d-40fd-9e87-7ee74fb995eb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1279 microversion: 2.1 time: 0.198233 Oct 28 17:51:44.019626 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2385/4873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:43 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:44.092674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:44.093490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:44.117732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:44.118229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:44.118677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:44.119406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:44.119864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:44.120294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:45.005001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:45.021057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba743d85-7de0-4a79-a342-e8cc3f0a635a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 0.928099 Oct 28 17:51:45.027478 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2489/4874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:44 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:45.050519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:45.051452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:45.077784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:45.087633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:45.088200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:45.088978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:45.089449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:45.089882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:46.050369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:46.052175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:46.064662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:46.066636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:46.067251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:46.069808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:46.072070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:46.074295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:46.533355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:46.546292 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b35e50f3-263f-4b9c-9ad0-f301425eb5fc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 1.501165 Oct 28 17:51:46.547921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2386/4875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:45 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:46.560481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639b5208-4d3e-44bf-99da-4ce9bf931807", "tag": "cc54145d-7599-46ba-90e5-1e8742132d27"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:46.580879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:46.583950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:46.584558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:46.617628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] Creating event network-changed:cc54145d-7599-46ba-90e5-1e8742132d27 for instance 639b5208-4d3e-44bf-99da-4ce9bf931807 on n-h1-860864-13 Oct 28 17:51:46.632795 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-487c2ff4-7100-437f-b326-aff03fc27829 req-d8d2ceff-a62b-4047-8068-d48b14d67c71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083578 Oct 28 17:51:46.635655 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2387/4876] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:46.648587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cb0cfe-7437-4886-8644-318b13899323", "tag": "753cc691-53ac-4038-a114-7db010c26b46"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:46.676827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:46.677255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:46.677701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:46.712102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] Creating event network-changed:753cc691-53ac-4038-a114-7db010c26b46 for instance d9cb0cfe-7437-4886-8644-318b13899323 on n-h1-860864-13 Oct 28 17:51:46.721723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-03ee6b81-4fb2-407a-a015-6d158547e5a7 req-76ef91f3-71de-4214-8983-e2289a1b92ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078331 Oct 28 17:51:46.724294 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2388/4877] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:46.967655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:46.998041 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4dcba2e6-3c0e-4022-a284-a50020b7f333 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 0.950873 Oct 28 17:51:47.018129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2490/4878] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:46 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:47.609394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:47.616401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:47.630886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:47.643721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:47.648545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:47.650085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:47.651294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:47.655100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.030695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:48.035070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:48.100801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:48.101316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:48.121111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.121111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:48.121111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:48.121111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.539993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:48.548873 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae301176-969b-47f8-9c72-8e954464d505 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 0.524364 Oct 28 17:51:48.553889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:48.554912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2491/4879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:48 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:48.575214 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-046ad1bc-25e1-4ef5-a975-29dc42777b53 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 1.007643 Oct 28 17:51:48.576459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2389/4880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:47 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:48.803429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ac7e09-291b-47f5-a40c-dea1a108579d", "tag": "f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:48.825891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:48.826590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:48.827757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.850530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] Creating event network-changed:f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b for instance c1ac7e09-291b-47f5-a40c-dea1a108579d on n-h2-860864-13 Oct 28 17:51:48.865023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b7396d0f-3b10-4ac4-82b3-f42f42f008ce req-c1d864b1-1fbf-4837-82d5-9153cfac6e11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066208 Oct 28 17:51:48.866428 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2492/4881] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:48.906509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:48.907081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:48.924167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:48.924660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:48.925092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.929857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:48.931617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:48.933996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:48.996053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-884262cd-1aa5-4d20-a9ff-83188ba77ee4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/ips" status: 200 len: 151 microversion: 2.20 time: 0.096215 Oct 28 17:51:48.996651 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2390/4882] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Oct 28 17:51:48 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/ips => generated 151 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:51:49.583196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:49.584051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:49.588701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:49.589698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:49.602732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:49.603940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:49.619528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:49.625248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:49.627427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:49.628427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:49.629345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:49.629958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:49.630545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:49.631223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:49.636336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:49.637259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:49.641292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:49.641978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:49.777710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:50.373069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:50.384353 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-09d972e9-bdb6-42d7-bc9e-8baf623c4577 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 0.785524 Oct 28 17:51:50.397533 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2391/4883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:49 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:51:50.441046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-730194459", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9add7a23-8cc2-49e5-b5d0-fce3c5f2f364"}], "security_groups": [{"name": "tempest-securitygroup--1954630863"}], "key_name": "tempest-keypair-1181556629", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a2674c38-2998-4052-8f44-d19651c59dc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:50.798030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:50.805969 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab02b378-9965-41e5-a995-ab9fdf95c9b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1517 microversion: 2.1 time: 1.228150 Oct 28 17:51:50.806566 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2493/4884] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:49 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1517 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:50.887220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] validate_networks() for [('9add7a23-8cc2-49e5-b5d0-fce3c5f2f364', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:51:51.423079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:51.424372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:51.431303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:51.437027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:51.437471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:51.439330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:51.440978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:51.441621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:51.442392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:51.958686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:51.973976 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9c9ec33-5d2d-4db0-9b82-b1401cd9dac9 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 0.557307 Oct 28 17:51:51.975237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2494/4885] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:51 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:52.002680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:52.005063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:52.028018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.031436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.032249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.035442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.038663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.040485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.402202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:52.420455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b4a4681-0824-43cd-818b-09238e1a7787 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.440208 Oct 28 17:51:52.420455 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2495/4886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:51 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:52.426690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:52.427436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:52.456838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.458393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for project c40b6cd44063465e8170e0c4299e1733. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:52.462300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.464248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.469740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.471680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.472232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.477774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for user ad63b71b912d4200bb5601950e0c33ca and project c40b6cd44063465e8170e0c4299e1733. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:52.524342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:51:52.530513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:51:52.533010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:51:52.533634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:51:52.540837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:51:52.544614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lazy-loading 'flavor' on Instance uuid 6279d691-97a6-42cc-86bf-a9fe321a7924 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:51:52.562708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.563465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.565319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.566092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.566624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.570043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.619578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for project c40b6cd44063465e8170e0c4299e1733. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:51:52.634970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Getting quotas for user ad63b71b912d4200bb5601950e0c33ca and project c40b6cd44063465e8170e0c4299e1733. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:51:52.794423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:51:52.797243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2674c38-2998-4052-8f44-d19651c59dc2',volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:51:52.928275 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f7fa429-f496-4d22-9498-f10124a09dd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/action" status: 202 len: 0 microversion: 2.20 time: 0.507263 Oct 28 17:51:52.937246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2496/4887] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:51:52 2022] POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:51:52.944526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:52.945361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:52.954053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.954829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.955462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:52.957877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:52.958900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:52.960150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:53.092838 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efc47291-78b7-45da-b713-c10022d68198 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.658033 Oct 28 17:51:53.097898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2392/4888] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:51:50 2022] POST /compute/v2.1/servers => generated 407 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:51:53.109419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:53.113671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:53.127886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:53.132567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:53.134096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:53.135039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:53.135778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:53.138923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:53.649308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:53.664725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:53.666945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:53.676002 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-04553be8-a4f0-4475-bcdc-16e3c7e66f3f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.736994 Oct 28 17:51:53.676930 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2497/4889] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:52 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:53.695884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bf971cd-a0ba-4aeb-9d76-9a4878a223d1 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:53.697145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2bf971cd-a0ba-4aeb-9d76-9a4878a223d1 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:53.810881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:53.819466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6bbe601-0f39-47e9-94d3-66f2d8ef42df tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 0.720402 Oct 28 17:51:53.824315 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2393/4890] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:53 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:53.844716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:53.845798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:53.855775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:53.861267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:53.861824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:53.862685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:53.863286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:53.864096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:53.978297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2bf971cd-a0ba-4aeb-9d76-9a4878a223d1 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:53.989976 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bf971cd-a0ba-4aeb-9d76-9a4878a223d1 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1121 microversion: 2.1 time: 0.311548 Oct 28 17:51:53.993192 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2498/4891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:53 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1121 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:54.030106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639b5208-4d3e-44bf-99da-4ce9bf931807", "name": "network-vif-plugged", "status": "completed", "tag": "cc54145d-7599-46ba-90e5-1e8742132d27"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:54.063513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:54.068190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:54.068190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:54.089942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] Creating event network-vif-plugged:cc54145d-7599-46ba-90e5-1e8742132d27 for instance 639b5208-4d3e-44bf-99da-4ce9bf931807 on n-h1-860864-13 Oct 28 17:51:54.099322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f3fe2124-86a3-454f-bd24-1b5bcd5c9d8d req-76871e20-b39b-4a21-963e-85c7da446470 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073122 Oct 28 17:51:54.100893 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2499/4892] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:54.304810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:54.318808 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f554474d-158a-4122-a2cb-10a8b8240bd5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.489627 Oct 28 17:51:54.320843 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2394/4893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:53 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:54.710644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:54.711349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:54.730177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:54.732670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:54.734902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:54.736728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:54.741980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:54.742433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:54.850548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:54.851973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:54.862799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:54.864860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:54.866508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:54.868145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:54.870056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:54.870719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:55.145532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.153974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.162965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.164307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-893003b7-a25d-48fc-b802-b8871bcca5d4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.458998 Oct 28 17:51:55.164955 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2500/4894] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:54 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:55.181140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:55.181140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:55.210063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:55.412529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.424314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cb5c560-91b6-4ec2-8072-b08dadaeabd5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 0.577602 Oct 28 17:51:55.425285 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2395/4895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:54 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:55.440571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:55.441748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:55.454077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:55.454853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:55.455532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:55.456447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:55.459982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:55.460603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:55.467196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.507186 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51779c0d-248a-4d0c-a1ce-9056c23254b4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1219 microversion: 2.1 time: 0.339411 Oct 28 17:51:55.537773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2501/4896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:55 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1219 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:55.826482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:55.839955 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31d1bf88-e06b-4ff1-acc0-8207cf8b380b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.413305 Oct 28 17:51:55.855865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2396/4897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:55 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:56.122360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ac7e09-291b-47f5-a40c-dea1a108579d", "name": "network-vif-plugged", "status": "completed", "tag": "f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b"}, {"server_uuid": "03187cb0-48a1-480e-856c-a38cff96867c", "name": "network-vif-unplugged", "status": "completed", "tag": "ae18c7af-9103-4e0b-9845-be55cd3c1829"}, {"server_uuid": "d9cb0cfe-7437-4886-8644-318b13899323", "name": "network-vif-plugged", "status": "completed", "tag": "753cc691-53ac-4038-a114-7db010c26b46"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:51:56.138992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:56.139746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:56.140367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:56.157011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Creating event network-vif-plugged:f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b for instance c1ac7e09-291b-47f5-a40c-dea1a108579d on n-h2-860864-13 Oct 28 17:51:56.159042 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Creating event network-vif-unplugged:ae18c7af-9103-4e0b-9845-be55cd3c1829 for instance 03187cb0-48a1-480e-856c-a38cff96867c on n-h2-860864-13 Oct 28 17:51:56.159849 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] Creating event network-vif-plugged:753cc691-53ac-4038-a114-7db010c26b46 for instance d9cb0cfe-7437-4886-8644-318b13899323 on n-h1-860864-13 Oct 28 17:51:56.180952 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-28d9b6e5-812b-475d-801c-fa781d37b33c req-14b6f549-9c1a-41cb-ad0a-e4a54134e0ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.062963 Oct 28 17:51:56.188017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2502/4898] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:51:56.199685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:56.204899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:56.229139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:56.229811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:56.233807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:56.234756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:56.237412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:56.239601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:56.452799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:56.453506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:56.467591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:56.468692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:56.469665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:56.470836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:56.471777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:56.472707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:57.050500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.069007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.078879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.082250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a118de87-aaa7-4e03-9653-024a3ab591d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.890191 Oct 28 17:51:57.086091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2397/4899] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:56 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:57.098228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:57.099916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:57.121599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:57.124505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:57.126579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:57.127736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:57.129072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:57.135210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:57.163234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.177778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ec8fdc1-962a-4290-94c0-18e63b8a0867 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1321 microversion: 2.1 time: 0.728416 Oct 28 17:51:57.183556 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2503/4900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:56 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1321 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:57.219682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:57.223831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:57.250548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:57.257036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:57.266538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:57.267631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:57.273921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:57.277424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:57.349374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:57.511488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.524150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78113e7f-2783-4325-9d0c-72f328a86b8b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1237 microversion: 2.1 time: 0.435881 Oct 28 17:51:57.525274 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2398/4901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:57 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1237 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:57.739437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:57.748843 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af8de25e-edbf-497e-a3e7-506d2b76faef tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.560086 Oct 28 17:51:57.753644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2504/4902] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:57 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:58.118369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:58.118989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:58.133855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:58.134351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:58.134792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:58.135542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:58.135997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:58.136422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:58.153606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:51:58.210557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:58.211226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:58.223236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:58.225048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:58.225354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:58.236088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:58.236378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:58.236818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:58.946446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:58.957929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:58.969084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:58.976694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:51:58.978251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b0abe45-d426-4f5d-b812-ee2c02b9b418 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.864257 Oct 28 17:51:58.980910 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2399/4903] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:51:58 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:51:58.983082 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d31f5d59-8598-4a29-86d2-7141cc3ed242 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1512 microversion: 2.1 time: 0.771133 Oct 28 17:51:58.988802 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2505/4904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:58 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1512 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:51:59.001081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:59.003921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:59.005471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:51:59.006102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:51:59.032579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:59.039061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:59.043835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:59.047674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:59.048335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:59.049756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:59.049908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:59.050656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:59.051279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:51:59.051665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:51:59.053498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:51:59.053947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.013196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.029818 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f6c50de-6dd1-434a-874a-30cd3bcf8a54 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 1.039630 Oct 28 17:52:00.030769 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2506/4905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:58 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:00.036522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:00.037529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:00.079806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.086790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.087241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.088092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.088557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.089314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.131856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.148972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14df6ad7-83a7-44b7-81ed-7e03f4dd3cf2 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1305 microversion: 2.1 time: 1.161180 Oct 28 17:52:00.150146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2400/4906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:51:58 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1305 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:00.162822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:00.172890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:00.193449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.194960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.196451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.198790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.199522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.201438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.641363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.666594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.673996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.677263 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45cfc18b-8aff-42c8-8455-5eb383ade9bb tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.517222 Oct 28 17:52:00.706577 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2401/4907] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:00 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:00.744571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:00.756218 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4d17de0-ee1d-4b5c-991f-acfde164fb59 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1511 microversion: 2.1 time: 0.724167 Oct 28 17:52:00.758830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2507/4908] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:00 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1511 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:00.785760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:00.786687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:00.802301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.804693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.807038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:00.815126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:00.815943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:00.816474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:01.066142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:01.067608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:01.086191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:01.087100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:01.089082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:01.092174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:01.093404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:01.094019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:01.225307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:01.237891 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbb1b691-46aa-41d9-b82a-9de7bccc911b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1511 microversion: 2.1 time: 0.456756 Oct 28 17:52:01.245225 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2402/4909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:00 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:01.251404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:01.253889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:01.272737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:01.274203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:01.274838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:01.278461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:01.279104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:01.279806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:01.901268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:01.913389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-453f348c-224d-4eb3-8283-7f92390067ec tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1305 microversion: 2.1 time: 0.666713 Oct 28 17:52:01.938011 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2403/4910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:01 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1305 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:01.957425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:01.977283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:01.979351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:02.032679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.032967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:02.033755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.036590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.037677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.038374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.039607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.044495 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43607168-c2e7-4a9a-bb8b-420240ce1106 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.981582 Oct 28 17:52:02.056734 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2508/4911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:01 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:02.086332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:02.092569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:02.112213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.112707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.113152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.118592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.120003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.120621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.280664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:02.516280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:02.523486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.525611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.525996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.709045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:02.721561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:02.724267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:02.733074 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64b37485-f177-423e-aaae-7d5b42e9259a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.671463 Oct 28 17:52:02.740196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2509/4912] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:02 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:02.748090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30166fe0-a403-436d-aa2e-6adf8527732a", "tag": "61d59349-4c25-478e-88cc-d4ec7e1fcec6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:02.774549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.775292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.775955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.801929 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] Creating event network-changed:61d59349-4c25-478e-88cc-d4ec7e1fcec6 for instance 30166fe0-a403-436d-aa2e-6adf8527732a on n-h1-860864-13 Oct 28 17:52:02.825082 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-193396f2-b190-4b4d-af66-973342806bf0 req-640e35a8-65ca-4b78-893e-4ce50d858508 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083254 Oct 28 17:52:02.830956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2510/4913] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:02.843068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03187cb0-48a1-480e-856c-a38cff96867c", "name": "network-vif-plugged", "status": "completed", "tag": "ae18c7af-9103-4e0b-9845-be55cd3c1829"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:02.880708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.883383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.883844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.914778 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] Creating event network-vif-plugged:ae18c7af-9103-4e0b-9845-be55cd3c1829 for instance 03187cb0-48a1-480e-856c-a38cff96867c on n-h2-860864-13 Oct 28 17:52:02.939274 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6ec82c9c-445a-43b1-9832-98427c1254b8 req-7666d157-e1a5-4669-b35b-df037fd14b6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106681 Oct 28 17:52:02.943981 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2511/4914] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:02.949992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:02.950447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:02.984230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.984891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.985347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:02.986099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:02.986559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:02.986993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.274494 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e29a60f-5de6-45d0-a92f-ceb6f35eb97a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.335163 Oct 28 17:52:03.283977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2404/4915] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Oct 28 17:52:01 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:03.289643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:03.298181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:03.316729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.317551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.318262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.319200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.321031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.321725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.503010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:03.515540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-31c451a3-e783-4981-a24d-7a60e56036d7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1305 microversion: 2.1 time: 0.567085 Oct 28 17:52:03.516395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2512/4916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:02 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1305 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:03.555778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:03.576743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:03.579999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-210216977', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:03.599310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.600545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.601170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.602142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.602769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.603746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.791312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:03.791660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:03.799917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bc0350e-9778-4710-9dae-e3ac99a06d12 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1523 microversion: 2.1 time: 0.514075 Oct 28 17:52:03.800518 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2405/4917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:03 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1523 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:03.813411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:03.816277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:03.828948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.829735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.830371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.832191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.833172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.833604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:03.947490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:03.954776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:03.963057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:03.963691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:04.502599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:04.522359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:04.525374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:04.531297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b420d8e-75d1-4a2a-86ca-4049cd1c21d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.722085 Oct 28 17:52:04.534635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2406/4918] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:03 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:04.551813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:04.552878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:04.568102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:04.568893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:04.569520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:04.570437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:04.571235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:04.572159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:04.722286 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08f4d50a-cede-4f30-a518-878ade080e89 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-210216977" status: 200 len: 1514 microversion: 2.1 time: 1.179104 Oct 28 17:52:04.723821 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2513/4919] 10.222.0.48 () {58 vars in 1261 bytes} [Fri Oct 28 17:52:03 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-210216977 => generated 1514 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:04.760013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:04.765841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:04.778491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:04.793368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:04.802925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:04.803730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:04.804389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:04.805310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:04.807201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:04.807663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:05.061079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:05.672150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:05.690381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:05.691205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:05.691904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:05.829498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:05.845215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c1a1992-a334-49e4-9caa-0abdd9393d65 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1305 microversion: 2.1 time: 1.299965 Oct 28 17:52:05.846847 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2407/4920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:04 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1305 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:05.855021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:05.856806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:05.878041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:05.878885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:05.880930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:05.883764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:05.884747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:05.885542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.327735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:06.341385 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb1d73d2-0873-4ddf-ac9f-b1081fd424ad tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1508 microversion: 2.1 time: 0.490894 Oct 28 17:52:06.347704 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2408/4921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:05 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1508 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:06.352866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:06.375361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f904967b-ee75-43ce-9f84-d19a515e99d6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.619219 Oct 28 17:52:06.375839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:06.379597 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2514/4922] 10.222.0.48 () {58 vars in 1173 bytes} [Fri Oct 28 17:52:04 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.392529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.394289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:06.395163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:06.411746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.417251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.418126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:06.420320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:06.421143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:06.424251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.172516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.181276 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2332cf98-9510-4bcc-9ba7-450891b3fa7e tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 200 len: 1508 microversion: 2.1 time: 0.792518 Oct 28 17:52:07.203188 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2515/4923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:06 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 1508 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:07.212825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:07.219529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.221019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.compute.servers [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Removing options 'limit' from query {{(pid=120567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 17:52:07.231647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:07.237849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.238346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.238985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.240145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.240786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.241389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.290605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.299294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.300054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.300672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.572842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.591908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.594696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.596367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e70d3f2b-3eb0-4668-9788-56ed969eff7b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1744 microversion: 2.20 time: 1.247246 Oct 28 17:52:07.597325 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2409/4924] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:06 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1744 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:07.605114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:07.606874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:07.617977 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-710266d2-147d-4ee2-9e3f-99741ada9834 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.413038 Oct 28 17:52:07.619070 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2516/4925] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 17:52:07 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:07.625312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:07.626141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:07.627455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.629855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.631968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.634495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.640351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.642887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.645116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.649425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.649891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.650816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:07.651286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:07.651872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:07.731803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:07.901143 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-900225aa-bb64-4e81-a439-f366ab9050fa tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 204 len: 0 microversion: 2.1 time: 0.279438 Oct 28 17:52:07.901819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2517/4926] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:07 2022] DELETE /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:07.915413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:07.944172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:07.947878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:08.013938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.020379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.022144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.025385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.030807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.035396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.170162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:08.203668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de322a49-59cc-4039-a1f8-01b317d34930 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.601130 Oct 28 17:52:08.224727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2410/4927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:07 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:08.249652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1703896777", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "6077c2ed-a62b-4d06-a667-d69048b9d447"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:08.274286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:08.348427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] validate_networks() for [('6077c2ed-a62b-4d06-a667-d69048b9d447', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:52:08.395000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:08.413111 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b441b9b7-b720-496b-af02-d4c717c1c206 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.504382 Oct 28 17:52:08.414033 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2518/4928] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:52:07 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:08.433587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:08.451610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:08.453153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.compute.servers [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Removing options 'limit' from query {{(pid=120567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 17:52:08.455210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:08.467672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.468370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.469004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.469930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.470576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.472114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.536803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:08.578736 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a1f2c3d-f779-4bce-9cc3-3ef949220604 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.153410 Oct 28 17:52:08.579890 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2519/4929] 10.222.0.48 () {58 vars in 1150 bytes} [Fri Oct 28 17:52:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:08.592318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:08.600385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:08.601404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:08.612003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.613321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.614474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.615831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.616488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.617425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.706991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:08.783725 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03e9b96e-9064-42fd-b561-23e08e5fcc01 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.195583 Oct 28 17:52:08.787858 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2520/4930] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:52:08 2022] GET /compute/v2.1/servers => generated 1010 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:08.799208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:08.800151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:08.817476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.818145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.818689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:08.820801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:08.821427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:08.823076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.158264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:09.178683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:09.180768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:09.182191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7a14e87-2a8c-4f8e-922d-8e1960b9b885 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1744 microversion: 2.20 time: 0.393275 Oct 28 17:52:09.183256 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2521/4931] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:08 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1744 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:09.188261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:09.197096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:09.202479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:09.232462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.233266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.233864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.234760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.235484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.236099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.434932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:09.467983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:52:09.468572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:52:09.469335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:52:09.469909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:52:09.470351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:52:09.500582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.501077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.502567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.504500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.504972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.506199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.537853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:52:09.543929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Getting quotas for user ea6781ab0164419ba1fc68626ebeae67 and project 1f1d7db389744c8fbd7bad834a45ef41. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:52:09.558572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:52:09.562711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:52:09.571423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bcb9f96a-cb42-4cb8-babd-b6eb040fa02b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.386503 Oct 28 17:52:09.580423 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2522/4932] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:52:09 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:09.602854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:09.603821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:09.619072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.619845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.620472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.627804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.630694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.631332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.652128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74740581-2799-49dd-a743-f88e6a668b96 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406345 Oct 28 17:52:09.656778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2411/4933] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:52:09.671228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:09.698500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:09.701087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.servers [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Removing options 'limit' from query {{(pid=120568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 17:52:09.701808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:09.712845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.713371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.713808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.714529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:09.714968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:09.716946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:09.751742 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85dc60dd-6868-4c24-b85e-b3512d948569 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.092779 Oct 28 17:52:09.756337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2412/4934] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Oct 28 17:52:09 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:09.761698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efe0d5e8-b664-4702-b60d-611c8ead6afb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:09.763271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efe0d5e8-b664-4702-b60d-611c8ead6afb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:10.085474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-efe0d5e8-b664-4702-b60d-611c8ead6afb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.096931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efe0d5e8-b664-4702-b60d-611c8ead6afb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1218 microversion: 2.1 time: 0.339109 Oct 28 17:52:10.097529 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2413/4935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:09 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1218 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:10.109788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "name": "network-vif-plugged", "status": "completed", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:10.134225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.136368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.138627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.180376 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] Creating event network-vif-plugged:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:52:10.196228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-834a7ed7-1ea3-415b-8c63-5bbfa77f08ac req-d7af1258-e718-4a72-b3dc-abcc20ddc445 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094237 Oct 28 17:52:10.199659 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2414/4936] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:10.236226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:10.256580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.257863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-210216977', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:10.270390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.271003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.271473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.272190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.272638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.273057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.338691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.360874 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6f9837f-2137-46c5-8b61-014a0622292b tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.787141 Oct 28 17:52:10.362857 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2523/4937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:09 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:10.373818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:10.376097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:10.403787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.408823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.410065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.415971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.416455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.416900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.428858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:10.534046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e38b290-51ad-43ac-b17d-14e6712a2785 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-210216977" status: 200 len: 345 microversion: 2.1 time: 0.330570 Oct 28 17:52:10.534865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2415/4938] 10.222.0.48 () {58 vars in 1240 bytes} [Fri Oct 28 17:52:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-210216977 => generated 345 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:10.549718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:10.572059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.573394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.573867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.696326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:52:10.789183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:10.829137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.845321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.846045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65b9c4a3-7a4d-4847-af53-4b3e4ac3e32a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "POST /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807/action" status: 202 len: 0 microversion: 2.1 time: 0.301757 Oct 28 17:52:10.850122 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2416/4939] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:52:10 2022] POST /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:52:10.850283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:10.850283 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2140d67a-56a1-4a62-ab01-9c945a121eb6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1744 microversion: 2.20 time: 0.485867 Oct 28 17:52:10.861336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:10.862050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:10.869353 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2524/4940] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:10 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1744 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:10.878817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.879696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.880155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:10.881081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:10.881652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:10.882247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.074033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:11.087716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6dde74b2-7f94-4957-bf99-52237c6a36d1 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.235971 Oct 28 17:52:11.088782 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2417/4941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:10 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:11.123872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:11.124751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:11.148194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.149013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.153422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.154981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.155683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.156315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.286076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:11.305406 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-24f615fd-1c8a-4540-bb06-4ae436669690 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1270 microversion: 2.1 time: 0.184630 Oct 28 17:52:11.306591 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2525/4942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:11 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:11.396336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:11.396336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:11.410538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.411091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.411686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.412404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.412861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.413288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.640645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03187cb0-48a1-480e-856c-a38cff96867c", "name": "network-vif-deleted", "tag": "ae18c7af-9103-4e0b-9845-be55cd3c1829"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:11.693381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.693830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.694260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.738723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] Creating event network-vif-deleted:ae18c7af-9103-4e0b-9845-be55cd3c1829 for instance 03187cb0-48a1-480e-856c-a38cff96867c on n-h2-860864-13 Oct 28 17:52:11.754574 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-19b486fe-94e1-4daa-99d1-8e98cf5d217b req-eed87862-b000-4893-a7e6-8195409badf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127203 Oct 28 17:52:11.757975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2526/4943] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:11.878741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:11.879510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:11.905664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.908118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.908765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:11.912867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:11.913604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:11.914267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:12.254996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:12.269969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0305ee0-4f8e-4131-b376-e2a8c5fdeab6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.882929 Oct 28 17:52:12.271678 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2418/4944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:11 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:12.287597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:12.288444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:12.306886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:12.308981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:12.311405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:12.313868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:12.316246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:12.318281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:12.611881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:12.626085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:12.632469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:12.653673 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d02a1079-cc39-433b-96dd-6a05709db37f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.760313 Oct 28 17:52:12.656129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2527/4945] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:11 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:12.669425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:12.672202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:12.692970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:12.694119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:12.696376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:12.698335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:12.699233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:12.701911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:13.000018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:13.033393 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e36c088-e943-4951-9471-e7d9990d46a2 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1276 microversion: 2.1 time: 0.371736 Oct 28 17:52:13.034157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2528/4946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:12 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:13.207248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:13.227812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-929246f3-7e48-4d85-8881-939237959aa6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.951614 Oct 28 17:52:13.231749 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2419/4947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:12 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:13.296030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:13.296636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:13.311853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:13.313431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:13.316804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:13.317554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:13.318018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:13.318438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:13.687912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:13.688511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:13.698467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:13.702168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:13.704543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:13.705455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:13.708062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:13.709069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:13.865480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:13.876226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6e7608e-e8b1-46f8-9aeb-4dce17673572 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.584681 Oct 28 17:52:13.877764 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2529/4948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:13 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:14.052629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:14.058257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:14.058940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:14.064013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:14.065575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:14.066873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e8fbfa3-a24c-45e9-848b-5508d8d1c36f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.385364 Oct 28 17:52:14.073098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.075022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.076869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:14.081484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.082249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.083381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:14.087623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2420/4949] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:13 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:14.258192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:14.259885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:14.263821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:14.275479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.276103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.278575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:14.279672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.281919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.282756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:14.321703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:14.332684 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c047cb42-5d60-4871-9957-41073c07e15c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.279084 Oct 28 17:52:14.347406 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2530/4950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:14 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:14.563222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:14.579394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0e84201d-53d9-4da1-97dc-e337cb617aac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.325255 Oct 28 17:52:14.583011 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2421/4951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:14 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:14.915118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:14.916685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:14.927557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.928544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.929148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:14.930055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:14.931794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:14.932410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.099577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:15.100901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:15.115299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.117654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.118281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.123065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.123792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.124508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.206290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:15.220933 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17b81deb-72f8-499c-a910-d0086a8a34df tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.322608 Oct 28 17:52:15.225227 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2531/4952] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:14 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:15.363042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:15.365685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:15.389348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.392215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.393777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.398516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.399274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.401156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.672134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:15.687580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:15.689145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:15.690548 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-357d7a27-3ab3-4ca5-a506-29674f45bd94 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.596537 Oct 28 17:52:15.695549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2422/4953] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:15 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:15.700920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:15.705329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:15.723258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.724336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.725176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:15.726147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:15.726847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:15.727928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:16.050315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:16.066282 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b16e97fb-dd39-4d71-bab7-7281d95452df tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.710366 Oct 28 17:52:16.067168 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2532/4954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:15 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:16.141002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:16.149290 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a365abad-5b14-4312-8245-d78d5d7ba889 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.452233 Oct 28 17:52:16.155586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2423/4955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:15 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:16.247777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:16.248656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:16.268439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:16.269246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:16.272314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:16.275704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:16.276774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:16.280082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:16.720238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:16.723860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:16.725077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:16.735624 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-265dad9f-d43a-4228-9730-8db82a949fa6 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.493369 Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:16.748023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:16.749048 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2533/4956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:16 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:17.094183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:17.095578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:17.108547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:17.109046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:17.109487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:17.110480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:17.111108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:17.111729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:17.289154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:17.891239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:17.899882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:17.901334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:17.916502 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62491c71-7688-4b01-923f-b6e08fb071e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 1.182592 Oct 28 17:52:17.944799 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2424/4957] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:16 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:17.984103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:17.994879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:17.998705 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ef2ff1e-e50e-4b7d-9f46-cbb03a935bae tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.908525 Oct 28 17:52:18.011413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:18.013096 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2534/4958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:17 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:18.021736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:18.022899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:18.026102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.030492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.031357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.032095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.033613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.034452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.035054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.038731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.042430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.049216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.051804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.052982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.062295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:18.512362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:18.520914 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-507dfcbe-8b70-4527-99ab-09f8a250907a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.574428 Oct 28 17:52:18.524037 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2425/4959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:17 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:18.533896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ad470e-f9bb-4bc3-a3d0-5e1271e78819", "tag": "907ba84f-228d-4214-bdb8-546c271d4244"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:18.534651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:18.547892 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb8c60cd-be6a-4225-a094-66c25d39d6d9 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.533367 Oct 28 17:52:18.552012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.553633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.554439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.554568 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2535/4960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:18 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:18.581373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30166fe0-a403-436d-aa2e-6adf8527732a", "name": "network-vif-plugged", "status": "completed", "tag": "61d59349-4c25-478e-88cc-d4ec7e1fcec6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:18.588784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] Creating event network-changed:907ba84f-228d-4214-bdb8-546c271d4244 for instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 on n-h2-860864-13 Oct 28 17:52:18.600011 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-abb4151e-0bed-441b-abaf-080f059439c7 req-91957e4f-6978-4be5-b84f-31f51abf92c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073935 Oct 28 17:52:18.601869 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2426/4961] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:18.627718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.629969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.630421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.671843 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] Creating event network-vif-plugged:61d59349-4c25-478e-88cc-d4ec7e1fcec6 for instance 30166fe0-a403-436d-aa2e-6adf8527732a on n-h1-860864-13 Oct 28 17:52:18.682908 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7116f459-117c-4f32-8a2c-32808e78e3cb req-86d295d8-8074-47c3-9bdc-550a24afe7f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125254 Oct 28 17:52:18.684275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2536/4962] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:18.950128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:18.950925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:18.966320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.966812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.967246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:18.968194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:18.972159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:18.972839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.026055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:19.027035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:19.039632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.041371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.044429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.045393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.048399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.049245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.297652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:19.650670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:19.669221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:19.678414 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9988fb03-dd0b-4c6e-b1c8-e980d3b41356 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.639205 Oct 28 17:52:19.681742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2537/4963] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:19 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:19.687517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:19.689007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:19.696163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:19.697589 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d84ff123-863a-4034-87e3-f36c20ee35bf tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.752302 Oct 28 17:52:19.698635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2427/4964] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:18 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:19.701265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:19.708667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:19.709273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:19.714079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.716465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.717085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.719190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.719857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.720311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.726574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.727073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.729908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:19.731516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:19.732157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:19.736483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:20.092454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=20 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:20.117972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:20.132602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71316013-5eea-4233-9f21-cbd3e9f2702b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.449531 Oct 28 17:52:20.133511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2538/4965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:19 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:20.145020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:20.162700 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63389f48-79d2-4bdb-a1ee-db5209c5b5c0 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1293 microversion: 2.1 time: 0.462205 Oct 28 17:52:20.167412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2428/4966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:19 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1293 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:20.703206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:20.704845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:20.715611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:20.717995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:20.719876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:20.720855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:20.724003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:20.724880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:20.731261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:20.732709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:20.737845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:20.742926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:20.743906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:20.744545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:20.747085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:20.747906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:20.748686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:21.110884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:21.120774 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8eab842-cef7-477e-a01e-222721bfab5c tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.421964 Oct 28 17:52:21.131152 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2539/4967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:20 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:21.160845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:21.162496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:21.185770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:21.186326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:21.196472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:21.203234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:21.205382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:21.210310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:21.623463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:21.661765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:21.665847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:21.672264 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92490d76-e373-4e82-a056-b955760d73e5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.949889 Oct 28 17:52:21.677837 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2429/4968] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:20 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:21.690739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:21.693966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:21.696870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:21.706019 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40a73083-f67a-4da3-a682-b8dcc88587cc tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.549018 Oct 28 17:52:21.712815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2540/4969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:21 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:21.732863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:21.733361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:21.733805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:21.734533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:21.734984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:21.735430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.129430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:22.143721 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b92230f-228a-4754-a834-a66b9a1f5ea4 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1484 microversion: 2.1 time: 0.464226 Oct 28 17:52:22.144513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2430/4970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:21 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1484 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:22.166287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:22.166904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:22.173380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:22.174103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:22.180168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.180794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.181331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.182543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.183744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.183744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.188650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.190387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.193949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.195683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.197076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.197678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.477759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f8045ad-2e6b-4e5b-9bf7-7031761c4f66 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308409 Oct 28 17:52:22.479306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2431/4971] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:52:22 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:52:22.715111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:22.716079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:22.744727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.745798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.746470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:22.747490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.748433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.748895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.749326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.762161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-903f21ff-822c-4f7e-a8bc-f592091b118f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.601291 Oct 28 17:52:22.763701 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2541/4972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:22 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:22.769491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:22.770308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:22.783010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.783909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.784789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:22.788576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:22.789366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:22.789979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:23.394925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:23.409024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:23.411000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:23.416738 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-302f656c-f7cd-4b20-a650-c1dab543d151 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.707298 Oct 28 17:52:23.418899 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2432/4973] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:22 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:23.493608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:23.503960 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-acf65b31-3fc9-424a-881c-4c07477020d3 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.738816 Oct 28 17:52:23.505104 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2542/4974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:22 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:23.788610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:23.789565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:23.799838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:23.800554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:23.802529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:23.805748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:23.806530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:23.807232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:24.287865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:24.297650 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d873677-43de-4991-adfa-ecf7fba2d652 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.512801 Oct 28 17:52:24.304300 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2433/4975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:23 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:24.442535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:24.443857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:24.456104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:24.458323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:24.458957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:24.460188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:24.463246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:24.463937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:24.531247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:24.531918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:24.541032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:24.541729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:24.542628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:24.544145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:24.544791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:24.545387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:24.552784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:25.002569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:25.016651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:25.038159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:25.043418 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad3892a9-909f-4220-ba73-94605f366487 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.515908 Oct 28 17:52:25.055266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2434/4976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:24 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:25.063151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:25.069804 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a83c2357-91fc-4f1d-9953-b8228bece797 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.631492 Oct 28 17:52:25.074830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2543/4977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:24 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:25.326818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:25.327761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:25.341883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:25.347597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:25.350798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:25.352265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:25.355841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:25.359127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.010362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ad470e-f9bb-4bc3-a3d0-5e1271e78819", "name": "network-vif-plugged", "status": "completed", "tag": "907ba84f-228d-4214-bdb8-546c271d4244"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:26.035343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.038381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.040146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.072360 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] Creating event network-vif-plugged:907ba84f-228d-4214-bdb8-546c271d4244 for instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 on n-h2-860864-13 Oct 28 17:52:26.080297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:26.091802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d994c0a7-8bc4-458c-a0ba-5ba0a3c3e9c4 req-3431ff1c-7432-49a3-a7d0-8187c5fb6501 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083951 Oct 28 17:52:26.092685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb043ae9-bb15-49b4-aad2-10e21be0891a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.769150 Oct 28 17:52:26.093727 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2544/4978] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:52:26.108262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:26.109206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:26.109769 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2435/4979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:25 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:26.115787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:26.124845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:26.154195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.156247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.158171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.166893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.170752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.172208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.172529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.184479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.185285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.190829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.191434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.192757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.782882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:26.792524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bb3774d-ec85-49e0-abd7-36d77a76712b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1521 microversion: 2.1 time: 0.697305 Oct 28 17:52:26.795682 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2545/4980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:26 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1521 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:26.807057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:26.809626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:26.829268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.830248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.830909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.832356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.834504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.835169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.848589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:26.872406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a1a9f64-6f7b-4c3e-9c11-1a3981956e3a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1484 microversion: 2.1 time: 0.761189 Oct 28 17:52:26.873037 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2436/4981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:26 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1484 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:26.897781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30166fe0-a403-436d-aa2e-6adf8527732a", "tag": "61d59349-4c25-478e-88cc-d4ec7e1fcec6"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:26.930644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:26.934217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:26.934867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:26.962332 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] Creating event network-changed:61d59349-4c25-478e-88cc-d4ec7e1fcec6 for instance 30166fe0-a403-436d-aa2e-6adf8527732a on n-h1-860864-13 Oct 28 17:52:26.976890 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7aee3fc3-2637-43b6-a352-ff74486c1515 req-0a2a9a90-9cd1-4af0-a850-a57ba7d9a7dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098213 Oct 28 17:52:26.980592 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2437/4982] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:27.128001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:27.129609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:27.164826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:27.165369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:27.165828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:27.166573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:27.167032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:27.167488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:27.710661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:27.735584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:27.740965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:27.749392 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e0549c3-6f6d-4161-a92b-1248f900039e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.951633 Oct 28 17:52:27.755157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2546/4983] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:26 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:27.836333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:27.837261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:27.847128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:27.852984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:27.854016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:27.858259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:27.859011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:27.859896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.070380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:28.087251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7e965a35-7690-49d9-988e-861fde30570f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1318 microversion: 2.1 time: 0.966801 Oct 28 17:52:28.118238 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2438/4984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:27 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1318 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:28.611827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:28.631962 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4fc8737e-f126-4140-9ed6-448a2ebb4839 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1498 microversion: 2.1 time: 0.813955 Oct 28 17:52:28.635059 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2547/4985] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:27 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1498 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:28.661124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:28.674649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:28.675877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:28.703530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:28.704276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:28.704916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.705906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:28.707221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:28.707868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.774953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:28.784271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:28.784884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:28.817550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:28.818357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:28.819339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.822931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:28.824422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:28.825542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.853325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46d543b1-59f7-4a4e-b5ff-f921368c0469 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.196264 Oct 28 17:52:28.861160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2439/4986] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Oct 28 17:52:28 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:28.866352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:28.885982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:28.895671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:28.896492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:28.939722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Going to try to start instance {{(pid=120568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 17:52:29.041219 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b6fd712-b064-4e3b-a54c-bf9b9b6330c5 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "POST /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807/action" status: 202 len: 0 microversion: 2.1 time: 0.170270 Oct 28 17:52:29.042669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2440/4987] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:52:28 2022] POST /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:52:29.054103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:29.060971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:29.102863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:29.104081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:29.104893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:29.106999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:29.107666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:29.108793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:29.593677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:29.604483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:29.612097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:29.623709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78eda5ce-6acd-46d4-9fac-0b84d3d9f7c9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.843168 Oct 28 17:52:29.624786 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2548/4988] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:28 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:29.642894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:29.650001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:29.667123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:29.670261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:29.671767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:29.678675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:29.679304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:29.684628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:30.319003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:30.328926 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ac46291-b144-43c9-b1b2-6b921fed3653 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1509 microversion: 2.1 time: 0.702921 Oct 28 17:52:30.332925 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2549/4989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:29 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1509 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:30.362275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:30.368224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:30.395437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:30.399945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:30.400877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:30.402097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:30.403433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:30.405403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:30.410656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca8174f2-dadb-4b70-96ad-e36e5230f9dd tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1507 microversion: 2.1 time: 1.360661 Oct 28 17:52:30.414756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:30.415736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2441/4990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:29 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1507 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:30.653916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:30.654526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:30.666411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:30.681261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:30.686991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:30.688001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:30.688626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:30.689230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.002729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:31.014281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c80f3f0-cb2b-4ab6-b42d-abd3fa01b191 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1509 microversion: 2.1 time: 0.658181 Oct 28 17:52:31.047729 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2550/4991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:30 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:31.059068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:31.061739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:31.079795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.080251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.080727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.083689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.084173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.086659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.233425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f096ca1-ce39-4fda-a10f-59814806b68d tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "PUT /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1081 microversion: 2.1 time: 0.179335 Oct 28 17:52:31.234826 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2551/4992] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:52:31 2022] PUT /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1081 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:31.256558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:31.257479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:31.269219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.270020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.276463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.277592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.278260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.278896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.303463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:31.313260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:31.327118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:31.328859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:31.338105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97bb447c-8384-48e2-afff-7d4733e5c788 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.689878 Oct 28 17:52:31.345708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2442/4993] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:30 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:31.445811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:31.446372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:31.456357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.461169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.463716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.466557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.471289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.472218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.614544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:31.622967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6532cf60-5472-4ff3-8ee5-d572a41a7393 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1507 microversion: 2.1 time: 0.370171 Oct 28 17:52:31.623681 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2552/4994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:31 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:31.648034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:31.648649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:31.657127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.657631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.658072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:31.664458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:31.665640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:31.666106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.060697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.076823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4db55229-cdd2-476c-b066-dd9550c951cc tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1507 microversion: 2.1 time: 0.432543 Oct 28 17:52:32.078074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2553/4995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:31 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:32.085958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.098472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de8dbfa5-5bfc-472c-b495-a653cbc6f432 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1507 microversion: 2.1 time: 0.657318 Oct 28 17:52:32.103912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2443/4996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:31 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1507 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:32.106906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:32.111898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:32.123134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.124348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.125052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.126111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.126811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.127504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.230623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd25ab36-aca8-44e2-ba05-c858f33bc164 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "PUT /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1083 microversion: 2.1 time: 0.130163 Oct 28 17:52:32.232307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2554/4997] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:52:32 2022] PUT /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1083 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:32.253480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:32.254639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:32.264770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.268180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.268908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.273350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.274071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.274694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.382316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:32.383630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:32.391538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.392453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.393212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.394201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.394892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.395608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.766838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.780287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.785695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.789535 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74401d12-cfaf-4cec-adf6-b4a065ea9968 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.410791 Oct 28 17:52:32.808336 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2555/4998] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:32 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:32.891115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:32.911870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-922187b4-c01b-43b9-8a18-e81f9ed0924f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1509 microversion: 2.1 time: 0.663002 Oct 28 17:52:32.912575 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2444/4999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:32 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:32.955292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:32.957630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:32.980529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.983526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.983526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:32.983526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:32.985770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:32.988097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.131736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:33.132600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:33.142723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.143211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.143692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.144403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.144830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.145248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.769060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:33.780733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:33.786200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7335e338-c8ce-45dd-8f58-76837ccc812b tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1509 microversion: 2.1 time: 0.846102 Oct 28 17:52:33.789329 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2556/5000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:32 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1509 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:33.800851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-08a17f21-4585-4658-9fe4-6007eaa6c087 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1511 microversion: 2.1 time: 0.673304 Oct 28 17:52:33.812069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2445/5001] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:33 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1511 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:33.817967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:33.820680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:33.830138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:33.835324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:33.837272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.837783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.838229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.838958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.845922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.848952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.866421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.servers [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Removing options 'limit' from query {{(pid=120568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 17:52:33.867277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:33.868510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.868999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.869440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.870175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.870859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.871159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.910224 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bedca8cc-ec0a-4b74-98d5-90874b95a4ab tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.083835 Oct 28 17:52:33.923261 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2446/5002] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Oct 28 17:52:33 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:52:33.928607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:33.937506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:33.962513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.967001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.969320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.970688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:33.977616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:33.984381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:33.993208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:34.174135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:34.215097 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f2d80a9-f3df-42f1-a577-52b15004f3b6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 204 len: 0 microversion: 2.1 time: 0.404409 Oct 28 17:52:34.223683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2557/5003] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:33 2022] DELETE /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:34.232703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:34.233839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:34.241199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:34.241954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:34.242636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:34.243733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:34.244519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:34.245163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.041813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:35.054656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:35.056564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:35.058089 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4dd93d70-c262-44cc-8e31-2e0cce3246ae tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 1.133518 Oct 28 17:52:35.059834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2447/5004] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:33 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:35.069192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:35.081152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ebc399a-e801-4bed-9b94-c33b527af37c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1511 microversion: 2.1 time: 0.856055 Oct 28 17:52:35.085848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:35.086974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2558/5005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:34 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:35.087706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:35.096092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.096832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.097464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.098407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.099002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.099729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.111262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:35.112115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:35.118731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.119397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.121180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.122257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.122964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.123681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.190874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:35.734187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:35.747419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5dcf94f-7ddd-43f2-bdaa-a568960b12e7 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1511 microversion: 2.1 time: 0.640458 Oct 28 17:52:35.763956 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2559/5006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:35 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1511 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:35.787051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:35.790158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:35.816342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.817129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.817727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:35.821506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:35.822848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:35.825028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:36.221006 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Instance is already in deleting state, ignoring this request Oct 28 17:52:36.234243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c706ea09-64f3-496c-834d-b4ee4200bfdb tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 204 len: 0 microversion: 2.1 time: 1.172248 Oct 28 17:52:36.239549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2448/5007] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:35 2022] DELETE /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:36.252439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:36.255084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:36.275713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:36.278296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:36.279566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:36.281584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:36.282766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:36.283865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:36.551017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:36.560753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f49f067-3426-4c4f-b626-545461b6f031 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1512 microversion: 2.1 time: 0.789789 Oct 28 17:52:36.580980 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2560/5008] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:35 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1512 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:36.588935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:36.590395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:36.597090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:36.597950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:36.598632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:36.599615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:36.601062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:36.601845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:37.029376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.036068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.044314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15b2cac0-ebaf-4683-a4a2-5261a635f8c6 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1515 microversion: 2.1 time: 0.461992 Oct 28 17:52:37.045952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:37.047125 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2561/5009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:36 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1515 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:37.061445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.062726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:37.063603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.064825 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-77498b84-dccf-43cd-8b65-850fa5159c64 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.822929 Oct 28 17:52:37.077074 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2449/5010] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:36 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:37.088765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.089985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:37.271403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:37.271914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:37.272437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:37.273176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:37.273634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:37.274067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:37.393546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:37.528460 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63d138a7-cc77-4e20-83a2-119bfb4b690c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.479028 Oct 28 17:52:37.533324 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2562/5011] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Oct 28 17:52:37 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:37.548037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:37.548701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:37.562597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:37.566035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:37.566712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:37.567806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:37.569828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:37.570463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:37.953421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:37.962132 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4161443a-782e-46dd-a750-78478eae905f tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1511 microversion: 2.1 time: 0.419623 Oct 28 17:52:37.972449 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2450/5012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:37 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:37.997879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:37.999384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:38.006374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.007232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.008035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:38.009004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.009749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.010413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:38.078716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:38.079926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:38.110824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.112710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.114724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:38.116409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.119145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.121557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:38.688680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:38.707490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da165d9e-6f96-458d-905e-8dcb3fb7859c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1511 microversion: 2.1 time: 0.714208 Oct 28 17:52:38.715346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2563/5013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:37 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1511 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:38.733756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:38.733756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:38.734184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:38.757563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.758069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.758584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:38.759303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:38.760837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:38.762135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.191548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.202917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-770cc989-8578-4541-9934-7c4167060ca5 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1515 microversion: 2.1 time: 1.129852 Oct 28 17:52:39.203875 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2451/5014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:38 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1515 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:39.233818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:39.237068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:39.283807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:39.291404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:39.291899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.293442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:39.293904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:39.294347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.434939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.445941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.448621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.450944 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3480c746-a98a-4989-94c7-f3f330c35c32 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1739 microversion: 2.20 time: 0.733928 Oct 28 17:52:39.452074 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2564/5015] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:38 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1739 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:39.818968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ad470e-f9bb-4bc3-a3d0-5e1271e78819", "name": "network-vif-deleted", "tag": "907ba84f-228d-4214-bdb8-546c271d4244"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:39.822402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.832507 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e7bb8da-ed49-4bb4-847a-f533af93c567 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1512 microversion: 2.1 time: 0.610950 Oct 28 17:52:39.846596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2452/5016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:39 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1512 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:39.851656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:39.852654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:39.863647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.872349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:39.878127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:39.879562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:39.887948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:39.889315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:39.890060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.891133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:39.892293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:39.893293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:39.937343 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] Creating event network-vif-deleted:907ba84f-228d-4214-bdb8-546c271d4244 for instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 on n-h2-860864-13 Oct 28 17:52:39.938864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:39.956624 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e00b0eb3-b5e4-4eee-a5ed-076d15c38a32 req-65da011c-3186-4303-9c29-13a62659892b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147491 Oct 28 17:52:39.959747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2565/5017] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:52:40.069023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:40.103286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.106228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.106637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.237627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:40.239530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:40.252986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.258434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.259726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.262120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.264789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.265551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.364262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.369472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.371464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.372460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lazy-loading 'fault' on Instance uuid 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:52:40.457416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6781ab0164419ba1fc68626ebeae67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f1d7db389744c8fbd7bad834a45ef41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:40.467814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:40.472185 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e35fd8b-b5e9-40eb-b443-149e0e0de454 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 200 len: 1308 microversion: 2.1 time: 0.248899 Oct 28 17:52:40.473376 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2566/5018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:40 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:40.481218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:40.482015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:40.490555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.491105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.491992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.493383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:40.494080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:40.497271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:40.633062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c981b61-a586-4afd-b838-d25dc9523f73 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.766333 Oct 28 17:52:40.635582 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2453/5019] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:52:39 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:40.663133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:40.672079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:40.675395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:41.304139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:41.316367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:41.318256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:41.319872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.320469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.320621 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74376f7b-fa5e-46fa-936f-18a5750f385b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1721 microversion: 2.20 time: 0.842416 Oct 28 17:52:41.321124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.322261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.323266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.324368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.332871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2567/5020] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:40 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1721 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:41.486445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:41.502556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.503922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 32ad470e-f9bb-4bc3-a3d0-5e1271e78819] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:41.519080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.522280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.522759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.529378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.530291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.533143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.585066 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] HTTP exception thrown: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Request method failure captured: Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 HTTP/1.1 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZFUAnMDRf9tW-Jt49QWQSODtPFU_ZLbUwVmjIGGiIzocTRbZE_OEARrkQ5EY8vjTtGZWXh1RTMGLbx86VaUpCtkZQwjTQ8JKgmh84S45DzXOddTkcEoaNUjM3l_NPVlTjrIe2E4uLcW0-Gu97_ywMfv-kMMCyMVkM8_4GYForX-qs Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1f1d7db389744c8fbd7bad834a45ef41"}]}] Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ea6781ab0164419ba1fc68626ebeae67 Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '32ad470e-f9bb-4bc3-a3d0-5e1271e78819'} Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.594283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Returning 404 to user: Instance 32ad470e-f9bb-4bc3-a3d0-5e1271e78819 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:41.599431 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bde4ed1f-5280-4053-a17d-85367ca97800 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819" status: 404 len: 111 microversion: 2.1 time: 0.098510 Oct 28 17:52:41.600127 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2568/5021] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:41 2022] GET /compute/v2.1/servers/32ad470e-f9bb-4bc3-a3d0-5e1271e78819 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:41.613204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.623381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:41.637532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.642450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.642928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.643741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.644241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.644696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.688073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] HTTP exception thrown: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Request method failure captured: Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c HTTP/1.1 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZFUAnMDRf9tW-Jt49QWQSODtPFU_ZLbUwVmjIGGiIzocTRbZE_OEARrkQ5EY8vjTtGZWXh1RTMGLbx86VaUpCtkZQwjTQ8JKgmh84S45DzXOddTkcEoaNUjM3l_NPVlTjrIe2E4uLcW0-Gu97_ywMfv-kMMCyMVkM8_4GYForX-qs Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1f1d7db389744c8fbd7bad834a45ef41"}]}] Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ea6781ab0164419ba1fc68626ebeae67 Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '03187cb0-48a1-480e-856c-a38cff96867c'} Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:41.694626 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.700070 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.704455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Returning 404 to user: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:41.704455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f47686bc-a3d4-4d67-903a-5d51e6288576 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 404 len: 111 microversion: 2.1 time: 0.103146 Oct 28 17:52:41.704455 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2569/5022] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:41 2022] DELETE /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:41.715919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.716832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: 03187cb0-48a1-480e-856c-a38cff96867c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:41.720665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1969cb68-35a6-437c-bc7a-879ecfe4915a tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1010 microversion: 2.1 time: 1.061678 Oct 28 17:52:41.721270 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2454/5023] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:52:40 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1010 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:41.724614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.725360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.726047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.727012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.727776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.728690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.737449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.742716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:41.743817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:41.749646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.750364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.751141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.752205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.752847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.753453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.758714 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] HTTP exception thrown: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Request method failure captured: Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c HTTP/1.1 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZFUAnMDRf9tW-Jt49QWQSODtPFU_ZLbUwVmjIGGiIzocTRbZE_OEARrkQ5EY8vjTtGZWXh1RTMGLbx86VaUpCtkZQwjTQ8JKgmh84S45DzXOddTkcEoaNUjM3l_NPVlTjrIe2E4uLcW0-Gu97_ywMfv-kMMCyMVkM8_4GYForX-qs Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1f1d7db389744c8fbd7bad834a45ef41"}]}] Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ea6781ab0164419ba1fc68626ebeae67 Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '03187cb0-48a1-480e-856c-a38cff96867c'} Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.760599 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.765657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Returning 404 to user: Instance 03187cb0-48a1-480e-856c-a38cff96867c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:41.766240 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d9dcfb05-7298-4748-8f1e-9a03032a3574 tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c" status: 404 len: 111 microversion: 2.1 time: 0.055052 Oct 28 17:52:41.768058 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2570/5024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:41 2022] GET /compute/v2.1/servers/03187cb0-48a1-480e-856c-a38cff96867c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:41.781237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.782656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:41.795088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.797745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.798508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.799640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.800365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.802639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.832982 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] HTTP exception thrown: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Request method failure captured: Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 HTTP/1.1 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZFUAnMDRf9tW-Jt49QWQSODtPFU_ZLbUwVmjIGGiIzocTRbZE_OEARrkQ5EY8vjTtGZWXh1RTMGLbx86VaUpCtkZQwjTQ8JKgmh84S45DzXOddTkcEoaNUjM3l_NPVlTjrIe2E4uLcW0-Gu97_ywMfv-kMMCyMVkM8_4GYForX-qs Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1f1d7db389744c8fbd7bad834a45ef41"}]}] Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ea6781ab0164419ba1fc68626ebeae67 Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b1963b4e-008c-48ff-86ba-490d7edd61f0'} Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:41.834985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.840969 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.846063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Returning 404 to user: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:41.847164 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9dece65a-6b3d-44ca-921e-fac14631ad6a tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 404 len: 111 microversion: 2.1 time: 0.074643 Oct 28 17:52:41.851964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2571/5025] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:41 2022] DELETE /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:41.860176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:41.863594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] [instance: b1963b4e-008c-48ff-86ba-490d7edd61f0] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:41.879598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.880445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.881069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.881988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:41.882618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:41.883220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:41.912116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] HTTP exception thrown: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Request method failure captured: Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 HTTP/1.1 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZFUAnMDRf9tW-Jt49QWQSODtPFU_ZLbUwVmjIGGiIzocTRbZE_OEARrkQ5EY8vjTtGZWXh1RTMGLbx86VaUpCtkZQwjTQ8JKgmh84S45DzXOddTkcEoaNUjM3l_NPVlTjrIe2E4uLcW0-Gu97_ywMfv-kMMCyMVkM8_4GYForX-qs Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1f1d7db389744c8fbd7bad834a45ef41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1f1d7db389744c8fbd7bad834a45ef41"}]}] Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 1f1d7db389744c8fbd7bad834a45ef41 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-519233116 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ea6781ab0164419ba1fc68626ebeae67 Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-519233116-project Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b1963b4e-008c-48ff-86ba-490d7edd61f0'} Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:41.923669 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. Oct 28 17:52:41.928306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:41.930710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] Returning 404 to user: Instance b1963b4e-008c-48ff-86ba-490d7edd61f0 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:41.932063 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d8ddbd3-9bdf-4113-8a13-7409d3a0852f tempest-ServerDiskConfigTestJSON-519233116 tempest-ServerDiskConfigTestJSON-519233116-project] 10.222.0.48 "GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0" status: 404 len: 111 microversion: 2.1 time: 0.075992 Oct 28 17:52:41.933512 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2572/5026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:41 2022] GET /compute/v2.1/servers/b1963b4e-008c-48ff-86ba-490d7edd61f0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:52:41.954941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:42.063463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62c3f627-9cc7-43bb-b827-e0f0637679c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.331280 Oct 28 17:52:42.064451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2455/5027] 10.222.0.48 () {58 vars in 1212 bytes} [Fri Oct 28 17:52:41 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:42.077309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:42.086572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:42.087996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:42.094472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.095294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.095963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.096978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.097691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.098349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.314936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:42.353128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:42.375977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:42.401201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.401201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.401201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.401201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.401201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.402692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.525584 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df15f04f-aa95-4934-b331-73273bc8474b tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.452898 Oct 28 17:52:42.536666 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2573/5028] 10.222.0.48 () {58 vars in 1196 bytes} [Fri Oct 28 17:52:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:42.541545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:42.555774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:42.557175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': '-210216977', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:42.569174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.569669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.570109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.570820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.571277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.571733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.746050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:42.859823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e149840d-dc80-4765-8f5c-edadac36adff tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-210216977" status: 200 len: 345 microversion: 2.1 time: 0.321702 Oct 28 17:52:42.860957 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2574/5029] 10.222.0.48 () {58 vars in 1156 bytes} [Fri Oct 28 17:52:42 2022] GET /compute/v2.1/servers?name=-210216977 => generated 345 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:52:42.876159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:42.893081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:42.898769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:42.905897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.910049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.913848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:42.914899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:42.915659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:42.916325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.040019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:43.158677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-76946946-ea44-468a-b5dc-214f847b4045 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.286832 Oct 28 17:52:43.167890 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2575/5030] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Oct 28 17:52:42 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:43.173955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:43.181357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:43.184231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-21021697', 'deleted': False, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:52:43.212284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.212985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.213483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.214938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.216739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.217283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.453044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:52:43.541983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:43.552496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:43.560755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:43.571175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7763147b-3e73-484c-9a9a-907282b8c5c6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1721 microversion: 2.20 time: 1.221368 Oct 28 17:52:43.595709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2456/5031] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:42 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1721 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:43.646030 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38744e20-e1fe-40f1-92c6-d174d45001af tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21021697" status: 200 len: 345 microversion: 2.1 time: 0.476460 Oct 28 17:52:43.647782 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2576/5032] 10.222.0.48 () {58 vars in 1226 bytes} [Fri Oct 28 17:52:43 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-21021697 => generated 345 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:43.655847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "name": "network-vif-unplugged", "status": "completed", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:43.664706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:43.671635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:43.679982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.681492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.682240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.684136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.684950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.685557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.701525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.702032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.702471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.716004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:43.772035 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] Creating event network-vif-unplugged:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:52:43.805484 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5808b6c6-0aa0-43e1-be48-04947624e324 req-3536a543-a5e9-4120-9fca-61a74ad2b0d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162316 Oct 28 17:52:43.806891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2457/5033] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:43.846897 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9e2e83c-d25f-4a97-ad69-75f3776c30ae tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 204 len: 0 microversion: 2.1 time: 0.186203 Oct 28 17:52:43.847673 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2577/5034] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:43 2022] DELETE /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:43.866969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:43.867775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:43.903291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.908040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.911722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:43.915057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:43.916122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:43.916651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:44.604393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:44.608080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:44.616622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:44.617157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:44.617886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:44.618899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:44.619626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:44.621798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:44.799070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:44.813150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfc890da-769f-4e73-9c26-64d53613d36c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1518 microversion: 2.1 time: 0.960015 Oct 28 17:52:44.833124 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2458/5035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:43 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1518 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:45.210972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:45.222153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:45.229177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:45.231351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-52e9a991-641c-4539-9ad5-d1edfc59e8f1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1724 microversion: 2.20 time: 0.634681 Oct 28 17:52:45.244905 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2578/5036] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:44 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1724 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:45.262572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27344f8f-e94e-46dd-a39d-0ed6c5667e64"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:45.272459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:45.286938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=74 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:45.289469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:45.290648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:45.291458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:45.293109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:45.293941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:45.294552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:45.845765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:45.847004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:45.858723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:45.861137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:45.861689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:45.862479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:45.864642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:45.865113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:45.867816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-02b6ea16-0db5-4825-8963-88de42842002 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.606035 Oct 28 17:52:45.871412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2459/5037] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Oct 28 17:52:45 2022] POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 188 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:52:46.099954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:46.101261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:46.116341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:46.116879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:46.117398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:46.118997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:46.119712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:46.122319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:46.169006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 17:52:46.190716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:46.206027 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2756792-43e9-463a-8601-f9ea4001c591 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1518 microversion: 2.1 time: 0.364013 Oct 28 17:52:46.217222 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2579/5038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:45 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1518 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:46.297699 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed9709a9-a9b3-4f91-a99e-64691f42f41c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/action" status: 202 len: 0 microversion: 2.20 time: 0.210936 Oct 28 17:52:46.298395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2460/5039] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:52:46 2022] POST /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:46.311652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:46.312727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:46.322272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:46.324445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:46.324951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:46.325674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:46.326264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:46.326855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:46.847423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:46.875952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:46.877414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:46.878640 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f879c6e-cac5-46e9-ba10-4ff5c6089936 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1750 microversion: 2.20 time: 0.574913 Oct 28 17:52:46.879547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2580/5040] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:46 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1750 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:47.233962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:47.235695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:47.265721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:47.283999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:47.284448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:47.299772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:47.300496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:47.301040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:47.534154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:47.547490 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3bae20dc-2ad6-4dbf-9138-6a61d38f6cbb tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 200 len: 1476 microversion: 2.1 time: 0.319240 Oct 28 17:52:47.554100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2461/5041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:47 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 1476 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:47.818432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ac7e09-291b-47f5-a40c-dea1a108579d", "name": "network-vif-deleted", "tag": "f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:47.841590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:47.842067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:47.846284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:47.897596 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] Creating event network-vif-deleted:f9f601fc-6dae-4b36-b1d3-c5c9f7d2684b for instance c1ac7e09-291b-47f5-a40c-dea1a108579d on n-h2-860864-13 Oct 28 17:52:47.909313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:47.910034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:47.912316 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3768e248-8c90-40ec-b127-645792b37c9f req-999fd349-4272-4820-8043-c4fdbfca375a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098914 Oct 28 17:52:47.915196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2581/5042] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:47.927836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:47.928307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:47.931488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:47.937133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:47.939096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:47.939788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:47.956585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:48.591207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:48.593812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: c1ac7e09-291b-47f5-a40c-dea1a108579d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:48.608052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.609028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.610274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:48.611484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.612104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.613232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:48.644355 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] HTTP exception thrown: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Request method failure captured: Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d HTTP/1.1 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBahd4DujDVzZ8aATEEwI4VCV1DoKhlypDJVarQkvFG9k_0BA0voIh0CPnWgwAg4hz-J0-QsfQtNxR2IV26PC4GWUqYMf-RkhncwbJL336FjXlQwdLaX65FeiAKY7reLkMxjwOhbB5dq3pwxTyNRrc-esOc8jEgEBrww0SW9ae1We34 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f91686e79734b2ca3b8f89d436b2e37"}]}] Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8d652564d640475fa03c7eecaa808942 Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c1ac7e09-291b-47f5-a40c-dea1a108579d'} Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:48.653543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Returning 404 to user: Instance c1ac7e09-291b-47f5-a40c-dea1a108579d could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b22275c0-5053-453b-8830-dae4192772c4 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d" status: 404 len: 111 microversion: 2.1 time: 0.078915 Oct 28 17:52:48.662760 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2582/5043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:48 2022] GET /compute/v2.1/servers/c1ac7e09-291b-47f5-a40c-dea1a108579d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:48.671020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:48.672730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:48.681529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.682020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.682450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:48.683298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.697808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.698656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:48.768977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:48.899158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:48.958929 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9df014d5-70c7-44aa-92d3-65c80c129a38 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 204 len: 0 microversion: 2.1 time: 0.298139 Oct 28 17:52:48.960984 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2583/5044] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:48 2022] DELETE /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:48.977271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:48.978687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:48.990776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.991723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.992397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:48.993465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:48.994142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:48.994832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:49.049777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:49.074976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:49.085041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:49.086895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e88c3731-f138-40b8-96f8-caaa39cd4dd8 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1750 microversion: 2.20 time: 1.181705 Oct 28 17:52:49.088638 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2462/5045] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:47 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1750 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:52:49.963186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:49.977429 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2c11615-f721-478c-9277-953fedc0592e tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1517 microversion: 2.1 time: 1.010609 Oct 28 17:52:49.996977 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2584/5046] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:48 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1517 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:50.123060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:50.123683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:50.136036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:50.142923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:50.143489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:50.143967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:50.144777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:50.145245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:50.145774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:51.008273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:51.017450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:51.037793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:51.038577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:51.039253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:51.040511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:51.041144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:51.041794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:51.717127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:51.734573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:51.736114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:51.737311 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34df34cc-523f-49dd-8082-497f081360bc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 1.621378 Oct 28 17:52:51.737881 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2463/5047] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:50 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:51.974428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:52.009496 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48fad539-cf02-40fc-8bf4-b52012471998 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1517 microversion: 2.1 time: 1.005030 Oct 28 17:52:52.010208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2585/5048] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:51 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1517 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:52.770954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:52.771637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:52.780224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:52.782667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:52.783230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:52.785998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:52.816662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:52.817166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:52.817611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:53.042567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:53.043450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:53.062964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:53.066194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:53.066827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:53.069724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:53.071764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:53.073259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:53.232902 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 17:52:53.233296 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 17:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 (ip 10.222.0.48) !!! Oct 28 17:52:53.332622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:52:54.307405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:54.330175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:54.333148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:54.335769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0b99156-da9a-4dcb-b9e0-4d244b3a52be tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 1.568618 Oct 28 17:52:54.337319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2464/5049] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:52 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:54.360299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0cfe-7437-4886-8644-318b13899323", "name": "network-vif-deleted", "tag": "753cc691-53ac-4038-a114-7db010c26b46"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:54.400349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:54.403709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:54.405787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:54.452180 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] Creating event network-vif-deleted:753cc691-53ac-4038-a114-7db010c26b46 for instance d9cb0cfe-7437-4886-8644-318b13899323 on n-h1-860864-13 Oct 28 17:52:54.463323 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-25c82599-05c0-464d-a354-0f558d7fd42e req-892798ae-f92c-44d9-8056-7377a79519ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124030 Oct 28 17:52:54.468827 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2465/5050] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:52:54.504849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:54.516435 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5dbac12-9ef4-44df-869d-9883a32bc111 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 200 len: 1475 microversion: 2.1 time: 1.479989 Oct 28 17:52:54.517123 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2586/5051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:53 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 1475 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:55.374542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:55.376897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:55.392523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.393575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.394985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.396179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.398183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.399630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.546475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:55.548575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: d9cb0cfe-7437-4886-8644-318b13899323] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:55.582968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.583686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.588821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.588821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.590023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.590023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.621707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] HTTP exception thrown: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Request method failure captured: Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 HTTP/1.1 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBahd4DujDVzZ8aATEEwI4VCV1DoKhlypDJVarQkvFG9k_0BA0voIh0CPnWgwAg4hz-J0-QsfQtNxR2IV26PC4GWUqYMf-RkhncwbJL336FjXlQwdLaX65FeiAKY7reLkMxjwOhbB5dq3pwxTyNRrc-esOc8jEgEBrww0SW9ae1We34 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f91686e79734b2ca3b8f89d436b2e37"}]}] Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 8d652564d640475fa03c7eecaa808942 Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'd9cb0cfe-7437-4886-8644-318b13899323'} Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:52:55.627350 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. Oct 28 17:52:55.632927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:52:55.637671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Returning 404 to user: Instance d9cb0cfe-7437-4886-8644-318b13899323 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:52:55.639272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3f286196-8cac-412b-ad5f-b53865e49269 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323" status: 404 len: 111 microversion: 2.1 time: 0.099698 Oct 28 17:52:55.640095 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2587/5052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:55 2022] GET /compute/v2.1/servers/d9cb0cfe-7437-4886-8644-318b13899323 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:52:55.649540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:55.654828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:55.663699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.665040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.665845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.667882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.668664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.669675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.704972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:52:55.871614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:55.882544 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-70a6be6b-056c-4e67-9465-ef0a05397b99 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "DELETE /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 204 len: 0 microversion: 2.1 time: 0.236912 Oct 28 17:52:55.884416 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2588/5053] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:52:55 2022] DELETE /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:52:55.887418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:55.889471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:55.891357 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-248fc237-5c2d-43c9-b0a0-6a2cbcc5c63d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 0.527223 Oct 28 17:52:55.892646 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2466/5054] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:55 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:55.893195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:55.893954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:55.941824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.943935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.944042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:55.944748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:55.948684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:55.949552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:56.297777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:56.316366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcc0e8b3-bed2-416f-a5c6-a28cc53d7a5c tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1517 microversion: 2.1 time: 0.427585 Oct 28 17:52:56.316966 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2589/5055] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:55 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:52:56.921261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:56.922640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:56.930377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:56.934610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:56.935550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:56.936545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:56.938204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:56.938812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:57.342000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:57.342711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:57.356201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:57.356442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:57.356771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:57.357211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:57.357924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:57.358384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:57.363968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:57.374983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:57.379663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:57.384562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04d8f2cf-9a93-4f2f-88cd-2bb331555a52 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 0.466758 Oct 28 17:52:57.408495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2467/5056] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:56 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:57.950189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:57.972323 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bba7e24-8c9d-4aca-bd20-d2f3204c92ac tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1517 microversion: 2.1 time: 0.636091 Oct 28 17:52:57.972959 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2590/5057] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:57 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1517 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:58.443183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:58.444679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:58.455752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:58.456465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:58.457098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:58.457982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:58.458600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:58.459189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:58.997949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:52:58.999250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:52:59.021979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:59.031185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:59.033043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:59.035004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:59.036183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:59.044094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:59.187564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:59.201680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:59.214953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:59.216530 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbf73394-4009-4325-ad27-eee25dd28423 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 0.780717 Oct 28 17:52:59.218340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2468/5058] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:52:58 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:52:59.316018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639b5208-4d3e-44bf-99da-4ce9bf931807", "name": "network-vif-deleted", "tag": "cc54145d-7599-46ba-90e5-1e8742132d27"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:52:59.317508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d652564d640475fa03c7eecaa808942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f91686e79734b2ca3b8f89d436b2e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:52:59.332656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a76c219-e0bc-48b9-8779-208379c1df6d tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 200 len: 1475 microversion: 2.1 time: 0.339601 Oct 28 17:52:59.335853 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2591/5059] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:52:58 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 1475 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:52:59.346158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:52:59.347157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:52:59.347884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:52:59.389664 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] Creating event network-vif-deleted:cc54145d-7599-46ba-90e5-1e8742132d27 for instance 639b5208-4d3e-44bf-99da-4ce9bf931807 on n-h1-860864-13 Oct 28 17:52:59.407334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a4982471-7079-4c62-b3b1-4f6197e0fd9e req-3d625b9d-8da6-45ec-b855-683bd603092c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103921 Oct 28 17:52:59.410177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2469/5060] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:00.249035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:00.249705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:00.268725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:00.269604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:00.271662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:00.272447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:00.275645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:00.275994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:00.362905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:00.363868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] [instance: 639b5208-4d3e-44bf-99da-4ce9bf931807] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:00.375186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:00.376684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:00.377793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:00.380395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:00.381017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:00.383867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:00.417743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] HTTP exception thrown: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Request method failure captured: Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 HTTP/1.1 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBahd4DujDVzZ8aATEEwI4VCV1DoKhlypDJVarQkvFG9k_0BA0voIh0CPnWgwAg4hz-J0-QsfQtNxR2IV26PC4GWUqYMf-RkhncwbJL336FjXlQwdLaX65FeiAKY7reLkMxjwOhbB5dq3pwxTyNRrc-esOc8jEgEBrww0SW9ae1We34 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7f91686e79734b2ca3b8f89d436b2e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7f91686e79734b2ca3b8f89d436b2e37"}]}] Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7f91686e79734b2ca3b8f89d436b2e37 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-645493925 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 8d652564d640475fa03c7eecaa808942 Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ListServerFiltersTestJSON-645493925-project Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '639b5208-4d3e-44bf-99da-4ce9bf931807'} Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:53:00.424016 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. Oct 28 17:53:00.429664 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:00.433836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] Returning 404 to user: Instance 639b5208-4d3e-44bf-99da-4ce9bf931807 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:53:00.437791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-abd6a6d2-3be8-4bb9-abe1-ad3efc5266f6 tempest-ListServerFiltersTestJSON-645493925 tempest-ListServerFiltersTestJSON-645493925-project] 10.222.0.48 "GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807" status: 404 len: 111 microversion: 2.1 time: 0.080198 Oct 28 17:53:00.439463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2470/5061] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:00 2022] GET /compute/v2.1/servers/639b5208-4d3e-44bf-99da-4ce9bf931807 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:53:02.030841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:02.095942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:02.103088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:02.109911 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a39e8cc-5e6d-4b82-a8c4-34bf93c43369 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 1.866264 Oct 28 17:53:02.123493 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2592/5062] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:00 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:03.146512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:03.147635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:03.170298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:03.170915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:03.189153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:03.190531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:03.191342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:03.192349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:04.542606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:04.574281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:04.588717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:04.590833 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a889e8d5-e4e9-495d-8735-f44e77ff8d03 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1752 microversion: 2.20 time: 1.448977 Oct 28 17:53:04.616814 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2471/5063] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:03 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1752 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:05.628050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:05.630270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:05.644318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:05.677286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:05.678774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:05.682186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:05.685165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:05.685742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:05.689538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:06.433630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:06.453371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:06.457380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:06.461160 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-256afdaf-82e7-43c3-b52e-a5c589674f59 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.842359 Oct 28 17:53:06.464063 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2593/5064] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:05 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:07.491670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:07.492408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:07.511046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:07.511791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:07.512057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:07.521053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:07.523200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:07.523867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.113734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:08.130659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.136769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Searching by: {'deleted': False, 'project_id': 'c40b6cd44063465e8170e0c4299e1733'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:53:08.171502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:08.171934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:08.172384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.178004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:08.178520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:08.178970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.242070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:53:08.324636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7315395-0f38-4ccd-aad0-7b9817cd02b7 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214906 Oct 28 17:53:08.338712 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2594/5065] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:53:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:08.349582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:08.362358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.365788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Searching by: {'deleted': False, 'project_id': 'c40b6cd44063465e8170e0c4299e1733'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:53:08.384546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:08.386402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:08.388468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.391483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:08.395634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:08.396700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.470089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:53:08.571404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.592216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:08.592706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:08.593147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:08.800228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87bf9a7e-35eb-4f44-9227-ac0be838c75a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.459329 Oct 28 17:53:08.800983 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2595/5066] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:53:08 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:08.836979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a618e5ea-07a1-4ca7-b55d-8907f6dfb94a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:08.857309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a618e5ea-07a1-4ca7-b55d-8907f6dfb94a tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024054 Oct 28 17:53:08.858295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2596/5067] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:53:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:08.904809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.920295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.926000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:08.932561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0a93966-bd3f-4f59-bdea-4856392c7bce tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.442523 Oct 28 17:53:08.935275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2472/5068] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:07 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:09.183595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:09.184230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:09.200389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:09.201009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:09.201707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:09.202646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:09.208605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:09.209358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:09.278380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:53:09.402296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:09.491827 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ab8419b-f0ba-4320-8554-08c6336b0a61 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "DELETE /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 204 len: 0 microversion: 2.1 time: 0.313302 Oct 28 17:53:09.493728 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2597/5069] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:53:09 2022] DELETE /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:53:09.503428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:09.504344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:09.517206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:09.519046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:09.519238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:09.520029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:09.520490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:09.520920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:09.972727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:09.980419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:09.981361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:10.002282 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fd51958-b69d-4223-9368-16a9731df064 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1609 microversion: 2.1 time: 0.503690 Oct 28 17:53:10.003316 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2473/5070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:09 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1609 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:10.017137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:10.018089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:10.018719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:10.019695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:10.020315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:10.021919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:10.397296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:10.410524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:10.422320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:10.430665 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d871ceb-3e51-4c73-bcdd-0e30835c4c74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.457349 Oct 28 17:53:10.436204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2598/5071] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:09 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:10.660424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1955680331", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "29c424f1-4958-4280-aa00-eb2d11528a6b"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:10.821899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] validate_networks() for [('29c424f1-4958-4280-aa00-eb2d11528a6b', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:53:11.028393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:11.029019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:11.039458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:11.045107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:11.045805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:11.046734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:11.047416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:11.048036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.065290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:53:12.067198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:53:12.068228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:53:12.069302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:53:12.070224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:53:12.097498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.098246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.099755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.107121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.108026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.108895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.154675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Getting quotas for project dfa4f855d7784970b95a72dedb600181. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:53:12.173661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Getting quotas for user edb48b23964a4d84adb5f8dec1ebc02e and project dfa4f855d7784970b95a72dedb600181. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:53:12.215692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Going to run 3 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:53:12.236161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:53:12.336636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=f099d043-c52a-4fd2-9ccf-c139b64ca675,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:53:12.371884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:12.416249 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-46e937a2-575b-4649-87d4-3f3f42e70a2f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1609 microversion: 2.1 time: 1.391806 Oct 28 17:53:12.419872 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2599/5072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:11 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1609 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:12.437887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:12.446381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:12.446785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=b1575b55-2f9b-407c-b9a3-a1ea54f32231,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:53:12.475143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.476051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.476727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.477717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.478707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.479446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.647122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b200d4f-34f7-4f4f-8113-f816d3353ab7 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.283303 Oct 28 17:53:12.655810 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2474/5073] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:53:12.675050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:12.690173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:12.694196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:53:12.773218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.774240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.782769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.784150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:12.785550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:12.786255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:12.864587 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0cfa8b1-8cc8-4981-af11-cc89f84724db tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.199432 Oct 28 17:53:12.866069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2475/5074] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:53:12 2022] GET /compute/v2.1/servers => generated 1018 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:12.881106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d20d8e5-3e68-4f85-b055-1d6fd8bd25f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:12.896818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d20d8e5-3e68-4f85-b055-1d6fd8bd25f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:13.332301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3d20d8e5-3e68-4f85-b055-1d6fd8bd25f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:13.342137 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d20d8e5-3e68-4f85-b055-1d6fd8bd25f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1223 microversion: 2.1 time: 0.467408 Oct 28 17:53:13.349622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2476/5075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:12 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1223 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:13.443200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:13.444207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:13.467828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:13.470679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:13.471507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:13.473873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:13.475610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:13.477595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:13.881540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:13.893052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:13.894503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:13.911519 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f91cbf3-45b2-4b0e-bf8a-45e410537343 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.490404 Oct 28 17:53:13.914780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2600/5076] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:12 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:14.389481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b74526b-deaa-415c-8fcf-07f595a149e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:14.389481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b74526b-deaa-415c-8fcf-07f595a149e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:15.481909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0b74526b-deaa-415c-8fcf-07f595a149e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:15.511749 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b74526b-deaa-415c-8fcf-07f595a149e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1223 microversion: 2.1 time: 1.132411 Oct 28 17:53:15.514708 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2601/5077] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:14 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1223 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:15.532603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:15.533677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:15.560337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:15.560853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:15.561298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:15.565250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:15.567553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:15.567664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:16.032276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:16.041435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d3a0bf4-7855-44bc-ae21-f5b0c0c64a1c tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1609 microversion: 2.1 time: 2.602930 Oct 28 17:53:16.042489 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2477/5078] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:13 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1609 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:16.539393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:16.540034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:16.561033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:16.564761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:16.565726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:16.565982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:16.566675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:16.575216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:16.575696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:17.535114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:17.578196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:17.584329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:17.598612 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88ffba56-2dd9-4652-bc12-d4faceb6b842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 2.077800 Oct 28 17:53:17.599576 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2602/5079] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:15 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:17.668787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:17.670081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:17.676526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:17.696066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:17.697161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:17.699972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:17.701267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:17.701996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:17.703776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:17.708387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7de05884-21d1-4c31-80dc-d0528cd64d87 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1227 microversion: 2.1 time: 1.172585 Oct 28 17:53:17.723707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2478/5080] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:16 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1227 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:18.408211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:18.502152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:18.522146 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48bb84ed-2b4c-45d8-91a0-6bfadf689a34 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1541 microversion: 2.1 time: 0.881014 Oct 28 17:53:18.542200 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2603/5081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:17 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1541 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:18.636258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:18.637468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:18.651523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30166fe0-a403-436d-aa2e-6adf8527732a", "name": "network-vif-deleted", "tag": "61d59349-4c25-478e-88cc-d4ec7e1fcec6"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:18.689579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:18.692224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:18.695420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:18.700604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:18.701551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:18.704808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:18.709246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:18.710378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:18.712227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:18.735695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=75 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:18.777164 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] Creating event network-vif-deleted:61d59349-4c25-478e-88cc-d4ec7e1fcec6 for instance 30166fe0-a403-436d-aa2e-6adf8527732a on n-h1-860864-13 Oct 28 17:53:18.817278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-967b1040-3b56-4463-a8bc-6e4e60c12272 req-a3b60c28-596b-42bb-a88b-ef46279e0ae0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170707 Oct 28 17:53:18.831645 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2604/5082] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:18.872179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:18.872919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:18.896224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:18.899045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:18.899787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:18.904528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:18.905025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:18.905478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:19.220254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:19.229565 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18e7b53d-fd9c-4a9d-bcf9-f07e41a98c16 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1283 microversion: 2.1 time: 0.396331 Oct 28 17:53:19.241411 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2605/5083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:18 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:19.480496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:19.508387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:19.511604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:19.513227 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b154a079-9f13-491f-814c-e496e1a64517 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.882485 Oct 28 17:53:19.514663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2479/5084] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:18 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:19.569545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:19.570166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:19.585787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:19.586364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:19.586957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:19.587827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:19.588347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:19.588808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:19.813872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:19.831899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-931b1ca0-20ab-4b0f-8674-cf1b42b70df5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.263896 Oct 28 17:53:19.834840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2606/5085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:19 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:20.270497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:20.271908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:20.289610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.293606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.299495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:20.302805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.303424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.303986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:20.503842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:20.520658 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad98c7ee-2339-4061-a512-1068926ed3b1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.247055 Oct 28 17:53:20.522012 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2480/5086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:20 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:20.544045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:20.545597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:20.557657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.560078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.560809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:20.561813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.567926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.568683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:20.857038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:20.860158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:20.896020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.896623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.914599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:20.916995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:20.922160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:20.925525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:21.018466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:21.068252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:21.070364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:21.075661 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02b02cbe-2420-4a3c-8690-2f2e096c596d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.536295 Oct 28 17:53:21.077031 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2607/5087] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:20 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:21.254358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:21.303784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4deb68c-6672-4c39-af0b-36bc22b7f4c5 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.448095 Oct 28 17:53:21.307673 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2481/5088] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:20 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:21.554730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:21.561978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:21.577322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:21.582438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:21.583611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:21.592711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:21.596931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:21.597764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:21.814604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:21.832372 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bc7a105-1ef5-4df4-953f-9e6f8c3c1fe2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.281508 Oct 28 17:53:21.837202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2608/5089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:21 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:22.108056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:22.108951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:22.133720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.134346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.139335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:22.156439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.157300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.158010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:22.333708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:22.334489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:22.345059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.348022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.351671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:22.352780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.355542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.358826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:22.581680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:22.590434 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6e28136-646d-458e-8b37-861a0e7e1951 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.261854 Oct 28 17:53:22.594877 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2609/5090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:22 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:22.632210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:22.643398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:22.650645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:22.652177 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e0e889b-2b54-4288-8701-9b6683583a9a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.550081 Oct 28 17:53:22.656470 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2482/5091] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:22 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:22.882346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:22.883637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:22.901511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.902428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.903133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:22.920458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:22.920956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:22.929209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:23.655075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:23.656413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:23.659503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:23.662875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:23.682755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:23.683493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:23.685212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:23.687289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:23.689885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:23.690519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:24.161863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:24.192211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd042885-7833-4274-9081-f0bbb5222ba4 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 1.313684 Oct 28 17:53:24.206416 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2610/5092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:22 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:24.212696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:24.217822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:24.218835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:24.234017 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dcaf4a67-9b56-4636-8d9d-cde90fc71e45 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.590032 Oct 28 17:53:24.234778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:24.235688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:24.236295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:24.237914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:24.238349 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2483/5093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:23 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:24.238633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:24.239301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:24.823620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:24.833714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:24.835904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:24.837302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2580891d-561d-4941-99fb-66069ecf9784 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.625592 Oct 28 17:53:24.857066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2611/5094] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:24 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:25.232395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:25.233024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:25.243198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.250379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.250907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:25.255313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.260682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.261187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:25.262547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:25.263167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:25.281860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.282372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.282808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:25.283575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.284027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.284450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:25.456805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:25.478097 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9844adf5-ac38-48f8-b054-e28d504832af tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.221780 Oct 28 17:53:25.488560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2612/5095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:25 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:25.545701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:25.561957 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef87c4a8-c827-4e0f-9c8d-4fbcde10693d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.333786 Oct 28 17:53:25.563492 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2484/5096] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:25 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:25.881944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:25.882940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:25.882940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:25.910635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.910850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.920124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:25.925420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:25.926128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:25.926750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:26.508185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:26.508806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:26.523089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:26.523947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:26.524585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:26.525926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:26.528942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:26.531993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:26.739177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:26.749386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9293137f-4d71-40a5-a731-d6ed49835615 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.245214 Oct 28 17:53:26.764819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2485/5097] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:26 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:26.770742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:26.772612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:26.784468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:26.797468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:26.798269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:26.800011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:26.808769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:26.809868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:27.680636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:27.692069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:27.701194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:27.712417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:27.715249 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1d266923-752f-418d-a331-13c731dc8e78 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.837306 Oct 28 17:53:27.719408 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2613/5098] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:25 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:53:27.719557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cecfd476-c982-47b5-826d-d86985f00c59 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.941482 Oct 28 17:53:27.724284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2486/5099] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:26 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:27.781047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:27.781998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:27.814941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:27.815490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:27.815931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:27.823428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:27.823929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:27.830208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:28.146007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:28.186148 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7f7e221-236e-456d-bf99-b8444ea1c0bf tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.408863 Oct 28 17:53:28.212012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2614/5100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:27 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:28.746570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:28.748149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:28.752659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:28.753955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:28.764871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:28.765991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:28.768047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:28.771699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:28.773138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:28.773965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:28.783389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:28.787101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:28.791215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:28.793668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:28.794205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:28.803762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:29.491693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:29.500793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:29.509293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-045ebb0e-0b40-4869-90ad-a5a2f7d2313b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.759813 Oct 28 17:53:29.509938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2615/5101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:28 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:29.524083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:29.525833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:29.536491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:29.537248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:29.537924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:29.539880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:29.542028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:29.543568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:29.716952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:29.730190 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0dfa804e-344b-42a4-bf2a-a0d35ab01d06 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.214325 Oct 28 17:53:29.730914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2616/5102] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:29 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:30.032842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:30.054037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:30.065957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:30.067228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a33c71e-93ce-408a-9b2a-3e6d7c279c17 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.326264 Oct 28 17:53:30.071687 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2487/5103] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:28 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:30.533224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:30.533910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:30.549891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:30.550390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:30.550836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:30.564538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:30.565063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:30.565513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:30.754238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:30.754853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:30.762293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:30.762795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:30.763234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:30.763970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:30.773577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:30.774757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:30.946171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:30.957119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6267a625-2eb1-4088-92a4-18d862b78f5f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1281 microversion: 2.1 time: 0.426907 Oct 28 17:53:30.959352 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2617/5104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:30 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:31.084359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:31.100518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:31.102394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:31.107549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d73dcc6a-f520-4feb-8b87-e50451f0d661 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1252 microversion: 2.1 time: 0.356738 Oct 28 17:53:31.108674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2488/5105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:30 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1252 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:31.122452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:31.125512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:31.126086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:31.127131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:31.127816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:31.128485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:31.981804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:31.982836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:32.012203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:32.018603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:32.019326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:32.023268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:32.026779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:32.027205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:32.272001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:32.318004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:32.326275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:32.334129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2b35e49-8a6c-4ee9-b196-674b0521e53e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.239846 Oct 28 17:53:32.344149 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2618/5106] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:31 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:32.372829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:32.379040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:32.402525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:32.404897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:32.407920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:32.408983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:32.409687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:32.411407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:32.507077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:32.507940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:32.508881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:32.513282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lazy-loading 'fault' on Instance uuid 30166fe0-a403-436d-aa2e-6adf8527732a {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:53:32.786317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad63b71b912d4200bb5601950e0c33ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40b6cd44063465e8170e0c4299e1733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:32.795214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ebb6496d-6eb9-46a4-a430-f9b3dee2632e tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 200 len: 1211 microversion: 2.1 time: 0.428552 Oct 28 17:53:32.813052 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2619/5107] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:32 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 1211 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:33.372632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:33.373917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:33.382228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:33.385675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:33.387958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:33.388951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:33.396119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:33.396856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:33.657586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:33.677513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4366c516-cfd4-4c02-9706-cfcf8f1b620a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 1.696417 Oct 28 17:53:33.678430 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2489/5108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:31 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:33.825226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:33.826118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] [instance: 30166fe0-a403-436d-aa2e-6adf8527732a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:33.845405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:33.851708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:33.855556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:33.855807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:33.859711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:33.860167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:33.895529 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] HTTP exception thrown: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Request method failure captured: Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a HTTP/1.1 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBaIVwkjPVlqBopnonffnIRf3Cbmu1oObUC8ZdbztevybF4fCcroJ1aT7MmUNNCXzsnUET0V7FgZvtDEKBKSsSU3tPrnVTRPrDHawELzK7DJGWlAHy9j5v1Mps-CJbol1RNqwIHlcMyowYNqB54io9r9RuZBINizTNDpTdPuhYJ0y0Y Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c40b6cd44063465e8170e0c4299e1733 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestBootFromVolume-720262510 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c40b6cd44063465e8170e0c4299e1733"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c40b6cd44063465e8170e0c4299e1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c40b6cd44063465e8170e0c4299e1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c40b6cd44063465e8170e0c4299e1733"}]}] Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestBootFromVolume-720262510 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c40b6cd44063465e8170e0c4299e1733 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestBootFromVolume-720262510 Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestBootFromVolume-720262510-project Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ad63b71b912d4200bb5601950e0c33ca Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestBootFromVolume-720262510-project Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '30166fe0-a403-436d-aa2e-6adf8527732a'} Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:53:33.897491 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. Oct 28 17:53:33.903529 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:53:33.905044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Returning 404 to user: Instance 30166fe0-a403-436d-aa2e-6adf8527732a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:53:33.908384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e608ba9c-bfae-4d70-a0e0-0772caf06c07 tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a" status: 404 len: 111 microversion: 2.1 time: 0.088173 Oct 28 17:53:33.912497 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2490/5109] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:33 2022] GET /compute/v2.1/servers/30166fe0-a403-436d-aa2e-6adf8527732a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:53:33.927746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd794756-1b3a-4fe0-8d32-d4406cd19d4f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] Calling method '.version_select at 0x7f751f59d550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:33.977194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd794756-1b3a-4fe0-8d32-d4406cd19d4f tempest-ServersTestBootFromVolume-720262510 tempest-ServersTestBootFromVolume-720262510-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181556629" status: 202 len: 0 microversion: 2.1 time: 0.057167 Oct 28 17:53:33.979807 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2491/5110] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 17:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181556629 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:53:34.416565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:34.428419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:34.430242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:34.432199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75201391-3356-4498-99c2-905ff0f20e6b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.063877 Oct 28 17:53:34.441103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2620/5111] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:33 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:53:34.704991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:34.705575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:34.720946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:34.721874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:34.723786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:34.727184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:34.729899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:34.731549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:35.458503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:35.459882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:35.474730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:35.495845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:35.496785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:35.498394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:35.502953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:35.508027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:36.402541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:36.412640 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4aef88d1-ab69-49e3-ae33-af39f2ada454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 1.712572 Oct 28 17:53:36.414432 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2492/5112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:34 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:36.747078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1575b55-2f9b-407c-b9a3-a1ea54f32231", "tag": "16d9eeff-6b73-4565-965e-41f8835caffe"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:36.770522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:36.771153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:36.771719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:36.795596 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] Creating event network-changed:16d9eeff-6b73-4565-965e-41f8835caffe for instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 on n-h1-860864-13 Oct 28 17:53:36.809149 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2cfed440-afa3-45f9-8f56-ad80a7ac3ae6 req-f0105455-a1a6-43d7-a7dd-75036240e1b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393235 Oct 28 17:53:36.811907 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2493/5113] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:37.437723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:37.438600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:37.451971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:37.452914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:37.454462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:37.455246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:37.455746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:37.463096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:37.514674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:37.583944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:37.586962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:37.589867 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-493336f6-4b2e-4dd4-91a0-41f550396f67 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 2.135562 Oct 28 17:53:37.590893 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2621/5114] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:35 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:53:38.460295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:38.469178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1446b22-e8a1-4c72-9623-a13686402ce2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 1.035640 Oct 28 17:53:38.476821 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2494/5115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:37 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:38.617490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:38.619254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:38.623089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:38.643298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:38.649162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:38.650104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:38.653617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:38.656336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:38.660723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:38.859471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f099d043-c52a-4fd2-9ccf-c139b64ca675", "tag": "786db010-cb9f-487f-9dbf-84259fececd5"}, {"name": "network-changed", "server_uuid": "f0176bf1-c14b-4d63-ab3e-4a294bd4d6de", "tag": "6f06b5ea-456d-464b-97f6-4492750eb92c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:38.881075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:38.885650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:38.886220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:38.914340 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Creating event network-changed:786db010-cb9f-487f-9dbf-84259fececd5 for instance f099d043-c52a-4fd2-9ccf-c139b64ca675 on n-h2-860864-13 Oct 28 17:53:38.915930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] Creating event network-changed:6f06b5ea-456d-464b-97f6-4492750eb92c for instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de on n-h2-860864-13 Oct 28 17:53:38.928113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-26bc4bb5-484a-4930-bb50-c9b37eb9a4a1 req-9a73c73f-8565-4e47-8172-b997fd8f862c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072290 Oct 28 17:53:38.942956 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2495/5116] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:39.168412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:39.188268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:39.192173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:39.198343 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e2e5c32-4551-4721-a343-fcbaea6bbef2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.584911 Oct 28 17:53:39.202828 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2622/5117] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:38 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:39.493258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:39.494555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:39.504945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:39.508111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:39.510583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:39.511712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:39.515141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:39.515983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:40.233094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:40.233716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:40.246636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:40.247057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:40.247522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:40.248239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:40.248691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:40.259649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:40.751100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:40.762184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38936c26-b18c-499d-b3fe-adaf4af471e9 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 1.273000 Oct 28 17:53:40.762782 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2496/5118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:39 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:41.129055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:41.139071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:41.141045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:41.142552 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3e9500e-0510-4c62-b128-b0043368534d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 0.914917 Oct 28 17:53:41.143685 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2623/5119] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:40 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:53:41.597183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "name": "network-vif-plugged", "status": "completed", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:41.643012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:41.643546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:41.656333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:41.677191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] Creating event network-vif-plugged:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:53:41.697829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2b340979-8b21-42f8-b8bd-6c05848c922f req-2262231d-2ffc-432e-9562-82fc7a9945ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103686 Oct 28 17:53:41.701965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2497/5120] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:41.789677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:41.790520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:41.803289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:41.804031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:41.804517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:41.805338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:41.807009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:41.810517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:42.175212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:42.176527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:42.202616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:42.203446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:42.204132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:42.208335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:42.209134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:42.209807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:42.626654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:42.646872 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1e189980-2fa5-4c41-b1dc-87a407a2a039 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 0.854247 Oct 28 17:53:42.651898 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2624/5121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:41 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:43.424667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:43.448925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:43.455605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:43.468585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1006618241", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "1ccd45fa-140d-4d9f-b198-221348ee294b"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:43.476832 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1b990c0-6573-40a9-92dd-b48fd1f84d74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.304986 Oct 28 17:53:43.492875 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2498/5122] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:42 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:43.650283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] validate_networks() for [('1ccd45fa-140d-4d9f-b198-221348ee294b', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:53:43.680036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:43.684225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:43.704802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:43.705746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:43.707529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:43.709870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:43.710604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:43.711609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:43.769584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:44.772563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:44.788406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-117ad7fd-e3da-4ca8-9dba-df602e24d1f8 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 1.111339 Oct 28 17:53:44.794122 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2499/5123] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:43 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:44.809135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:44.810042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:44.833878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:44.835362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:44.836683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:44.838909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:44.842562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:44.845918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:45.822189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:45.859966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:45.863925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:45.871491 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ba86f41-8fc8-4498-ac95-e8e51ca574ab tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 1.071667 Oct 28 17:53:45.872485 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2500/5124] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:44 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:45.902673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1575b55-2f9b-407c-b9a3-a1ea54f32231", "name": "network-vif-plugged", "status": "completed", "tag": "16d9eeff-6b73-4565-965e-41f8835caffe"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:45.931113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:45.931663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:45.932113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:45.964907 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] Creating event network-vif-plugged:16d9eeff-6b73-4565-965e-41f8835caffe for instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 on n-h1-860864-13 Oct 28 17:53:45.978823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6ac6c72d-81e9-478e-ad9c-233b91eec018 req-15576703-9abd-4001-87d3-a6399234de71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083181 Oct 28 17:53:45.979755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2501/5125] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:45.999002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:46.003851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:46.033346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.035695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.040162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:46.044951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.047597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.048628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:46.477333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:53:46.480087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:53:46.480773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:53:46.481668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:53:46.482537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:53:46.501559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.502356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.504353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:46.505360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.506020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.506635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:46.529490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Getting quotas for project 52cdce55315e4291aab1f31320558f57. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:53:46.548287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Getting quotas for user b3f262de3b3d41beaf8944a8e2201187 and project 52cdce55315e4291aab1f31320558f57. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:53:46.597774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:53:46.600482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:53:46.632838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:46.650856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-534e9343-db95-416c-870c-a553c808af9a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 0.661410 Oct 28 17:53:46.653186 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2502/5126] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:45 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:46.716850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a07ba23-1cc6-4997-8558-4abae3c1bed7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.422168 Oct 28 17:53:46.717964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2625/5127] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:53:46.752822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84a128b5-1203-4e16-9215-2c54bbf4abaf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:46.755919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84a128b5-1203-4e16-9215-2c54bbf4abaf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:46.775061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:46.905543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:46.906454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:46.928903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.929993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.932252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:46.937488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:46.940019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:46.941125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:47.010457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84a128b5-1203-4e16-9215-2c54bbf4abaf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:47.020998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84a128b5-1203-4e16-9215-2c54bbf4abaf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1217 microversion: 2.1 time: 0.286678 Oct 28 17:53:47.027146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2503/5128] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:46 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1217 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:47.683165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:47.683847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:47.701676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:47.702234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:47.702668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:47.705035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:47.705543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:47.705993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:49.462652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:49.475104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:49.488691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:49.494670 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eba42eec-2b17-4bee-acbf-290b7e6550d9 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1808 microversion: 2.20 time: 2.588627 Oct 28 17:53:49.498518 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2626/5129] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:46 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1808 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:49.503329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:49.503964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:49.546970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:49.547561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:49.556543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:49.557515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:49.558012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:49.558456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:49.670828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:49.718760 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-659dee12-0da2-4179-acb2-ea054c946cf2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 2.039456 Oct 28 17:53:49.730276 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2504/5130] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:47 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:49.887961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:49.896563 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e27861bd-6cea-4f7c-84b1-3ee2346c5878 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1213 microversion: 2.1 time: 0.396928 Oct 28 17:53:49.914208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2627/5131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:49 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1213 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:49.923266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f099d043-c52a-4fd2-9ccf-c139b64ca675", "name": "network-vif-plugged", "status": "completed", "tag": "786db010-cb9f-487f-9dbf-84259fececd5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:49.944170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:49.944817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:49.949343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:49.984331 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] Creating event network-vif-plugged:786db010-cb9f-487f-9dbf-84259fececd5 for instance f099d043-c52a-4fd2-9ccf-c139b64ca675 on n-h2-860864-13 Oct 28 17:53:49.997477 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-efbc3d3f-7f2b-4a39-baf5-3a60a76e13b9 req-b37ec0f5-eafa-4b27-a6c2-b5186e88f67a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079842 Oct 28 17:53:49.999733 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2505/5132] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:50.536958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:50.539430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:50.556698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:50.557824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:50.558768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:50.561486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:50.562711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:50.564293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:50.747779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:50.748609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:50.767629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:50.768326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:50.768953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:50.772695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:50.776087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:50.777563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:51.136486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:51.148032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:51.150567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:51.151961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5af5b1d4-2fd5-460a-b1dc-326eb6a87bc1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1795 microversion: 2.20 time: 0.626205 Oct 28 17:53:51.153266 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2628/5133] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:53:50 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1795 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:53:51.158014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:51.158909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:51.165421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:51.166427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:51.167325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:51.168252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:51.169037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:51.169638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:51.289311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:51.304150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9bf661d2-49c2-4c96-8075-0c93c0371454 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 0.561895 Oct 28 17:53:51.304885 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2506/5134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:50 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:51.322170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:51.334369 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-109e9aef-bdb1-4bbe-94d6-a29e5706ce94 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1275 microversion: 2.1 time: 0.179803 Oct 28 17:53:51.334982 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2629/5135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:51 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:52.066821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0176bf1-c14b-4d63-ab3e-4a294bd4d6de", "name": "network-vif-plugged", "status": "completed", "tag": "6f06b5ea-456d-464b-97f6-4492750eb92c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:52.123561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:52.125806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:52.127821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:52.165606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] Creating event network-vif-plugged:6f06b5ea-456d-464b-97f6-4492750eb92c for instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de on n-h2-860864-13 Oct 28 17:53:52.178255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3ad93a37-7dac-4bfd-be7e-eea6577ad1f8 req-03e7b5af-6d55-46a3-8395-66d15dd84597 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115671 Oct 28 17:53:52.182930 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2507/5136] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:53:52.329931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:52.331349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:52.346974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:52.351492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:52.360021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:52.360791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:52.374786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:52.375654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:52.397293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:52.397838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:52.411774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:52.412282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:52.412725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:52.413450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:52.413901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:52.414325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:53.081386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:53.100960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:53.107831 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0699927-47db-4a0b-a707-6fc758f85dbf tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.751942 Oct 28 17:53:53.111605 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2508/5137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:52 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:53.116894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57c6d1f2-4920-4786-a97b-6d8a86210815 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 0.790686 Oct 28 17:53:53.118563 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2630/5138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:52 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:54.137190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:54.137819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:54.142068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:54.142564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:54.148292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:54.148802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:54.149312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:54.156532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:54.157185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:54.158540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:54.160400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:54.160876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:54.162378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:54.162530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:54.163540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:54.165631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:54.569210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:54.579403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6eeab1f5-9cf3-448a-b29e-05666a454c2c tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.451048 Oct 28 17:53:54.583829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2509/5139] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:54 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:54.656858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5ad3683-b6fc-45fd-b750-87223cc6d295", "tag": "057121bb-9cde-49f7-aed3-79b3d989ac75"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:53:54.663066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:54.671181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-331ed8cc-1f90-4c3a-8019-a34adc9fa43d tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1323 microversion: 2.1 time: 0.534140 Oct 28 17:53:54.673585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:54.674312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:54.674729 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2631/5140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:54 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:54.675258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:54.692751 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] Creating event network-changed:057121bb-9cde-49f7-aed3-79b3d989ac75 for instance e5ad3683-b6fc-45fd-b750-87223cc6d295 on n-h1-860864-13 Oct 28 17:53:54.698920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1bd5bcdb-67bb-4239-98aa-cf239a8ef1f4 req-1451c42f-5339-48da-8997-70209d106833 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046116 Oct 28 17:53:54.700313 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2510/5141] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:53:55.610741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:55.611525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:55.620069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:55.620903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:55.621331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:55.629585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:55.630319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:55.631898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:55.704098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:55.704879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:55.719507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:55.720950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:55.721583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:55.725028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:55.726524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:55.728951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:55.924729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:55.930306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:55.936383 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aff8e9f2-1bc0-469b-8b70-f241d6d2b3d1 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.330535 Oct 28 17:53:55.952698 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2632/5142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:55 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:56.061023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:56.073465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2267b53e-7f09-411e-956e-c34d7be986aa tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 200 len: 1515 microversion: 2.1 time: 0.372833 Oct 28 17:53:56.091735 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2511/5143] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:55 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:56.102237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:56.104126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:56.111279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.111820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.112267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.112982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.113444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.114702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.405676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:56.424920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e3e87f4-5532-4bdf-b657-d36114db847f tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 200 len: 1514 microversion: 2.1 time: 0.326493 Oct 28 17:53:56.428495 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2633/5144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:56 2022] GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:53:56.451530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:56.452157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:56.462683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.463184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.463652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.464470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.465116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.465829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.832438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:56.844683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64576765-c6c7-4d29-b05f-833e4be7ba8b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1515 microversion: 2.1 time: 0.398519 Oct 28 17:53:56.856154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2512/5145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:56 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:56.870480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:56.871063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:56.881261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:56.884401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:56.903682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.904360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.904903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.907098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.908537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.909241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.950023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:53:56.966679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:56.967298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:56.981160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.981678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.990717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:56.994649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:56.995221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:56.998881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:57.023845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:53:57.168541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d47e8271-8d25-4e9d-93e0-f1ebda759860 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 204 len: 0 microversion: 2.1 time: 0.302984 Oct 28 17:53:57.173700 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2634/5146] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:53:56 2022] DELETE /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:53:57.179731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:57.181912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:57.188874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:57.189826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:57.191710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:57.192664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:57.193968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:57.194855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:57.491756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:57.506770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a435038-46f8-4c10-968d-48cfa56addb7 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.543868 Oct 28 17:53:57.508075 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2513/5147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:56 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:57.726321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:57.748591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca353dfa-28cf-4bef-adf3-b1b5f9e81d7b tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1521 microversion: 2.1 time: 0.571800 Oct 28 17:53:57.749498 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2635/5148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:57 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:58.531566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:58.533310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:58.550445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:58.551403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:58.552180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:58.553395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:58.554014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:58.554446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:58.780629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:58.781249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:58.816266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:58.827323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:58.828051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:58.830344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:58.831055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:58.836360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:58.854762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:58.881163 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4fd26cb-fa47-45a0-87d1-746caa7d65ec tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.354344 Oct 28 17:53:58.887442 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2514/5149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:58 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:59.249153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:53:59.261381 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e488cff-8ecf-4204-9ee0-8ea62f8ad93a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1521 microversion: 2.1 time: 0.485350 Oct 28 17:53:59.268438 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2636/5150] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:58 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:53:59.914369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:53:59.915257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:53:59.934872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:59.935434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:59.935895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:53:59.939270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:53:59.939800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:53:59.940250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:00.317688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:00.323874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:00.323874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:00.336218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:00.347516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-91f19f2b-907b-45af-90f1-ca5a7653b512 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.436876 Oct 28 17:54:00.350655 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2515/5151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:53:59 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:00.768171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:00.791252 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d4cba46-b255-42e1-ad57-f10b701c43dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1521 microversion: 2.1 time: 0.504925 Oct 28 17:54:00.796877 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2637/5152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:00 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:01.386445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:01.388167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:01.410511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:01.411024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:01.411508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:01.412242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:01.412702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:01.413141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:01.830296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:01.831808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:01.863993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:01.864487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:01.864929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:01.865650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:01.866108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:01.866536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:02.062904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:02.082292 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9689f09-d3bf-4785-afdc-d31adfa58f60 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1479 microversion: 2.1 time: 0.253692 Oct 28 17:54:02.084413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2638/5153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:01 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1479 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:02.113246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:02.130324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4d584bb-c061-4850-b16c-3849276b3f5f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.750955 Oct 28 17:54:02.143585 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2516/5154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:01 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:02.198870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f099d043-c52a-4fd2-9ccf-c139b64ca675", "name": "network-vif-deleted", "tag": "786db010-cb9f-487f-9dbf-84259fececd5"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:02.274986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:02.276564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:02.277645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:02.368791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] Creating event network-vif-deleted:786db010-cb9f-487f-9dbf-84259fececd5 for instance f099d043-c52a-4fd2-9ccf-c139b64ca675 on n-h2-860864-13 Oct 28 17:54:02.404700 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-81d6078d-3efb-499e-8080-cf4ec0edfc1e req-4220f00e-21c1-45a1-84a9-017659d407b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224395 Oct 28 17:54:02.411525 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2639/5155] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:03.117616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:03.119975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:03.168516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:03.168987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:03.169598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:03.170102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:03.170849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:03.171316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:03.172235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:03.182560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:03.187211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:03.189799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:03.191474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:03.193894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:03.195256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:03.196865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:03.320320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:03.326808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:03.327921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:03.328846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lazy-loading 'fault' on Instance uuid f099d043-c52a-4fd2-9ccf-c139b64ca675 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:54:03.823135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:03.841043 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5917e7e-efcd-407c-af6a-57b5e1217488 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 200 len: 1313 microversion: 2.1 time: 0.734222 Oct 28 17:54:03.841672 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2517/5156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:03 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:04.044099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:04.057663 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5794f64a-8382-4ab2-9ee9-e1ff75afdb83 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.898427 Oct 28 17:54:04.071430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2640/5157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:03 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:04.191911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ad3683-b6fc-45fd-b750-87223cc6d295", "name": "network-vif-plugged", "status": "completed", "tag": "057121bb-9cde-49f7-aed3-79b3d989ac75"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:04.213699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:04.214168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:04.214619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:04.241232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] Creating event network-vif-plugged:057121bb-9cde-49f7-aed3-79b3d989ac75 for instance e5ad3683-b6fc-45fd-b750-87223cc6d295 on n-h1-860864-13 Oct 28 17:54:04.271038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0b5f4b8c-70c0-4432-9fc4-15cfed5bb2bd req-639c5c3a-3c03-4f78-b7ca-596b99d2edd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422997 Oct 28 17:54:04.271756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2518/5158] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:04.871296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:04.873874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:04.885285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:04.885846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:04.887218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:04.890112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:04.890817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:04.891606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:04.914354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] HTTP exception thrown: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 HTTP/1.1 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f099d043-c52a-4fd2-9ccf-c139b64ca675'} Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:04.919075 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 404 to user: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:04.922316 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b99c4f52-be16-4d73-a606-3b4222ebda06 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 404 len: 111 microversion: 2.1 time: 0.058454 Oct 28 17:54:04.926912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2641/5159] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:04 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:54:04.933181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:04.944838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:04.948195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:04.960798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:04.962387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:04.963491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:04.979766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:04.980622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:04.982172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.083899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.087227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:05.117712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.120345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.123195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.128546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.131767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.136404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.151319 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b50b1dba-2014-498e-9b79-f9d8ccbeb0dc tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.223952 Oct 28 17:54:05.159965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2519/5160] 10.222.0.48 () {58 vars in 1230 bytes} [Fri Oct 28 17:54:04 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:54:05.175806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fec1c2c-e7df-496a-ac9c-c76cae18c72e tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fec1c2c-e7df-496a-ac9c-c76cae18c72e tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 17:54:05.196795 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fec1c2c-e7df-496a-ac9c-c76cae18c72e tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fec1c2c-e7df-496a-ac9c-c76cae18c72e tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.035317 Oct 28 17:54:05.204833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2520/5161] 10.222.0.48 () {58 vars in 1182 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:54:05.216382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.228763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:05.229934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:05.244600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.246572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.246807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.249970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.251083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.251557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.334661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:54:05.348131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:05.407453 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f2d2a9a-54d5-4ad4-b483-ad1d7eaaa400 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.202144 Oct 28 17:54:05.408505 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2521/5162] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers => generated 683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:05.425712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.434234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:05.438212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.servers [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Removing options 'limit' from query {{(pid=120568) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 17:54:05.441089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:05.451657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.456700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.457403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.458460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.459713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.460563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.537948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:54:05.617555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58946a8c-c114-4248-8930-5731f8abd923 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.200302 Oct 28 17:54:05.621887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2522/5163] 10.222.0.48 () {58 vars in 1144 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:05.640509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba2aa4ab-17ef-4b8d-817f-e4f14117f113 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.649450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba2aa4ab-17ef-4b8d-817f-e4f14117f113 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: action_args: {} Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '-1' Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 17:54:05.657296 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 17:54:05.661207 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.663391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba2aa4ab-17ef-4b8d-817f-e4f14117f113 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:05.663938 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60de5b8d-1c65-48f7-b71c-532a4801cd0a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1317 microversion: 2.1 time: 0.584636 Oct 28 17:54:05.664569 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2642/5164] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:05.674230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba2aa4ab-17ef-4b8d-817f-e4f14117f113 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.041923 Oct 28 17:54:05.686633 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2523/5165] 10.222.0.48 () {58 vars in 1142 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:54:05.695302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8a68e0b-1c1e-4991-93fe-05f855ce2422 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8a68e0b-1c1e-4991-93fe-05f855ce2422 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: action_args: {} Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'testing' Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 17:54:05.705586 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:05.709026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c8a68e0b-1c1e-4991-93fe-05f855ce2422 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:05.715530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c8a68e0b-1c1e-4991-93fe-05f855ce2422 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016384 Oct 28 17:54:05.716180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2643/5166] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:54:05.725379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37b4646c-7723-4df4-a6c4-4a79ed80567c tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.741608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-37b4646c-7723-4df4-a6c4-4a79ed80567c tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:05.742569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-37b4646c-7723-4df4-a6c4-4a79ed80567c tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:05.766308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.servers [None req-37b4646c-7723-4df4-a6c4-4a79ed80567c tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Flavor 'non_existing_flavor' could not be found {{(pid=120568) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 28 17:54:05.767591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37b4646c-7723-4df4-a6c4-4a79ed80567c tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.045940 Oct 28 17:54:05.779630 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2524/5167] 10.222.0.48 () {58 vars in 1178 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:54:05.794775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:05.800211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:05.812553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:05.829483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.830121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.830735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:05.831529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:05.837962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:05.842872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.041348 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-187a3720-6f0f-44f7-85ba-3f530668faac tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.250527 Oct 28 17:54:06.050939 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2644/5168] 10.222.0.48 () {58 vars in 1174 bytes} [Fri Oct 28 17:54:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:54:06.056243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:06.061473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:06.062152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:06.078380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.078846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.079472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.080218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.080680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.081149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.265620 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aded704c-b673-4037-9a3a-3353bb3a20a6 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.213676 Oct 28 17:54:06.276051 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2525/5169] 10.222.0.48 () {58 vars in 1184 bytes} [Fri Oct 28 17:54:06 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:54:06.292599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:06.307318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:06.309355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:06.316231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.316927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.317583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.319162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.319971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.321877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.459231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:54:06.547573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:06.564016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.564552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.570641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.690033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:06.691285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:06.707936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.709706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.723135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:06.724433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:06.727529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:06.729978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.329903 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ea594b9-27ab-43bd-9ab9-83f1d6599055 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 1.044974 Oct 28 17:54:07.335874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2645/5170] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 17:54:06 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:54:07.377479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f56fbe50-b35b-4816-8e0a-fe9277417aec tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.385248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f56fbe50-b35b-4816-8e0a-fe9277417aec tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:07.387054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f56fbe50-b35b-4816-8e0a-fe9277417aec tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.019240 Oct 28 17:54:07.388759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2646/5171] 10.222.0.48 () {58 vars in 1178 bytes} [Fri Oct 28 17:54:07 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:54:07.419419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.426919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:07.428574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Searching by: {'deleted': False, 'project_id': 'dfa4f855d7784970b95a72dedb600181'} {{(pid=120567) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 17:54:07.440677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.441454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.442214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.443433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.444184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.444921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.488508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.multi_cell_list [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 17:54:07.534053 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-006f5934-4062-4cf9-8892-44d07fc61456 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.136051 Oct 28 17:54:07.539126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2647/5172] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 17:54:07 2022] GET /compute/v2.1/servers => generated 683 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:07.551763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.554206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.563097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.564178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.564963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.566681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.567544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.568948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.611381 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] HTTP exception thrown: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 HTTP/1.1 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f099d043-c52a-4fd2-9ccf-c139b64ca675'} Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:07.615598 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:07.619523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 404 to user: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:07.620704 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-513162e1-4af5-47b8-ab64-beb585b352f5 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 404 len: 111 microversion: 2.1 time: 0.073659 Oct 28 17:54:07.628490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2648/5173] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:54:07 2022] DELETE /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:54:07.636802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.637300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.651979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:07.654997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.655655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.655947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.656826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.657425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.657998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.662457 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9852abdb-48ad-4bb4-8d2d-94eabdaa248a tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1506 microversion: 2.1 time: 0.976193 Oct 28 17:54:07.666454 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2526/5174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:06 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:54:07.694189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.696936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.724392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.725720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.726415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.729290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.731928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.732575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.736333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:54:07.809489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-180b4afd-312c-4ca0-82df-1f980f0afa9f tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips" status: 200 len: 109 microversion: 2.1 time: 0.119094 Oct 28 17:54:07.816901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2527/5175] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:54:07 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips => generated 109 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:07.825725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.826376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.834223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.834813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.835728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.837537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.838740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.839418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.843646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:07.871012 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-754251bc-5205-4741-8473-14aeceddeb5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips" status: 200 len: 109 microversion: 2.1 time: 0.052259 Oct 28 17:54:07.871974 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2528/5176] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:54:07 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips => generated 109 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:07.896460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.899937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.910233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0891b300-c8f7-4a6e-afde-094eee208cc1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 204 len: 0 microversion: 2.1 time: 0.277543 Oct 28 17:54:07.911211 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2649/5177] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:54:07 2022] DELETE /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:54:07.916101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.917326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.920394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.921249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.921501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:07.922230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:07.932604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.933302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.936899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.937597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.938190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:07.939044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:07.939667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:07.940236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.010138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-355961c3-686c-4207-a9d6-68900105215b tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips/tempest-ServerAddressesTestJSON-127700014-network" status: 200 len: 94 microversion: 2.1 time: 0.119072 Oct 28 17:54:08.013730 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2529/5178] 10.222.0.48 () {58 vars in 1398 bytes} [Fri Oct 28 17:54:07 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295/ips/tempest-ServerAddressesTestJSON-127700014-network => generated 94 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 17:54:08.019170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:54:08.029824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:08.030800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:08.067752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.073393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.080683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.083032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.092261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.092954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.199853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:54:08.287173 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-797c4c38-bdb8-4703-afa6-9d3b650af70a tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 204 len: 0 microversion: 2.1 time: 0.370203 Oct 28 17:54:08.289184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2650/5179] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:54:07 2022] DELETE /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 17:54:08.316562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:08.317608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f099d043-c52a-4fd2-9ccf-c139b64ca675] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:08.338705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.343640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.344710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.345709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.346484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.347135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.367939 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] HTTP exception thrown: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 HTTP/1.1 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f099d043-c52a-4fd2-9ccf-c139b64ca675'} Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:08.371169 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. Oct 28 17:54:08.374556 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:08.381328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 404 to user: Instance f099d043-c52a-4fd2-9ccf-c139b64ca675 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:08.382619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f0e50d4-4110-479f-bcd7-59e9832977a2 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675" status: 404 len: 111 microversion: 2.1 time: 0.087662 Oct 28 17:54:08.384374 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2651/5180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:08 2022] GET /compute/v2.1/servers/f099d043-c52a-4fd2-9ccf-c139b64ca675 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:54:08.393559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:08.400710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:08.422087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.422871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.423594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.424571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.425285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.425953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.511675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b193650-d5fb-4e29-97da-60b8414a0fc6 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 204 len: 0 microversion: 2.1 time: 0.486524 Oct 28 17:54:08.525182 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2530/5181] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:54:08 2022] DELETE /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:54:08.557719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:08.561583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:08.574586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.576432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.577418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:08.578297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:08.579206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:08.579996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:09.606737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:09.618242 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-06c11c1b-fb12-4a0d-9ad8-9d43505c4cae tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1512 microversion: 2.1 time: 1.072627 Oct 28 17:54:09.620968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2531/5182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:08 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1512 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:09.687510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:09.695521 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45aa33b4-23b2-4a03-bde3-7e2a5c4795fd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 200 len: 1520 microversion: 2.1 time: 1.306294 Oct 28 17:54:09.704299 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2652/5183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:08 2022] GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 1520 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:10.649643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:10.650520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:10.669029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:10.671915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:10.672675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:10.673483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:10.675728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:10.676388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:10.677772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:11.190614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e22a069-b095-4449-a8e7-fe10a6e0e381 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Action: 'create', calling method: .version_select at 0x7f751f814940>, body: {"keypair": {"name": "tempest-keypair-689245528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaYJHpqemqbNCqqKevZukliYKQA+xiJvKANsdZGKiWjZXodlEpsCMq+3H7ok1fBbHSC7rLNktSfdiz6su1qlrc9WPFtZxhm0dL0SeSCpYdUqlgvKDmw/FrMp06dN6hVRg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:11.251198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8e22a069-b095-4449-a8e7-fe10a6e0e381 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Getting quotas for project 9040461111d2497ab28105c19e40d32a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:54:11.268794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-8e22a069-b095-4449-a8e7-fe10a6e0e381 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Getting quotas for user d568f170bf874dd68cc22b2ed0106a03 and project 9040461111d2497ab28105c19e40d32a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:54:11.323026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e22a069-b095-4449-a8e7-fe10a6e0e381 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.734402 Oct 28 17:54:11.324027 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2532/5184] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:54:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:11.328852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:11.331208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:11.350134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:11.350700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:11.351284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:11.352799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:11.353529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:11.384483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:11.421980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:11.435485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97dde52b-c174-4b11-af3b-6c022158baa0 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1512 microversion: 2.1 time: 0.790504 Oct 28 17:54:11.443759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2653/5185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:10 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1512 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:11.638557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:11.659769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01e195fe-5850-4a08-bafb-9aef83d892bd tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 200 len: 1478 microversion: 2.1 time: 0.334468 Oct 28 17:54:11.660377 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2533/5186] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:11 2022] GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 1478 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:11.892688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1575b55-2f9b-407c-b9a3-a1ea54f32231", "name": "network-vif-deleted", "tag": "16d9eeff-6b73-4565-965e-41f8835caffe"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:11.944056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:11.946795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:11.947512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:11.984653 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] Creating event network-vif-deleted:16d9eeff-6b73-4565-965e-41f8835caffe for instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 on n-h1-860864-13 Oct 28 17:54:11.998295 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-aeea6449-84fe-4b29-a305-b1b275b119d7 req-f3023026-d541-4a4c-878e-de02d5b2616c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113484 Oct 28 17:54:12.001093 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2654/5187] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:12.462263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:12.462892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:12.471645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:12.472132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:12.472569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:12.473273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:12.473721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:12.479956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:12.690006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:12.690847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:12.706883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:12.712314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:12.713017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:12.714112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:12.715099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:12.716511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:12.816331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:12.817933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:12.821690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:12.822455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lazy-loading 'fault' on Instance uuid b1575b55-2f9b-407c-b9a3-a1ea54f32231 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:54:13.029286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb48b23964a4d84adb5f8dec1ebc02e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa4f855d7784970b95a72dedb600181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:13.042227 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38c8ce8c-7aec-45a7-ba32-587e7d8207f1 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 200 len: 1313 microversion: 2.1 time: 0.357306 Oct 28 17:54:13.045311 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2655/5188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:12 2022] GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:13.125615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:13.142117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-93d41f66-248e-4248-8b8b-dc6f62dc2c5d tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1512 microversion: 2.1 time: 0.685837 Oct 28 17:54:13.143498 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2534/5189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:12 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1512 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:13.362788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5ad3683-b6fc-45fd-b750-87223cc6d295", "name": "network-vif-deleted", "tag": "057121bb-9cde-49f7-aed3-79b3d989ac75"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:13.393040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:13.396194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:13.398310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:13.447875 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] Creating event network-vif-deleted:057121bb-9cde-49f7-aed3-79b3d989ac75 for instance e5ad3683-b6fc-45fd-b750-87223cc6d295 on n-h1-860864-13 Oct 28 17:54:13.472573 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-67d32f42-4832-4d29-951a-19eb8c854d11 req-76dd1daa-6510-4180-9195-5517da63d20b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114673 Oct 28 17:54:13.473552 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2656/5190] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:14.017782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0176bf1-c14b-4d63-ab3e-4a294bd4d6de", "name": "network-vif-deleted", "tag": "6f06b5ea-456d-464b-97f6-4492750eb92c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:14.046846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.049428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.052924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.072334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:14.073035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: b1575b55-2f9b-407c-b9a3-a1ea54f32231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:14.100528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.101033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.101713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.104110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.107207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.107844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.126795 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] Creating event network-vif-deleted:6f06b5ea-456d-464b-97f6-4492750eb92c for instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de on n-h2-860864-13 Oct 28 17:54:14.147718 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-70c711b1-b0d8-4e52-a63e-f5b5f8efd45e req-9ee33afb-2bad-44d2-89f1-f8a285e8124e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135701 Oct 28 17:54:14.151888 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2535/5191] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:14.174677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:14.175460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:14.192090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] HTTP exception thrown: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 HTTP/1.1 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b1575b55-2f9b-407c-b9a3-a1ea54f32231'} Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.194060 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 404 to user: Instance b1575b55-2f9b-407c-b9a3-a1ea54f32231 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:14.198243 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-405b62b5-ee8a-43c7-80bc-3c479e5b0a04 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231" status: 404 len: 111 microversion: 2.1 time: 0.130430 Oct 28 17:54:14.203669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.204175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.204618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.205331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.212883 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2657/5192] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:14 2022] GET /compute/v2.1/servers/b1575b55-2f9b-407c-b9a3-a1ea54f32231 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:54:14.217707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:14.218314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] [instance: f0176bf1-c14b-4d63-ab3e-4a294bd4d6de] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:14.220656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.221267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.257726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.259016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.259491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.260217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.260675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.261107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.319474 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] HTTP exception thrown: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Request method failure captured: Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de HTTP/1.1 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcGz5igCbLdnb1jTVkNqVit4KVicmo4pf6EqYeQdr4fvyvCPYSyPdVSUQjF32gdbiNm_Q4kGwhY_lNGZoDiYkqkjXLcJWCFsy5VGqwEP17osqA6v7FjoBJfYchV1aXE8qIPamkcITeOxwJX1Axb8Fgz2mozQzeaBuWShOE4enb5Vx0 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfa4f855d7784970b95a72dedb600181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfa4f855d7784970b95a72dedb600181"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfa4f855d7784970b95a72dedb600181"}]}] Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: dfa4f855d7784970b95a72dedb600181 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1738304686 Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: edb48b23964a4d84adb5f8dec1ebc02e Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ListServersNegativeTestJSON-1738304686-project Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f0176bf1-c14b-4d63-ab3e-4a294bd4d6de'} Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.321888 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] Returning 404 to user: Instance f0176bf1-c14b-4d63-ab3e-4a294bd4d6de could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:14.325270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-935f8b26-5fe2-485e-8d7d-91e64ec1da50 tempest-ListServersNegativeTestJSON-1738304686 tempest-ListServersNegativeTestJSON-1738304686-project] 10.222.0.48 "GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de" status: 404 len: 111 microversion: 2.1 time: 0.109670 Oct 28 17:54:14.330626 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2658/5193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:14 2022] GET /compute/v2.1/servers/f0176bf1-c14b-4d63-ab3e-4a294bd4d6de => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:54:14.345212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:14.355473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:14.356423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:14.357055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lazy-loading 'fault' on Instance uuid e5ad3683-b6fc-45fd-b750-87223cc6d295 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:54:14.738341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f262de3b3d41beaf8944a8e2201187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52cdce55315e4291aab1f31320558f57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:14.752260 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3ecc279-d57d-4d79-91f3-745064ec1904 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 200 len: 1307 microversion: 2.1 time: 0.588669 Oct 28 17:54:14.752888 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2536/5194] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:14 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 1307 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:15.781882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:15.783160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] [instance: e5ad3683-b6fc-45fd-b750-87223cc6d295] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:15.806418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:15.807645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:15.809671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:15.811547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:15.812235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:15.813089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:15.865967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] HTTP exception thrown: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Request method failure captured: Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 HTTP/1.1 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBcmnWgA_qmVMJfMmaG8-bKflhwFbHAMb2U2klbRjBpX_5cJYJYn_qzuRf3cFkvdoZDHc8GJ52jasWt4KfW-QcDlB97En9ksnOXBj_94Uoe8WVyx9Qvhc8BVb7R6GrIRZcsxlPrJ8Ekxa-lFL4vipsnJlbWIDT8zgOqFUo8aKUDQfew Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 52cdce55315e4291aab1f31320558f57 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerAddressesTestJSON-1510359980 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52cdce55315e4291aab1f31320558f57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52cdce55315e4291aab1f31320558f57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52cdce55315e4291aab1f31320558f57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52cdce55315e4291aab1f31320558f57"}]}] Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerAddressesTestJSON-1510359980 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 52cdce55315e4291aab1f31320558f57 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1510359980 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerAddressesTestJSON-1510359980-project Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b3f262de3b3d41beaf8944a8e2201187 Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerAddressesTestJSON-1510359980-project Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e5ad3683-b6fc-45fd-b750-87223cc6d295'} Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:15.876061 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. Oct 28 17:54:15.879555 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:15.881717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] Returning 404 to user: Instance e5ad3683-b6fc-45fd-b750-87223cc6d295 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:15.882589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-343e8ae8-7ab2-42a2-bf89-85effbcb3da5 tempest-ServerAddressesTestJSON-1510359980 tempest-ServerAddressesTestJSON-1510359980-project] 10.222.0.48 "GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295" status: 404 len: 111 microversion: 2.1 time: 0.106066 Oct 28 17:54:15.888787 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2659/5195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:15 2022] GET /compute/v2.1/servers/e5ad3683-b6fc-45fd-b750-87223cc6d295 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:54:17.467601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "22530cb7-a3f5-4616-866f-d861c7483f6c"}], "security_groups": [{"name": "tempest-securitygroup--577476350"}], "key_name": "tempest-keypair-689245528", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:17.549935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:17.559413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:18.176417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] validate_networks() for [('22530cb7-a3f5-4616-866f-d861c7483f6c', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:54:21.235814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:54:21.237170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:54:21.237834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:54:21.238426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:54:21.239120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:54:21.253248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:21.254247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:21.254884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:21.255979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:21.257189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:21.258751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:21.290251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Getting quotas for project 9040461111d2497ab28105c19e40d32a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:54:21.299954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Getting quotas for user d568f170bf874dd68cc22b2ed0106a03 and project 9040461111d2497ab28105c19e40d32a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:54:21.326456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:54:21.329956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:54:21.453773 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-741dea8e-d015-4e75-bec9-52b42f082b5f tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.991858 Oct 28 17:54:21.455597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2537/5196] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:54:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 3994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:54:21.466328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6f09ee4-f948-4245-8d1b-f52709953ccb tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:21.467783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6f09ee4-f948-4245-8d1b-f52709953ccb tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:21.471319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:21.479321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:21.969105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a6f09ee4-f948-4245-8d1b-f52709953ccb tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:21.977201 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6f09ee4-f948-4245-8d1b-f52709953ccb tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1225 microversion: 2.1 time: 0.514328 Oct 28 17:54:21.983985 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2660/5197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:21 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1225 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:23.008004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:23.008781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:23.032756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:23.035841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:23.040701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:23.047079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:23.047841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:23.048528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:23.300536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:23.315874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10502766-50f7-4ca5-8570-3d1c54865056 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1277 microversion: 2.1 time: 0.311190 Oct 28 17:54:23.327399 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2538/5198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:23 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:24.346316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:24.347557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:24.381467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:24.386529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:24.387883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:24.390908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:24.392430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:24.393078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:25.802368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:25.831627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ab20531-f419-447b-b5ab-6524a094e98c tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1283 microversion: 2.1 time: 1.492090 Oct 28 17:54:25.835500 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2661/5199] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:24 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1283 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:26.875710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:26.876641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:26.897859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:26.907757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:26.913179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:26.920297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:26.925072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:26.928485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:27.214867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:27.238272 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-845706c0-7d30-4b6b-be21-63dea03dab5d tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1283 microversion: 2.1 time: 0.373453 Oct 28 17:54:27.240928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2539/5200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:26 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:28.267907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:28.272728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:28.286851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:28.291186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:28.294010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:28.294927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:28.297843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:28.298443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:28.464645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:28.473096 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-873ca01e-6137-468c-9bcb-3e2fd4339f7b tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1283 microversion: 2.1 time: 0.214259 Oct 28 17:54:28.485819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2662/5201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:28 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:29.510475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:29.511515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:29.527940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:29.529365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:29.529989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:29.530881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:29.531523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:29.532103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:30.483946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:30.514569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cb68c740-caa8-43b3-a3d5-03863b5dc09e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 1.001368 Oct 28 17:54:30.516498 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2540/5202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:29 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:31.543058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:31.543705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:31.566796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:31.570756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:31.572020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:31.575675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:31.578018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:31.579725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:31.976799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:32.422870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:32.437891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-453730d3-0685-4b8e-a6de-085c9032d0fd tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.899800 Oct 28 17:54:32.455301 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2663/5203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:31 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:32.711427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:32.713156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:32.958079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e533d85a-3af8-4af0-a399-bddd2a8f87cb", "tag": "a004a3e1-ac61-429f-8b89-1b5969b4606b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:32.983910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:32.984560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:32.985999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:33.032285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] Creating event network-changed:a004a3e1-ac61-429f-8b89-1b5969b4606b for instance e533d85a-3af8-4af0-a399-bddd2a8f87cb on n-h1-860864-13 Oct 28 17:54:33.053139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6bb155a3-afe2-4790-924c-6534c781fcd8 req-7e60f8d1-855b-46ff-aa30-0a0562254ef1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351220 Oct 28 17:54:33.059106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2541/5204] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:33.466346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:33.467051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:33.491057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:33.495446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:33.496618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:33.500711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:33.502175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:33.503951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:34.274618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2048554997", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:34.375344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:54:34.375805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:54:34.376285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:54:34.376693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:54:34.377109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:54:34.402931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:34.404171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:34.404672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:34.408534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:34.409222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:34.411903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:34.535983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Getting quotas for project 0c71cc653707478b952788aa2c00ea1e. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:54:34.560893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Getting quotas for user cefae739e71f4191b277a7a820099666 and project 0c71cc653707478b952788aa2c00ea1e. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:54:34.619933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:54:34.629543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:54:34.793725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49a382b0-a041-41e6-a334-69cea5a8a996 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.953500 Oct 28 17:54:34.795448 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2542/5205] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:54:34.808254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:34.811886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:34.891049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:34.902140 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3065867b-6be6-40bb-a491-16d951b77af4 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 1.443947 Oct 28 17:54:34.905126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2664/5206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:33 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:34.984934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:34.999057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:35.001408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:35.002578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28fe5990-8570-42df-b684-b220f3646bb0 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1281 microversion: 2.47 time: 0.200629 Oct 28 17:54:35.025592 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2543/5207] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:34 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:35.459768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-225816718", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": "none"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:35.533034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:54:35.533466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:54:35.533943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:54:35.534354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:54:35.534767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:54:35.559450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:35.559961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:35.560303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:35.561039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:35.561497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:35.567754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:35.616792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Getting quotas for project e8157dfba71a4dff905c12584432bc74. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:54:35.633517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Getting quotas for user 6077ea8061ea4592a43e20fa46eb4c9b and project e8157dfba71a4dff905c12584432bc74. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:54:35.678080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:54:35.682356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:54:35.774965 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d377664f-54b7-422d-a9fc-ef9e5c48689c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.587041 Oct 28 17:54:35.783727 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2665/5208] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 17:54:35.791696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:35.792343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:35.928131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:35.928755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:35.937261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:35.937762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:35.938537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:35.939616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:35.940747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:35.947506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:36.041659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.056503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.060671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.064967 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7712e364-832c-4e46-91bc-130325176cd9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1277 microversion: 2.57 time: 0.281540 Oct 28 17:54:36.067586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2544/5209] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:35 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1277 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:36.077927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:36.079282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:36.090581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:36.091309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:36.091941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:36.092856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:36.094343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:36.095326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:36.135954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:36.378056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.379581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.390615 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4970c49-4e10-4697-978a-a37f192471a7 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.467183 Oct 28 17:54:36.391602 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2666/5210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:35 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:54:36.412036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.413846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:36.415658 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9051b32-6bd8-4097-802f-03c9949a4872 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1333 microversion: 2.47 time: 0.346874 Oct 28 17:54:36.416502 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2545/5211] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:36 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1333 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:37.105810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:37.107092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:37.139873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.140375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.142290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.147265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.149272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.150613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.309104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.330393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.332217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.333444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb4ca950-13f1-41ba-9642-1b7e5b345f3c tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1329 microversion: 2.57 time: 0.233644 Oct 28 17:54:37.338899 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2667/5212] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:37 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1329 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:37.418467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:37.419166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:37.432989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.433485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.437569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.443755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:37.444641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:37.449446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.450256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.451451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.453079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.453566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.453998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.454704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:37.455151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:37.464035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:37.616357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.630786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.634278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.638540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e40be37d-5400-4911-976c-791787bb93b2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1339 microversion: 2.47 time: 0.197242 Oct 28 17:54:37.640593 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2668/5213] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:37 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1339 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:54:37.881531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:37.893773 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdbf4e59-b80f-4dae-a930-6f16444f9937 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.480810 Oct 28 17:54:37.895114 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2546/5214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:37 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:38.368943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:38.371673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:38.400519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.403539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.405017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:38.406954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.407878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.410211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:38.494640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:38.650700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.659138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.671094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:38.672315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:38.677754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.681703 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8263a07-771d-46b9-9a5c-d5f2df9b2b71 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1337 microversion: 2.57 time: 0.318868 Oct 28 17:54:38.684958 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2669/5215] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:38 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1337 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:38.686464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.688644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.689305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:38.692570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.693213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.693796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:38.875136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.890995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.892606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:38.893818 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78f5ee4b-6d4e-47aa-b495-65b6394b9be2 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1339 microversion: 2.47 time: 0.226592 Oct 28 17:54:38.894397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2547/5216] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:38 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:38.918622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:38.919242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:38.926800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.927285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.931199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:38.932310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:38.932950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:38.933630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:39.288155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:39.301839 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f2321a99-00fa-49f9-80b8-b0014f0d1cad tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.386946 Oct 28 17:54:39.302446 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2670/5217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:38 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:39.712265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:39.713523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:39.726137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:39.731592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:39.732237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:39.740417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:39.746141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:39.746754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:39.930764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:39.932086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:39.941816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:39.946260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:39.946961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:39.948193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:39.949601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:39.951947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:40.106215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.121345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.128268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.131591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ab7cb78-69c4-4220-8e9b-a56da292f91d tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1347 microversion: 2.57 time: 0.423371 Oct 28 17:54:40.135581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2548/5218] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:39 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1347 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:40.154147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.162702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.180253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.181453 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83984ff1-3bd5-44f1-89ab-d6be934d7945 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1339 microversion: 2.47 time: 0.254655 Oct 28 17:54:40.182045 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2671/5219] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:39 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1339 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:40.333448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:40.349312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:40.380263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:40.381385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:40.381842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:40.382854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:40.383324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:40.387559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:40.732397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:40.749029 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5453cbc-3991-4f1b-a7f9-598822a74ebe tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.426344 Oct 28 17:54:40.750240 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2549/5220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:40 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:41.077428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e533d85a-3af8-4af0-a399-bddd2a8f87cb", "name": "network-vif-plugged", "status": "completed", "tag": "a004a3e1-ac61-429f-8b89-1b5969b4606b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:41.120228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:41.131865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.132642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.133217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.165185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:41.165799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:41.179744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.180312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.180763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.181507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.181968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.184819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.189090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] Creating event network-vif-plugged:a004a3e1-ac61-429f-8b89-1b5969b4606b for instance e533d85a-3af8-4af0-a399-bddd2a8f87cb on n-h1-860864-13 Oct 28 17:54:41.208853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-322a6f15-df42-462e-9bdb-a247642e3af7 req-0b8fd2f4-ee4a-4472-b34f-55534ca8445f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136610 Oct 28 17:54:41.210320 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2672/5221] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:41.228661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:41.229688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:41.265576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.266083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.272144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.273207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.284003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.284670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.578158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.592234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.599682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.602070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.607412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.607919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22eed6bb-4f77-4299-ba26-307aaeabf9e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1335 microversion: 2.57 time: 0.442477 Oct 28 17:54:41.619416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2550/5222] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:41 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1335 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:41.620075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:41.620075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8ca6c37-d268-4f0a-ad95-b4b4cbfab675 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1339 microversion: 2.47 time: 0.397690 Oct 28 17:54:41.636555 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2673/5223] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:41 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:41.775076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:41.775754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:41.788729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.791985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.792593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:41.794403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:41.795041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:41.797976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:42.635331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:42.643760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:42.645989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:42.666043 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2dbf0d25-7d73-4be8-b90e-bf127ff30477 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.895704 Oct 28 17:54:42.679397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2551/5224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:41 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:42.679720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:42.679720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:42.679720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:42.679720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:42.683969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:42.684799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:42.688516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:42.697243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:42.722608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:42.725129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:42.727284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:42.728519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:42.730531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:42.733568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:43.059868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.071323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.083004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.085608 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e189129-858b-4139-b126-937b812dff61 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1335 microversion: 2.57 time: 0.446415 Oct 28 17:54:43.108110 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2674/5225] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:42 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1335 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:43.133707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.142922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.157064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:43.168562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d10b08f-71c0-4f2a-9645-a46955b8932a tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1339 microversion: 2.47 time: 0.498715 Oct 28 17:54:43.169851 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2552/5226] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:42 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1339 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:43.696264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:43.697555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:43.714277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:43.714766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:43.715208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:43.728537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:43.729031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:43.729473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.121578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:44.122202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:44.139084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.143214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.143860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.149458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.150168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.150901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.305440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.317699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec92050f-be5a-48ef-9542-320052a05e28 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1350 microversion: 2.1 time: 0.626384 Oct 28 17:54:44.320905 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2675/5227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:43 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1350 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:44.343707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:44.348204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:44.366900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.369034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.371351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.372478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.378788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.380298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.390240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.428800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.436316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.439867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b41c53a5-6a93-4cae-80c3-0c14c735d927 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1335 microversion: 2.57 time: 0.321679 Oct 28 17:54:44.446513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2553/5228] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:44 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1335 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:54:44.920021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.934673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.937051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:44.938598 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e4f5c91-d9f9-40d4-a02e-3bce4395ad08 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1360 microversion: 2.47 time: 0.616483 Oct 28 17:54:44.939327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2676/5229] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:44 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1360 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:44.969535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-608901214"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:44.972087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:44.985648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:44.992615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.993216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.993709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:44.996142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:44.997164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:44.997759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.348245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:45.348855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:45.365284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.366855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.373350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.374764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.378059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.378689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.419418 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-005dd92e-64c5-4f38-8176-64665fac47af tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "POST /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61/action" status: 202 len: 52 microversion: 2.47 time: 0.452807 Oct 28 17:54:45.422836 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2554/5230] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:54:44 2022] POST /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61/action => generated 52 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:54:45.440646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:45.443029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:45.454277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.454785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.455222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.455960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.456415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.456840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.525998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:54:45.582076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:45.674254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:45.686769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-312aa9bb-9b98-4885-a95e-4faee00ff97d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "DELETE /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 204 len: 0 microversion: 2.47 time: 0.255405 Oct 28 17:54:45.692488 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2555/5231] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:54:45 2022] DELETE /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:54:45.715675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:45.718375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:45.745461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.746111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.746656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.748882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.749459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.751933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.910350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:45.921175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a63d206-81be-46db-bf0b-e1fd49698233 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1541 microversion: 2.1 time: 0.575054 Oct 28 17:54:45.923327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2677/5232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:54:45 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1541 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:54:45.948799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:45.949674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:45.978583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.980499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.981274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:45.982382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:45.983003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:45.985003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.048222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:46.080777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.092998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.094732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.098777 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9db9085b-8a02-4180-b512-f772efaa87b5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1356 microversion: 2.57 time: 0.399074 Oct 28 17:54:46.104008 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2556/5233] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:45 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1356 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:46.114284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:46.118073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:46.133927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.134731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.135443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.152326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.152790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.153883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.167890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.182682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.188487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.189946 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6456afdb-4b34-4c7d-a984-2a2e401b032d tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1366 microversion: 2.47 time: 0.246450 Oct 28 17:54:46.196812 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2678/5234] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:45 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:46.201876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:46.204806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:46.212256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.212756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.213191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.214203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.214917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.215569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.318094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:54:46.318862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:54:46.319703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:54:46.320353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:54:46.320880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:54:46.383898 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fd93716-15c7-42ea-a413-037329223919 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.278294 Oct 28 17:54:46.387554 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2557/5235] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:54:46 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:54:46.435349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:46.442515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.443072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.443545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.445412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.446071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.446594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.481311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c83f4c5b-0a9a-4257-9c81-ad56c8a971a5 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "POST /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857/action" status: 202 len: 1137 microversion: 2.57 time: 0.283196 Oct 28 17:54:46.482313 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2679/5236] 10.222.0.48 () {62 vars in 1320 bytes} [Fri Oct 28 17:54:46 2022] POST /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857/action => generated 1137 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 17:54:46.506063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:46.507649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:46.520642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.520846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.527615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.528432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.530871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.531316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.672922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.699162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.702477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:46.704610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18eddd49-c96e-4330-a550-bda6fe7ca241 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.202342 Oct 28 17:54:46.705606 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2558/5237] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:46 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:46.761464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:46.762315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:46.782339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.783089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.783733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.784437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:46.785033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:46.788878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:46.883345 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de6e54d7-c6e6-4cb9-8cfb-e4be38da9af3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments/27344f8f-e94e-46dd-a39d-0ed6c5667e64" status: 200 len: 194 microversion: 2.20 time: 0.127668 Oct 28 17:54:46.885637 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2680/5238] 10.222.0.48 () {60 vars in 1454 bytes} [Fri Oct 28 17:54:46 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments/27344f8f-e94e-46dd-a39d-0ed6c5667e64 => generated 194 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:47.020226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:47.021386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:47.033541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.034085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.036994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.040493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.041672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.044105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.052528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:47.192523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lazy-loading 'services' on Instance uuid 6279d691-97a6-42cc-86bf-a9fe321a7924 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:54:47.228831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:47.230587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:47.240997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.242807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.244313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.245352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.245987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.246599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.329252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29c7c02d-41f1-4ea5-bf01-e984d05e0359 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments/27344f8f-e94e-46dd-a39d-0ed6c5667e64" status: 202 len: 0 microversion: 2.20 time: 0.313944 Oct 28 17:54:47.330436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2559/5239] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Oct 28 17:54:47 2022] DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments/27344f8f-e94e-46dd-a39d-0ed6c5667e64 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:54:47.340543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:47.342875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:47.383822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.385118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.387475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.392028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.395399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.395926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.468173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:47.484081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:47.485544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:47.491897 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8f9db289-bed8-43f4-89a4-5efea6e15cd6 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1366 microversion: 2.47 time: 0.266619 Oct 28 17:54:47.493346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2681/5240] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:47 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:54:47.515038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9dd3c505-bb18-4f35-849f-fc6ededfad57 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.177603 Oct 28 17:54:47.518151 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2560/5241] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:47 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:47.735119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:47.735821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:47.761968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.763063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.763234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:47.766160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:47.766643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:47.769438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.054436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:48.068477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:48.071762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:48.077683 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8ad74d5-428a-44b7-8af9-0954ce95d1f3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.347611 Oct 28 17:54:48.087266 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2682/5242] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:47 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:48.521941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:48.523863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e533d85a-3af8-4af0-a399-bddd2a8f87cb", "tag": "a004a3e1-ac61-429f-8b89-1b5969b4606b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:54:48.525961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:48.554285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:48.557790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:48.558300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:48.558740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.559473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:48.559922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:48.560344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.590720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:48.591125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:48.591595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.666390 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] Creating event network-changed:a004a3e1-ac61-429f-8b89-1b5969b4606b for instance e533d85a-3af8-4af0-a399-bddd2a8f87cb on n-h1-860864-13 Oct 28 17:54:48.680009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a6243b27-b425-489f-abc2-b69dfd30376e req-6923b7e3-a738-431d-a356-e2678d4afc91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166249 Oct 28 17:54:48.680898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2561/5243] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:54:48.718292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:48.721750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:48.738376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:48.739254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:48.742767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.748081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:48.748618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:48.749389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:48.850129 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40599d66-d394-4092-b3ee-329fec1b8b1a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163004 Oct 28 17:54:48.852663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2562/5244] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:48 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:49.002872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.036304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.048909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.061286 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc66ef9f-f521-41a9-8799-e7387bed5bb3 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1366 microversion: 2.47 time: 0.543108 Oct 28 17:54:49.061989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2683/5245] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:48 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1366 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:54:49.113252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:49.114241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:49.129900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:49.130535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:49.130987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:49.135857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:49.136572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:49.137318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:49.526553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.579444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.584433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:49.589059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9b8de4c-ae1c-4f28-a38d-6f657da33b34 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.480267 Oct 28 17:54:49.593165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2563/5246] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:49 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:49.865224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:49.867735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:49.882748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:49.883159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:49.888106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:49.889177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:49.889660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:49.891444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:49.926426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:54:49.980612 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e7626f9-f281-406b-8682-aa2da7280c0b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119395 Oct 28 17:54:49.987446 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2684/5247] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:49 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:50.099167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:50.103437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:50.122675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:50.123200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:50.123688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:50.124419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:50.124876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:50.125306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:50.361648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.375352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.382980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.386249 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2c477a8-2084-4225-9df5-462a6527a40b tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1366 microversion: 2.47 time: 0.291377 Oct 28 17:54:50.389692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2564/5248] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:50 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:50.632294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:50.633643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:50.661689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:50.662194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:50.662645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:50.665401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:50.665868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:50.666295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:50.836913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.856488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.868212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:50.869693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f4ea8f5-ee36-4581-9a93-367cc25d6a6b tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.244914 Oct 28 17:54:50.870292 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2685/5249] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:50 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:50.995078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:50.997691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:51.014639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.015176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.015694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.017586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.019538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.020068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.100784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0e9924b8-3975-4a06-89de-9673d11e6b2b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108108 Oct 28 17:54:51.103262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2565/5250] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:50 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:51.418342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:51.419122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:51.433500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.438338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.439007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.439932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.443435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.444613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.593088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.598218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.601154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.604159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lazy-loading 'fault' on Instance uuid 92cc90fc-c7a0-469a-840c-f4bb68d19e61 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:54:51.903651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:51.904329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:51.924490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.925447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.926124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.926935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:51.931863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:51.933814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:51.963191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:51.978659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:51.980550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cefae739e71f4191b277a7a820099666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c71cc653707478b952788aa2c00ea1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:51.986765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-357a339d-f931-462a-8965-9a7d1d90fde7 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 200 len: 1371 microversion: 2.47 time: 0.573400 Oct 28 17:54:51.987669 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2686/5251] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:51 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:52.119413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:52.126188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:52.139631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:52.141487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:52.142135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:52.145246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:52.146944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:52.148828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:52.238163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:52.257978 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f9f4f72-2bd7-4d79-abdf-9443ee3b6b26 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145033 Oct 28 17:54:52.259708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:52.260379 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2687/5252] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:52 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:52.261299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:52.271481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f796439-46dd-4fe4-8f89-dff2e5206a01 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.372048 Oct 28 17:54:52.272085 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2566/5253] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:51 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:53.017654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:53.018200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] [instance: 92cc90fc-c7a0-469a-840c-f4bb68d19e61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:53.042265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.046795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.047517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.054910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.055678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.056307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.085879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] HTTP exception thrown: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Request method failure captured: Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 HTTP/1.1 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBdZPQopvQdw15ppkmfoyB6SyRo0ZDVs_Y8nkOYtv1EEAyNrRbI1W-OP5JNgCRlCT7BMRSUqmkEaYgZHmb2uzVwPKgBz_mtDUDCyEXDKOGmFrMCKP7N_n7J-DIPknKTasS1xXouO3IWoBamNY_SbENLU5jHCr9jsI9h0VwzTG2rrAsA Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 0c71cc653707478b952788aa2c00ea1e Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAaction247Test-696697236 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c71cc653707478b952788aa2c00ea1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c71cc653707478b952788aa2c00ea1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c71cc653707478b952788aa2c00ea1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c71cc653707478b952788aa2c00ea1e"}]}] Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAaction247Test-696697236 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 0c71cc653707478b952788aa2c00ea1e Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAaction247Test-696697236 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAaction247Test-696697236-project Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: cefae739e71f4191b277a7a820099666 Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAaction247Test-696697236-project Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '92cc90fc-c7a0-469a-840c-f4bb68d19e61'} Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:54:53.098301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. Oct 28 17:54:53.102041 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:54:53.103977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] Returning 404 to user: Instance 92cc90fc-c7a0-469a-840c-f4bb68d19e61 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:54:53.105016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21d7690a-eb5f-4b65-9219-b5dd850665b4 tempest-ServersAaction247Test-696697236 tempest-ServersAaction247Test-696697236-project] 10.222.0.48 "GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61" status: 404 len: 111 microversion: 2.47 time: 0.091850 Oct 28 17:54:53.106151 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2688/5254] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:53 2022] GET /compute/v2.1/servers/92cc90fc-c7a0-469a-840c-f4bb68d19e61 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:54:53.273328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:53.275935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:53.298105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:53.299041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:53.309212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.314102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.315204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.322920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.323609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.324289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.325136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.325862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.325972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:53.326617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.327048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:53.331105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:53.453755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd76bfd0-8d94-463f-8301-56f36b675f9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184515 Oct 28 17:54:53.459099 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2567/5255] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:53 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:53.634595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:53.664625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:53.670600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:53.674020 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d6bccf6e-906e-4e00-a949-f8ab65022251 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.377704 Oct 28 17:54:53.696945 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2689/5256] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:53 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:54.504095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:54.512861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:54.575106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:54.575951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:54.579183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:54.580360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:54.583200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:54.593165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:54.712162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:54.713465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:54.743205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-981028cf-dc18-4f59-9998-440688464ce3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.276227 Oct 28 17:54:54.745028 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2568/5257] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:54 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:54.754474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:54.755762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:54.758706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:54.765150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:54.765744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:54.766251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:55.028136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:55.047124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:55.054542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:55.062369 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4608b350-c861-43aa-8169-cf6fc9a48f7a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.351800 Oct 28 17:54:55.063720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2690/5258] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:54 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:55.756763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:55.759650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:55.801400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:55.802744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:55.806539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:55.813140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:55.815581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:55.820418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:55.924801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5bd0974c-74f3-4f62-bfa7-214ebe8a9d34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168602 Oct 28 17:54:55.930592 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2569/5259] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:55 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:56.096284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:56.096893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:56.112349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:56.118875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:56.121034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:56.123240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:56.126026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:56.126494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:56.431760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:56.444803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:56.446707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:56.447703 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90508910-c6e6-477a-91b3-961650472ae0 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.355346 Oct 28 17:54:56.459119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2691/5260] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:56 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:56.940612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:56.943614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:56.955340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:56.961579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:56.962420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:56.963324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:56.964179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:56.966031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:57.048448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29f4e074-8d3b-4e85-85bc-cd4b6c9ea374 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112181 Oct 28 17:54:57.051700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2570/5261] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:56 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:57.486251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:57.486869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:57.519298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:57.523873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:57.530054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:57.535425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:57.539417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:57.541930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:57.692860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:57.718742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:57.728919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:57.735324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-377d50a4-02ac-4414-89e6-857b59406f54 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.250201 Oct 28 17:54:57.737569 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2692/5262] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:57 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:54:58.063342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:58.066991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:58.090968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:58.091499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:58.094976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:58.095752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:58.107808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:58.108423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:58.217956 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-280e9492-e9da-42f3-8f67-f1b0bcbcb505 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159137 Oct 28 17:54:58.225471 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2571/5263] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:58 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:54:58.770937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:58.771752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:58.783950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:58.792481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:58.792941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:58.793702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:58.794164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:58.794601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:59.242850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:54:59.246592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:54:59.291901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:59.291901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:59.294421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:59.298467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:54:59.298467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:54:59.298467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:54:59.434203 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72dd40dc-1337-4936-84a4-b498c9a73989 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198786 Oct 28 17:54:59.443185 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2572/5264] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:54:59 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 17:54:59.644949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:59.654856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:59.656617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:54:59.663270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1396999-6df5-4d19-bb2e-c6bfc94bb487 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.896270 Oct 28 17:54:59.667442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2693/5265] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:54:58 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:00.453749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:00.457046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:00.474394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.474891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.476429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.477159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.480291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.480986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.612009 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80583fca-0304-431f-b76b-da88d9406831 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.163763 Oct 28 17:55:00.612948 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2573/5266] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:55:00 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:00.696917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:00.698972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:00.742136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.743026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.746469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.751951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.760316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.764248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.781749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:00.782263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:00.800668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.801471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.803752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.805113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:00.807635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:00.808260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:00.921619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:55:00.961905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:00.987014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:00.996872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:01.002638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:01.009050 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6c6d2f5b-3e42-4b25-a0ad-783d9002235a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.323115 Oct 28 17:55:01.012375 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2694/5267] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:00 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:01.070676 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c61aa1c2-d543-42a1-8fb3-ee4f41ebbcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 204 len: 0 microversion: 2.20 time: 0.293391 Oct 28 17:55:01.077595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2574/5268] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:55:00 2022] DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:55:01.086739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:01.089410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:01.100996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:01.101489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:01.101923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:01.102625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:01.106880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:01.109851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:01.748984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:01.762740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:01.767549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:01.774793 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f1002753-d2f2-4e8f-bafe-88782319c4a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.696129 Oct 28 17:55:01.786878 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2695/5269] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:01 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:02.038794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:02.039588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:02.054787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:02.055277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:02.057610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:02.058363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:02.058828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:02.059259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:02.348708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:02.375020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:02.376496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:02.385217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26a325d3-d022-404b-b804-3d5ae0ca3610 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.350697 Oct 28 17:55:02.388389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2575/5270] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:02 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:02.817170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:02.817881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:02.839815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:02.841881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:02.847328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:02.848338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:02.855350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:02.856933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:03.367771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.381166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.385201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.393165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e2766f31-9ac3-46bd-83ec-c64bc7ced590 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.580343 Oct 28 17:55:03.395398 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2696/5271] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:02 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:03.423331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:03.424691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:03.451666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:03.452468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:03.453100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:03.454016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:03.454691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:03.455310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:03.671538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.683172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.689529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:03.691045 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15702708-bcb1-4d81-abf7-522306afd62a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.273392 Oct 28 17:55:03.695621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2576/5272] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:03 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:04.428569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:04.429795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:04.449568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:04.450841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:04.453050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:04.453909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:04.456331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:04.456894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:04.730112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:04.730720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:04.752087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:04.753907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:04.757633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:04.760468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:04.761992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:04.763815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:04.814212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:04.834051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:04.842870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:04.847044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e92fbd7d-74df-442f-a4fd-e045b109b414 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1723 microversion: 2.20 time: 0.420165 Oct 28 17:55:04.847753 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2697/5273] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:04 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:04.981698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:05.009600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:05.011446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:05.014698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60bfc0bf-8d00-4172-a9fa-774f344b13df tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.289770 Oct 28 17:55:05.015785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2577/5274] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:04 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:05.878296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:05.880776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:05.918682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:05.919414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:05.920088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:05.921953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:05.922805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:05.923448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:06.046258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:06.048454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:06.064039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:06.064542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:06.071734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:06.072872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:06.076108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:06.080453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:07.054162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.078995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.082321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.095238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.111574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd1e6b68-9787-4ce0-ad28-ab5ec613b4d3 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 1.046221 Oct 28 17:55:07.113496 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2578/5275] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:06 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:07.121668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.142108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:07.145625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6279d691-97a6-42cc-86bf-a9fe321a7924", "name": "network-vif-deleted", "tag": "7e5407a9-658c-4d5b-b2fa-f405b24e3fba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:07.146485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43e22d60-8979-40dc-a4a4-be595818ba28 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1656 microversion: 2.20 time: 1.273248 Oct 28 17:55:07.148798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2698/5276] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:05 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1656 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:07.212221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:07.214884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:07.215361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:07.245877 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] Creating event network-vif-deleted:7e5407a9-658c-4d5b-b2fa-f405b24e3fba for instance 6279d691-97a6-42cc-86bf-a9fe321a7924 on n-h2-860864-13 Oct 28 17:55:07.257114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ec11adcd-c967-421f-b357-aa0e243b6e23 req-3e1ec296-b346-4c22-9e5d-3d302712825c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136388 Oct 28 17:55:07.260570 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2579/5277] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:08.154339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:08.155013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:08.170157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:08.176012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:08.176722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:08.177629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:08.177747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:08.179072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:08.183803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:08.198316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:08.206907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:08.207435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:08.207882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:08.208604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:08.209066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:08.224578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:08.322299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:08.322832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:08.323311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:08.323828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lazy-loading 'fault' on Instance uuid 6279d691-97a6-42cc-86bf-a9fe321a7924 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:55:08.677213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.686508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.696156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.697676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fda9f25c-703a-4d7d-9291-a1f8867bb52a tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.557677 Oct 28 17:55:08.698468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2699/5278] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:08 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:08.776288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.785387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.791300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:08.794673 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d676df50-a971-4a07-909a-10df14b660b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 200 len: 1372 microversion: 2.20 time: 0.621143 Oct 28 17:55:08.805678 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2580/5279] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:08 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 1372 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:09.568367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-493936985", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "81d65e2f-cd30-423c-b020-72bec265895a"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:09.727026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] validate_networks() for [('81d65e2f-cd30-423c-b020-72bec265895a', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:55:09.730975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:09.731644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:09.746805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:09.747303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:09.748457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:09.749209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:09.749676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:09.750108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:10.046669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:10.066938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:10.069317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:10.078780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1f6346d-bfb9-4a92-97f9-149a76c8c2e1 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.349984 Oct 28 17:55:10.085545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2581/5280] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:09 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:10.706990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:10.708356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:10.722474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:10.731496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:10.732636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:10.733698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:10.734329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:10.735888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:10.778876 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 HTTP/1.1 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '6279d691-97a6-42cc-86bf-a9fe321a7924'} Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:10.782649 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:55:10.786393 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:10.791268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:55:10.791268 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f02388d9-df9d-4460-98af-e34672413955 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 404 len: 111 microversion: 2.20 time: 0.703715 Oct 28 17:55:10.791268 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2582/5281] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:10 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 111 bytes in 705 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:55:10.810709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f62bada-470b-41bf-8653-f358cce506ee tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '.version_select at 0x7f752866fe50>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:10.859278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f62bada-470b-41bf-8653-f358cce506ee tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232632844" status: 204 len: 0 microversion: 2.20 time: 0.061054 Oct 28 17:55:10.860667 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2583/5282] 10.222.0.48 () {60 vars in 1262 bytes} [Fri Oct 28 17:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232632844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:55:11.111604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:11.112386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:11.149074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:11.149883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:11.153764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:11.156715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:11.158086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:11.167628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:11.436979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:55:11.437501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:55:11.438092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:55:11.438645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:55:11.439150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:55:11.448056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=64 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:11.483508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:11.484934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:11.492069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:11.495294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:11.496339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:11.498144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:11.563631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Getting quotas for project f56df11974fb4dfa8757aacf3ca3cb09. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:55:11.575164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:11.583527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Getting quotas for user 27b9427e30814dbdaf2ed8d337abcf1d and project f56df11974fb4dfa8757aacf3ca3cb09. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:55:11.588831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:11.590293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:11.602324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-043b2cf6-4d4e-46b1-a2cb-f818ab2d60c9 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.484525 Oct 28 17:55:11.603250 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2584/5283] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:11 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:11.652561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:55:11.662052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:55:11.830366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ebda5f0-f761-4257-b4f0-16bdeafb7cf9 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.877436 Oct 28 17:55:11.838555 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2700/5284] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:55:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:55:11.850998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58f4f8df-0d94-47dd-ad6d-95b7a0e1e51e tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:11.852467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58f4f8df-0d94-47dd-ad6d-95b7a0e1e51e tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:11.966494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-58f4f8df-0d94-47dd-ad6d-95b7a0e1e51e tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:11.975040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58f4f8df-0d94-47dd-ad6d-95b7a0e1e51e tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1215 microversion: 2.1 time: 0.128854 Oct 28 17:55:11.976927 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2585/5285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:11 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:12.645058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:12.647201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:12.681340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:12.687035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:12.687898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:12.694874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:12.697208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:12.697793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:13.001356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c288a94-0a0a-43e8-a321-16e87495dbe2 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:13.002921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c288a94-0a0a-43e8-a321-16e87495dbe2 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:13.034825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:13.050083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:13.057258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:13.065524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d021607f-6084-4009-9651-45f6229eb8d8 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.433152 Oct 28 17:55:13.071318 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2701/5286] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:12 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:13.426743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3c288a94-0a0a-43e8-a321-16e87495dbe2 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:13.438347 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c288a94-0a0a-43e8-a321-16e87495dbe2 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1215 microversion: 2.1 time: 0.440917 Oct 28 17:55:13.442910 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2586/5287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:12 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1215 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:13.555512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aeb9a5f5-3795-47e7-9e11-54c81356c78c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: .version_select at 0x7f75243b9940>, body: {"keypair": {"name": "tempest-keypair-13568021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmYxGcHKSdzdEXMxSvs5BCLvMXFFS0leFR/Yi7LnatKB4TJZbGsBzjqcxn/WQJYEDZxtJfZi25i11mCGlkKY9+dQ1lCYxCSZMYbHqvBCDSF859Y1SqnidHJWD4HdxDhqw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:13.619126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-aeb9a5f5-3795-47e7-9e11-54c81356c78c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:55:13.634293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-aeb9a5f5-3795-47e7-9e11-54c81356c78c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for user d9009e2acd3345f2a5dd2d609685d0aa and project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:55:13.705135 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aeb9a5f5-3795-47e7-9e11-54c81356c78c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.154360 Oct 28 17:55:13.706768 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2702/5288] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Oct 28 17:55:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 17:55:14.103433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:14.104652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:14.120488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:14.121190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:14.121814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:14.122734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:14.129060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:14.129986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:14.474197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:14.475878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:14.503840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:14.503840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:14.503840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:14.504485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:14.505117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:14.505753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:14.556172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:14.971327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:14.974260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:14.981391 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-67cb29e2-976b-4623-8481-7546e18fee10 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1285 microversion: 2.1 time: 0.514851 Oct 28 17:55:14.988031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:14.997003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:14.998154 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2703/5289] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:14 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1285 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:15.000515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d048b34-9cda-4646-bb14-f12dff3f92c7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1365 microversion: 2.57 time: 0.902110 Oct 28 17:55:15.001491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2587/5290] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:14 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1365 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:16.009023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:16.009625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:16.029428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:16.030593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:16.032597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:16.033124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:16.035406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:16.036202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:16.036635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:16.040631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:16.041225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:16.042071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:16.042590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:16.044001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:16.044698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:16.045332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:16.647264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:16.660829 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c409bf1d-5cd2-4ad5-be16-5a79d6df39a6 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.656576 Oct 28 17:55:16.671912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2704/5291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:16 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:16.686140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1174787798", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d9c1808-e3ae-4085-94de-277d9e33776c"}], "security_groups": [{"name": "tempest-securitygroup--1699400875"}], "key_name": "tempest-keypair-13568021", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:16.723903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:16.751044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:16.758247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:16.767982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59acf082-7226-4d0b-880d-d69c8d17c932 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1371 microversion: 2.57 time: 0.742723 Oct 28 17:55:16.769065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2588/5292] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:16 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1371 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:17.150122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] validate_networks() for [('1d9c1808-e3ae-4085-94de-277d9e33776c', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:55:17.687615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:17.688302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:17.698642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:17.699133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:17.712099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:17.713153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:17.713954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:17.714573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.259756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:18.277651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dac78007-026c-4096-bdfe-70f3ca0349ed tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.595219 Oct 28 17:55:18.280159 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2589/5293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:17 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:18.291063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:18.292123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:18.336182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.336719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.337162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.338955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.339689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.340514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.541760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:18.554431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:18.555915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:18.560785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6dc4c1fc-2148-448f-8798-62c3db879822 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1356 microversion: 2.57 time: 0.278922 Oct 28 17:55:18.561595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2590/5294] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:18 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1356 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:18.592463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:18.593235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:18.612294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.614492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.616071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.618813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.619702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.622784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.703026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:55:18.752465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:55:18.753062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:55:18.753361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:55:18.753774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:55:18.754184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:55:18.768493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.777587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.778765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.781673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:18.783404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:18.784814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:18.834730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:55:18.842266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Getting quotas for user d9009e2acd3345f2a5dd2d609685d0aa and project 2854b7a7ca0948359265d36cb0bf4fcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:55:18.860217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:55:18.862874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:55:18.896913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:18.927194 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d38facb-50cf-4590-b671-5abbd795e30a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.252975 Oct 28 17:55:18.944221 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2705/5295] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Oct 28 17:55:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 17:55:18.959958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:18.962303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:18.969415 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-810b2c77-4b47-4e4b-ac5b-c2cc7daf23d4 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 204 len: 0 microversion: 2.57 time: 0.380359 Oct 28 17:55:18.975071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2591/5296] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:55:18 2022] DELETE /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:55:18.996494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:19.003561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:19.016270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:19.016784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:19.019652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:19.021001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:19.021542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:19.025608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:19.642383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.653892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.658757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.660111 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0952536f-7eba-4ed6-9f7f-17fe87439699 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1280 microversion: 2.20 time: 0.709858 Oct 28 17:55:19.665671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2706/5297] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:18 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1280 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:19.672429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:19.673228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:19.686970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.702491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:19.702824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.703921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:19.703921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:19.704637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:19.705020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:19.705455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:19.708001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:19.711585 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd9fb252-0ae3-4599-8a0a-dca3dc0132d7 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1362 microversion: 2.57 time: 0.728650 Oct 28 17:55:19.714968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2592/5298] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:18 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1362 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:19.968636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a97a7e9-9348-4f4e-b653-a685ce55b366", "tag": "f9be6b22-6991-4c25-9787-dd10f072ba16"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:19.998938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:20.002364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:20.003084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:20.047431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:20.053818 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] Creating event network-changed:f9be6b22-6991-4c25-9787-dd10f072ba16 for instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 on n-h1-860864-13 Oct 28 17:55:20.070521 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-405f66a1-1e13-4f1e-81d0-1eec17fc4fa5 req-ffe95708-501e-4ede-8f56-ba9076b74961 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106703 Oct 28 17:55:20.072217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2593/5299] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:20.494736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.509508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1fca4f67-413f-4ce5-96d0-ef411df06fbc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.840128 Oct 28 17:55:20.510347 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2707/5300] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:19 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:20.695772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:20.696734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:20.710878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:20.714194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:20.716458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:20.717906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:20.719550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:20.720158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:20.747386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:20.748167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:20.760369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:20.762742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:20.767239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:20.768453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:20.770209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:20.772112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:20.931688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.935033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.946513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.950776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6077ea8061ea4592a43e20fa46eb4c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8157dfba71a4dff905c12584432bc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.954847 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1202930a-8a42-4027-8839-8f2680af3883 tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 200 len: 1362 microversion: 2.57 time: 0.213699 Oct 28 17:55:20.956798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.960117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:20.962096 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c8f9d21-09de-4449-a63e-94739ae15635 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1332 microversion: 2.20 time: 0.272731 Oct 28 17:55:20.965416 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2708/5301] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:20 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:20.967401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2594/5302] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:20 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1332 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:21.534738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:21.535360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:21.571735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:21.573183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:21.574826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:21.576128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:21.577014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:21.578220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:21.883630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:21.896301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cf6af66-7415-4e3e-bb13-d4dfcf3facd0 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.362715 Oct 28 17:55:21.897554 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2709/5303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:21 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:22.007399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:22.008594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] [instance: ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:22.010919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:22.011620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:22.029093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.029872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.030494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:22.032093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.032371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.032592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.033036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:22.034077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.034725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:22.040098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.040891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.041496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:22.077431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] HTTP exception thrown: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Request method failure captured: Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 HTTP/1.1 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBdamCp3ImDu7wDqqde8NH_UM6aRhR87cZOCZ0Yzg7JlabHIWNhm0MLxznodqabXI5iDp6BgiDkAPJ_7HAeg49-1o_oujXuNR20lsPE3NfiQnYeA438O8gjmuvKyijsyqLSCI_9ZxW1pQZHa9wIiIzJZgKyJ0pM6Vw_p6OLszZxij1M Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.57 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: e8157dfba71a4dff905c12584432bc74 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerShowV257Test-474162809 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8157dfba71a4dff905c12584432bc74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8157dfba71a4dff905c12584432bc74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8157dfba71a4dff905c12584432bc74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8157dfba71a4dff905c12584432bc74"}]}] Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerShowV257Test-474162809 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: e8157dfba71a4dff905c12584432bc74 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerShowV257Test-474162809 Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerShowV257Test-474162809-project Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6077ea8061ea4592a43e20fa46eb4c9b Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerShowV257Test-474162809-project Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857'} Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:22.080481 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] Returning 404 to user: Instance ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:55:22.084867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8c3d8c6-138c-4125-bb14-10a82d89c8fe tempest-ServerShowV257Test-474162809 tempest-ServerShowV257Test-474162809-project] 10.222.0.48 "GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857" status: 404 len: 111 microversion: 2.57 time: 0.082585 Oct 28 17:55:22.085668 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2595/5304] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:22 2022] GET /compute/v2.1/servers/ab2d44a7-d6a1-4f82-8ff2-a9bdb44e2857 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:55:22.248104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:22.260890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:22.263018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:22.264862 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d874740b-2152-4c7b-a585-1b542f689f97 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1338 microversion: 2.20 time: 0.259761 Oct 28 17:55:22.281488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2710/5305] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:22 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:22.924774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:22.926651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:22.941668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.943842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.946077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:22.955016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:22.955888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:22.960277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:23.296548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:23.297159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:23.325295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:23.325863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:23.326972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:23.329242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:23.329700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:23.330129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:23.438505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:23.518337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:23.534856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:23.539905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:23.545416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:23.546865 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b552018-8f1f-4cea-a740-befa7ddc2c13 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1338 microversion: 2.20 time: 0.254092 Oct 28 17:55:23.559404 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e4be4ac-d371-4776-a581-e3b23a76387c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.631368 Oct 28 17:55:23.559404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2596/5306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:22 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:23.569052 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2711/5307] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:23 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:24.592300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:24.593211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:24.602555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:24.607488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:24.608688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:24.609206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:24.609918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:24.611071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:24.611785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:24.621198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:24.625069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:24.625556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:24.625990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:24.640267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:24.641626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:24.642076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:25.300213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:25.314770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6031d5ad-f97b-40b7-bf76-baecc9ea9b56 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.721628 Oct 28 17:55:25.316323 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2597/5308] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:24 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:25.390183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:25.401142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:25.405035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:25.408199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9dbcd779-b1ec-469e-9cbb-29b8f00c0a6e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.809524 Oct 28 17:55:25.409363 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2712/5309] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:24 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:26.342580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:26.345767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:26.363627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:26.366125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:26.368377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:26.370127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:26.370745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:26.372326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:26.437921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:26.440560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:26.458242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:26.459039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:26.459734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:26.460632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:26.461249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:26.461848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:26.918981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:26.923973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:26.935617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5a711c7e-1c49-427f-af9d-17183d5084ca tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.596466 Oct 28 17:55:26.942004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:26.944218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2598/5310] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:26 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:26.952072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:26.956216 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c112914-6940-402a-89d3-5c50581642e4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.522520 Oct 28 17:55:26.985441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2713/5311] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:26 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:27.905719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:27.962942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:27.963098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:27.963919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:27.964161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:27.964597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:27.977687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:27.978901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:27.981574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:27.982565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:27.991837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:27.993143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:28.007713 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] Creating event network-changed:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:55:28.034762 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9e0c1816-5b8f-4564-b0ad-473297cd90fb req-d8ed6f3e-b95e-494a-a9d3-6fc92b10a9f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134594 Oct 28 17:55:28.040479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2599/5312] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:28.060699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:28.061866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:28.090970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:28.091900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:28.092331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:28.096561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:28.097030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:28.097462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:28.810444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:28.856682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:28.893332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:28.913736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:28.914388 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfeca906-f95b-4431-9f27-da98c16a7776 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.960014 Oct 28 17:55:28.922974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:28.928217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60605d89-e197-4e9f-9613-c1d165cf1385 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.886048 Oct 28 17:55:28.929401 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2714/5313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:27 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:28.936275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2600/5314] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:28 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:29.585830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a97a7e9-9348-4f4e-b653-a685ce55b366", "name": "network-vif-plugged", "status": "completed", "tag": "f9be6b22-6991-4c25-9787-dd10f072ba16"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:29.652998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:29.656796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:29.659434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:29.670617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=18 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:29.695520 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] Creating event network-vif-plugged:f9be6b22-6991-4c25-9787-dd10f072ba16 for instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 on n-h1-860864-13 Oct 28 17:55:29.704719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2383ca67-b4af-4412-8409-f4376ae34004 req-1465fed1-7544-467c-824f-2ccbe1aa40cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155908 Oct 28 17:55:29.707474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2715/5315] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:29.943590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:29.944878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:29.958957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:29.960666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:29.961331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:29.964139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:29.965958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:29.967815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:29.995613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:29.996781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:30.023141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:30.032445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:30.034157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:30.039136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:30.042503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:30.043208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:30.640194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:30.664023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:30.665758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:30.667127 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f06f07c-e3a2-4646-ac0e-4decb67b1ca5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.676299 Oct 28 17:55:30.680210 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2716/5316] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:29 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:30.704474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:30.712569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64ec1a58-6adf-4729-a81c-90394fe9df4f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1315 microversion: 2.1 time: 0.774270 Oct 28 17:55:30.716560 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2601/5317] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:29 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1315 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:31.698895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:31.699649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:31.720242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:31.720951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:31.721537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:31.722431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:31.723019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:31.728710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:31.742008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:31.743735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:31.762925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:31.768720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:31.769559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:31.770479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:31.774165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:31.774791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:32.888419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:32.898568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:32.909257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:32.910644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-19ce2c90-d7d3-42c4-a5ca-20c774a57fa6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 1.215932 Oct 28 17:55:32.911414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2717/5318] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:31 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:32.947165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:32.962466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e072afd8-e073-4a01-b2fe-8f20251ff839 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1502 microversion: 2.1 time: 1.224690 Oct 28 17:55:32.963228 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2602/5319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:31 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1502 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:32.990905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:32.991481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:33.001629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.002255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.002696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.003498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.004011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.005072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.143894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c5493904-68b7-448a-af04-ad140f648642 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.157594 Oct 28 17:55:33.163893 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2718/5320] 10.222.0.48 () {58 vars in 1296 bytes} [Fri Oct 28 17:55:32 2022] DELETE /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366/os-server-password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:55:33.165342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:33.166004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:33.184406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.185416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.186010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.186904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.187541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.188116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.259920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b745ba63-37e3-4c88-baca-2f2bad50263c tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.099307 Oct 28 17:55:33.260534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2603/5321] 10.222.0.48 () {58 vars in 1293 bytes} [Fri Oct 28 17:55:33 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366/os-server-password => generated 16 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:55:33.272779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:33.274276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:33.290240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.305054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-601123670", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "78f3cd5f-9631-4517-965d-0e43f9993756"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:33.307042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.311475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.321908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.385926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.068s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.386660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.440969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] validate_networks() for [('78f3cd5f-9631-4517-965d-0e43f9993756', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:55:33.450155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:55:33.504009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:33.611913 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93ef3561-204b-4a49-b886-ed40b5b2bc3a tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 204 len: 0 microversion: 2.1 time: 0.344341 Oct 28 17:55:33.615584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2719/5322] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:55:33 2022] DELETE /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:55:33.633556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:33.639623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:33.666241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.667135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.667871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:33.669430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:33.670505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:33.671221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:34.221222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:34.234176 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ca31dc2-fe27-45f5-a0df-2c9e3bd227bc tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1508 microversion: 2.1 time: 0.611307 Oct 28 17:55:34.247180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2720/5323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:33 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1508 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:34.257847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:34.258724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:34.266446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:34.267173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:34.267853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:34.268798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:34.269729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:34.270543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:35.016998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:35.027213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:35.028888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:35.030372 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c6917af-47c7-42a2-9c06-87f45d870839 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.781537 Oct 28 17:55:35.031792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2721/5324] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:34 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:55:35.099975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:55:35.101055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:55:35.101708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:55:35.102337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:55:35.103182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:55:35.118063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:35.123294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:35.123922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:35.124848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:35.125450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:35.126035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:35.168155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Getting quotas for project 9c6fc113b1334436be574812dac037cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:55:35.174379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Getting quotas for user 92578ba9a594468eafa07b5bbe913aed and project 9c6fc113b1334436be574812dac037cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:55:35.189556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:55:35.192184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:55:35.254887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de0f555c-39f5-4e42-9b38-5f6b03f5a1d3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954322 Oct 28 17:55:35.259343 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2604/5325] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:55:35.264173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:35.264790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:35.270586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8570627-7480-4453-b0bf-17fb74af4320 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:35.273184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8570627-7480-4453-b0bf-17fb74af4320 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:35.274649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:35.275286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:35.275623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:35.276398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:35.276747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:35.284607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:35.529971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8570627-7480-4453-b0bf-17fb74af4320 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:35.544948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8570627-7480-4453-b0bf-17fb74af4320 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1213 microversion: 2.1 time: 0.279027 Oct 28 17:55:35.546986 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2605/5326] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:35 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1213 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:36.059749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:36.060661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:36.085900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:36.086821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:36.087829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:36.088793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:36.089700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:36.090694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:36.785957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:36.808833 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-046487bc-103d-413b-acbe-919625e6070f tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1508 microversion: 2.1 time: 1.548785 Oct 28 17:55:36.821501 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2722/5327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:35 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1508 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:36.854680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "name": "network-vif-plugged", "status": "completed", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:36.870353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:36.870836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:36.871264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:36.901624 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] Creating event network-vif-plugged:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:55:36.919489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-85971642-81df-44f8-b3ce-056e89dc6d51 req-a8c5686e-c920-4e7d-8219-69a756f3e097 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092989 Oct 28 17:55:36.920772 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2723/5328] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:36.926095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:36.932774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:36.939510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:36.940224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:36.940818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:36.941671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:36.942271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:36.943690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:37.274519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:37.291671 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-85dea725-eb04-485b-a29a-547cca96f2e2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1265 microversion: 2.1 time: 0.369393 Oct 28 17:55:37.292639 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2724/5329] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:36 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:37.462250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:37.480273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:37.482366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:37.486527 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ebea315-e105-4074-9414-1d7bbe05141d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 1.432477 Oct 28 17:55:37.490181 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2606/5330] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:36 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:37.851115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:37.851815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:37.873267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:37.873769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:37.874275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:37.875223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:37.875967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:37.876402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:37.976825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b9427e30814dbdaf2ed8d337abcf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f56df11974fb4dfa8757aacf3ca3cb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:38.006690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e28dcf74-d3c5-4b8f-8992-eb2e10d95457 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 200 len: 1466 microversion: 2.1 time: 0.154436 Oct 28 17:55:38.010002 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2725/5331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:37 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:38.146440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a97a7e9-9348-4f4e-b653-a685ce55b366", "name": "network-vif-deleted", "tag": "f9be6b22-6991-4c25-9787-dd10f072ba16"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:38.168881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:38.169356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:38.169791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:38.201127 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] Creating event network-vif-deleted:f9be6b22-6991-4c25-9787-dd10f072ba16 for instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 on n-h1-860864-13 Oct 28 17:55:38.231958 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-cada59ec-89f1-4338-a264-fffa9a0abb9c req-2fb8d953-192c-4ea5-8a15-2d0ccad89487 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091451 Oct 28 17:55:38.235206 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2607/5332] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:55:38.321385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:38.322313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:38.331232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:38.334942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:38.337017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:38.339829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:38.341345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:38.341785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:38.521226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:38.525025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:38.525938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:38.538373 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-19cdb298-38c9-4527-bbd4-b4c43fba5f43 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1271 microversion: 2.1 time: 0.220315 Oct 28 17:55:38.539384 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2726/5333] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:38 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:38.541929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:38.543884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:38.544469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:38.545767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:38.548452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:38.551685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:39.006839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:39.029405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:39.036416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:39.037114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:39.038253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] [instance: 4a97a7e9-9348-4f4e-b653-a685ce55b366] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:39.041556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:39.042780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-167aff93-d615-4ac5-a547-00b5d7e2bff4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1406 microversion: 2.20 time: 0.518552 Oct 28 17:55:39.063411 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2608/5334] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:38 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:39.088671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:39.089482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:39.090100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:39.091035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:39.091762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:39.092247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:39.125264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] HTTP exception thrown: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Request method failure captured: Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 HTTP/1.1 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBd8374fQmqDTcqTWcerJVYEs2fSiesd3sIhx18iVZh7OSP7UQAcPqe_CyTm82DVWbJFJeBNSV-w9CW6R--OI2EdyreZHKYDxrNrDS7g2zRwwkBHLsmrIWGowZz_YGke78yQyB5EGaqW-fcj-F6Y2jMSO_OQxwjPWyTpUZAIBsbWtFo Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: f56df11974fb4dfa8757aacf3ca3cb09 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerPasswordTestJSON-1994608846 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f56df11974fb4dfa8757aacf3ca3cb09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f56df11974fb4dfa8757aacf3ca3cb09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f56df11974fb4dfa8757aacf3ca3cb09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f56df11974fb4dfa8757aacf3ca3cb09"}]}] Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerPasswordTestJSON-1994608846 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: f56df11974fb4dfa8757aacf3ca3cb09 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1994608846 Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerPasswordTestJSON-1994608846-project Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 27b9427e30814dbdaf2ed8d337abcf1d Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerPasswordTestJSON-1994608846-project Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '4a97a7e9-9348-4f4e-b653-a685ce55b366'} Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:39.126987 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. Oct 28 17:55:39.131182 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:55:39.135446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] Returning 404 to user: Instance 4a97a7e9-9348-4f4e-b653-a685ce55b366 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:55:39.139659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b172f026-19ec-4bb0-80b4-5e299928e959 tempest-ServerPasswordTestJSON-1994608846 tempest-ServerPasswordTestJSON-1994608846-project] 10.222.0.48 "GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366" status: 404 len: 111 microversion: 2.1 time: 0.107340 Oct 28 17:55:39.140538 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2727/5335] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:39 2022] GET /compute/v2.1/servers/4a97a7e9-9348-4f4e-b653-a685ce55b366 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:55:39.580333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:39.584312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:39.621918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:39.623711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:39.629143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:39.631240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:39.635008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:39.635617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:40.078375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.079172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:40.092571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:40.093370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:40.100336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:40.101348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:40.105384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:40.106158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:40.654289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:40.664820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9762bb7-c073-4db1-b2fc-f4c33d067f68 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 1.095932 Oct 28 17:55:40.666273 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2609/5336] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:39 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:40.939896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:40.953636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:40.955106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:40.963165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bd5e7af-d32b-4714-9933-ad054c47cffc tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1597 microversion: 2.20 time: 0.887053 Oct 28 17:55:40.988228 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2728/5337] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1597 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:55:40.996230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:40.996750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:41.011938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:41.012359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:41.012786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:41.013501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:41.013951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:41.014372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:41.214351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00562b69-7e34-474a-9c38-fffb77111842 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.222634 Oct 28 17:55:41.214960 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2610/5338] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Oct 28 17:55:40 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-interface => generated 284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:55:41.711997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:41.718409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:41.767034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:41.771975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:41.774200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:41.776613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:41.780725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:41.784638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:42.300943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:42.315742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6764d21a-c829-478d-9333-c62eaf4684e9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.625469 Oct 28 17:55:42.316724 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2729/5339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:41 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:43.024492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78a1432-b2c8-4fee-89ef-b274037a84eb", "tag": "215ff75c-ea69-4bb3-842e-8ffc6fe087ed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:43.048172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:43.053373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:43.054351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:43.084930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] Creating event network-changed:215ff75c-ea69-4bb3-842e-8ffc6fe087ed for instance b78a1432-b2c8-4fee-89ef-b274037a84eb on n-h2-860864-13 Oct 28 17:55:43.097676 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5e8989c4-d6d7-4c5e-a66f-9cfc6ba899a2 req-6b42a11e-a8bd-4b7b-ab85-eae42c338b9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078787 Oct 28 17:55:43.100653 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2611/5340] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:43.340316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:43.340926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:43.351578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:43.357673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:43.358353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:43.359284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:43.361466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:43.362090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:44.068112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:44.078133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee2056fa-e9d3-48f0-85ae-17c755d6293a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.741684 Oct 28 17:55:44.088139 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2730/5341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:43 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:45.115672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:45.116480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:45.130373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:45.132928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:45.134998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:45.137041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:45.138654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:45.139394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:45.143851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:45.318758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1760970650", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:45.425587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] validate_networks() for [('f77b061d-e7ef-4fd5-b30a-b8ae1f30e705', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:55:45.543506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:45.605535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:45.644054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-515f488e-810f-4e5f-8992-6a1659017076 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.532858 Oct 28 17:55:45.652180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2731/5342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:45 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:45.670713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:45.709748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:45.716136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:45.718902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:45.761430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] Creating event network-changed:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:55:45.775774 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6fbccfba-50b2-47ea-b7ce-223037010397 req-3be68293-6eea-43ca-a913-b8f0b258cc01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120633 Oct 28 17:55:45.777486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2732/5343] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:46.680868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:46.681881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:46.700879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:46.707269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:46.708816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:46.709717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:46.710423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:46.710970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:48.106720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:55:48.107735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:55:48.108290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:55:48.109264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:55:48.109919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:55:48.115764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:48.133528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:48.135736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:48.137611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:48.140197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:48.141885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:48.142805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:48.146461 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-11619378-8b76-4c12-a0c6-35e8398a3dc1 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 1.471828 Oct 28 17:55:48.149725 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2733/5344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:46 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:48.196830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Getting quotas for project 667da1a2b1c24fe8807a4af03e7a3b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:55:48.203753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Getting quotas for user 86eed03bb1414f038da85d3742f9a9cc and project 667da1a2b1c24fe8807a4af03e7a3b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:55:48.220353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:55:48.224339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:55:48.344715 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-038bb270-9040-40aa-946e-0c58caf75929 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.274136 Oct 28 17:55:48.378206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db58aab3-efae-4bfa-ae14-ce24be9cc093 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:48.379101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db58aab3-efae-4bfa-ae14-ce24be9cc093 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:48.397403 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2612/5345] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:55:48.518264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db58aab3-efae-4bfa-ae14-ce24be9cc093 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:48.526826 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db58aab3-efae-4bfa-ae14-ce24be9cc093 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1217 microversion: 2.1 time: 0.172613 Oct 28 17:55:48.555697 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2734/5346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:48 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:49.175978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:49.177187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:49.185697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:49.213285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:49.213781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:49.214216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:49.220681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:49.221331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:49.225039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:49.549941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:49.550554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:49.578374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:49.579168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:49.579912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:49.580794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:49.581253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:49.581672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:50.660577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:50.678898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41bb4c23-deeb-49a7-841e-1840a2096efc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1221 microversion: 2.1 time: 1.132625 Oct 28 17:55:50.683137 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2735/5347] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:49 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1221 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:50.699781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:50.700278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:50.714451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:50.715929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:50.716545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:50.717730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:50.718396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:50.719093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:50.756346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:55:50.865572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:50.875248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=86 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:50.882208 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7e3c8c0-6cbe-4955-8aa1-6f9f472ed119 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 1.710893 Oct 28 17:55:50.890617 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2613/5348] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:49 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:50.917530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93a4b822-8653-4291-abab-d771de80b115 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 204 len: 0 microversion: 2.1 time: 0.231875 Oct 28 17:55:50.919334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2736/5349] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:55:50 2022] DELETE /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:55:50.929007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:50.929626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:50.943801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:50.944325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:50.944814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:50.947329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:50.947834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:50.949448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:51.376217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:51.386759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b664a22-08da-443b-9acc-9ec98299c9f1 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1666 microversion: 2.1 time: 0.462903 Oct 28 17:55:51.388445 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2614/5350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:50 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1666 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:51.711621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:51.714119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:51.742409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:51.742409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:51.750067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:51.752705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:51.754074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:51.754607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:51.769775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:51.906900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:51.908735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:51.922067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:51.924080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:51.926618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:51.929523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:51.931698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:51.932365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:51.939899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:51.959659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5747278-6312-474a-9126-f18b010f600f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1275 microversion: 2.1 time: 0.253175 Oct 28 17:55:51.962899 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2737/5351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:51 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:52.413003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:52.415685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:52.437415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:52.438268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:52.439847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:52.479393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:52.482449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:52.486017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:52.565333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:52.588897 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65e069cc-7a61-46ea-81b1-d71fd941807d tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.686453 Oct 28 17:55:52.596685 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2615/5352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:51 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:52.990660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:52.991983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:53.005253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:53.007459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:53.008062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:53.009739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:53.010517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:53.011090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:53.539509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:53.549025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7b9b40f-0e16-422f-86ed-dace1f256564 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1666 microversion: 2.1 time: 1.141052 Oct 28 17:55:53.549819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2738/5353] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:52 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1666 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:53.623293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:53.623843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:53.638353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:53.638853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:53.639288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:53.640020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:53.640473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:53.640895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:53.805537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:53.821200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81d32463-3169-4789-8098-de738769b61e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1275 microversion: 2.1 time: 0.828092 Oct 28 17:55:53.822163 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2616/5354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:52 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1275 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:54.577628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:54.578281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:54.594182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:54.601759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:54.602206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:54.606006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:54.610357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:54.612436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:54.634902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:54.648792 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6ac1cc3-8409-47cb-bc7b-d026be71362c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 1.029296 Oct 28 17:55:54.649397 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2739/5355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:53 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:54.848617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:54.849230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:54.866363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:54.871253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:54.872246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:54.872521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:54.875788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:54.876334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:55.214966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd568f170bf874dd68cc22b2ed0106a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9040461111d2497ab28105c19e40d32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:55.233229 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1fef47d4-ddbe-4e6c-aba8-f4cf5d08320e tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 200 len: 1599 microversion: 2.1 time: 0.659914 Oct 28 17:55:55.258664 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2617/5356] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:54 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 1599 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:55.264245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e533d85a-3af8-4af0-a399-bddd2a8f87cb", "name": "network-vif-deleted", "tag": "a004a3e1-ac61-429f-8b89-1b5969b4606b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:55.312745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:55.313242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:55.313673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:55.358408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] Creating event network-vif-deleted:a004a3e1-ac61-429f-8b89-1b5969b4606b for instance e533d85a-3af8-4af0-a399-bddd2a8f87cb on n-h1-860864-13 Oct 28 17:55:55.374855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0d7bce3d-ef72-48e6-b675-8026bbe20968 req-a9a27c86-908d-4070-80be-730ec8d5c619 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114513 Oct 28 17:55:55.381506 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2618/5357] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:55.397518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78a1432-b2c8-4fee-89ef-b274037a84eb", "name": "network-vif-plugged", "status": "completed", "tag": "215ff75c-ea69-4bb3-842e-8ffc6fe087ed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:55.431653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:55.434626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:55.435113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:55.435578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:55.467171 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0809c5e-26e8-4182-91aa-53131ed070f3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.622627 Oct 28 17:55:55.471841 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2740/5358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:54 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:55:55.490783 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] Creating event network-vif-plugged:215ff75c-ea69-4bb3-842e-8ffc6fe087ed for instance b78a1432-b2c8-4fee-89ef-b274037a84eb on n-h2-860864-13 Oct 28 17:55:55.507727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f05d7185-b904-409d-9180-0ea92cf808d7 req-e62a0ebe-8f9a-4b7e-9b2c-bad7f2491037 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124522 Oct 28 17:55:55.513135 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2619/5359] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:55.677197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:55.678529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:55.697205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:55.697722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:55.698243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:55.699007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:55.699491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:55.699927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:56.264111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:56.265036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] [instance: e533d85a-3af8-4af0-a399-bddd2a8f87cb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:56.267117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:56.281887 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c4b9a35-2bda-4765-b40b-3e23dbac55b2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.608718 Oct 28 17:55:56.282452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:56.283125 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2741/5360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:55 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:56.291595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:56.291595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:56.291595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:56.291595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:56.291595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:56.335994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] HTTP exception thrown: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Request method failure captured: Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb HTTP/1.1 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBdC2DPqaA3EtGQ19IJKTh8QIAwm4BqiSTpafGfD0Vp0y3wzsyW2Xm0bnX3fu1dtJKGRFRFfVHqjcC6U_Ki3_eHXpMVDodjEACiev2ePpg4r9ZhIBsA1VAaVzfVehjqK-4a30UnXgT1216_oGJj0CkVMAHIfxHcs3MGncsA0ThgwSvY Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9040461111d2497ab28105c19e40d32a Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersTestFqdnHostnames-1689586598 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9040461111d2497ab28105c19e40d32a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9040461111d2497ab28105c19e40d32a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9040461111d2497ab28105c19e40d32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9040461111d2497ab28105c19e40d32a"}]}] Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersTestFqdnHostnames-1689586598 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9040461111d2497ab28105c19e40d32a Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1689586598 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersTestFqdnHostnames-1689586598-project Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d568f170bf874dd68cc22b2ed0106a03 Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersTestFqdnHostnames-1689586598-project Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e533d85a-3af8-4af0-a399-bddd2a8f87cb'} Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:55:56.341508 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. Oct 28 17:55:56.345237 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:55:56.347181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Returning 404 to user: Instance e533d85a-3af8-4af0-a399-bddd2a8f87cb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:55:56.349569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b206272f-7eb0-4740-9396-08a79f3e02d3 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb" status: 404 len: 111 microversion: 2.1 time: 0.092355 Oct 28 17:55:56.358322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2620/5361] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:56 2022] GET /compute/v2.1/servers/e533d85a-3af8-4af0-a399-bddd2a8f87cb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:55:56.378999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a76bb42-1b2c-422c-91ce-898571d19f48 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] Calling method '.version_select at 0x7f75248dfaf0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:56.408753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a76bb42-1b2c-422c-91ce-898571d19f48 tempest-ServersTestFqdnHostnames-1689586598 tempest-ServersTestFqdnHostnames-1689586598-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689245528" status: 202 len: 0 microversion: 2.1 time: 0.040060 Oct 28 17:55:56.409789 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2742/5362] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 17:55:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689245528 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:55:56.497443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:56.498315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:56.513346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:56.513938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:56.514619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:56.515457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:56.515986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:56.516481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:57.212113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:57.221667 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0951144b-7921-4247-8d37-cb409b4b80e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.729511 Oct 28 17:55:57.246795 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2621/5363] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:56 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:57.308790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:57.309440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:57.322128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:57.322670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:57.323050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:57.323790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:57.329667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:57.330438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:57.878192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:57.889737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d249561-64ab-4e68-86bc-4d906f475ddf tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1313 microversion: 2.1 time: 0.584837 Oct 28 17:55:57.893975 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2743/5364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:57 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:58.219740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:55:58.239795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:58.243185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:58.251592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:58.252259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:58.272053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:58.272562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:58.273002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:58.279181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:58.279728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:58.280173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:58.280894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:58.281349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:58.281773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:58.313820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] Creating event network-changed:84511947-c6da-4a50-aee3-30f88c1fd9ee for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 on n-h1-860864-13 Oct 28 17:55:58.343417 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-32b9a4ba-cff8-4bea-8162-3bbe53187331 req-57123a5a-36ba-4ddd-bb79-5d358a3d123b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127564 Oct 28 17:55:58.347139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2622/5365] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:55:58.522902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:55:58.698612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:55:58.730489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a23aea48-ef3a-4291-802b-18b2e0f4ca3d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.482639 Oct 28 17:55:58.732002 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2744/5366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:58 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:55:58.921352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:58.921972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:58.930758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:58.931639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:58.932291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:58.933822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:58.934536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:58.935176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:59.756282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:55:59.756833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:55:59.766830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:59.769711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:59.772459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:55:59.774810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:55:59.776694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:55:59.777389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:00.450130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:00.476097 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9b6bd01-9c98-4951-ba65-9eb2f7310b2f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1497 microversion: 2.1 time: 1.563678 Oct 28 17:56:00.485367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2623/5367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:58 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1497 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:00.602966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:00.621215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73469ca7-f4c9-458c-9b0e-e80874191c3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.871435 Oct 28 17:56:00.630716 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2745/5368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:55:59 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:01.326517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:01.327188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:01.340657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.342729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.344539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:01.346064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.347868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.351841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:01.428878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:56:01.649935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:01.650916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:01.683144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.690737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.693244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:01.696652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.701386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.702362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:01.763991 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd6c7149-4a45-4114-bf4f-2b50239a23a9 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 204 len: 0 microversion: 2.1 time: 0.439138 Oct 28 17:56:01.769867 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2624/5369] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:56:01 2022] DELETE /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:56:01.782830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:01.785482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:01.806330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.811014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.811628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:01.812491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:01.813952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:01.814492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:02.520361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:02.532150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b8e90c4-e067-4c2e-85ab-6cbff737b9d2 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1503 microversion: 2.1 time: 0.760036 Oct 28 17:56:02.540310 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2625/5370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:01 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1503 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:02.786954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:02.795233 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e25509ce-4e90-41d9-87b4-b674016611d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 1.150742 Oct 28 17:56:02.806673 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2746/5371] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:01 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:03.566893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:03.567730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:03.578294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:03.581161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:03.581721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:03.583210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:03.585216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:03.586457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:03.828856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:03.829376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:03.845252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:03.846154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:03.848673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:03.849749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:03.851913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:03.854132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:04.196909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:04.212915 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9179eaa3-6b83-4392-8195-37655b414da3 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 200 len: 1461 microversion: 2.1 time: 0.648686 Oct 28 17:56:04.214812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2626/5372] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:03 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 1461 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:04.224651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78a1432-b2c8-4fee-89ef-b274037a84eb", "name": "network-vif-deleted", "tag": "215ff75c-ea69-4bb3-842e-8ffc6fe087ed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:04.240451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:04.241090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:04.241788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:04.265979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] Creating event network-vif-deleted:215ff75c-ea69-4bb3-842e-8ffc6fe087ed for instance b78a1432-b2c8-4fee-89ef-b274037a84eb on n-h2-860864-13 Oct 28 17:56:04.273744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9229c7bd-3cb7-4be2-907c-edee66218197 req-285663b6-9d84-4487-a1d9-51e608ed6244 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057236 Oct 28 17:56:04.275063 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2627/5373] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:04.707730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:04.730278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b880c2c3-137d-491f-bf3c-7e590e33545e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.906193 Oct 28 17:56:04.730910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2747/5374] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:05.242356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:05.243681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: b78a1432-b2c8-4fee-89ef-b274037a84eb] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:05.262595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:05.272145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:05.274374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:05.277749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:05.278346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:05.279741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:05.314251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] HTTP exception thrown: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Request method failure captured: Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb HTTP/1.1 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeRka3eW5KWEgOgdchQpsjdVv3-7diu_XmS5UGKNJoLJkcQrHkWUtVdjuZ1Wm6jlJE2xk91L1ZEJz26My8gfzm9W5ickzfwz0F9NkdKVCwWpukEB3AX0gIwieEsapLIeu2BPFaeCLIY7mz5fcSj3gUpOdVx_Klx1qwRVTjbrhJhS4A Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9c6fc113b1334436be574812dac037cc Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6fc113b1334436be574812dac037cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6fc113b1334436be574812dac037cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6fc113b1334436be574812dac037cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6fc113b1334436be574812dac037cc"}]}] Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9c6fc113b1334436be574812dac037cc Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesActionsTest-1086043590-project Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 92578ba9a594468eafa07b5bbe913aed Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesActionsTest-1086043590-project Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b78a1432-b2c8-4fee-89ef-b274037a84eb'} Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:05.327687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. Oct 28 17:56:05.331189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:05.337370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Returning 404 to user: Instance b78a1432-b2c8-4fee-89ef-b274037a84eb could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:56:05.338745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af1fd8a7-d7d9-41ba-82dd-de4a2a98bd18 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb" status: 404 len: 111 microversion: 2.1 time: 0.101619 Oct 28 17:56:05.339922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2628/5375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:05 2022] GET /compute/v2.1/servers/b78a1432-b2c8-4fee-89ef-b274037a84eb => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:56:05.669783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2130818507", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "78f3cd5f-9631-4517-965d-0e43f9993756"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:05.759399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:05.760443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:05.772685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:05.774969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:05.776759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:05.779659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:05.783113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:05.783916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:06.596756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:06.609369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-44345994-13ac-4213-b0c9-3ad08cf33782 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.852236 Oct 28 17:56:06.610358 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2629/5376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:05 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:07.635044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:07.636541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:07.656929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:07.661613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:07.662441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:07.663592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:07.664541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:07.665234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:08.045402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:08.059975 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19d4d73f-0e5c-4def-8762-6a079ba71626 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.424294 Oct 28 17:56:08.060857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2630/5377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:07 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:09.090295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:09.090906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:09.107400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:09.109966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:09.113123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:09.115923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:09.116612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:09.118730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:09.542345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:09.554057 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b98f7cd1-29e4-477f-8607-0aa3b3255574 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.467633 Oct 28 17:56:09.555249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2631/5378] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:09 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:09.809356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0770acfd-ecef-4d5d-b93a-6ad73d7a816e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: .version_select at 0x7f7524bdd1f0>, body: {"keypair": {"name": "tempest-keypair-1698402751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZvk/8CnaLr8r19tb8OzKT0HbORLEU0ggGBJVclS9Tf6y/GaeO8H1kwYIRS7JbG533iyywdV8DUd+QlVvaiHxBQD5WNg/GAB5ROakLSS7379iqhvwXESy057XXvGkoMzg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:09.840562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0770acfd-ecef-4d5d-b93a-6ad73d7a816e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:56:09.847580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-0770acfd-ecef-4d5d-b93a-6ad73d7a816e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for user f6f45bc3e1be43878f3d43f3ba870cc6 and project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:56:09.885132 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0770acfd-ecef-4d5d-b93a-6ad73d7a816e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.326432 Oct 28 17:56:09.892218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2632/5379] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:56:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:10.580558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:10.581177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:10.628434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:10.632755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:10.633300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:10.636191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:10.638261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:10.642238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:11.036792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:11.041075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:11.072969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef692826-5a9e-4b70-b1cc-8d6a0ed0202b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.497103 Oct 28 17:56:11.076068 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2633/5380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:11.094407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "name": "network-vif-plugged", "status": "completed", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:11.128180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:11.133291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:11.136188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:11.192017 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] Creating event network-vif-plugged:84511947-c6da-4a50-aee3-30f88c1fd9ee for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 on n-h1-860864-13 Oct 28 17:56:11.208291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1a2cb32e-019e-41bb-88df-5ee267c18f0f req-82b89a67-1d4a-4f13-8130-20003347aa34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129122 Oct 28 17:56:11.213216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2634/5381] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:12.100977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:12.101915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:12.118194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:12.118689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:12.119123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:12.119902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:12.120288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:12.120713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:12.724886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:12.736531 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a93d255-33a2-4277-a4c6-a328666db3f1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1317 microversion: 2.1 time: 0.641729 Oct 28 17:56:12.747623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2635/5382] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:13.772597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:13.773202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:13.786347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:13.786847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:13.791706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:13.792352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:13.792824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:13.793346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:14.615185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:14.640549 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-464a90a5-a22a-4534-a3b2-4f63932c853a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.872620 Oct 28 17:56:14.655950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2636/5383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:14.717640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=59 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:14.901382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1918025924", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90955362-9ae1-4331-9c4d-327ae4902862"}], "security_groups": [{"name": "tempest-securitygroup--575287850"}], "key_name": "tempest-keypair-1698402751", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:15.729163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:19.857888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:24.164124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] validate_networks() for [('78f3cd5f-9631-4517-965d-0e43f9993756', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:56:24.470436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] validate_networks() for [('90955362-9ae1-4331-9c4d-327ae4902862', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:56:24.622963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=15 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:24.940652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:25.812073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:56:25.813087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:56:25.813911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:56:25.814733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:56:25.815327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:56:25.838200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:25.838978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:25.839615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:25.840537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:25.841166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:25.842644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:25.895400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Getting quotas for project 9c6fc113b1334436be574812dac037cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:56:25.921111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Getting quotas for user 92578ba9a594468eafa07b5bbe913aed and project 9c6fc113b1334436be574812dac037cc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:56:25.976934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:56:25.987818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:56:26.070314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b873f9eb-894d-49c5-8828-4314abc7fdf7 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 20.405829 Oct 28 17:56:26.071323 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2748/5384] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 20408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:56:26.093879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-211966778", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:26.138351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:56:26.138832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:56:26.139226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:56:26.139667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:56:26.140074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:56:26.180633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:26.181124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:26.181560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:26.182285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:26.182739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:26.183162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:26.214277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] validate_networks() for [('f77b061d-e7ef-4fd5-b30a-b8ae1f30e705', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:56:26.259050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:56:26.273145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for user f6f45bc3e1be43878f3d43f3ba870cc6 and project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:56:26.289461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:56:26.292793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:56:26.382668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9940a19-1c04-4ce3-b012-8adf4575587b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 11.489575 Oct 28 17:56:26.388616 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2637/5385] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 11496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:56:26.918015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1029463407", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:27.018309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] validate_networks() for [('4b7287a8-7e5e-4176-a733-3e629774da91', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:56:27.674363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:56:27.675054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:56:27.675893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:56:27.676371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:56:27.676887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:56:27.710229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:27.710731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:27.717629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:27.718765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:27.719291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:27.719765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:27.801890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Getting quotas for project 667da1a2b1c24fe8807a4af03e7a3b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:56:27.818006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Getting quotas for user 86eed03bb1414f038da85d3742f9a9cc and project 667da1a2b1c24fe8807a4af03e7a3b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:56:27.891919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:56:27.897497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:56:28.057968 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-650f233c-f55c-4644-8937-425d9bb3e587 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.974154 Oct 28 17:56:28.060804 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2749/5386] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:56:28.081146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:28.085716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:28.122297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.122721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.127346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.128085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.136068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.137099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.376441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:28.397323 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2589ea75-e5dc-4b68-86d6-e68f892b2266 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1266 microversion: 2.1 time: 0.334136 Oct 28 17:56:28.402832 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2750/5387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:28 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:28.427036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:28.429448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:28.461692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.463080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.466144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.471091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.473879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.476283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.789214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:28.804757 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-89b7b51c-00dc-43e0-b639-ca0058873216 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1290 microversion: 2.1 time: 0.397021 Oct 28 17:56:28.805421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2751/5388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:28 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1290 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:28.826088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-897057cc-0a41-4b1b-9ac6-8d8e441f4c52 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:28.829959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-897057cc-0a41-4b1b-9ac6-8d8e441f4c52 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:28.871993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:56:28.873508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:56:28.875611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:56:28.876615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:56:28.882845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:56:28.905254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.912298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.913388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.915284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:28.917407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:28.918234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:28.973671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-897057cc-0a41-4b1b-9ac6-8d8e441f4c52 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:28.984242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-897057cc-0a41-4b1b-9ac6-8d8e441f4c52 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1216 microversion: 2.1 time: 0.177660 Oct 28 17:56:28.990068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2752/5389] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:28 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:29.029353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Getting quotas for project d5e107ff184342b8bf8c23f467134d69. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:56:29.049471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Getting quotas for user f2b91bf30bbe4fee97e31179f4bd1238 and project d5e107ff184342b8bf8c23f467134d69. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:56:29.083005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:56:29.088721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:56:29.277503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9277fca-399a-4ad7-97bd-49f4ae2c1045 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.887438 Oct 28 17:56:29.294474 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2638/5390] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:56:29.297707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-266874bd-af23-4b80-a10d-39155bff1ece tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:29.298390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-266874bd-af23-4b80-a10d-39155bff1ece tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:29.427231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:29.428535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:29.451820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:29.452620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:29.453331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:29.454377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:29.455071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:29.457165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:29.460478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-266874bd-af23-4b80-a10d-39155bff1ece tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:29.471679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-266874bd-af23-4b80-a10d-39155bff1ece tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1223 microversion: 2.1 time: 0.176946 Oct 28 17:56:29.474933 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2753/5391] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:29 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1223 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:29.718380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:29.733711 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b1d6954-6a22-4d38-88f8-23c67ec3aaff tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1272 microversion: 2.1 time: 0.311415 Oct 28 17:56:29.764442 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2639/5392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:29 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:29.839603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:29.840228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:29.858631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:29.866559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:29.867534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:29.868764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:29.869412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:29.870081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:29.961251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:29.985097 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab8ee7f2-731c-45ab-991e-0149bbdb763b tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1308 microversion: 2.1 time: 0.154378 Oct 28 17:56:29.989401 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2754/5393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:29 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:30.023168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:30.027017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:30.041485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:30.045358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:30.046342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:30.049231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:30.052232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:30.052897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:30.267173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:30.279477 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-daf44845-cae5-4f4f-b41f-e53e0ec7d994 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1268 microversion: 2.1 time: 0.266164 Oct 28 17:56:30.280483 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2640/5394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:30 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:30.499209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-878a0941-4754-46e8-80af-2c4773fd0c76 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:30.499851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-878a0941-4754-46e8-80af-2c4773fd0c76 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:30.656481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-878a0941-4754-46e8-80af-2c4773fd0c76 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:30.665483 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-878a0941-4754-46e8-80af-2c4773fd0c76 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1223 microversion: 2.1 time: 0.170091 Oct 28 17:56:30.665754 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2755/5395] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:30 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:30.794946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:30.795954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:30.810848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:30.812616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:30.814058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:30.814957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:30.818083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:30.818749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:30.971393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:30.984912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7b1f502-87ba-4728-819c-4d0784e6b345 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1272 microversion: 2.1 time: 0.195374 Oct 28 17:56:30.988994 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2641/5396] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:30 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:31.021312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:31.022698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:31.040797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.042705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.043396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.045781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.046264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.051625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.240427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:31.261859 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38623b79-db47-448e-a3e3-9602f7ef79fd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1296 microversion: 2.1 time: 0.243721 Oct 28 17:56:31.268259 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2756/5397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:31 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1296 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:31.305380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:31.306189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:31.318263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.318778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.319224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.321870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.323106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.323551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.694432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:31.695676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:31.712383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.712921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.713366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.726483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:31.726990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:31.727717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:31.852690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:31.864895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c42079ff-9de4-4179-b820-cc954da6da53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1274 microversion: 2.1 time: 0.564977 Oct 28 17:56:31.869663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2642/5398] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:31 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1274 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:31.989231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:32.000930 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6874e6ad-57ba-48ee-b88c-1f54fd5a83f3 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1283 microversion: 2.1 time: 0.311431 Oct 28 17:56:32.006099 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2757/5399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:31 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1283 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:32.011378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:32.011997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:32.023704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.024203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.027142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:32.030210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.030709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.032940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:32.292135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:32.293465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:32.304087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.305652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.307106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:32.310095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.311217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.311899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:32.521927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:32.530507 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2651dfe2-baa0-4dfc-b8b9-977f55fbb9db tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1296 microversion: 2.1 time: 0.242422 Oct 28 17:56:32.541265 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2758/5400] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:32 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1296 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:32.712006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:32.733372 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56e18087-49ec-4cc4-bcf6-4f5ff4b240be tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.720927 Oct 28 17:56:32.734712 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2643/5401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:32 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:32.892409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:32.893414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:32.905488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.906398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.907063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:32.909184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:32.918255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:32.919131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.028054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:33.028848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:33.035461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.039909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.040458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.044253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.044865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.045405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.171244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:33.188906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b399c04a-6eb4-4303-83f5-726d392c6288 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1281 microversion: 2.1 time: 0.164458 Oct 28 17:56:33.189448 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2644/5402] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:33 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:33.457970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:33.471095 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eeb80290-44ea-4964-a0d5-6ffb7544d0ca tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.582741 Oct 28 17:56:33.471807 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2759/5403] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:32 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:33.572668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:33.575853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:33.595097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.601623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.602156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.603207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.604432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.606970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.763512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:33.764680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:33.776363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.779340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.781625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.782975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:33.785622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:33.786231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:33.842975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:33.852644 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d2818d3-2de8-4a25-8b23-5a4100b5185e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1296 microversion: 2.1 time: 0.287769 Oct 28 17:56:33.853254 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2645/5404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:33 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1296 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:34.101979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:34.110189 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36ec413d-794b-481d-bb21-dbf0c9ce0a11 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.352280 Oct 28 17:56:34.110771 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2760/5405] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:33 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:34.216790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:34.217409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:34.228958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cfe9b7-50fe-4906-a4fd-3499b128f2aa", "tag": "7a048bee-fee3-43f6-8f4e-21c8268f3b70"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:34.244701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.246428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.250123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.251311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.252438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.252949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.254391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.255229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.256647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.293972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] Creating event network-changed:7a048bee-fee3-43f6-8f4e-21c8268f3b70 for instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa on n-h1-860864-13 Oct 28 17:56:34.310353 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-90d17a82-aedb-40c8-aa22-8f4542eec889 req-a6b5cbf5-6fd3-4f41-b341-0117e3687429 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085592 Oct 28 17:56:34.311288 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2761/5406] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:34.474679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:34.491033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b46f304-fe25-4c00-9585-d872d3b132ec tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1281 microversion: 2.1 time: 0.278937 Oct 28 17:56:34.494159 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2646/5407] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:34 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:34.499634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:34.500405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:34.516297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.517391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.518256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.519423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.519992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.523290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.883541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:34.884469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:34.885999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:34.900449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ebb4888f-e5df-4df7-84bf-e1ac86e1be5d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.405326 Oct 28 17:56:34.904205 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2762/5408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:34 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:34.911513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.913779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.914822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:34.915645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:34.918473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:34.918920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.092687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:35.110937 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-07b41009-9a7c-4788-a56c-a2be519ffd75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1296 microversion: 2.1 time: 0.237989 Oct 28 17:56:35.115545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2647/5409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:34 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1296 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:35.151331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:35.153123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:35.165172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.165900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.166517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.167590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.168353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.169010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.505100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:35.521950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:35.522938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:35.542802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.543137 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6949ecb-a614-4a16-b495-c77c17fcfa9f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.385046 Oct 28 17:56:35.544279 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2763/5410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:35 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:35.546535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.550639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.552019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.552449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.552922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.832599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:35.854381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b564b015-d482-4891-9782-d9cd341c91d8 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.335799 Oct 28 17:56:35.856992 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2648/5411] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:35 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:35.928959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:35.930629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:35.953278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.955772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.957081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:35.959328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:35.960452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:35.962690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.137098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:36.137718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:36.146365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.147445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.151041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.156358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.158296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.162617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.328622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:36.342602 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f91a367-a194-43b4-9b52-6a79cb7d9e3c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1296 microversion: 2.1 time: 0.209657 Oct 28 17:56:36.344276 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2649/5412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:36 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:36.377756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:36.387500 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43cb3668-42ed-4112-8e75-8d49159fe1b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.465063 Oct 28 17:56:36.397707 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2764/5413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:35 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:36.570807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:36.571590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:36.594280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.596071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.596791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.601039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.601737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.605513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.881056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:36.882456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:36.894873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.897359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.900581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.902318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:36.903573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:36.904288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:36.924718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:36.942520 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c6b7b892-1341-4e30-b510-ddb86fd21d20 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.372158 Oct 28 17:56:36.943538 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2650/5414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:36 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:37.108292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:37.121062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0cfe09c7-ad28-469a-9386-fba985be7c9c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.245473 Oct 28 17:56:37.121986 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2765/5415] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:36 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:37.374097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:37.375355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:37.389113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.392573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.393386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:37.395246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.397167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.397798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:37.420070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:37.420689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:37.436866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.438003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.439160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:37.440131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.443886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.444757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:37.754720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:37.837540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:37.841334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:37.864584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c625046-03dc-4d9a-a405-4bc9cc8b8eb6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.493361 Oct 28 17:56:37.866549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2651/5416] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:37 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:37.869045 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43874f2e-ae59-4a7f-b17e-4988b30ed5b2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.452799 Oct 28 17:56:37.869637 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2766/5417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:37 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:37.967120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:37.968131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:37.977100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.978425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.979309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:37.980466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:37.981491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:37.982169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.147035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6eabbaf-f8dc-4508-8c4b-dff707b00ba1", "tag": "cae8cdb9-6d45-447a-8170-590dd43e8c55"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:38.174404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.184000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.184812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.207499 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] Creating event network-changed:cae8cdb9-6d45-447a-8170-590dd43e8c55 for instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 on n-h2-860864-13 Oct 28 17:56:38.216986 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8b291ace-5864-4f42-9cbb-95287fff01d6 req-6eedcb3f-941d-46fa-97b8-ddf8f73fad49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075001 Oct 28 17:56:38.221351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2767/5418] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:38.244958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:38.245990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:38.253511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.254007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.254445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.255146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.255622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.260149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.416060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:38.427896 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af307a6d-a668-4a41-ada0-02496e024abe tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.465435 Oct 28 17:56:38.429127 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2652/5419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:37 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:38.621718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:38.634101 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7757cc5-78e0-4fe4-91dc-5f8af030a5fc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.409814 Oct 28 17:56:38.634876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2768/5420] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:38 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:38.888635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:38.889539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:38.895068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:38.895883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:38.900162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.900707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.901082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.901790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.902891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.905515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.906650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.915027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.915921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.916744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:38.917431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:38.918023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:38.970851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:39.071446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:39.988161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:39.999861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e764672a-da68-4868-95a4-eaa970779688 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 1.107158 Oct 28 17:56:40.006440 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2769/5421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:38 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:40.013574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:40.014373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:40.023854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:40.024909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:40.025537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:40.026557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:40.027303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:40.028246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:40.035512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:40.046427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4c248cd-f722-49f1-80ab-f7d68e652fa9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 1.161916 Oct 28 17:56:40.051876 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2653/5422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:38 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:40.061867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:40.075058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:40.075964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:40.090964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:40.091905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:40.092526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:40.094685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:40.095312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:40.096531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:40.493185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:40.501961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5ee3e3d-9317-4bc1-bec8-dfab41fd594a tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.494201 Oct 28 17:56:40.507458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2770/5423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:40 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:40.510221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:40.512702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f432a3-e744-4993-9f97-c3956216eb92", "tag": "c0078b66-d30f-46a6-a517-ad30858368dd"}, {"name": "network-changed", "server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:40.517546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:40.529251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:40.529954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e9e69ad-1463-4d17-bf20-7ad0128f80a6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.473462 Oct 28 17:56:40.530111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:40.530423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:40.539939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2654/5424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:40 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:40.546614 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Creating event network-changed:c0078b66-d30f-46a6-a517-ad30858368dd for instance 58f432a3-e744-4993-9f97-c3956216eb92 on n-h2-860864-13 Oct 28 17:56:40.547333 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] Creating event network-changed:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:56:40.565557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9ab6141d-6524-4024-8f71-417490f761d2 req-444e4ece-2d37-47eb-a512-5d8459ebadc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056493 Oct 28 17:56:40.566767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2771/5425] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:41.032009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:41.032626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:41.039885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.040384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.040811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.041815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.042276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.042714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.078963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:41.079907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:41.082935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=18 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:41.089772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.090391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.090928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.091812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.092508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.093052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.408353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:41.413234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:41.423501 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a058540d-99a3-4205-9b02-33ac7b1b6eeb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.395219 Oct 28 17:56:41.438484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2655/5426] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:41 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:41.442914 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d73301d-ecbe-4135-9988-93648adf73cd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.368399 Oct 28 17:56:41.445617 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2772/5427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:41 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:41.526131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:41.526988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:41.537573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.538530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.538980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.541132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.541613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.542048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.555731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:41.556554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:41.566878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.583114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.583613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:41.584371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:41.586186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:41.586636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:42.356627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:42.381400 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5be51aea-dc86-4edc-98df-05bafd88287e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.858800 Oct 28 17:56:42.381824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2656/5428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:41 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:42.406245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cfe9b7-50fe-4906-a4fd-3499b128f2aa", "name": "network-vif-plugged", "status": "completed", "tag": "7a048bee-fee3-43f6-8f4e-21c8268f3b70"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:42.448830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:42.456871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:42.457434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:42.507351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] Creating event network-vif-plugged:7a048bee-fee3-43f6-8f4e-21c8268f3b70 for instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa on n-h1-860864-13 Oct 28 17:56:42.525570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2fd2e6ab-7500-4192-aadd-15c774bce22f req-a0ec6b01-6406-4399-81b6-e3042fac7b49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142482 Oct 28 17:56:42.538651 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2657/5429] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:42.554091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:42.555182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:42.578022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:42.578624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:42.580017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:42.586351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:42.586976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:42.587550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:42.640730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:42.651299 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b00ab0ed-3ee4-45f3-9819-f3a76df13d13 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 1.099564 Oct 28 17:56:42.659820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2773/5430] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:41 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:42.685563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:42.689332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:42.713840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:42.723022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:42.723661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:42.734877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:42.736201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:42.736664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:43.376221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:43.387612 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbb488e1-5a71-48af-815c-7ce53c9b6a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.847461 Oct 28 17:56:43.392427 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2658/5431] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:42 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:43.410998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:43.412227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:43.424103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:43.426548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:43.428267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:43.429398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:43.431803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:43.432965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:43.462162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:43.473593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ac36c34-c584-4953-830d-20399f196e60 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.809293 Oct 28 17:56:43.478304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2774/5432] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:42 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:43.686005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:43.686649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:43.699309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:43.699841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:43.700300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:43.704353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:43.706679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:43.706679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:43.942260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:43.956642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a04a4e1-4375-4653-8b6b-9d9cc21f00ad tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.549915 Oct 28 17:56:43.957470 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2659/5433] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:43 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:44.059693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:44.073353 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d74a23c-0fed-4ea0-acc3-80dcb62a1edc tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.390873 Oct 28 17:56:44.074851 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2775/5434] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:43 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:44.414277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:44.414894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:44.434209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:44.443566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:44.443566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:44.443566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:44.443566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:44.443566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:44.506212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:44.506885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:44.518263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:44.519067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:44.519544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:44.523598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:44.526303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:44.527555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:44.912310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:44.924142 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56ac9f62-2f6c-4922-9db4-10e461d7fbb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1316 microversion: 2.1 time: 0.513647 Oct 28 17:56:44.941957 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2660/5435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:44 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:44.964602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:44.982072 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e482a5d-5501-47a5-8694-0b7bcde35725 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.479421 Oct 28 17:56:44.982873 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2776/5436] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:44 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:44.999698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:45.000614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:45.017512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.018691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.019470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:45.020379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.021009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.021594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:45.099325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:45.100502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:45.113956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.115461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.116734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:45.117577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.118855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.121105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:45.313365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:45.330476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d204643b-00dc-4643-bfda-406781d49d73 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.349860 Oct 28 17:56:45.333489 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2661/5437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:44 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:45.407346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:45.418202 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a6d92cf-3ae0-42a5-b67d-b29a994d6521 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.324090 Oct 28 17:56:45.421240 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2777/5438] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:45 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:45.949781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:45.950674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:45.961643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.962173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.962612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:45.963326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:45.963807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:45.964236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:46.006698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:46.007307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:46.037942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:46.038723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:46.040887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:46.041740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:46.043451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:46.044903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:46.328335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:46.341707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34097550-3db9-4bd6-91fd-d6512d9e1ac2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1505 microversion: 2.1 time: 0.393717 Oct 28 17:56:46.342534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2662/5439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:45 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:46.361962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:46.362919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:46.371905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:46.375199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:46.376017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:46.377376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:46.379612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:46.382821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.066686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:47.082386 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d8beac9-6312-48dd-9970-9d2a10770ca1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 1.079323 Oct 28 17:56:47.083316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2778/5440] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:46 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:47.089710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:47.090465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:47.098555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.099328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.100353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.103255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.104003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.104872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.155400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:56:47.249390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:47.262483 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bef1f8b8-3605-4439-9200-c2ef3e341d33 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 0.904514 Oct 28 17:56:47.263101 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2663/5441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:46 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:47.275069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:47.275932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:47.282393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.283131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.283913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.284915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.285537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.285878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:47.286316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.310117 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0328a7c4-e223-4973-9797-0a703d9869bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 204 len: 0 microversion: 2.1 time: 0.224648 Oct 28 17:56:47.313817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2779/5442] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:56:47 2022] DELETE /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:56:47.321082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eabbaf-f8dc-4508-8c4b-dff707b00ba1", "name": "network-vif-plugged", "status": "completed", "tag": "cae8cdb9-6d45-447a-8170-590dd43e8c55"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:47.340726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.341516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.342112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.360428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] Creating event network-vif-plugged:cae8cdb9-6d45-447a-8170-590dd43e8c55 for instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 on n-h2-860864-13 Oct 28 17:56:47.366337 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-470bd6f7-7d97-43ed-92c8-1b7ca2e53cea req-541d14e5-ee02-412c-a56f-1998f9f9e7ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050583 Oct 28 17:56:47.367124 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2780/5443] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:47.373527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:47.374003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:47.382523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.383303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.383774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.384489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.384950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.385381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.423897 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c26daa2-a296-48e9-9070-aff1aca23971 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/ips" status: 200 len: 151 microversion: 2.20 time: 0.055186 Oct 28 17:56:47.425866 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2781/5444] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Oct 28 17:56:47 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:56:47.433441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:47.434750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:47.444154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.457492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.458787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.459748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:47.462066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:47.462741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:47.714972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:47.728733 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-acd71886-469f-42a2-ace0-fbf3f65b2bb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.457779 Oct 28 17:56:47.732039 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2664/5445] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:47 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:47.801872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:47.838137 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0fd45e8-6b42-47a9-aca6-4acc2b7e5ded tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1511 microversion: 2.1 time: 0.410624 Oct 28 17:56:47.839351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2782/5446] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:47 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:48.112078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:48.113032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:48.130765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.131525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.132161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:48.133896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.134717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.135302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:48.295454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:48.297131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:48.311356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.315173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.315739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:48.318222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.320078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.320608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:48.855723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:48.865845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfeec1e3-98cb-41a2-a607-19d54909c448 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.760819 Oct 28 17:56:48.887790 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2665/5447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:48 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:48.893479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:48.904299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:48.913553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.914319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.915272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:48.916323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:48.918729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:48.927566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:49.301883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:49.327572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec277272-7a53-43fc-a212-c3e680cf7f59 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1314 microversion: 2.1 time: 1.036845 Oct 28 17:56:49.345937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2783/5448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:48 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:49.376422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:49.377062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:49.412491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:49.421846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:49.422719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:49.426716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:49.436493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:49.436646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:49.523910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:49.538662 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e89c4e0a-2e1f-431c-a4a2-d8ff28d8f74c tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.648591 Oct 28 17:56:49.541410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2666/5449] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:48 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:49.591362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "name": "network-vif-plugged", "status": "completed", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:49.616665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:49.624826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:49.625471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:49.670117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] Creating event network-vif-plugged:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:56:49.689929 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f8bac10e-cfaa-4572-89d0-df760c4761f9 req-95cc0249-12b0-4ba2-9187-4f81132ee3f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104134 Oct 28 17:56:49.697978 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2667/5450] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:56:49.862232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:49.884689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28be49fc-687b-4135-abbe-a2cf013c5c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1511 microversion: 2.1 time: 0.537199 Oct 28 17:56:49.885308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2784/5451] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:49 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1511 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:49.901587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:49.902107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:49.912440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:49.912950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:49.913379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:49.914322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:49.914627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:49.915057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:50.300901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:50.309544 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b736d1c-b238-4d3e-b1b7-e9fc129c7f71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.412756 Oct 28 17:56:50.324044 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2668/5452] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:49 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:50.368425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:50.369584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:50.388490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:50.389192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:50.389641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:50.390375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:50.390838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:50.391267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:50.555059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:50.556444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:50.575500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:50.576653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:50.577259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:50.578135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:50.578765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:50.579555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:50.652036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lazy-loading 'flavor' on Instance uuid 1904b39e-0bfe-4078-b38a-e461a568348c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:56:51.057057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:51.075167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b4631ea6-5d00-472f-891e-a17f968c4f25 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1499 microversion: 2.1 time: 0.714007 Oct 28 17:56:51.078218 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2785/5453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:50 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1499 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:51.106503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:51.107150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:51.128373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.128837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.129288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.130021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.130484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.130917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.142175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c26819f-1df0-4f92-b5d9-fc43f470192e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/action" status: 202 len: 0 microversion: 2.20 time: 0.590880 Oct 28 17:56:51.142963 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2669/5454] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:56:50 2022] POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:56:51.148945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cfe9b7-50fe-4906-a4fd-3499b128f2aa", "name": "network-vif-deleted", "tag": "7a048bee-fee3-43f6-8f4e-21c8268f3b70"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:51.176245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.178962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.183437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.203343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] Creating event network-vif-deleted:7a048bee-fee3-43f6-8f4e-21c8268f3b70 for instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa on n-h1-860864-13 Oct 28 17:56:51.214151 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-45e75696-13d7-4bd9-bab3-3cf75a0b7f8e req-b8837de6-0311-446a-a524-72d960f72e06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069119 Oct 28 17:56:51.220188 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2670/5455] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:51.227233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:51.232347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:51.247912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.260165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.260789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.261753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.263938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.264492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.305256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:51.335133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:51.337058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.339938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.343930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.344517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lazy-loading 'fault' on Instance uuid 09cfe9b7-50fe-4906-a4fd-3499b128f2aa {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:56:51.509513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:51.519305 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a8266f1-9c93-4961-b00e-2bf271d0c3b4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 200 len: 1306 microversion: 2.1 time: 0.297759 Oct 28 17:56:51.551165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2671/5456] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:51 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 1306 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:51.551165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:51.552152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:51.568588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.577900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.587990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.588899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.590213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.590910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.737344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:51.744240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:51.756577 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6272501c-e34d-44f9-890f-2d6feac03283 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1323 microversion: 2.1 time: 0.674507 Oct 28 17:56:51.764766 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2786/5457] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:51 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:51.792481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:51.793140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:51.822074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.823987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.825979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:51.826862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:51.827779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:51.829896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.102654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.115124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.119198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.128014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6324d74d-ffd5-4d05-9e9f-b84d539a54c1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.594625 Oct 28 17:56:52.130568 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2672/5458] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:51 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:56:52.137056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f432a3-e744-4993-9f97-c3956216eb92", "name": "network-vif-plugged", "status": "completed", "tag": "c0078b66-d30f-46a6-a517-ad30858368dd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:52.189391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.190542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.191111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.245561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] Creating event network-vif-plugged:c0078b66-d30f-46a6-a517-ad30858368dd for instance 58f432a3-e744-4993-9f97-c3956216eb92 on n-h2-860864-13 Oct 28 17:56:52.262413 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1df0b5f2-aee8-4c49-92bc-98f8a58ce97d req-b5d08de8-012c-434a-a837-de6b095e67dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128074 Oct 28 17:56:52.265870 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2673/5459] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:52.283039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:52.290351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:52.310987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.311743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.312345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.313210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.313827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.314443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.366561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:56:52.523343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d4b5862-b865-4ed6-b9ac-e11ded61ef8e tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 204 len: 0 microversion: 2.1 time: 0.249726 Oct 28 17:56:52.524347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2674/5460] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:56:52 2022] DELETE /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:56:52.533595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:52.544667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:52.561748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.563668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.564404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.568825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.569545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.570177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.590486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.604499 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e18f6c08-2a72-4842-864e-2a6db3f390bf tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.838405 Oct 28 17:56:52.605392 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2787/5461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:51 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:52.610306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:52.610926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:52.638658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.645884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.646749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.652288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.652774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.653213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.691100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa HTTP/1.1 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '09cfe9b7-50fe-4906-a4fd-3499b128f2aa'} Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:52.692900 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:56:52.697602 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:52.701864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:56:52.705108 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6993edbd-1c0d-4f67-b959-935e6d4fe9eb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 404 len: 111 microversion: 2.1 time: 0.098583 Oct 28 17:56:52.708893 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2788/5462] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:52 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:56:52.722147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:52.724121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:52.733682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.734351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.734948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.741593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.745093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.745720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.821694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.830312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4a5ebdb-9770-422c-9657-a27067a43246 tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1505 microversion: 2.1 time: 0.301353 Oct 28 17:56:52.832769 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2675/5463] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:52 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:52.844444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:52.845354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:52.857147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.863301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.863932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.864793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:52.865374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:52.865908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:52.957895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:52.969054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-600b713c-c224-4344-b11c-035db05b69cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.253974 Oct 28 17:56:52.970263 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2789/5464] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:52 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:53.100199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:53.110718 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2be27fcb-fca9-463c-8abc-fa6582e39d83 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1519 microversion: 2.1 time: 0.269998 Oct 28 17:56:53.112067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2676/5465] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:52 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:53.127295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed8f4eb1-ad6a-4b0f-bba7-2b5cb94e72d6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed8f4eb1-ad6a-4b0f-bba7-2b5cb94e72d6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 163 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": 12345, "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 12345 Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:56:53.132495 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed8f4eb1-ad6a-4b0f-bba7-2b5cb94e72d6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:56:53.138766 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed8f4eb1-ad6a-4b0f-bba7-2b5cb94e72d6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013345 Oct 28 17:56:53.140354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:53.140447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2790/5466] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:53 2022] POST /compute/v2.1/servers => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:56:53.140521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:53.147209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.147736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.148180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.149028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.149496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.149926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.155396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:53.156039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:53.176856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.177544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.177986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.178713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lazy-loading 'flavor' on Instance uuid 46f587f7-044d-401c-8c00-e022cfccc4f4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:56:53.178837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.179919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.180495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.277207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-087f1c3f-74d1-4823-af20-c9033638804a tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action" status: 200 len: 32 microversion: 2.1 time: 0.146700 Oct 28 17:56:53.278036 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2677/5467] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:56:53 2022] POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 17:56:53.286833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:53.287846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:53.297998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.298371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.298884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.299835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.300430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.301588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.474451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:53.486679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-235ac2df-b2ab-4581-a7a5-acc42f7d88d2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.338011 Oct 28 17:56:53.511421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2791/5468] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:53 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:53.511421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:53.511421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:53.517712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.518394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.523049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.524746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.542503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.543165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.568022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:53.584318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:53.588524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:53.589932 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-884ad294-1041-4b57-9e48-78614a5f1e24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.310411 Oct 28 17:56:53.593982 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2678/5469] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:53 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:56:53.599672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:53.602156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:53.618715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.623315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.623955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:53.625204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:53.625980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:53.633599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.266238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:54.286226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed3bf476-f5e2-4b65-8919-c1fe3ce18125 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.788680 Oct 28 17:56:54.287046 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2792/5470] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:53 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:54.297654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:54.298278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:54.316579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.317086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.317536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.318328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.318806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.319503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.340711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:54.351041 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1694758f-9aa1-49b0-b25d-d2882e6b8194 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.755747 Oct 28 17:56:54.352101 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2679/5471] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:53 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:54.357122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:54.357920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:54.367284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.370439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.371038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.374060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.374884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.375516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.788314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:54.798712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0b2207a-992b-41b3-85f2-322cfcb95d82 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1363 microversion: 2.1 time: 0.509740 Oct 28 17:56:54.801694 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2793/5472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:54 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:54.817664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:54.818493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:54.834739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.835537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.836128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:54.837967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:54.838588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:54.839276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:55.076398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:55.091040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d45acf73-bfd5-412a-9cfb-8cc4a9f97b2c tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1505 microversion: 2.1 time: 0.737445 Oct 28 17:56:55.092453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2680/5473] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:54 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:55.275813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:55.286686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:55.292429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:55.293939 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e00289d-3b8d-45a4-b397-b4bb4fe61c34 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.489901 Oct 28 17:56:55.294625 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2794/5474] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:54 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:56:55.310120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:55.310980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:55.319198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:55.319708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:55.320142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:55.320839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:55.321286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:55.321708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:55.563843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6eabbaf-f8dc-4508-8c4b-dff707b00ba1", "name": "network-vif-deleted", "tag": "cae8cdb9-6d45-447a-8170-590dd43e8c55"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:55.587296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:55.595147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:55.608074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:55.638409 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] Creating event network-vif-deleted:cae8cdb9-6d45-447a-8170-590dd43e8c55 for instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 on n-h2-860864-13 Oct 28 17:56:55.655188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-46d68ec6-c582-4a05-9cf2-ac135062a276 req-9ac19084-41d6-4916-9fe0-0db9e74b492d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094874 Oct 28 17:56:55.657726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2795/5475] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:56:55.828639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:55.829700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:55.842254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:55.842752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:55.843186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:55.853403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:55.853918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:55.854364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.224296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:56.235559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf561410-ae3a-457e-a32c-f21b0d7d146e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.930398 Oct 28 17:56:56.241748 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2681/5476] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:55 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:56.248009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:56.248776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:56.255608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.256266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.256853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.257709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.257955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:56.258487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.259046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.270395 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-21284c5b-6376-416b-b07c-3f5e1d245a71 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1549 microversion: 2.1 time: 0.445908 Oct 28 17:56:56.289381 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2796/5477] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:55 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1549 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:56.309199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:56.309967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:56.313156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.316435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.318729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.319353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lazy-loading 'fault' on Instance uuid e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:56:56.335581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.336363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.336961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.337824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.348106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.348781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.415214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92578ba9a594468eafa07b5bbe913aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6fc113b1334436be574812dac037cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:56.433712 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0444803-81c6-4744-846f-b326bdf6b52f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 200 len: 1304 microversion: 2.1 time: 0.190580 Oct 28 17:56:56.434249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2682/5478] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:56 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:56.444564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:56.446072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:56.491296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.500113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.500842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.501828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:56.508408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:56.515771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:56.587708 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4a74de9a-f5ed-406f-82ee-82e28465454f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.296441 Oct 28 17:56:56.588812 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2797/5479] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 17:56:56 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-interface => generated 284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:57.202338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:57.225560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:57.227045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:57.228517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a24f7100-debf-4041-8e79-1183f541f8c3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.789592 Oct 28 17:56:57.229467 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2683/5480] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:56 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:56:57.276880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:57.277869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:57.289543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.290609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.291261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.292171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.292783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.293395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.460419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:57.461288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] [instance: e6eabbaf-f8dc-4508-8c4b-dff707b00ba1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:57.478151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.480121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.480746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.485911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.486397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.490010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.509762 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] HTTP exception thrown: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Request method failure captured: Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 HTTP/1.1 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeRka3eW5KWEgOgdchQpsjdVv3-7diu_XmS5UGKNJoLJkcQrHkWUtVdjuZ1Wm6jlJE2xk91L1ZEJz26My8gfzm9W5ickzfwz0F9NkdKVCwWpukEB3AX0gIwieEsapLIeu2BPFaeCLIY7mz5fcSj3gUpOdVx_Klx1qwRVTjbrhJhS4A Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9c6fc113b1334436be574812dac037cc Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6fc113b1334436be574812dac037cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6fc113b1334436be574812dac037cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6fc113b1334436be574812dac037cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6fc113b1334436be574812dac037cc"}]}] Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9c6fc113b1334436be574812dac037cc Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesActionsTest-1086043590 Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesActionsTest-1086043590-project Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 92578ba9a594468eafa07b5bbe913aed Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesActionsTest-1086043590-project Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e6eabbaf-f8dc-4508-8c4b-dff707b00ba1'} Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:57.511657 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] Returning 404 to user: Instance e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5c82d7c-bae1-4bd0-ad9c-4a7f9085103f tempest-VolumesActionsTest-1086043590 tempest-VolumesActionsTest-1086043590-project] 10.222.0.48 "GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1" status: 404 len: 111 microversion: 2.1 time: 0.057370 Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2684/5481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:57 2022] GET /compute/v2.1/servers/e6eabbaf-f8dc-4508-8c4b-dff707b00ba1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:56:57.520533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c86ab305-1bf8-44a8-a311-ad2e6f6c9381 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-797460554", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "eac7feb0-30e7-47b1-9225-4d1b25511cd6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:57.633184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-c86ab305-1bf8-44a8-a311-ad2e6f6c9381 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c86ab305-1bf8-44a8-a311-ad2e6f6c9381 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 357 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-797460554", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "eac7feb0-30e7-47b1-9225-4d1b25511cd6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: exception: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-797460554', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'eac7feb0-30e7-47b1-9225-4d1b25511cd6'}], 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:56:57.650736 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c86ab305-1bf8-44a8-a311-ad2e6f6c9381 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Block Device eac7feb0-30e7-47b1-9225-4d1b25511cd6 is not bootable. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c86ab305-1bf8-44a8-a311-ad2e6f6c9381 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.137971 Oct 28 17:56:57.656178 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2685/5482] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:56:57 2022] POST /compute/v2.1/servers => generated 110 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:56:57.663267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:57.664793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:57.676724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.677224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.677664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.678391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:57.678849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:57.679269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:57.698961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:56:57.981817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:57.991846 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7594f93a-046c-46c5-acbe-f9c1028ae261 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.726996 Oct 28 17:56:57.992977 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2798/5483] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:57 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:58.054391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:58.066574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b346aed-0094-41b7-ad91-339c155a54f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.407199 Oct 28 17:56:58.068281 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2686/5484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:57 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:56:58.094321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:58.094604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:58.102959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:58.103622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:58.104295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:58.105684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:58.106232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:58.106786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:58.257984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:58.259310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:58.267221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:58.273780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:58.274636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:58.278609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:58.282502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:58.283004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:58.677996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:58.689629 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-26d8a696-1d59-42fd-b639-e47bfe14df67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.600493 Oct 28 17:56:58.699436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2799/5485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:58 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:58.918680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:58.937939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:58.942478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:58.946933 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-afbae681-29e8-4781-bc65-b6e3e87a8ea6 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.692954 Oct 28 17:56:58.948116 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2687/5486] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:58 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:56:59.018406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:59.020523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:59.032817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:59.036481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:59.037267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:59.039456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:59.041683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:59.042150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:59.105755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f432a3-e744-4993-9f97-c3956216eb92", "tag": "c0078b66-d30f-46a6-a517-ad30858368dd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:56:59.129552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:59.130248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:59.130864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:56:59.157083 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] Creating event network-changed:c0078b66-d30f-46a6-a517-ad30858368dd for instance 58f432a3-e744-4993-9f97-c3956216eb92 on n-h2-860864-13 Oct 28 17:56:59.173027 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5a36a1cb-a00f-4f1d-b142-eaf37e57b718 req-a1b7243f-8f33-4c60-a487-d9c5791bab9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071001 Oct 28 17:56:59.176479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2688/5487] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:56:59.484452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:56:59.497083 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65aa0bce-f5f5-4292-817f-c9225bb77c95 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.484212 Oct 28 17:56:59.508088 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2800/5488] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:56:59 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:56:59.979886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:56:59.981213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:56:59.998002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:56:59.998572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:56:59.999545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:00.001701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:00.010019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:00.011227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:00.496444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:00.522957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:00.524363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:00.524480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:00.527215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:00.531579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ccac3399-8ae0-408f-a4e1-373a41363132 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.556572 Oct 28 17:57:00.534210 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2689/5489] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:56:59 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:00.550471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:00.551783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:00.555875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:00.557021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:00.559474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:00.563800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:00.942310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:00.954423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-452984d1-2d1e-4e17-a168-de79dcb21d08 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.436808 Oct 28 17:57:00.973988 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2801/5490] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:00 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:01.562616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:01.564030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:01.584221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:01.585013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:01.585705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:01.588942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:01.589622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:01.590303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:01.896931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:01.932467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:01.938641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:01.944294 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d07b6ea-2494-4c94-a90e-27a7041fdc4c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.385380 Oct 28 17:57:01.946081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2690/5491] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:01 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:01.984709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:01.985335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:02.001389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.001907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.004135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.006359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.006852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.007296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.102051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffceb7ab-e31b-442b-b9bf-119d5fa8d614 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688530701", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f7274c7-779f-4acb-8077-345620e4cdc6", "destination_type": "local"}, {"source_type": "volume", "uuid": "a541b38b-b89b-478d-8b71-f5d6989a834f", "destination_type": "invalid"}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffceb7ab-e31b-442b-b9bf-119d5fa8d614 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 494 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688530701", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "4f7274c7-779f-4acb-8077-345620e4cdc6", "destination_type": "local"}, {"source_type": "volume", "uuid": "a541b38b-b89b-478d-8b71-f5d6989a834f", "destination_type": "invalid"}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-688530701', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'a541b38b-b89b-478d-8b71-f5d6989a834f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:02.106901 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 17:57:02.110315 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:02.117454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffceb7ab-e31b-442b-b9bf-119d5fa8d614 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:02.118647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffceb7ab-e31b-442b-b9bf-119d5fa8d614 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020676 Oct 28 17:57:02.119873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2691/5492] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:02.129810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:02.134296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:02.150433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.151274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.151999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.155082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.155857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.156636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.469811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:02.484772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d04ae43c-8995-42c3-b678-5a340118c839 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.503768 Oct 28 17:57:02.485638 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2802/5493] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:01 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:02.564160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:02.575687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-41fa15bb-ea25-4087-82e6-b828b6c6e9f4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.451570 Oct 28 17:57:02.577019 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2692/5494] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:02 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:02.601980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:02.603238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:02.618093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.620623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.621515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.622452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.626369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.627668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.949991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:02.958861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7632f9c-7fdd-43ea-ac13-e8c939938a88 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.361614 Oct 28 17:57:02.976686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:02.978770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:02.979920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2803/5495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:02 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:02.991467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.992607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.993298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:02.994450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:02.995124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:02.996002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.067387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa0badd9-df99-471b-be67-58b4905c8f00 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-860452454", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa0badd9-df99-471b-be67-58b4905c8f00 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 491 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-860452454", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-860452454', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.072058 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa0badd9-df99-471b-be67-58b4905c8f00 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa0badd9-df99-471b-be67-58b4905c8f00 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010490 Oct 28 17:57:03.075012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2804/5496] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:03 2022] POST /compute/v2.1/servers => generated 624 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:57:03.085378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:03.086043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:03.103514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.104020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.104462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.105188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.105657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.106093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.697912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:03.706699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-20a25620-a401-42a4-912f-30dca9c3d80e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.626738 Oct 28 17:57:03.707391 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2805/5497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:03.741520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:03.743736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:03.754741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.759468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.760169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.761251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.762630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.764166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.766831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:03.784698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:03.786387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:03.787627 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-074d400c-0547-45bc-8042-1841d53b8d24 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.815964 Oct 28 17:57:03.789926 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2693/5498] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:02 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:57:03.803335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:03.804218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:03.821283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.824816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.825479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:03.827234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:03.836157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:03.836618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.309139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:04.317472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc874a4d-cd40-40f0-8589-2162a7c35ac4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.526268 Oct 28 17:57:04.347103 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2694/5499] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:04.358796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:04.376676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17f1f75a-0a01-4923-b974-b65f0c2aabb5 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.647382 Oct 28 17:57:04.379635 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2806/5500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:03 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:04.421819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b41bd2bb-a837-4c39-8329-50cc78c2ad33 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b41bd2bb-a837-4c39-8329-50cc78c2ad33 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 416 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.432046 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b41bd2bb-a837-4c39-8329-50cc78c2ad33 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b41bd2bb-a837-4c39-8329-50cc78c2ad33 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.015860 Oct 28 17:57:04.435716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2695/5501] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:04 2022] POST /compute/v2.1/servers => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:57:04.442628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:04.443253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:04.459402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.459909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.464140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.465087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.465720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.469496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.478023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:04.782096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:04.792618 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7019604-6bf5-4c77-8f2a-9c79c2ed91f9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.354021 Oct 28 17:57:04.796088 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2807/5502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:04.826635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:04.827825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:04.835843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:04.849225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.849980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.850583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.851685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:04.852828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.855201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.855854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.873379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.874132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.875931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:04.876816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:04.884779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:04.885551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.165087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.170579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.179275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.182112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.183407 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a944c6f3-0b29-4534-8894-adcd9b810bb1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.351350 Oct 28 17:57:05.184260 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2808/5503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:05.193283 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-876797f4-8458-4029-adb8-d5efb3318e22 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.370655 Oct 28 17:57:05.194982 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2696/5504] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:04 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:05.320595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5139a241-09e2-4cd3-a779-134f10b5604a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-299987926", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": -1, "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:05.344800 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5139a241-09e2-4cd3-a779-134f10b5604a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Flavor -1 could not be found. Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5139a241-09e2-4cd3-a779-134f10b5604a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 205 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-299987926", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": -1, "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: exception: Flavor -1 could not be found. Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-299987926', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': -1, 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:05.360329 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 28 17:57:05.365249 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:05.368020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5139a241-09e2-4cd3-a779-134f10b5604a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:05.369120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5139a241-09e2-4cd3-a779-134f10b5604a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.052576 Oct 28 17:57:05.370271 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2809/5505] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:05 2022] POST /compute/v2.1/servers => generated 73 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:57:05.379146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:05.380175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:05.390759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.396017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.396919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.407790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:05.414142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:05.419517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.423659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.432046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.445295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.446083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.447971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.448924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.450730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.452010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.890037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.902549 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ff3f59f-6693-4fee-bc4b-e875a6c7913e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.504222 Oct 28 17:57:05.903142 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2810/5506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:05 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:05.929530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:05.946536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa20b381-7ba8-43b5-80fa-f2dc0053c5a9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.571614 Oct 28 17:57:05.948370 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2697/5507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:05 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:05.975004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:05.975958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:05.982808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.983556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.984161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:05.985037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:05.985682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:05.986272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.225107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:06.233988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:06.234585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:06.244777 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01a9a952-055a-401a-bfa9-395ca162e0d9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.274334 Oct 28 17:57:06.250167 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2811/5508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:05 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:06.266518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.267040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.282447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.283404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.283879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.284523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.385089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adcebe7-8a5d-429b-8103-7199d708b84f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-141506153", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adcebe7-8a5d-429b-8103-7199d708b84f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 172 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-141506153", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-141506153', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi -1 Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:06.397159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 17:57:06.401927 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:06.403912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6adcebe7-8a5d-429b-8103-7199d708b84f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:06.405069 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6adcebe7-8a5d-429b-8103-7199d708b84f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.040438 Oct 28 17:57:06.405752 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2812/5509] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:06 2022] POST /compute/v2.1/servers => generated 145 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:06.422536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:06.424317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:06.432843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.433612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.434351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.435292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.436006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.436658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.682937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:06.695299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:06.698242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:06.701080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4913a521-0eb8-44fe-a523-d5f715735c55 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.472141 Oct 28 17:57:06.704112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2698/5510] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:06 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:57:06.857290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:06.868419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d526a2e-9406-49a0-93fa-7f0164af3bb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.455734 Oct 28 17:57:06.869121 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2813/5511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:06 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:06.907423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:06.909959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:06.930568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:06.931198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:06.940245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.941471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.941919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.942567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.942719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.943095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.943362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.943838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.944550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:06.945010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:06.951061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:06.958760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:07.411495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:07.432456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b4ec6a9-1f9a-4f9e-a5a3-dec281c0f481 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.533169 Oct 28 17:57:07.433911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2699/5512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:06 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:07.454765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:07.469824 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-227fdf27-4229-49fa-817b-f9e0d1703f58 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.547596 Oct 28 17:57:07.472367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2814/5513] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:06 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:07.532238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2788c892-9a53-420f-b99b-6c7008369e55 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251763739", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:07.545623 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2788c892-9a53-420f-b99b-6c7008369e55 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2788c892-9a53-420f-b99b-6c7008369e55 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 215 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251763739", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-251763739', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:07.553137 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 17:57:07.557556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:07.562219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2788c892-9a53-420f-b99b-6c7008369e55 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:07.563658 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2788c892-9a53-420f-b99b-6c7008369e55 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.037822 Oct 28 17:57:07.569938 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2700/5514] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:07 2022] POST /compute/v2.1/servers => generated 123 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:07.579787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:07.581027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:07.591066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:07.592613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:07.593543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:07.596811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:07.597874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:07.598805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:07.730753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:07.732574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:07.757069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:07.760523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:07.761581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:07.765512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:07.766472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:07.767220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:08.835743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:08.851056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e8c9e0b-a520-4847-8b81-74f7d022f294 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.276347 Oct 28 17:57:08.866290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2815/5515] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:07 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:08.894967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:08.897109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:08.911136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:08.913403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:08.914373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:08.915643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:08.917066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:08.917690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:08.935319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:08.953722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:08.958203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:08.959670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78b7dda3-1e2f-470c-b60d-e974f4bf51c0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1743 microversion: 2.20 time: 1.233393 Oct 28 17:57:08.978940 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2701/5516] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:07 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1743 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:57:08.984902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:08.985741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:08.992992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:08.993677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:09.011800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:09.026133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:09.036601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:09.037987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:09.365914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:09.384957 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a27203a7-bafc-4bc2-bc4a-719f639284bf tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.503356 Oct 28 17:57:09.391571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2816/5517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:08 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:09.441274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:09.453376 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c423190-2b0b-4118-9906-3a08386a9316 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.472712 Oct 28 17:57:09.453965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2702/5518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:08 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:09.746481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1222117152", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-key-298050845", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:09.972447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] validate_networks() for [('f77b061d-e7ef-4fd5-b30a-b8ae1f30e705', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:57:09.990390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:09.992899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:10.024919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.027526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.031229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.032357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.033501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.034218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.511351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:10.514043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Invalid key_name provided. Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 246 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1222117152", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-key-298050845", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid key_name provided. Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1222117152', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'key_name': 'tempest-key-298050845', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-298050845 not found for user 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:10.516979 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:10.521149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid key_name provided. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:10.525665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:10.525665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:10.529467 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-800e74dc-692e-44e6-97f3-4770464aaa1d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.789970 Oct 28 17:57:10.529812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a55783c-64e7-4cba-8a81-0e37bac27fef tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1743 microversion: 2.20 time: 0.538031 Oct 28 17:57:10.529970 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2817/5519] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:09 2022] POST /compute/v2.1/servers => generated 70 bytes in 797 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 17:57:10.539871 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2703/5520] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:09 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1743 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:10.547668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:10.548291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:10.551396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:10.554941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.555468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.555884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:10.556003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.556613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.557075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.557508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.578438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.578930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.585437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.588033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.588524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.588963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.901181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:10.913529 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d215a1a5-abb5-4ea5-a569-4e3d60d39a37 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.384974 Oct 28 17:57:10.918747 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2818/5521] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:10 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:10.927149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:10.945937 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca10161e-ccfe-4f40-9a11-4dd50e3aa54a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.403131 Oct 28 17:57:10.947734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2704/5522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:10.978728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:10.979331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:10.992915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.993676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.994276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:10.995159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:10.995789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:10.996362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:11.303883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:11.319580 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dccff0f4-ad71-4382-ba45-b89df4342b5e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.344827 Oct 28 17:57:11.320535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2819/5523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:11.558584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:11.563804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1094868945", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:11.568780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:11.595180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:11.599338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:11.600258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:11.601213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:11.602681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:11.603327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:11.875400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.security_group_api [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Neutron security group does_not_exist not found {{(pid=120568) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 28 17:57:11.875996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 258 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1094868945", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1094868945', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 17:57:11.914628 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:11.919205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:11.924654 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2813b544-00b4-4656-934e-5ec6ce933209 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.371884 Oct 28 17:57:11.924654 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2705/5524] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:11 2022] POST /compute/v2.1/servers => generated 106 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:11.926698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:11.927193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:11.927842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:11.935557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:11.936260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:11.937025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:11.938725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:11.939450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:11.940241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:11.961897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:11.968796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:11.972311 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b72130d3-763a-44f7-9b1e-c9bbc92d51ed tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1743 microversion: 2.20 time: 0.420996 Oct 28 17:57:11.974867 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2820/5525] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:11 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1743 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:11.991468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:11.992888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:12.022088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.032853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.034203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:12.037182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.037889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.038333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:12.341437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:12.362986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-718239ab-bfd5-49b8-bc69-b86f3cee839b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.440097 Oct 28 17:57:12.364324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2706/5526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:11 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:12.400592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:12.405838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:12.434077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.434579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.435028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:12.436011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.436455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.440202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:12.522828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:12.532836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:12.544647 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03c69b50-daee-4293-937d-bf833fe63fd9 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.566220 Oct 28 17:57:12.547651 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2821/5527] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:11 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:12.861536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:12.871306 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aeefaa00-c5ac-46ac-9fb9-35c4e576d14a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.486353 Oct 28 17:57:12.872506 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2707/5528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:12.920427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:12.921234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 090ec356-680b-4408-960f-6ada587c96aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:12.932351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/090ec356-680b-4408-960f-6ada587c96aa HTTP/1.1 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '090ec356-680b-4408-960f-6ada587c96aa'} Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:12.934121 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. Oct 28 17:57:12.939590 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:12.945675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 090ec356-680b-4408-960f-6ada587c96aa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:12.948122 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-986857e3-3a81-4d5c-9c0d-b957c9bcc62c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/090ec356-680b-4408-960f-6ada587c96aa" status: 404 len: 111 microversion: 2.1 time: 0.051803 Oct 28 17:57:12.948971 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2822/5529] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:57:12 2022] DELETE /compute/v2.1/servers/090ec356-680b-4408-960f-6ada587c96aa => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:12.957798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:12.959179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:12.967017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.968848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.971325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:12.972977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:12.975861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:12.976854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.001521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:13.002958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:13.011982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.012715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.013380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.014724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.015985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.016641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.458263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:13.470515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9978faf-1ed7-4066-b2fe-b3836ee6bd7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.516847 Oct 28 17:57:13.473557 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2708/5530] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:13.475221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:13.478390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "name": "network-vif-plugged", "status": "completed", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:13.485201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:13.489275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:13.491336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2831c1de-2cab-4be0-973c-b267b9e86495 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.494528 Oct 28 17:57:13.492600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.493336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.493683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2823/5531] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:12 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:13.494236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.508103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:13.508723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:13.509860 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] Creating event network-vif-plugged:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:57:13.517055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-bcb7ccd6-2202-41f0-91d6-e57f12166e09 req-830ee556-632e-4fd1-88d5-fa85a416d939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041801 Oct 28 17:57:13.517667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.518680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2709/5532] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:13.518873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.519306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.532308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.535090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.536554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.579312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:13.580755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:13.608979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.613410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.614702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.616605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.618270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.620227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.881114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:13.897878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a609fedb-7a1d-4344-9709-45cb04e9af3a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.402794 Oct 28 17:57:13.898835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2824/5533] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:13.931599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:13.932439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:57:13.933201 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 9223372036854775808 could not be found. Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '9223372036854775808'} Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:13.935022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:13.939308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:13.939308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:13.939308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:13.939308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 28 17:57:13.939308 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:13.944268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:13.945750 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b914f6f4-0e27-4bee-bc94-5306fa5f0de7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022800 Oct 28 17:57:13.949596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2825/5534] 10.222.0.48 () {58 vars in 1188 bytes} [Fri Oct 28 17:57:13 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:57:13.964945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:13.972986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:13.992979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:13.993496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:13.993945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:13.994687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.006557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.008646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.142206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.153085 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15b36342-5ecb-409c-b605-01029903618e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.580347 Oct 28 17:57:14.153707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2710/5535] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:13 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:14.303832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.317714 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c6e4b4b-25f5-4d49-8594-5a5dff46615e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.363148 Oct 28 17:57:14.321026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2826/5536] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:14.346097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:14.348076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:14.363774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.364383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.364831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.373357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.374234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.374686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.526615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:14.527251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:14.548626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.550126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.550726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.551793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.552404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.553366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.770455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.782144 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aade2bff-6e20-40b8-8d51-c078ebdb234e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.440559 Oct 28 17:57:14.787082 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2711/5537] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:14 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:14.814077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:14.815659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Failed to fetch instance by id -1 {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 17:57:14.816464 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance -1 could not be found. Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance -1 could not be found. Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '-1'} Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:14.819047 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:14.826829 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:14.826829 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:14.826829 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 28 17:57:14.826829 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:14.828370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:14.831137 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d971f74-299c-4f1f-91aa-2c1e84f722f6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025042 Oct 28 17:57:14.832015 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2712/5538] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:57:14 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:57:14.850939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:14.852592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:14.870373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.883795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.890941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.891446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.892697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.896644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:14.897370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:14.898262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:14.901025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:14.904047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bccc8b41-bf3d-492a-946a-08defed3f366 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.378362 Oct 28 17:57:14.907185 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2827/5539] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:14 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:15.177209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:15.178508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:15.193527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.197535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.200476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.202743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.204497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.207087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.371703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:15.388379 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78e1dadf-0afa-401b-9c6c-ac909103e041 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.551637 Oct 28 17:57:15.391319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2713/5540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:14 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:15.426151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:15.427577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:15.447199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.449256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.450044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.457227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.459077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.461070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.709591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:15.713403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:15.718354 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23e5cbc1-c23c-4c56-b1e2-f3f44393043d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.545917 Oct 28 17:57:15.723224 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2828/5541] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:15 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:15.914184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:15.927249 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9ea36f5-77c3-4709-a2d9-46f241f55915 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.508846 Oct 28 17:57:15.936379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:15.937243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:15.940002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2714/5542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:15 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:15.952616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.956553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.958393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.960620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:15.963703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:15.964421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:15.982976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:15.984224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: a7957357-ab83-4796-a76c-53189a72ae11] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:15.992545 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/a7957357-ab83-4796-a76c-53189a72ae11/action HTTP/1.1 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 19 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: {"forceDelete": {}} Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a7957357-ab83-4796-a76c-53189a72ae11', 'body': {'forceDelete': {}}} Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:16.002625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:16.007432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:16.007432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:16.007432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. Oct 28 17:57:16.007432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.009500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance a7957357-ab83-4796-a76c-53189a72ae11 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:16.012486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b74985d-b176-447b-8bff-bc9dcbaccae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/a7957357-ab83-4796-a76c-53189a72ae11/action" status: 404 len: 111 microversion: 2.1 time: 0.040156 Oct 28 17:57:16.024512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2715/5543] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:15 2022] POST /compute/v2.1/servers/a7957357-ab83-4796-a76c-53189a72ae11/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:16.033268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:16.042222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:16.074007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.074519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.075592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.082123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.084258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.085065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.472102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:16.488848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:16.493239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:16.494483 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e14baaa-e93e-4033-b98a-acbe291bb14d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.562361 Oct 28 17:57:16.508973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2829/5544] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:15 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:16.511016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:16.516985 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d35b790d-7b77-4f7a-b66a-f31c812968ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.489087 Oct 28 17:57:16.517512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2716/5545] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:16 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:16.543767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:16.544390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:16.570320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.580434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.582435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.583719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.584357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.585057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.747070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:16.748293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:16.765211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.776564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.779474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.784138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.789883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.790969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.815673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:16.830916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cab908dd-7f3c-4cd4-9de9-b5e40c53b8ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.291404 Oct 28 17:57:16.833129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2830/5546] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:16 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:16.862581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:16.865742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 2fd7e80a-7721-4899-8017-9785fa2ac874] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:16.877405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:16.891446 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/2fd7e80a-7721-4899-8017-9785fa2ac874/action HTTP/1.1 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 39 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: {"os-getConsoleOutput": {"length": 10}} Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '2fd7e80a-7721-4899-8017-9785fa2ac874', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.902959 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 2fd7e80a-7721-4899-8017-9785fa2ac874 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0c267bc7-bbc9-4c04-b976-ede863a7cbd5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/2fd7e80a-7721-4899-8017-9785fa2ac874/action" status: 404 len: 111 microversion: 2.1 time: 0.048308 Oct 28 17:57:16.908571 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2831/5547] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:16 2022] POST /compute/v2.1/servers/2fd7e80a-7721-4899-8017-9785fa2ac874/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:57:16.913821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:16.916111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:16.937816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.938608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.949735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:16.950696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:16.951336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:16.952019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:17.307684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.316978 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-547b5b05-ac86-4101-9f9a-b3da954cdf72 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.574096 Oct 28 17:57:17.336397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2717/5548] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:16 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:17.422587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.442935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-088f762d-56ce-4245-87a1-7891de624137 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.532703 Oct 28 17:57:17.448914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2832/5549] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:16 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:17.474657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:17.475276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:17.486224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:17.486722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:17.487205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:17.490475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:17.490475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:17.491131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:17.525438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:17.526032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:17.546713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:17.547128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:17.547650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:17.548374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:17.554334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:17.555386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:17.884572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.901123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6c9fd67-bdad-4787-8091-8f7a492dce78 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.427859 Oct 28 17:57:17.907660 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2718/5550] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:17 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:17.933492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:17.934400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 42a0e761-01f5-494a-9af4-2b62560e23da] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:17.946996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/42a0e761-01f5-494a-9af4-2b62560e23da HTTP/1.1 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '42a0e761-01f5-494a-9af4-2b62560e23da'} Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:17.948814 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:17.953168 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:17.953168 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:17.953168 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:17.953168 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. Oct 28 17:57:17.953168 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:17.953543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.958123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 42a0e761-01f5-494a-9af4-2b62560e23da could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:17.960265 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d203b937-1068-4b55-962e-848587a4495c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/42a0e761-01f5-494a-9af4-2b62560e23da" status: 404 len: 111 microversion: 2.1 time: 0.030848 Oct 28 17:57:17.963669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2719/5551] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:17 2022] GET /compute/v2.1/servers/42a0e761-01f5-494a-9af4-2b62560e23da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:17.968141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.969651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:17.971747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3f33ad5f-5bc3-4a36-b0a9-7fa79e7ad09e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.450378 Oct 28 17:57:17.972924 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2833/5552] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:17 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:17.998379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:18.004124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:18.025162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.031318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.032010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:18.034910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.036051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.038865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:18.346261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:18.353630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:18.353819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:18.369058 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf16f792-5887-413b-83ce-ade754ba180a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.402077 Oct 28 17:57:18.373884 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2720/5553] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:17 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:18.387897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.389053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.390267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:18.391171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.392020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.392644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:18.401149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:18.402064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:18.406159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:18.426356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.428518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.429984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:18.441170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:18.442324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:18.445208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.025584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.039807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0cfeb635-39fe-4635-bf5f-2607b743fcd7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.696683 Oct 28 17:57:19.041684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2834/5554] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:18 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:19.043921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.054525 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e31c738-d7e1-48c5-8a8f-8701b0e24cff tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.658149 Oct 28 17:57:19.056419 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2721/5555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:18 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:19.065885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:19.076190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:19.120142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.125745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.127262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.132666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.141145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.143228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.340197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f114b24-1275-4976-ae92-388e923d562d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-292849458", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f114b24-1275-4976-ae92-388e923d562d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 237 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-292849458", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-292849458', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.376183 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 17:57:19.380265 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:19.383512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f114b24-1275-4976-ae92-388e923d562d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:19.384569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f114b24-1275-4976-ae92-388e923d562d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.049734 Oct 28 17:57:19.385312 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2722/5556] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:19.410133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:19.411260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:19.453702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.457024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.457692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.460496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.462198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.463851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.582358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.598110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.599850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.602662 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2292dec1-faad-4b87-9535-2e6f1c07173f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.558862 Oct 28 17:57:19.615403 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2835/5557] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:19 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:19.835252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:19.850691 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-568dc335-abdc-4075-b991-26fe2fa759d4 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.458829 Oct 28 17:57:19.851505 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2723/5558] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:19 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:19.878310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:19.878927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:19.888238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.888701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.892043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:19.893068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:19.899597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:19.900119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.069041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:20.069654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:20.080128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.088995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.089685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.092681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.093335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.093936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.313625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:20.331815 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9c591ec-6924-4a08-8d4a-eaddb0026e8d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.452317 Oct 28 17:57:20.334233 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2836/5559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:19 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:20.494368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:20.518525 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-410a6010-0d91-429e-81e4-cd451b9e1aa7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.454713 Oct 28 17:57:20.531874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2724/5560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:20 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:20.560905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1624485-3a38-481e-aaf1-cbf1d870553b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-510154325", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1624485-3a38-481e-aaf1-cbf1d870553b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 234 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-510154325", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-510154325', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.566923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1624485-3a38-481e-aaf1-cbf1d870553b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1624485-3a38-481e-aaf1-cbf1d870553b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011469 Oct 28 17:57:20.571138 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2837/5561] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:20 2022] POST /compute/v2.1/servers => generated 133 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:57:20.577577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:20.578087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:20.596485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.597014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.599941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.600644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.601117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.601555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.633553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:20.634164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:20.660916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.665846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.667416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:20.668927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:20.670201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:20.672069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.029732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:21.055867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-531420c7-b394-40a3-a62f-eea38bdce6b7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.482263 Oct 28 17:57:21.070360 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2725/5562] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:20 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:21.090970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:21.091625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:21.117611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:21.136689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:21.137401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.139780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.141518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.143093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.144851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:21.150500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.153895 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bbc3137-7a5e-48dd-87c5-2cfcca9e3161 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.525117 Oct 28 17:57:21.155887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.159229 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2838/5563] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:20 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:21.539335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:21.546668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:21.548786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:21.563857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.564632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.565260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.566158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.566775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.567488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.568339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-362248f7-bfb4-418e-8920-c35b5950f034 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.487228 Oct 28 17:57:21.569770 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2726/5564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:21 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:21.598907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:21.599809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: b72eb78f-86d3-4a64-ae25-4505116e24fd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:21.612026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/b72eb78f-86d3-4a64-ae25-4505116e24fd/action HTTP/1.1 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 13 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: {"pause": {}} Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b72eb78f-86d3-4a64-ae25-4505116e24fd', 'body': {'pause': {}}} Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:21.621926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:21.625896 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:21.625896 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:21.625896 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. Oct 28 17:57:21.625896 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:21.627938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance b72eb78f-86d3-4a64-ae25-4505116e24fd could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:21.629038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-297424ef-6141-4e3b-b71b-6b712ee1d05a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/b72eb78f-86d3-4a64-ae25-4505116e24fd/action" status: 404 len: 111 microversion: 2.1 time: 0.036700 Oct 28 17:57:21.633404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2727/5565] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:21 2022] POST /compute/v2.1/servers/b72eb78f-86d3-4a64-ae25-4505116e24fd/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:21.644426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:21.652468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:21.669616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.670479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.671112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:21.672057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:21.673467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:21.674833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:22.537060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:22.553895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:22.567153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8232143-d63b-4e7d-ad84-8af9e5784816 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.931425 Oct 28 17:57:22.567808 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2728/5566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:21 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:22.574558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c11e11d2-e062-44c8-a24c-10d3713d1107 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 1.032927 Oct 28 17:57:22.590979 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2839/5567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:21 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:22.594738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:22.604740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:22.614218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:22.621727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:22.651999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:22.652961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:22.660580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:22.665693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:22.667825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:22.669092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:22.674220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:22.676856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:22.677703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:22.682584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:22.686756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:22.696178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.449949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:23.455255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:23.469742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:23.471413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:23.474865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79d3c5a2-04b6-4b3d-88c9-4bfb01c30908 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.895070 Oct 28 17:57:23.478456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2729/5568] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:22 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:23.483019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:23.505910 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec59d156-daa4-411a-b771-8c9c5146dcf5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.913484 Oct 28 17:57:23.509822 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2840/5569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:22 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:23.541339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:23.542363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:23.582787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.591165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.592967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.595740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.597791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.600857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.627589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:23.628802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:23.641005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.646482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.647167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.648099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.648714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.649332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.821312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5a5f265-3367-46b5-961a-c6458e5f2647 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.288064 Oct 28 17:57:23.825982 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2730/5570] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:23 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:23.840106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:23.842322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:23.857060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.859458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.859973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:23.860793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:23.861244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:23.861669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:24.340367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:24.372921 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f27b02a7-d667-4dd1-b5bd-4787eb525bd2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1511 microversion: 2.1 time: 0.542338 Oct 28 17:57:24.374232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2731/5571] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:23 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:24.380266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:24.412261 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-daa04a15-cc19-4ae7-a8ae-c7c155f69c2b tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1525 microversion: 2.1 time: 0.788553 Oct 28 17:57:24.413157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2841/5572] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:23 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1525 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:24.504584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:24.505572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:24.514988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:24.522959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:24.523830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:24.524876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:24.525541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:24.527502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:24.927130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:24.951506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:24.962306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:24.966642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89b5b447-96cf-4f40-a1b2-c9ed847e14dd tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.468306 Oct 28 17:57:24.976586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2732/5573] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:24 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:25.398998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:25.399977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:25.427456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:25.428507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:25.429191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:25.437067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:25.438388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:25.445324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:25.449239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:25.450005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:25.473027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:25.473858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:25.474526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:25.475468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:25.476111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:25.480794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.040504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:26.049234 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3dc0bfd7-0534-4d1d-926b-9a6956ee30fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1491 microversion: 2.1 time: 0.654216 Oct 28 17:57:26.052048 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2842/5574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:25 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1491 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:26.067077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:26.068617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:26.086830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.088952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.089845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.092188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.092829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.096182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.123765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:26.150015 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da6d10b6-ffd9-4b0c-b886-3eb7a7c4bd14 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1505 microversion: 2.1 time: 0.717223 Oct 28 17:57:26.150877 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2733/5575] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:25 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1505 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:26.155691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:26.166515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:26.193616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.194296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.195775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.196562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.197352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.197483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.307269 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'pause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state paused Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 13 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: {"pause": {}} Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'pause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state paused Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'pause': {}}} Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state paused. Cannot pause while the instance is in this state. Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state paused Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:26.319189 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:26.323824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:26.323824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:26.323824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:26.323824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state paused Oct 28 17:57:26.323824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:26.329500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'pause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state paused {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:26.333194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b7c6a07-0826-495e-92d6-2995bbd3c241 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 143 microversion: 2.1 time: 0.181319 Oct 28 17:57:26.337125 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2734/5576] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:26 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 143 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:57:26.348241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f25531e5-3981-4046-88e2-5913606710f6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'create', calling method: .version_select at 0x7f7524192ee0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1495174840", "description": "tempest-description-115518465"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:26.565150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:26.581250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:26.588810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:26.593209 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf6b35c3-5b65-425b-aea7-f79a70fedcde tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.539281 Oct 28 17:57:26.594061 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2843/5577] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:26 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:26.605788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:26.606704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:26.637334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.641208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.643969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.645024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.646802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.648732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.905214 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90cccdf9-5b39-4a5b-b107-d85526f5918d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.305501 Oct 28 17:57:26.905831 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2844/5578] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:26 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:26.916291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:26.921714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:26.939667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.940276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.940774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.941505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.944051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.946311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.950380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f25531e5-3981-4046-88e2-5913606710f6 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.611917 Oct 28 17:57:26.951548 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2735/5579] 10.222.0.48 () {60 vars in 1180 bytes} [Fri Oct 28 17:57:26 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:26.965674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1495174840"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:26.966509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:26.982687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.984415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.986911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:26.994928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:26.995730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:26.996371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:27.409565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Adding security group cf37f467-491e-493a-b346-96443c8e0d9f to port c1654529-0d7f-4082-a856-0bf4e674e4a9 Oct 28 17:57:27.597647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:27.609742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f46c99cd-329b-4392-8845-052ab0aae5bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1498 microversion: 2.1 time: 0.696975 Oct 28 17:57:27.613720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2845/5580] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:26 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1498 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:27.632873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:27.643898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:27.668277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:27.669006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:27.669664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:27.691757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:27.695315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:27.696868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:27.777676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:28.011075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:28.021511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:28.033745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:28.035356 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5dbcc6d-50c6-46d7-9871-9a1836a8b3d5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.406506 Oct 28 17:57:28.052486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2846/5581] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:27 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:28.563134 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ff46675-ce45-4872-a71b-d4bdd9ec5096 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action" status: 202 len: 0 microversion: 2.1 time: 1.601531 Oct 28 17:57:28.564127 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2736/5582] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:26 2022] POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action => generated 0 bytes in 1603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:28.592364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1495174840"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:28.596578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:28.613985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:28.644441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:28.649127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:28.649871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:28.654025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:28.659114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:28.660902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:28.663090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:28.671815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:28.672720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:28.735605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] Creating event network-changed:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:57:28.750180 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fc00ea20-b54b-40d4-9941-9024590818fe req-f8d35b75-aa78-4fd4-b3af-35ee4eee685f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139898 Oct 28 17:57:28.755090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2737/5583] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:28.779240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:28.780372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:28.796703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:28.802535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:28.803137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:28.806012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:28.806632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:28.807174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:29.405173 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.network.security_group_api [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Removing security group cf37f467-491e-493a-b346-96443c8e0d9f from port c1654529-0d7f-4082-a856-0bf4e674e4a9 Oct 28 17:57:29.881551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:29.893279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-37bd4b38-0a90-49bc-b84d-c5dfd0bc7c23 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.135221 Oct 28 17:57:29.909463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2738/5584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:28 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:29.920547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:29.921648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:29.928863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:29.929591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:29.930213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:29.931103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:29.931754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:29.932344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:31.068441 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-571a220d-16f3-4810-9836-20db440f08c7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action" status: 202 len: 0 microversion: 2.1 time: 2.499508 Oct 28 17:57:31.069069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2847/5585] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:28 2022] POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action => generated 0 bytes in 2501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:31.073711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:31.074331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:31.112037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:31.112561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:31.113022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:31.113760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:31.114221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:31.114655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:31.120174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:31.150095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:31.151594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:31.160711 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b86cd63-ca75-41ea-8909-58ebd0018238 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 1.250035 Oct 28 17:57:31.163877 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2739/5586] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:29 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:31.184370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8a864cc-62b3-4e7c-afae-245d08d915ba tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'create', calling method: .version_select at 0x7f75287dfe50>, body: {"pool": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:32.077711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:32.089958 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a71bb57-6f05-4044-8296-fb00e2a29dc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.019802 Oct 28 17:57:32.090563 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2848/5587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:31 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:32.114345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:32.144765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:32.148360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:32.170126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:32.206649 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] Creating event network-changed:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:57:32.223902 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-68d679b4-d7af-4a7e-af9f-7df1c1146f2a req-00b538f9-bb58-4a5f-b55d-f3861a0e0c37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119000 Oct 28 17:57:32.227876 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2849/5588] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:32.240677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:32.245134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:32.273117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:32.278203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:32.278897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:32.281029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:32.282093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:32.286204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:32.397791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action HTTP/1.1 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 28 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: {"reboot": {"type": "SOFT"}} Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '09cfe9b7-50fe-4906-a4fd-3499b128f2aa', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:32.406283 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:32.411159 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:32.414719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:32.418368 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6aef544d-b045-4f4e-adda-2f1d4894a9e8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action" status: 404 len: 111 microversion: 2.1 time: 0.188550 Oct 28 17:57:32.435801 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2850/5589] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:32 2022] POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:32.449663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:32.453468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:32.490436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:32.491199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:32.491842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:32.492749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:32.493368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:32.494863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:32.976148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:32.991360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:32.996299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:32.997490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-082a8b4d-eee1-447c-86df-68e727e3634a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.558249 Oct 28 17:57:32.998059 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2851/5590] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:32 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:33.015190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:33.028311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:33.048807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:33.052593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:33.053228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:33.059124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:33.060217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:33.063290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:33.832612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:33.841546 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e665451b-9605-4bd5-b3d9-dd9df646b255 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.830094 Oct 28 17:57:33.854068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2852/5591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:32 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:33.885409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:33.886026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:33.895735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:33.897029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:33.899615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:33.900541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:33.904245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:33.905036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:34.582075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:34.590781 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f262fce-78e5-41d5-9ed2-d4cf5c504831 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.709873 Oct 28 17:57:34.601404 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2853/5592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:33 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:34.625849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:34.635088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:34.709919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:34.712687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:34.713615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:34.715882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:34.716722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:34.718090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:35.088707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:35.110470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:35.121447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:35.124381 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-329ef7f1-205f-49d6-a7a3-d4f8b19646c2 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.519980 Oct 28 17:57:35.141194 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2854/5593] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:34 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:35.160456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:35.164995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 0cc52e30-5e9b-4352-ac7a-856db8245913] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:35.172928 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/0cc52e30-5e9b-4352-ac7a-856db8245913/action HTTP/1.1 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 28 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: {"reboot": {"type": "SOFT"}} Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0cc52e30-5e9b-4352-ac7a-856db8245913', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. Oct 28 17:57:35.175724 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. Oct 28 17:57:35.179794 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:35.210559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 0cc52e30-5e9b-4352-ac7a-856db8245913 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:35.211611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e247bca3-acb0-4ee6-ad2f-22165e41872b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc52e30-5e9b-4352-ac7a-856db8245913/action" status: 404 len: 111 microversion: 2.1 time: 0.067846 Oct 28 17:57:35.212249 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2855/5594] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:35 2022] POST /compute/v2.1/servers/0cc52e30-5e9b-4352-ac7a-856db8245913/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:35.240720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:35.245625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:35.265090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:35.267965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:35.269946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:35.271921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:35.273163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:35.276181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:36.629920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:36.660721 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6c473354-c477-42ef-9e2e-8854e1544d17 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.435096 Oct 28 17:57:36.661930 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2856/5595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:35 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:36.671296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:36.672181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:36.703861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:36.704629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:36.705259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:36.705982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:36.706443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:36.706872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.133740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:37.144394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:37.155668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:37.159159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e66aa72-0d65-4704-9bdc-ee24a9ba4d85 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1738 microversion: 2.20 time: 0.494605 Oct 28 17:57:37.162584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2857/5596] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:36 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1738 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:37.177830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:37.178805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:37.185698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.186778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.187657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.189103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.199349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.200425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.200648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8a864cc-62b3-4e7c-afae-245d08d915ba tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.035611 Oct 28 17:57:37.201262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2740/5597] 10.222.0.48 () {60 vars in 1170 bytes} [Fri Oct 28 17:57:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:37.215675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.138"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:37.221856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:37.249051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.251402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.252967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.253931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.266984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.268334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.339713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:57:37.340367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquired lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:57:37.447010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:37.458555 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ead7543-3749-440f-9525-2c3674d40eaf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.294050 Oct 28 17:57:37.480029 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2858/5598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:37 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:37.491446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:37.497908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:37.514358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.519196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.520200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.521281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.521978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.522767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.549351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action HTTP/1.1 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 65 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '09cfe9b7-50fe-4906-a4fd-3499b128f2aa', 'body': {'rebuild': {'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6'}}} Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 17:57:37.551729 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:57:37.555635 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:37.558818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:37.560154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f47a24c4-1dd3-40dc-9cae-f8be9bafcae3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action" status: 404 len: 111 microversion: 2.1 time: 0.073520 Oct 28 17:57:37.565340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2859/5599] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:37 2022] POST /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:57:37.571050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:37.571979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:37.579012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.579871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.580543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.581654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.582366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.583278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.815022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:37.823975 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7685604-ff46-44c4-b646-ffe1a2377a11 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.257178 Oct 28 17:57:37.844067 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2860/5600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:37 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:37.869610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:37.870623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:37.881681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.883931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.886106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:37.887036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:37.889237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:37.890114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:38.364977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:38.402864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37046222-5850-4910-9c33-f64fc515afa3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.537195 Oct 28 17:57:38.420043 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2861/5601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:37 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:38.426271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:38.427111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:38.434907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:38.435642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:38.436423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:38.437568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:38.438081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:38.439334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:38.902582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:38.914377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:38.916294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:38.917925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09e5b1bc-640e-45ba-92f6-479de6e7f034 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1720 microversion: 2.20 time: 0.496293 Oct 28 17:57:38.918637 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2862/5602] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:38 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1720 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:38.944571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:38.948495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 8c58c0e7-4d8a-432f-a175-0d93a092565a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:38.963336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/8c58c0e7-4d8a-432f-a175-0d93a092565a/action HTTP/1.1 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 65 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8c58c0e7-4d8a-432f-a175-0d93a092565a', 'body': {'rebuild': {'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6'}}} Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 17:57:38.965309 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. Oct 28 17:57:38.970397 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:38.979582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 8c58c0e7-4d8a-432f-a175-0d93a092565a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:38.981881 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60fd3ff7-d266-425b-a5fc-9e05812a7c7e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/8c58c0e7-4d8a-432f-a175-0d93a092565a/action" status: 404 len: 111 microversion: 2.1 time: 0.048472 Oct 28 17:57:38.984258 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2863/5603] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:38 2022] POST /compute/v2.1/servers/8c58c0e7-4d8a-432f-a175-0d93a092565a/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:38.995912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:38.999020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:39.015332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:39.018950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:39.019647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:39.020597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:39.021247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:39.021873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:39.335394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:39.343790 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23648031-3224-445e-9f00-237ab6bb6863 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.354793 Oct 28 17:57:39.346191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2864/5604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:38 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:39.373310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:39.374245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:39.383703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:39.384446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:39.385091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:39.385984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:39.387160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:39.387808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:39.621558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:39.638315 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-301b0be1-813e-4457-ac28-c894b6dd33fc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.269073 Oct 28 17:57:39.638910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2865/5605] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:39 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:39.662527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:57:39.864004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a163f1c-5d24-4c4a-835e-6110c2bc9c5b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Action: 'create', calling method: .version_select at 0x7f752420e040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1728383910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIun/Zza8nn4mpTtuWwfS4ruetxUSxCwsR9PbHhtqh31vMZ41gxx3Y65IzoCVl04D9DgpPjReUKotWx1mcYtpbY+xeJgrbPGFyWEILtfTUju2LIupKh1pubCHeFc+p6dlQ=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:39.921701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9a163f1c-5d24-4c4a-835e-6110c2bc9c5b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:57:39.951353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9a163f1c-5d24-4c4a-835e-6110c2bc9c5b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for user ce67aabadec84b459ec2cb4b465aab4d and project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:57:39.995638 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a163f1c-5d24-4c4a-835e-6110c2bc9c5b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.350731 Oct 28 17:57:40.004216 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2866/5606] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 17:57:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:40.022014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:40.024034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: ab3d6b88-def6-45b4-a2df-8f6093701e72] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:40.047444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/ab3d6b88-def6-45b4-a2df-8f6093701e72/action HTTP/1.1 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: {"restore": {}} Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ab3d6b88-def6-45b4-a2df-8f6093701e72', 'body': {'restore': {}}} Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:40.053022 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:40.057723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:40.057723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:40.057723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. Oct 28 17:57:40.057723 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:40.058707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance ab3d6b88-def6-45b4-a2df-8f6093701e72 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:40.060333 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-98a28b47-c203-43ed-8e9d-cdfb0c7d2d2f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/ab3d6b88-def6-45b4-a2df-8f6093701e72/action" status: 404 len: 111 microversion: 2.1 time: 0.054313 Oct 28 17:57:40.063785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2867/5607] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:40 2022] POST /compute/v2.1/servers/ab3d6b88-def6-45b4-a2df-8f6093701e72/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:40.075718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:40.113497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:40.114253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:40.115090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:40.132183 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] Creating event network-changed:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:57:40.145539 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ac4eb857-cc40-4f52-9c09-21db0952d350 req-ce3f446b-5ab7-4784-a4a8-8ab439a5916e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078244 Oct 28 17:57:40.147469 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2868/5608] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:40.176014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:40.178710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:40.195503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:40.197882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:40.200470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:40.201427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:40.202260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:40.203567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:40.672296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:40.690279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:40.691982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:40.693203 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c1579ac-334c-428b-bc52-c6fc9375db9f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1723 microversion: 2.20 time: 0.544449 Oct 28 17:57:40.698577 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2869/5609] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:40 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1723 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:40.712647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:40.713261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:40.756237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:40.756748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:40.757370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:40.759129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:40.759766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:40.760364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:40.795102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:41.917668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:41.932844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4242dd46-993d-4b9e-896f-9b30c377ec35 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.232171 Oct 28 17:57:41.935430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2870/5610] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:40 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:41.968123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35cedbe9-cc0e-43a1-9f35-ab362e58e606"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:41.972998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:41.987037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:41.988010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:41.988720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:41.989779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:41.990471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:41.991131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.060623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Updating instance_info_cache with network_info: [{"id": "c1654529-0d7f-4082-a856-0bf4e674e4a9", "address": "fa:16:3e:51:10:8d", "network": {"id": "4b7287a8-7e5e-4176-a733-3e629774da91", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1619113324-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d5e107ff184342b8bf8c23f467134d69", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1654529-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:57:42.080358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Releasing lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:57:42.081473 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4bb0ae59-a2d2-485b-b824-6361e32b1fe7 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action" status: 202 len: 0 microversion: 2.1 time: 4.870894 Oct 28 17:57:42.082529 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2741/5611] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:37 2022] POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action => generated 0 bytes in 4872 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:57:42.091674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:42.121826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.122307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.122733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.153994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] Unable to find a host for instance 1904b39e-0bfe-4078-b38a-e461a568348c. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:57:42.154623 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-248bccc7-3f4b-4217-ad7a-9d4520d34f62 req-f4a6d0d4-07f1-41c5-bc77-2bc34862200b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067629 Oct 28 17:57:42.155720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2742/5612] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 17:57:42.160521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:42.163644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:42.176896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.177451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.177828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.178528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.178973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.179409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.468020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:42.481082 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7baa4745-a274-46ee-b566-2c9fe3bbc826 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.324286 Oct 28 17:57:42.482357 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2743/5613] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:42 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:42.488909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.138"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:42.640666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-49ab518b-96ed-4855-a309-d617b7f2184e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.703083 Oct 28 17:57:42.643319 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2871/5614] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Oct 28 17:57:41 2022] POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments => generated 188 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 17:57:42.667171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:42.667971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:42.685610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:42.692432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.693128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.693737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.694678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.695920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.697063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.697709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.699609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.701537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.702223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.704113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.704531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.740679 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'restore' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: {"restore": {}} Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'restore' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'restore': {}}} Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state active. Cannot restore while the instance is in this state. Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:42.742424 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:42.746494 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:42.746494 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:42.746494 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:42.746494 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:42.746494 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:42.748193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'restore' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:42.749257 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad07c457-aa82-4310-a2a0-36801c1742a8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 145 microversion: 2.1 time: 0.104707 Oct 28 17:57:42.750883 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2872/5615] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:42 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:57:42.759948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:42.761560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:42.795875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.798262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.799598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:42.803226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:42.804229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:42.806244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.169386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:43.177837 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-321ff4a6-eca7-4f9e-9a60-57b4917d7a04 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.422447 Oct 28 17:57:43.182850 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2873/5616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:42 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:43.195072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 17:57:43.195072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquired lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 17:57:43.198970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:43.199673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:43.219146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.220378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.221129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.221865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.222314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.222924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.653987 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eaeef4be-ab6a-4aaf-b124-627f4189d6d0 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments/35cedbe9-cc0e-43a1-9f35-ab362e58e606" status: 202 len: 0 microversion: 2.20 time: 0.468470 Oct 28 17:57:43.655263 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2874/5617] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Oct 28 17:57:43 2022] DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments/35cedbe9-cc0e-43a1-9f35-ab362e58e606 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:57:43.661475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:43.662481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:43.678658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.681353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.682050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.684730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.690750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.691679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.948594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:43.957454 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3d57323-1045-4469-96c1-e9e2adf0102e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.300509 Oct 28 17:57:43.976086 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2875/5618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:43 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:43.983787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:43.984648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:43.993238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.994021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.994719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:43.995635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:43.996383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:43.997229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:44.065660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:44.069268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 17:57:44.180700 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-45f7e2ca-6c38-4fcb-a03a-53f5a5b8d048 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/action" status: 202 len: 0 microversion: 2.20 time: 0.202731 Oct 28 17:57:44.186073 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2876/5619] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Oct 28 17:57:43 2022] POST /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:57:44.192851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:44.193788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: ab8e07bf-7107-4cc2-9151-ef1c946b3efe] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:44.202100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/ab8e07bf-7107-4cc2-9151-ef1c946b3efe/action HTTP/1.1 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 14 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: {"resume": {}} Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ab8e07bf-7107-4cc2-9151-ef1c946b3efe', 'body': {'resume': {}}} Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:44.207756 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:44.212828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:44.212828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:44.212828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. Oct 28 17:57:44.212828 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:44.214507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance ab8e07bf-7107-4cc2-9151-ef1c946b3efe could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:44.216079 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78ab2ccb-c7d6-43ce-8abb-7b58e0538191 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/ab8e07bf-7107-4cc2-9151-ef1c946b3efe/action" status: 404 len: 111 microversion: 2.1 time: 0.028465 Oct 28 17:57:44.217489 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2877/5620] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:44 2022] POST /compute/v2.1/servers/ab8e07bf-7107-4cc2-9151-ef1c946b3efe/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:44.224265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:44.225952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:44.251360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:44.253671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:44.258086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:44.258870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:44.259341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:44.259802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:44.737024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:44.745452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Building network info cache for instance {{(pid=120568) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 17:57:44.752357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:44.755736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:44.757012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-960e7e61-cd91-4796-b7e9-2a66129ce91b tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1671 microversion: 2.20 time: 0.538127 Oct 28 17:57:44.757580 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2878/5621] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:44 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1671 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:44.778444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:44.781435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:44.805735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:44.806235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:44.806690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:44.807431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:44.807901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:44.808333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:45.583311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:45.592030 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6832a106-f2bf-414b-83c1-d9b80b3eb46f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.830017 Oct 28 17:57:45.592815 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2879/5622] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:44 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:45.601753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:45.620231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:45.621246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:45.621831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:45.645585 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] Creating event network-changed:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:57:45.651451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ccaaf263-d071-4158-8e7d-b169b2a8063d req-827040b9-c664-40a3-a1fe-136f332d04cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057144 Oct 28 17:57:45.653569 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2880/5623] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:45.660381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:45.661382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:45.670173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:45.670859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:45.671706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:45.674015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:45.675608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:45.677964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:45.988628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:46.001382 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e117db7-5e76-4a86-b1c9-597937d1dccb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.344752 Oct 28 17:57:46.022816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2881/5624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:45 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:46.028864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:46.033165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:46.053128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.054574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.056913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:46.057854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.066857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.067596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:46.185634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Updating instance_info_cache with network_info: [{"id": "c1654529-0d7f-4082-a856-0bf4e674e4a9", "address": "fa:16:3e:51:10:8d", "network": {"id": "4b7287a8-7e5e-4176-a733-3e629774da91", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1619113324-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d5e107ff184342b8bf8c23f467134d69", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1654529-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120568) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 17:57:46.206922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Releasing lock "refresh_cache-46f587f7-044d-401c-8c00-e022cfccc4f4" {{(pid=120568) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 17:57:46.208248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-673e6839-f2fb-410c-9b81-9a94ea9fd8bb tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action" status: 202 len: 0 microversion: 2.1 time: 3.724689 Oct 28 17:57:46.209822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2744/5625] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:42 2022] POST /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4/action => generated 0 bytes in 3726 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 17:57:46.225242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:46.226003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:46.236928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.238835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.239587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:46.241403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.243998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.244700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:46.293931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'resume' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 14 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: {"resume": {}} Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'resume' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'resume': {}}} Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state active. Cannot resume while the instance is in this state. Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:46.296171 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:57:46.300668 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:46.302370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'resume' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:46.303510 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa3f61f5-ac72-4098-94ae-92d18645c951 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 144 microversion: 2.1 time: 0.092204 Oct 28 17:57:46.308005 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2745/5626] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:46 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 144 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:57:46.313986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14111b3a-1de7-449e-92c5-a7a12ddcf583 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '.version_select at 0x7f75240343a0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:46.513094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:46.520486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:46.530554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:46.532659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:46.538436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea3872cd-7bec-435f-ac01-d528cbeac540 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1671 microversion: 2.20 time: 0.509661 Oct 28 17:57:46.542108 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2882/5627] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:46 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1671 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:46.553135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:46.555967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:46.563194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.563981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.564593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:46.568283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:46.568804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:46.569251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:47.463692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:47.479864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5fb2b78c-3e2c-4d82-b204-19ae45506a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.936567 Oct 28 17:57:47.482237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2883/5628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:46 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:47.515298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:47.516256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:47.523299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:47.524052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:47.524743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:47.525523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:47.526048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:47.526540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:48.062794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:48.075712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1960ee9e-bbf4-4cfe-a1ea-09e68deb9d76 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.569852 Oct 28 17:57:48.076977 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2884/5629] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:47 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:48.089709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:48.090334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:48.104906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:48.105410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:48.105849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:48.106566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:48.108002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:48.108558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:48.857941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:48.873140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:48.877947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:48.887113 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-38b11f38-c92f-4d63-984f-8ac098c5731c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.806952 Oct 28 17:57:48.890761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2885/5630] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:48 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:48.906002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-722fb3d6-d4f4-46a9-a22f-df4d0a82eb03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-722fb3d6-d4f4-46a9-a22f-df4d0a82eb03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 160 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f77b061d-e7ef-4fd5-b30a-b8ae1f30e705"}]}} Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'server': {'name': '', 'imageRef': '4f7274c7-779f-4acb-8077-345620e4cdc6', 'flavorRef': '452', 'networks': [{'uuid': 'f77b061d-e7ef-4fd5-b30a-b8ae1f30e705'}]}}} Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi '' Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:57:48.925737 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-722fb3d6-d4f4-46a9-a22f-df4d0a82eb03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-722fb3d6-d4f4-46a9-a22f-df4d0a82eb03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.034346 Oct 28 17:57:48.929857 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2886/5631] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:48 2022] POST /compute/v2.1/servers => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:57:48.955406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:48.956032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:48.968783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:48.973694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:48.974366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:48.975310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:48.975957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:48.976549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:49.199685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14111b3a-1de7-449e-92c5-a7a12ddcf583 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/e2b8fa22-f534-4063-9f25-07d97de521db" status: 202 len: 0 microversion: 2.1 time: 2.890162 Oct 28 17:57:49.202551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2746/5632] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 17:57:46 2022] DELETE /compute/v2.1/os-floating-ips/e2b8fa22-f534-4063-9f25-07d97de521db => generated 0 bytes in 2894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:49.216848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb933e71-c475-45c5-b399-397d13d0f223 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '.version_select at 0x7f751f638040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:49.476869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:49.491273 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10c3b6a3-ea5c-4bde-b54e-dd2e12aa75c3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.548619 Oct 28 17:57:49.492711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2887/5633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:48 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:49.522561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:49.523553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:49.534960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:49.535884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:49.536549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:49.537590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:49.538352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:49.540312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:49.972239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:50.020617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cb933e71-c475-45c5-b399-397d13d0f223 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/cf37f467-491e-493a-b346-96443c8e0d9f" status: 202 len: 0 microversion: 2.1 time: 0.809753 Oct 28 17:57:50.022555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2747/5634] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 17:57:49 2022] DELETE /compute/v2.1/os-security-groups/cf37f467-491e-493a-b346-96443c8e0d9f => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:50.034479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:50.037506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:50.066248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=43 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:50.071652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.074056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.074607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.076080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.079034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.083646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.317294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:50.349305 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f1e1753-421d-403e-bd70-a327778d5b9a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.828409 Oct 28 17:57:50.349929 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2888/5635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:49 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:50.380825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:50.381331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:50.425299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.426053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.435755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.440203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.442993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.452148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.571260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:57:50.650518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:50.674101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:50.679669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:50.692060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5e69140-2908-4541-a264-913284ea58da tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.664024 Oct 28 17:57:50.692729 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2748/5636] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:50 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:50.718432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:50.720206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 861d4891-df0c-482e-9717-06d6e93b1e50] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:50.738875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/861d4891-df0c-482e-9717-06d6e93b1e50/action HTTP/1.1 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 14 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: {"shelve": {}} Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '861d4891-df0c-482e-9717-06d6e93b1e50', 'body': {'shelve': {}}} Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:50.744636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 861d4891-df0c-482e-9717-06d6e93b1e50 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:50.750947 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cacd32c-fdc3-4f21-8cc8-26c401666212 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/861d4891-df0c-482e-9717-06d6e93b1e50/action" status: 404 len: 111 microversion: 2.1 time: 0.049799 Oct 28 17:57:50.756276 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2749/5637] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:50 2022] POST /compute/v2.1/servers/861d4891-df0c-482e-9717-06d6e93b1e50/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:57:50.771070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:50.773179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:50.797138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.799792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.803061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.803934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.806137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.807562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.867017 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-befae0ad-fc53-4584-85f9-b6ee3d7c58a0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 204 len: 0 microversion: 2.1 time: 0.513292 Oct 28 17:57:50.871500 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2889/5638] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:57:50 2022] DELETE /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:57:50.886309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:50.896964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:50.916783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.928361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.929073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:50.930909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:50.933777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:50.934385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:51.474063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:51.499085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-682896ac-458d-49bf-9a58-86d0b17680e0 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1511 microversion: 2.1 time: 0.622104 Oct 28 17:57:51.502338 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2890/5639] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:50 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:51.720826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:51.721799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:51.742316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:51.752730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:51.754279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:51.758066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:51.761831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:51.762369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:51.861345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:51.876016 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f3b5322-41ca-4783-b5e2-e57be0b98652 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 1.118344 Oct 28 17:57:51.877096 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2750/5640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:50 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:51.906385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:51.907714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:51.916869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:51.917364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:51.926155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:51.927004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:51.929439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:51.930040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:51.934952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:52.334932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:52.349818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:52.351233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:52.352994 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9874d4ff-66b6-44c4-b1a5-084ffd9071c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.636657 Oct 28 17:57:52.379489 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2891/5641] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:51 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:52.504861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:52.518191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1cb17a3-07d2-4a4e-b15a-06d3808010f0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.615983 Oct 28 17:57:52.519191 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2751/5642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:51 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:57:52.542085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:52.542811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:52.543832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:52.544536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:52.553954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:52.554472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:52.556861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:52.558369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:52.560101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:52.560346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:52.560966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:52.561871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:52.562600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:52.564094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:52.567141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:52.567741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:52.661349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lazy-loading 'flavor' on Instance uuid 5d74c8d2-d52e-49ec-b840-a6d801c7db61 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:57:53.042110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:53.054724 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0f48ae3-7804-4629-846b-caa8360b0095 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1511 microversion: 2.1 time: 0.521230 Oct 28 17:57:53.060843 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2892/5643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:52 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1511 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:53.238777 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d474814b-accd-4d21-8631-5e84a64f7b32 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.699712 Oct 28 17:57:53.242588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2752/5644] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:57:52 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:57:53.248971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:53.249987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:53.257903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:53.258822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:53.259536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:53.260589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:53.261566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:53.262525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:53.383104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:53.384576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:53.405923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:53.408511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:53.409147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:53.410921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:53.412906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:53.415387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:53.931735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:53.955339 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7fba4827-29a0-4842-b628-e7adbd974fc1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.696501 Oct 28 17:57:53.956834 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2893/5645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:53 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:54.050386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:54.067958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:54.073457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:54.077941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8af2644-3517-4f19-af99-aebf99105d4a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.699195 Oct 28 17:57:54.080827 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2753/5646] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:53 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:54.104389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:54.105145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:54.115699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:54.120360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:54.121737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:54.124703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:54.126842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:54.128244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:54.130249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1302970608", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:54.298512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:57:55.092615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:57:55.094666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:57:55.095609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:57:55.096190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:57:55.096848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:57:55.121364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.122061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.123233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.125098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.127663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.128374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.163809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:55.176648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec980f53-6371-429b-aabc-189baebccb92 tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1511 microversion: 2.1 time: 1.084274 Oct 28 17:57:55.178962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2894/5647] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:54 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1511 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:55.184890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:55.194408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Getting quotas for project 696997478771414f8df68ca182bd48a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:57:55.194784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:55.210705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Getting quotas for user aaacc8a1b32140aebe109d7c629e443c and project 696997478771414f8df68ca182bd48a3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:57:55.211841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.212437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.212876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.215151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.217608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.219648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.239827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:57:55.245981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:57:55.365515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70782d21-c73a-46fa-9b1b-f23cec7c0d25 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241192 Oct 28 17:57:55.370138 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2754/5648] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 17:57:55.385789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:55.395483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:55.417925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.418432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.418877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.429945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:55.430472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:55.430931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:55.696658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:55.738366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-62e0611d-2062-4f0a-81eb-8fe0f4e2ac74 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.557342 Oct 28 17:57:55.738987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2895/5649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:55 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:55.783876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4eb522a0-b6ba-4f0e-abaa-82ea8b9bc362 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:55.784612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4eb522a0-b6ba-4f0e-abaa-82ea8b9bc362 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:56.060622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4eb522a0-b6ba-4f0e-abaa-82ea8b9bc362 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:56.074223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4eb522a0-b6ba-4f0e-abaa-82ea8b9bc362 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1214 microversion: 2.1 time: 0.310543 Oct 28 17:57:56.075518 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2896/5650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:55 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:56.101709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f587f7-044d-401c-8c00-e022cfccc4f4", "name": "network-vif-deleted", "tag": "c1654529-0d7f-4082-a856-0bf4e674e4a9"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:56.147761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.148798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.152649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:56.197683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:56.211568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] Creating event network-vif-deleted:c1654529-0d7f-4082-a856-0bf4e674e4a9 for instance 46f587f7-044d-401c-8c00-e022cfccc4f4 on n-h1-860864-13 Oct 28 17:57:56.218881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:56.238517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:56.242609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4417d9e5-41f9-4647-ac4a-2385fcdb0803 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.869983 Oct 28 17:57:56.246159 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-81844391-64d6-4025-aebf-727984fb7a4d req-0cb0646b-afc5-4d26-860b-c01d298919bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169114 Oct 28 17:57:56.247014 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2755/5651] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:55 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:56.258620 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2897/5652] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:57:56.265170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:56.272411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:56.286008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.286619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.287264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:56.288112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.292037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.292688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:56.372662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.373916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.374714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:56.376002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lazy-loading 'fault' on Instance uuid 46f587f7-044d-401c-8c00-e022cfccc4f4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:57:56.454218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b91bf30bbe4fee97e31179f4bd1238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e107ff184342b8bf8c23f467134d69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:56.472939 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50680eeb-c428-4b4c-8118-69506598585e tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 200 len: 1313 microversion: 2.1 time: 0.209329 Oct 28 17:57:56.478742 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2756/5653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:56 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:56.765396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:56.766280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:56.788067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.789205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.791657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:56.794504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:56.798917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:56.800196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.106895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:57.107765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:57.126847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.127775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.128497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.129345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.129820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.132637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.194514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:57.204956 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4796de2d-e1b7-4447-8d23-e2707988ee71 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.446281 Oct 28 17:57:57.205667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2898/5654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:56 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:57.257491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:57.267288 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-124d52c6-e178-4910-8a2f-665497c4371f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1266 microversion: 2.1 time: 0.173033 Oct 28 17:57:57.268900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2757/5655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:57 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:57.278845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:57.280387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:57.291132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.292688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.293436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.294767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.295708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.298288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.495770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:57.506959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:57.507794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] [instance: 46f587f7-044d-401c-8c00-e022cfccc4f4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:57.519866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:57.521330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:57.523351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.523960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.524497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.525449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f58f45f5-4ffa-46cb-94c3-59a1e44bfdd4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.252326 Oct 28 17:57:57.526374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:57.527622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:57.550119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2899/5656] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:57 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:57.550518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:57.567805 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] HTTP exception thrown: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Request method failure captured: Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 HTTP/1.1 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBfHzkpzqnVwqgLtC47-sbcB0Z2jTk41eJpqfiW0jG50fC7zgLysjLsKMgleBA-jYOCYtfpDm6cGkfoqZUo8Oi8-uUhgV0oRtjxhPq34sZlE2GEkPSE-tED-UHL-SPqGSss9MrWlTY8g9mCrxy2WJ2niyWdvzC-yRZ_8rn-CoJiA4ZU Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d5e107ff184342b8bf8c23f467134d69 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1515441853 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5e107ff184342b8bf8c23f467134d69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d5e107ff184342b8bf8c23f467134d69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d5e107ff184342b8bf8c23f467134d69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d5e107ff184342b8bf8c23f467134d69"}]}] Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1515441853 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d5e107ff184342b8bf8c23f467134d69 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1515441853 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerRescueTestJSONUnderV235-1515441853-project Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f2b91bf30bbe4fee97e31179f4bd1238 Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1515441853-project Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '46f587f7-044d-401c-8c00-e022cfccc4f4'} Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:57.569982 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. Oct 28 17:57:57.575450 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:57:57.577784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] Returning 404 to user: Instance 46f587f7-044d-401c-8c00-e022cfccc4f4 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:57:57.579641 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-27caac1e-a813-42c0-8102-b14767ab197d tempest-ServerRescueTestJSONUnderV235-1515441853 tempest-ServerRescueTestJSONUnderV235-1515441853-project] 10.222.0.48 "GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4" status: 404 len: 111 microversion: 2.1 time: 0.076715 Oct 28 17:57:57.580682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2758/5657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:57 2022] GET /compute/v2.1/servers/46f587f7-044d-401c-8c00-e022cfccc4f4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:57:57.652902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1080815288-access_point-2063894453", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "955ba9b9-ba45-4cd2-9e4f-db455888cc1a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1728383910", "security_groups": [{"name": "tempest-secgroup_access--2015956208"}, {"name": "tempest-secgroup_general--580392981"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:57:57.942625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] validate_networks() for [('955ba9b9-ba45-4cd2-9e4f-db455888cc1a', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:57:58.240063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:58.240690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:58.251033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:58.251541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:58.254692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:58.255850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:58.257878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:58.258605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:58.617789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:58.633845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48bcb769-cb20-4938-9073-50e49cf2e5e3 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.403352 Oct 28 17:57:58.638184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2759/5658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:58 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:58.673889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:58.677059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:58.699398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:58.703023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:58.706725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:58.709151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:58.718624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:58.722405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.012158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:59.028230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99890dd2-ae40-4c1a-ba97-df8d12c806c9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1272 microversion: 2.1 time: 0.385279 Oct 28 17:57:59.031108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2760/5659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:58 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:57:59.051427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:59.053271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:59.090690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.095207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.096275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.099824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.102805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.103536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.185921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:57:59.190128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:57:59.190808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:57:59.191502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:57:59.192097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:57:59.216372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.219825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.220625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.223955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.225713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.227349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.315512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:57:59.327316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for user ce67aabadec84b459ec2cb4b465aab4d and project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:57:59.346078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:57:59.351199 n-d-860864-13 devstack@n-api.service[120567]: WARNING nova.utils [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1080815288-access_point-2063894453 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1080815288-ac Oct 28 17:57:59.353401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:57:59.440436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:59.455183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:59.457328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:59.458761 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f7e724e-7395-47fa-bb6c-ad6762baa51f tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.425594 Oct 28 17:57:59.459826 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2761/5660] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:57:59 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:57:59.469861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a8ede769-cba5-49c7-92a2-7b0b02fb1f67 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.820560 Oct 28 17:57:59.471561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2900/5661] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:57:57 2022] POST /compute/v2.1/servers => generated 457 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:57:59.514761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0fe1db63-3d8c-4ea1-a7b7-f263667f2ae6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:59.516501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0fe1db63-3d8c-4ea1-a7b7-f263667f2ae6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:59.663631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0fe1db63-3d8c-4ea1-a7b7-f263667f2ae6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:57:59.664934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:57:59.666859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:57:59.676883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0fe1db63-3d8c-4ea1-a7b7-f263667f2ae6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1295 microversion: 2.1 time: 0.198045 Oct 28 17:57:59.679292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.682346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.683149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.684025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:57:59.684498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:57:59.684936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:57:59.693735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:57:59.695323 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2762/5662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:59 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:00.024855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:00.045786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c72b9793-2ec3-427f-bed0-af6b6a6058a0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.384743 Oct 28 17:58:00.047442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2901/5663] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:57:59 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:00.062590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:00.063674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:00.080138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.082837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.083299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.085278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.085765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.087063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.214826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:00.228285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9e23e04-c16c-4e74-926c-312bf9e810f5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1272 microversion: 2.1 time: 0.170046 Oct 28 17:58:00.229828 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2763/5664] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:00 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:00.486328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:00.487608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:00.501292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.504032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.511164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.512241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.512872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.513499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.710111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:00.711493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:00.730605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.733175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.733637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.737246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:00.737757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:00.738199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:00.957488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:00.972462 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-474aab1f-8d04-4456-9231-8a8215e0c0e6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1299 microversion: 2.1 time: 0.263694 Oct 28 17:58:00.996484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2764/5665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:00 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1299 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:01.041858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:01.074057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:01.076717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:01.077548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:01.080922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:01.089190 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-604c6ee6-f56a-4a59-8754-95b8d6b2f546 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.600698 Oct 28 17:58:01.103401 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2902/5666] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:00 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:01.103769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:01.257381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:01.258202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:01.270655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:01.271198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:01.276983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:01.277763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:01.279656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:01.280119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:01.540579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:01.555670 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd1ccc6f-8aec-4e96-8cdc-f8e3b8486ac9 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1272 microversion: 2.1 time: 0.303795 Oct 28 17:58:01.560177 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2903/5667] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:01 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:01.701287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:01.715131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb009718-467c-4eac-b7cb-b7b9c3ab5470 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.644824 Oct 28 17:58:01.726684 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2765/5668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:01 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:01.998614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:01.999153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:02.022320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.025983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.026755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.033881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.034702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.037134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.123071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:02.124105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:02.137824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.146345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.149236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.150855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.154146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.155570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.245881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:02.257322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-384b594d-4065-46b5-b35a-749cd4b34bb3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1365 microversion: 2.1 time: 0.263189 Oct 28 17:58:02.264962 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2904/5669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:01 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:02.474955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:02.483811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:02.485418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:02.487882 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2477552-ee8b-4c2b-8ac2-b271a2b06b5c tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.369652 Oct 28 17:58:02.503788 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2766/5670] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:02 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:02.582079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:02.583404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:02.590616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.591508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.592150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.593103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.594151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.598234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.676164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:02.684608 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3606d9b-e12a-4604-9674-f120afeb5bd5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1272 microversion: 2.1 time: 0.107064 Oct 28 17:58:02.691439 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2905/5671] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:02 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:02.744680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:02.745281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:02.753337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.753892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.754345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:02.755063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:02.755545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:02.755978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.214367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.220456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:03.228216 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f9dade35-2f72-4479-ab22-05a9d2d18c36 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.487860 Oct 28 17:58:03.229072 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2767/5672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:02 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:03.302805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:03.311781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:03.318696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.319264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.319817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.320599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.321125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.321800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.473705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.482512 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-088f0006-a678-49a4-8cbc-101aad7e5186 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1353 microversion: 2.1 time: 0.193376 Oct 28 17:58:03.483763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2906/5673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:03 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:03.521203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:03.522161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:03.530636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.531540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.532185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.533092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.534441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.535081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.711541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:03.713770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:03.723662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.724163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.724668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.725539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:03.726004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:03.727491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:03.738833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.747515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.750854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.752336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d531005-3dd7-47a0-b520-2819db1288c4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.238668 Oct 28 17:58:03.769091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2768/5674] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:03 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:03.888639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:03.898744 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a59524f1-9853-4dd0-a179-61e31f246cd1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.193046 Oct 28 17:58:03.912090 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2907/5675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:03 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:04.251908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:04.252604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:04.259859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.260344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.260776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.261473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.261925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.262345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.441049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:04.455520 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da1bef4c-1ab8-497c-9494-cd3db6f4ecb6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.207360 Oct 28 17:58:04.459610 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2769/5676] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:04.507769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:04.509187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:04.518236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.518725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.519156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.520153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.520670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.521348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.730419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:04.739540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc383073-9bed-425f-b6cc-43b1ec867034 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.236240 Oct 28 17:58:04.756952 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2908/5677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:04 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:04.779981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:04.781992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:04.797790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.798549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.799159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.800076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.800687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.801308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.922430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:04.923172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:04.930454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.930947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.931408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.932126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:04.932575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:04.939636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:04.974313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:04.987887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:04.989948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:04.991580 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-390fa9d0-188d-4821-8b25-4324cfdaa115 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.217369 Oct 28 17:58:05.007576 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2770/5678] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:04 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:05.208195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:05.222325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba554f95-ced5-406c-a736-d3c906c78193 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.303859 Oct 28 17:58:05.235884 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2909/5679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:04 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:05.480306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:05.481211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:05.483246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:05.492379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:05.492807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:05.493240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:05.494107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:05.494713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:05.495452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:05.643165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:05.655607 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2bcff3d-5a04-4a8e-983a-13715a54b651 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1533 microversion: 2.1 time: 0.179267 Oct 28 17:58:05.657670 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2771/5680] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:05 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1533 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:05.769324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:05.770038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:05.777280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:05.777861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:05.778300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:05.779176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:05.779810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:05.780400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:05.935053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:05.945181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a8c5a98-3980-448d-9077-016fa9005f91 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.180171 Oct 28 17:58:05.945778 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2910/5681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:05 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:06.023404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:06.024094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:06.034243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.034937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.035324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.036177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.036698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.037229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.192331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:06.204361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:06.209066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:06.211399 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-612f8377-18e3-409d-adc0-196249b6020d tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.193318 Oct 28 17:58:06.212147 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2772/5682] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:06 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:06.250167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:06.251176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:06.261109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.261949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.262389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.263102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.268060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.269596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.351699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee01030c-8351-460a-97a1-221241449bc6", "tag": "eda33f05-9344-448e-a7af-e46d39cadd6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:06.377219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.380662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.383453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.405760 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] Creating event network-changed:eda33f05-9344-448e-a7af-e46d39cadd6a for instance ee01030c-8351-460a-97a1-221241449bc6 on n-h1-860864-13 Oct 28 17:58:06.441543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-28bc9677-c8c0-4c1f-a302-730badb28adc req-cb462aaa-bd19-46d9-a701-01474675ed2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094809 Oct 28 17:58:06.442235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2773/5683] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:06.536819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:06.547592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c39639d7-8122-4151-a3cc-22870409c133 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.301121 Oct 28 17:58:06.549716 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2911/5684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:06 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:06.683507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:06.684229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:06.691867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.692690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.693366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.694311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.695293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.696452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.901745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:06.910093 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1b9bed9-371b-42bd-b41e-933aacbb8ba9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1533 microversion: 2.1 time: 0.231618 Oct 28 17:58:06.910987 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2774/5685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:06 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1533 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:06.912080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:06.912648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:06.941599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.942119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.942976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.943797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.944265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.944645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.971166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:06.972015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:06.980514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.981008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.982653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:06.983509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:06.984002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:06.984479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.008699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87ca11d0-e3a6-4e25-bf83-a6526e128af2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/ips" status: 200 len: 146 microversion: 2.1 time: 0.114529 Oct 28 17:58:07.009309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2912/5686] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:58:06 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/ips => generated 146 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:07.160673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:07.169907 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1fbe6246-c446-40f5-8e18-9cb1610ba361 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.204667 Oct 28 17:58:07.170808 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2775/5687] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:06 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:07.239536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:07.239536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:07.246520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.247006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.247735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.248677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.249342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.250038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.421574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:07.431179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:07.433588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:07.435091 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f80bd19-408d-4bb4-8725-cd23f87919a4 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.201347 Oct 28 17:58:07.436289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2913/5688] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:07 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:07.572784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:07.573389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:07.580469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.581225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.581881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.582439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.583022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.583479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.809787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:07.837518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.268415 Oct 28 17:58:07.840400 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2776/5689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:07 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:07.936828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:07.939092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:07.945539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:07.953724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.954997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.956315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.957422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:07.958246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:07.959123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:07.982085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:07.983555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78ffb29b-8ec2-4aee-b1ee-5bc310a6cb03 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001918 Oct 28 17:58:07.984241 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2777/5690] 10.222.0.48 () {56 vars in 886 bytes} [Fri Oct 28 17:58:07 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 17:58:08.194502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:08.196521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:08.213701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.214687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.215390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.217106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.217855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.219290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.273296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:08.296112 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0dff4065-f8e3-4dbc-966b-0b751a98b321 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1533 microversion: 2.1 time: 0.362239 Oct 28 17:58:08.299545 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2914/5691] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:07 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1533 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:08.449337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:08.462848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:08.463858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:08.466707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5581f51f-6949-48cb-aad1-97efb8463948 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.276777 Oct 28 17:58:08.467309 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2778/5692] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:08 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:08.483224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.484130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.484978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.485984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.486906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.487796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.488108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e79d28-f126-439b-8f24-c7628e6290ce", "tag": "93e010df-9d60-4cf6-9073-660280759e3d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:08.520681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.521169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.522752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.553219 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] Creating event network-changed:93e010df-9d60-4cf6-9073-660280759e3d for instance 52e79d28-f126-439b-8f24-c7628e6290ce on n-h2-860864-13 Oct 28 17:58:08.568024 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-804bcd3d-16ce-4674-8cc6-38957e16f463 req-706fc462-f660-4a45-95bc-2f52a6abe542 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095191 Oct 28 17:58:08.571398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2779/5693] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:08.700080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:08.712948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:08.725893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:08.730292 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-061d6b9b-2c22-4f00-832f-3561b31fdda3 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.271886 Oct 28 17:58:08.732134 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2915/5694] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:08 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:08.872397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:08.873139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:08.892214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.893132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.893661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:08.894470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:08.896365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:08.898039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.082788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:09.094427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9533dfd5-0a3d-405e-a697-89b9669106e1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.232645 Oct 28 17:58:09.095740 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2780/5695] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:08 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:09.326273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:09.327627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:09.334540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:09.339247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:09.346276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.349965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.352392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.370104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.370669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.371561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.495017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:09.497521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:09.504891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.506054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.506711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.507964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.508659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.509773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.584117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:09.597210 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f1c6950-69b3-448d-bc43-e631122f6aa9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1533 microversion: 2.1 time: 0.277985 Oct 28 17:58:09.597820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2916/5696] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:09 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1533 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:09.676502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:09.766891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:09.767562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:09.771818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:09.782393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.783061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.783339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b3cff22-a521-4351-9a83-2b10d03a91f5 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.292120 Oct 28 17:58:09.783570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.785297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:09.787108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:09.788783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:09.793021 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2781/5697] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:09 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:10.066867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:10.078592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:10.081027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:10.092964 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1cb4795c-0c5c-443f-b142-be6b4351b57a tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.330236 Oct 28 17:58:10.094287 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2917/5698] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:09 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 17:58:10.119149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:10.120642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:10.129174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:10.136739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:10.137427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:10.141195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:10.141873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:10.143057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:10.174963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "name": "network-vif-plugged", "status": "completed", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:10.186485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:10.187410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:10.188236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:10.193570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:10.203189 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] Creating event network-vif-plugged:84511947-c6da-4a50-aee3-30f88c1fd9ee for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 on n-h1-860864-13 Oct 28 17:58:10.209090 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5a0c3f6e-6f72-4309-a1fd-1db2343cb0cd req-01831e0b-8621-414b-9776-d0646e7887cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039573 Oct 28 17:58:10.209947 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2918/5699] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:10.435165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:10.449408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72eb3040-ffa5-436a-8dbf-55b24f24d35d tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.333984 Oct 28 17:58:10.462869 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2782/5700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:10 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:10.626023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:10.626488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:10.634477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:10.635294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:10.635954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:10.636881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:10.637530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:10.638297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:10.976735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:10.986516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-01f622ef-309c-49c8-bb5a-37af1c416250 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1533 microversion: 2.1 time: 0.367031 Oct 28 17:58:11.000578 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2919/5701] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1533 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:11.009521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:11.010550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:11.019805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.020577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.021180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.022052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.022664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.024009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.176026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0e68314-cd95-4cac-a572-5b68cfc71716 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] Calling method '.version_select at 0x7f752427e9d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:11.279030 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0e68314-cd95-4cac-a572-5b68cfc71716 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.600587 Oct 28 17:58:11.287114 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2783/5702] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:58:10 2022] GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b/defaults => generated 371 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:11.293424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc40dcd8-a405-435c-9c82-efe3c6429422"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:11.299518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:11.319610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.320059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.320493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.321197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.322061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.322638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.332733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:11.347322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0de58603-d32a-45f1-8b16-395f47e5cf0a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.344917 Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2920/5703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:11 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.370549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.588233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:11.598018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:11.600145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:11.601595 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-068441dd-f3d9-48de-93d7-c69ee711e940 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.252731 Oct 28 17:58:11.602641 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2921/5704] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:11 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:11.619432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10cc8873-521d-470b-b7ae-93abbedb6b86 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] Calling method '.version_select at 0x7f75243038b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:11.713536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-64e74c16-759c-44a9-8e62-d823e66e8863 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429412 Oct 28 17:58:11.714298 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2784/5705] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:58:11 2022] POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:11.742882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:11.744318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:11.760891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.762971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.763617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:11.766037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:11.776818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:11.777106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.041258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:12.055105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-684a6097-ec15-4f1c-a7bf-2ec49e3ecdf1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.339274 Oct 28 17:58:12.055755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2785/5706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:11 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:12.069888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:12.070503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:12.083490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.083989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.084417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.088393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.090812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.091453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.130663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:12.182319 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10cc8873-521d-470b-b7ae-93abbedb6b86 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b" status: 200 len: 371 microversion: 2.1 time: 0.578365 Oct 28 17:58:12.186709 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2922/5707] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:58:11 2022] GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b => generated 371 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:12.199450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66fe313c-d242-42dc-85b7-a6f8a5f29079 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] Calling method '.version_select at 0x7f75241be8b0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:12.367533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:12.383394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7559c5ee-7c69-486b-87dd-2338183fd548 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.322117 Oct 28 17:58:12.388244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2786/5708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:12.405634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "name": "network-vif-plugged", "status": "completed", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:12.445077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66fe313c-d242-42dc-85b7-a6f8a5f29079 tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.249903 Oct 28 17:58:12.445971 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2923/5709] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b/defaults => generated 371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:58:12.451334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:12.452549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:12.455530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.456152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.456619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.462509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.463314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.464280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.465247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.465933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.467137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.504520 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] Creating event network-vif-plugged:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:58:12.525347 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b2752b46-d2c1-41ce-a824-7072e8ac41b7 req-07e9cd0c-9814-4574-bdc5-3a3ad6925294 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134823 Oct 28 17:58:12.525977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2787/5710] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:12.540537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5631c719-f623-4cdb-89b1-4374c94ddafa tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] Calling method '.version_select at 0x7f7524614790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:12.708879 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5631c719-f623-4cdb-89b1-4374c94ddafa tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b" status: 200 len: 371 microversion: 2.1 time: 0.181528 Oct 28 17:58:12.711475 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2788/5711] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b => generated 371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:12.726600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:12.728024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:12.739649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:12.741645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.742333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.742978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.748232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:12.753754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:12.756940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:12.778204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:12.788498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d67802b5-79b8-44c5-bc6c-3b8302b82f65 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.340980 Oct 28 17:58:12.789289 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2924/5712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:12.810881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6107e917-f4b6-4903-96f6-be3e6a6b86dd tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] Calling method '.version_select at 0x7f7524437310>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:13.097193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:13.115198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:13.116784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:13.126593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2463bf04-b12d-46d2-90e1-eb1049cd5224 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.412861 Oct 28 17:58:13.144301 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2789/5713] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:13.157892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:13.159301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:13.168097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.168919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.169583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.170490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.171230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.172433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.335024 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6107e917-f4b6-4903-96f6-be3e6a6b86dd tempest-QuotasTestJSON-983236539 tempest-QuotasTestJSON-983236539-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b?user_id=541c9237e535492c9be556cdda6aa2e3" status: 200 len: 371 microversion: 2.1 time: 0.541471 Oct 28 17:58:13.338484 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2925/5714] 10.222.0.48 () {58 vars in 1323 bytes} [Fri Oct 28 17:58:12 2022] GET /compute/v2.1/os-quota-sets/1c6a9c2f4e574b4dafd7c1a8d391670b?user_id=541c9237e535492c9be556cdda6aa2e3 => generated 371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:13.415073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:13.415728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:13.435339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.435909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.436362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.438470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.438963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.439634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.600784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:13.621820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-838d2f71-31c2-499b-b33e-056fcaff2c99 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.476480 Oct 28 17:58:13.628622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2790/5715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:13 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:13.815272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:13.816056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:13.824960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.835823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.836664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.837671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:13.838376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:13.839062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:13.905750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:13.922917 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6fcb096d-89c4-42d9-b3ad-9606368717c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.505818 Oct 28 17:58:13.926755 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2926/5716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:14.158895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:14.160389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:14.177375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:14.177876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:14.178310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:14.179194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:14.180659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:14.183912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:14.341828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:14.353281 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01e9a47c-9225-4b3e-85e2-6086a7c652d8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.541956 Oct 28 17:58:14.353891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2791/5717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:13 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:14.654475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:14.656611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:14.667740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:14.669747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:14.670344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:14.674693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:14.675434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:14.678005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:14.825166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:14.861235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:14.871057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:14.877293 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-748d4eca-b841-4b5f-901d-c2d64c010fc5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.719566 Oct 28 17:58:14.893819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2927/5718] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:14 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:14.914050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee01030c-8351-460a-97a1-221241449bc6", "name": "network-vif-plugged", "status": "completed", "tag": "eda33f05-9344-448e-a7af-e46d39cadd6a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:14.944826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:14.946808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:14.948305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:14.974601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] Creating event network-vif-plugged:eda33f05-9344-448e-a7af-e46d39cadd6a for instance ee01030c-8351-460a-97a1-221241449bc6 on n-h1-860864-13 Oct 28 17:58:15.006342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-49a1ac65-dbbc-4cd1-b8d7-b9e654f03644 req-5581d24b-53ac-41c4-8f09-37b71333a252 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081254 Oct 28 17:58:15.008052 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2928/5719] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:15.029249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:15.034731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:15.069108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.070055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.080098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:15.082703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.085469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.086592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:15.274011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:15.287482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c8d4e70-d6b0-4f62-8c23-5c680b993847 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.635130 Oct 28 17:58:15.289587 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2792/5720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:14 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:15.382211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:15.382829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:15.403226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.404483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.407704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:15.408671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.409648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.410463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:15.693873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:15.709508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af31487c-3258-434b-8d00-33d54bf7a268 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.697871 Oct 28 17:58:15.711827 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2929/5721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:15 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:15.907549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:15.910301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:15.910918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:15.919406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f2d886ee-357e-4956-9eb5-d720d7103e86 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1472 microversion: 2.1 time: 0.542010 Oct 28 17:58:15.921102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.927730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.929054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:15.932250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:15.932723 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2793/5722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:15 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:15.935283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:15.944213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.259718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:16.273006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:16.274482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:16.280915 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-091f87d9-995f-4554-bf4c-033be15f05ec tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1729 microversion: 2.20 time: 0.371420 Oct 28 17:58:16.292720 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2930/5723] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:15 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1729 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:16.315095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:16.316371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:16.346543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.347314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.348580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.350347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.354110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.355685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.658382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:16.680797 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72c00795-8112-4555-b3c2-cc11ea7296b1 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.372258 Oct 28 17:58:16.681949 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2794/5724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:16 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:16.736198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:16.736868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:16.773963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.774640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.780720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.782209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.782865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.783495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.956717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:16.956717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:16.964783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.967557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.969099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:16.973681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:16.978899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:16.979495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.010201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.019558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-735a2517-dca3-4cd3-a7ac-574e67682acd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.287976 Oct 28 17:58:17.035914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2931/5725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:16 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:17.106121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e79d28-f126-439b-8f24-c7628e6290ce", "name": "network-vif-plugged", "status": "completed", "tag": "93e010df-9d60-4cf6-9073-660280759e3d"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:17.121791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.122524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.123187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.137935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] Creating event network-vif-plugged:93e010df-9d60-4cf6-9073-660280759e3d for instance 52e79d28-f126-439b-8f24-c7628e6290ce on n-h2-860864-13 Oct 28 17:58:17.144061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3bf790a9-ba12-4a12-83f9-07458f7c3877 req-f9e49a35-f77f-491b-9c85-fd8dbb1ff257 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042598 Oct 28 17:58:17.146095 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2932/5726] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:58:17.376879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.387750 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-faaf787f-0f7b-4b5c-aa19-77bfbdeacefc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1645 microversion: 2.1 time: 0.446161 Oct 28 17:58:17.389106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2795/5727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:16 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1645 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:17.394977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:17.395783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:17.402415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.403059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.403825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.404679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.405369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.405991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.517763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5166b16f-5584-479b-abfb-861c82827c7a tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Action: 'create', calling method: .version_select at 0x7f7524336040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-385373581", "metadata": {"Type": "work"}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5166b16f-5584-479b-abfb-861c82827c7a tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 121 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-385373581", "metadata": {"Type": "work"}}} Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-385373581', 'metadata': {'Type': 'work'}}}} Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:58:17.524033 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5166b16f-5584-479b-abfb-861c82827c7a tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:17.529116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5166b16f-5584-479b-abfb-861c82827c7a tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.348094 Oct 28 17:58:17.539823 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2933/5728] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Oct 28 17:58:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:58:17.545068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:17.545791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:17.566551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.567045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.567508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.568414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.569132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.569703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.625396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.635972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.638112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.639833 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4830e18-0470-4aff-bbb0-2b615ba16934 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1716 microversion: 2.20 time: 0.249267 Oct 28 17:58:17.640978 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2796/5729] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:58:17 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1716 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:58:17.661231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90ec7cb5-bbf7-47c4-b639-f9093d57bb50 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Action: 'create', calling method: .version_select at 0x7f751f65bdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1431741909", "metadata": {"Type": "work"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90ec7cb5-bbf7-47c4-b639-f9093d57bb50 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 120 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1431741909", "metadata": {"Type": "work"}}} Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1431741909', 'metadata': {'Type': 'work'}}}} Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '0' Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:58:17.674192 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 17:58:17.679107 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.680877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90ec7cb5-bbf7-47c4-b639-f9093d57bb50 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:17.684721 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90ec7cb5-bbf7-47c4-b639-f9093d57bb50 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.042200 Oct 28 17:58:17.685767 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2797/5730] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Oct 28 17:58:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:58:17.703151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2bb13999-1b5e-4739-800d-171b01d8a7e4 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Action: 'create', calling method: .version_select at 0x7f751f52bb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-59820392", "metadata": {"Type": "work"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2bb13999-1b5e-4739-800d-171b01d8a7e4 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 117 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-59820392", "metadata": {"Type": "work"}}} Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: method: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-59820392', 'metadata': {'Type': 'work'}}}} Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '' Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:58:17.708234 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 17:58:17.712730 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:17.716127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2bb13999-1b5e-4739-800d-171b01d8a7e4 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:17.718591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2bb13999-1b5e-4739-800d-171b01d8a7e4 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021942 Oct 28 17:58:17.723457 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2798/5731] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Oct 28 17:58:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:58:17.733589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:17.735334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:17.752803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.753697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.754146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.756027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:17.756495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:17.757392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:17.881048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:17.890104 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c7030e7-43ef-4f66-80e6-9fb8150d6ef9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1645 microversion: 2.1 time: 0.348995 Oct 28 17:58:17.890827 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2934/5732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:17 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1645 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:17.904063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e3eead2-c0d1-4703-9958-e93a890f9fe1 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Calling method '.version_select at 0x7f7524336670>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:18.010563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:18.021539 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4bd11d3-4cae-49af-8db7-c81ca89efa4a tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1314 microversion: 2.1 time: 0.291936 Oct 28 17:58:18.023493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2799/5733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:17 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:18.035819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:18.037219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:18.043681 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2e3eead2-c0d1-4703-9958-e93a890f9fe1 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] HTTP exception thrown: Volume tempest-invalid-751681418 could not be found. Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e3eead2-c0d1-4703-9958-e93a890f9fe1 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-751681418 HTTP/1.1 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: exception: Volume tempest-invalid-751681418 could not be found. Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'tempest-invalid-751681418'} Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-751681418 could not be found. (HTTP 404) (Request-ID: req-661a03ab-dfc8-4f64-a652-67e013e4cb16) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:58:18.045923 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-751681418 could not be found. Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-751681418 could not be found. Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-751681418 could not be found. Oct 28 17:58:18.050252 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:18.055017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:18.060842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e3eead2-c0d1-4703-9958-e93a890f9fe1 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 404 to user: Volume tempest-invalid-751681418 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:18.062364 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e3eead2-c0d1-4703-9958-e93a890f9fe1 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-751681418" status: 404 len: 98 microversion: 2.1 time: 0.170390 Oct 28 17:58:18.063520 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2935/5734] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Oct 28 17:58:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-751681418 => generated 98 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:58:18.090402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:18.095670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:18.116100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:18.119479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:18.122046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:18.123558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:18.124028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:18.127540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:18.386243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:18.395241 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3dcf6811-e7af-4937-852c-0eae1c8e9e5c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.330450 Oct 28 17:58:18.398386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2936/5735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:18 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:18.403557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18831d1d-1655-4d20-ac3b-62f070d83b90 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004081 Oct 28 17:58:18.408655 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2937/5736] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Oct 28 17:58:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 17:58:18.422280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d959d8a4-29f7-4d69-ae5f-acec1f436e36 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005354 Oct 28 17:58:18.424101 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2938/5737] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Oct 28 17:58:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 17:58:18.440555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eb50865-e9d7-43e9-94a7-08d92822a47c tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Calling method '.version_select at 0x7f7524336a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:18.505336 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-1eb50865-e9d7-43e9-94a7-08d92822a47c tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] HTTP exception thrown: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eb50865-e9d7-43e9-94a7-08d92822a47c tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/os-volumes/11d5e224-44fb-44b8-a994-98943b8ba172 HTTP/1.1 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: exception: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '11d5e224-44fb-44b8-a994-98943b8ba172'} Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. (HTTP 404) (Request-ID: req-4bc0e9e8-2668-4606-abd4-349d34753ff0) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:58:18.507291 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eb50865-e9d7-43e9-94a7-08d92822a47c tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 404 to user: Volume 11d5e224-44fb-44b8-a994-98943b8ba172 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1eb50865-e9d7-43e9-94a7-08d92822a47c tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/11d5e224-44fb-44b8-a994-98943b8ba172" status: 404 len: 109 microversion: 2.1 time: 0.077031 Oct 28 17:58:18.516522 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2939/5738] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:58:18 2022] DELETE /compute/v2.1/os-volumes/11d5e224-44fb-44b8-a994-98943b8ba172 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:58:18.524398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c0ad4d-31e2-486c-8fa2-409e94928613 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Calling method '.version_select at 0x7f7524232e50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:18.638561 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a2c0ad4d-31e2-486c-8fa2-409e94928613 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] HTTP exception thrown: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c0ad4d-31e2-486c-8fa2-409e94928613 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Request method failure captured: Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-volumes/e845a402-ed7c-49ee-b528-18d1998734f0 HTTP/1.1 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBg5w86VJaF3j1UZLarxR5JSGwrcrsfjH1ld-mGlEzL_YlxtHJbrGk_af_j3fhmjvPf8mWkCpX2WnSXM3q7uJeEeKS1MwxNeU8gXEHeQLzyv4Bt0UlvPyQ4lSdsgi89Wj59Cjiv8HZiI8noTmJYymM9sjXWqEudb0MF2wiq37npu9HM Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cef24206acb749949253b67a756327fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cef24206acb749949253b67a756327fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cef24206acb749949253b67a756327fc"}]}] Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: cef24206acb749949253b67a756327fc Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesNegativeTest-1781008539 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b11ca211091a4485a78212a716c80e15 Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesNegativeTest-1781008539-project Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: exception: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e845a402-ed7c-49ee-b528-18d1998734f0'} Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. (HTTP 404) (Request-ID: req-f9d200d7-70d2-4554-9f1b-58ea6a2727e5) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:58:18.641644 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. Oct 28 17:58:18.645492 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:58:18.655495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2c0ad4d-31e2-486c-8fa2-409e94928613 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] Returning 404 to user: Volume e845a402-ed7c-49ee-b528-18d1998734f0 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:18.655495 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2c0ad4d-31e2-486c-8fa2-409e94928613 tempest-VolumesNegativeTest-1781008539 tempest-VolumesNegativeTest-1781008539-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e845a402-ed7c-49ee-b528-18d1998734f0" status: 404 len: 109 microversion: 2.1 time: 0.139637 Oct 28 17:58:18.655495 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2940/5739] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:58:18 2022] GET /compute/v2.1/os-volumes/e845a402-ed7c-49ee-b528-18d1998734f0 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:58:18.690683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2be9a6c5-f877-4130-9539-dbc9c5ad5792 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1798 microversion: 2.1 time: 0.666020 Oct 28 17:58:18.692347 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2800/5740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:18 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1798 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:19.053684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:19.064266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:19.072060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.072826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.073458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.084429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.085180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.085628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.422142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:19.423860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:19.436529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.442948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.448004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.449022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.449689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.453516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.511823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:19.523702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2dee37e5-3aee-4ccb-a313-64f42a418e21 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1463 microversion: 2.1 time: 0.473128 Oct 28 17:58:19.526304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2941/5741] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:19 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:19.560011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8072cdf-5e05-4814-990e-5d8748e874f8", "device": "/dev/sdb"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:19.565081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:19.583148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.584052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.589858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.592966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:19.594276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:19.595213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:19.738113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:19.774117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e1cc15e-a266-4fcd-ac4f-2c1b3e02235b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.353060 Oct 28 17:58:19.794562 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2801/5742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:19 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:20.061585 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0166abbe-69a0-4150-aaae-cc14df0f64a0 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "POST /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511850 Oct 28 17:58:20.069809 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2942/5743] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 17:58:19 2022] POST /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:58:20.804281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:20.805490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:20.824910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:20.831779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:20.834346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:20.835251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:20.837680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:20.840660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:21.198589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:21.206778 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef720acd-a147-4c89-a485-e4be31a57827 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.407346 Oct 28 17:58:21.211568 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2802/5744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:20 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:22.238414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:22.239515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:22.264782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:22.266009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:22.266958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:22.267853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:22.268582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:22.269511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:22.638008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:22.647980 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56268984-472d-49a5-9f2e-d524a23e411b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.415349 Oct 28 17:58:22.653587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2943/5745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:22 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:22.919695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee01030c-8351-460a-97a1-221241449bc6", "tag": "eda33f05-9344-448e-a7af-e46d39cadd6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:22.932384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:22.963013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:22.966711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:22.967887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:23.025131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] Creating event network-changed:eda33f05-9344-448e-a7af-e46d39cadd6a for instance ee01030c-8351-460a-97a1-221241449bc6 on n-h1-860864-13 Oct 28 17:58:23.048005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fbd9435c-7b5c-442f-b402-4b6e38416849 req-242c6e21-d9dc-415f-aeed-947a3f5ee79d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132104 Oct 28 17:58:23.056100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2803/5746] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:23.681590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:23.682202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:23.700827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:23.702811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:23.705379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:23.712033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:23.713021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:23.713656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:23.714284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:23.797246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:24.351217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:24.368215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73f75682-8cb7-4f38-890e-439ce653f494 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.690449 Oct 28 17:58:24.379485 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2944/5747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:23 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:25.398970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:25.402042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:25.425089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:25.425601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:25.426051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:25.426797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:25.427263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:25.427731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:25.831066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:25.839289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd75ec4c-2148-4410-88fd-d1ee46f8265b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.448809 Oct 28 17:58:25.851968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2804/5748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:25 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:26.865672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:26.866296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:26.882960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:26.883487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:26.883933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:26.884668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:26.885110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:26.885741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:27.227888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:27.240116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de3b8da2-c43a-497b-802d-de2655006ddc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.377956 Oct 28 17:58:27.241846 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2945/5749] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:26 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:27.754772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:27.769700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:27.770271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:27.770653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:27.805507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 17:58:27.961834 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e9be1aa3-0a80-4553-8fbf-acf6df3a689d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.211205 Oct 28 17:58:27.963078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2805/5750] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:58:27 2022] POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:58:27.972126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:27.973465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:27.987463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:27.990025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:27.992177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:27.995359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:27.997195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:27.997863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:28.270262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:28.271065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:28.285104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:28.292714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:28.293571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:28.297770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:28.298489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:28.301653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:28.375591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:28.594049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:28.601174 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a22754e-71b5-4b4e-a26a-cc7299d05d56 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.633948 Oct 28 17:58:28.602519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2946/5751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:27 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:28.701584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:28.710685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9858feb-084b-469e-9687-7a9aa0e2f819 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.444926 Oct 28 17:58:28.719754 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2806/5752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:28 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:29.631788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:29.636427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:29.650828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:29.652129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:29.653545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:29.657394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:29.658789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:29.660991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:29.740759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:29.741993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:29.765806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:29.768137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:29.771062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:29.772030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:29.788554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:29.789006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:30.080795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:30.084440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:30.094245 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-75e74a8a-d9c5-4c74-ac98-e76c01989ae2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.359883 Oct 28 17:58:30.095351 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2807/5753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:29 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:30.099787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ce9ad005-792e-4fa0-ad36-58d73df3c0fe tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.472887 Oct 28 17:58:30.100517 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2947/5754] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:29 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:31.120045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:31.122496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:31.129216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:31.130997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:31.146974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:31.147734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:31.147868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:31.148918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:31.149404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:31.150319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:31.150779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:31.150901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:31.151262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:31.153633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:31.157592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:31.159290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:31.472923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:31.482977 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48998972-26e9-44ad-b064-3e49631fa9a2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.358690 Oct 28 17:58:31.496282 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2948/5755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:31 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:31.532071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:31.547939 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5c807a6c-2754-4481-8e21-923c128704dd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1528 microversion: 2.1 time: 0.432967 Oct 28 17:58:31.548841 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2808/5756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:31 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1528 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:32.516562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:32.517177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:32.525691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:32.526174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:32.526974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:32.527704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:32.528337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:32.529677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:32.573240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:32.573842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:32.581990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:32.582861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:32.583502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:32.584355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:32.585507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:32.586193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:32.818507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:32.831712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00c4650f-5366-4324-98eb-da58b4d6afa8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.317298 Oct 28 17:58:32.848612 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2949/5757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:32 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:32.865245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:32.874321 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0fb97d5-e6ee-435c-96f3-8984dd0fb328 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1510 microversion: 2.1 time: 0.304950 Oct 28 17:58:32.875218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2809/5758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:32 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:33.858946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:33.859863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:33.867329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:33.867868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:33.868304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:33.869201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:33.869718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:33.870145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:33.898827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:33.901049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:33.926675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:33.927507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:33.928467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:33.929367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:33.929999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:33.930625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:34.116491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:34.129504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:34.139217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-397e7774-4096-482c-a5e6-228811694a5b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1510 microversion: 2.1 time: 0.244971 Oct 28 17:58:34.140384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2810/5759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:33 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:34.143321 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4f2e391d-feb5-4741-96a0-13abc4c0910d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.288565 Oct 28 17:58:34.144367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2950/5760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:33 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:35.168553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:35.169954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:35.171162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:35.171984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:35.188430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.188931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.189366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.190080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.190536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.190772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.191277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.191728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.192433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.192876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.193486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.194042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.472392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:35.490450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ef65497a-50a9-44d6-8ea4-2222b73af669 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.323701 Oct 28 17:58:35.491197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2951/5761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:35 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:35.512393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:35.521899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f175a52-9197-486a-b137-f1090951de2d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1513 microversion: 2.1 time: 0.362397 Oct 28 17:58:35.522663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2811/5762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:35 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1513 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:35.550505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:35.551459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:35.564768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.565536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.566078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.566909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.570284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.571559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.756028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:35.768524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3069444-f6c9-4b6e-8345-be6405e313ed tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1453 microversion: 2.1 time: 0.221818 Oct 28 17:58:35.772231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2952/5763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:35 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:35.837651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:35.838265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:35.845683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.849297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.849892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.850741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.851246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.852076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.897611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lazy-loading 'flavor' on Instance uuid 5d74c8d2-d52e-49ec-b840-a6d801c7db61 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:58:35.928705 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'shelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state shelved_offloaded Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 14 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: {"shelve": {}} Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'shelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state shelved_offloaded Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'shelve': {}}} Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:58:35.930792 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state shelved_offloaded Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state shelved_offloaded Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'shelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state shelved_offloaded {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:58:35.935090 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f916440-cf58-41b9-b17b-43eb751cc129 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 155 microversion: 2.1 time: 0.098650 Oct 28 17:58:35.942888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:35.943789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:35.946968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2812/5764] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:58:35 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 155 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:58:35.953605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.954105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.955507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:35.956236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:35.959467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:35.960103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.026728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 17:58:36.132650 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-436630ab-8bb5-411e-a3ff-6f33b7514d51 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.193661 Oct 28 17:58:36.134181 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2953/5765] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:58:35 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:58:36.147345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:36.147988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:36.157380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:36.170001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:36.170818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.171804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:36.173214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:36.173854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.425775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:36.439187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6f720c8-2f4f-42c2-9ee9-b210b8d49a95 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1461 microversion: 2.1 time: 0.300537 Oct 28 17:58:36.442741 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2813/5766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:36 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1461 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:36.523906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:36.524975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:36.537324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:36.537835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:36.538279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.544070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:36.544812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:36.545444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.767156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "name": "network-vif-unplugged", "status": "completed", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:36.785690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:36.797511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:36.798211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:36.836020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] Unable to find a host for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 17:58:36.848734 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-55bc4d6f-d531-4892-a04b-761f79b9eb14 req-bde7f5e6-97ba-448c-96e7-ca605716ebf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086066 Oct 28 17:58:36.852998 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2814/5767] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 17:58:36.864264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:36.874754 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5253723-c850-486a-83fd-33786a771931 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.359864 Oct 28 17:58:36.876099 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2954/5768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:36 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:37.466387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:37.468503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:37.481414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:37.481695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:37.482207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:37.483218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:37.483989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:37.492964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:37.706992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:37.725727 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71bd4aa8-78d3-43fa-9d49-35c163d834c7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1461 microversion: 2.1 time: 0.263296 Oct 28 17:58:37.726319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2815/5769] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:37 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1461 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:37.898372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:37.899683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:37.908034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:37.908758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:37.909201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:37.920473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:37.921292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:37.921848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:38.083202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:38.095568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eba11c8f-5c08-43e3-bb5e-802e5d42bbf3 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.200444 Oct 28 17:58:38.113926 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2955/5770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:37 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:38.756118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:38.756743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:38.768427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:38.768931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:38.769370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:38.770090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:38.770547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:38.770979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:39.009681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:39.019599 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98cd15bf-5e0c-4d96-8937-d93ad968bb67 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.267269 Oct 28 17:58:39.024197 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2816/5771] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:38 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:39.122137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:39.122754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:39.130619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:39.133176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:39.133668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:39.134107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:39.135081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:39.138981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:39.139538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:39.338227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:39.349608 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7717c976-5025-4a19-9a9e-f6ff27c54229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.231194 Oct 28 17:58:39.364588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2956/5772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:39 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:40.044622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:40.046103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:40.053901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:40.055307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:40.057088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:40.058033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:40.060795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:40.062047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:40.375906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:40.377935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:40.410086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:40.414343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:40.419017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:40.422932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:40.424287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:40.428819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:40.437251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:40.454169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6dc28239-4b0a-4f0c-8ada-6a05b95e07af tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.414182 Oct 28 17:58:40.461630 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2817/5773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:40 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:40.835900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:40.851489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a4b6f781-16fe-4770-9cd4-bcb5abb8f906 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.480170 Oct 28 17:58:40.855413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2957/5774] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:40 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:41.489843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:41.490780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:41.503492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:41.518144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:41.518988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:41.520409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:41.521034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:41.521636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:41.748183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:41.759917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9311423-1ddf-4678-b252-cdd91c3f7ae8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.275053 Oct 28 17:58:41.763435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2818/5775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:41 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:41.880005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:41.881279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:41.911190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:41.915560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:41.923346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:41.925395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:41.927320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:41.927973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:42.464930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:42.481469 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-987c4e28-c527-47dd-aa50-a0c3f3537f20 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.600819 Oct 28 17:58:42.482785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2958/5776] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:41 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:42.801418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:42.802805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:42.831352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:42.831853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:42.832581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:42.833623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:42.836026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:42.836724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:43.350943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:43.382383 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a82a84f-bec3-497d-97ef-b9bc18d70de5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.600615 Oct 28 17:58:43.383785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2819/5777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:42 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:43.509520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:43.510286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:43.521390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:43.525897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:43.526456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:43.527307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:43.534736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:43.535533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:44.051153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:44.077181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd4c8d46-15b5-4e92-b8e4-c10ef4d889f8 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.558403 Oct 28 17:58:44.078788 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2959/5778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:43 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:44.410220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:44.410826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:44.422920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=58 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:44.435820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:44.437839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:44.438335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:44.440455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:44.441418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:44.442118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:44.968786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:44.986113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c2c39d93-c67c-46b8-ad01-8793d0a909fb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.579586 Oct 28 17:58:44.993778 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2820/5779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:44 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:58:45.105243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:45.106445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:45.122547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:45.128098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:45.128837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:45.129892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:45.130594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:45.131253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:45.204466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:45.434390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:45.446056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a6aaa0b-d2dd-4e28-b550-3ee6acdcde96 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.344895 Oct 28 17:58:45.447448 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2960/5780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:45 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:46.025213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:46.025897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:46.039961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:46.040891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:46.041513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:46.042273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:46.042725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:46.043147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:46.361270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:46.377131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9cd03f79-db56-4dd6-8f8f-bf99e450f3f8 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.356133 Oct 28 17:58:46.378139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2821/5781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:46 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:46.473622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:46.474177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:46.491235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:46.491757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:46.492427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:46.497117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:46.497601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:46.498030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:46.833042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:46.849783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e533054-ff03-4ef2-b5fd-efd536134f5f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.376907 Oct 28 17:58:46.851461 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2961/5782] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:46 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:47.406165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:47.407523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:47.430124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:47.433643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:47.438867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:47.441112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:47.444209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:47.447431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:47.865090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:47.876489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97c5f187-6021-4d1a-98fd-1915823521ce tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.476884 Oct 28 17:58:47.877618 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2822/5783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:47 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:47.895719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:47.897489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:47.912982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:47.920059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:47.921208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:47.922059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:47.924002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:47.924721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:48.283846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:48.316551 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9438817b-0a8a-456e-b96f-bae7c640ae8e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.435266 Oct 28 17:58:48.317254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2962/5784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:47 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:48.909131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:48.913415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:48.963114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:48.964032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:48.967682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:48.969999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:48.975061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:48.975946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:49.346816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:49.353950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:49.387848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:49.389855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:49.391390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:49.395272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:49.399451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:49.400078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:49.900560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:49.941565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:49.946735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:58:49.968875 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1460c3de-ff73-4d0b-8750-1163216a26d1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1701 microversion: 2.1 time: 0.626934 Oct 28 17:58:49.979287 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76a7fe9b-d0b1-4730-a6b6-1ff9f5201d2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 1.079094 Oct 28 17:58:49.981201 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2963/5785] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:49 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1701 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:49.985703 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2823/5786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:48 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:50.007900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:50.018156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:50.037513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:50.037959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:50.146856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Going to try to start instance {{(pid=120567) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 17:58:50.309087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-132fdabc-fcc6-450a-af65-7c087e8e8495 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.304815 Oct 28 17:58:50.312277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2964/5787] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:58:50 2022] POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:58:50.324707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:50.326884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:50.348393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:50.349553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:50.350287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:50.351409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:50.352323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:50.352969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:50.808237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:50.826092 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f411a60-529b-45b8-8e29-01fad7f06d65 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1710 microversion: 2.1 time: 0.510957 Oct 28 17:58:50.833025 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2824/5788] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:50 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1710 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:51.013570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:51.015637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:51.040719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:51.042642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:51.046883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:51.050855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:51.052250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:51.053236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:51.558889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:51.577305 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63480f96-ae7b-4652-a71b-b66bfba8e7c5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.567879 Oct 28 17:58:51.577758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2965/5789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:51 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:51.862516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:51.863905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:51.879484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:51.880248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:51.880840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:51.881723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:51.882195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:51.882620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:52.052532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:52.066504 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3400ec2d-1f4e-4ebb-bf46-96ce0763ea80 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1710 microversion: 2.1 time: 0.209573 Oct 28 17:58:52.083848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2825/5790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:51 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1710 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:52.602144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:52.603556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:52.615823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:52.616845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:52.617591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:52.618534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:52.619148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:52.619898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:52.916446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:52.925477 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4bf62f6-c710-4334-96b1-359fb4d6a5e6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.327687 Oct 28 17:58:52.931811 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2966/5791] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:52 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:53.091173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:53.092839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:53.100377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:53.101164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:53.102159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:53.103179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:53.103836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:53.104429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:53.317802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:53.334879 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38df8123-30d9-425a-a710-3da6d78ab193 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1714 microversion: 2.1 time: 0.245653 Oct 28 17:58:53.350592 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2826/5792] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:53 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1714 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:53.953691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:53.956221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:53.965170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:53.966161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:53.966856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:53.967680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:53.968298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:53.968994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:54.149835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:54.166536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69043bfd-2539-4854-9c42-a612d0a8a370 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.217623 Oct 28 17:58:54.167339 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2967/5793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:53 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:55.192332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:55.193129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:55.207092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:55.207697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:55.208227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:55.209043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:55.209593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:55.210109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:55.355538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:55.366687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-959cfe20-f813-4dc7-b2cb-257f62e10622 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.178365 Oct 28 17:58:55.368199 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2827/5794] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:55 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:56.392601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:56.393304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:56.400185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:56.400672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:56.401111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:56.401816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:56.402273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:56.402699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:56.556079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:56.566167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-defb64ae-492c-4fa9-bc81-0c27aad3e020 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.177953 Oct 28 17:58:56.575877 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2968/5795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:56 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:57.590357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:57.591613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:57.599104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:57.599631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:57.600282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:57.600997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:57.601857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:57.602644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:57.762775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:57.771974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29f17425-644c-4d7a-81f0-dbdd092d9d53 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.185626 Oct 28 17:58:57.779588 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2828/5796] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:57 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:58:58.798697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:58:58.799929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:58:58.809489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "name": "network-vif-plugged", "status": "completed", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:58:58.822679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:58.823181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:58.823645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:58.829172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:58.831113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:58:58.831621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:58.832058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:58.836460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:58:58.837117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:58:58.856016 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] Creating event network-vif-plugged:84511947-c6da-4a50-aee3-30f88c1fd9ee for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 on n-h1-860864-13 Oct 28 17:58:58.865197 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-71322fff-2600-428e-a18b-5514610d3de4 req-36454b53-2ee5-4a0e-af5a-56a17b6d1e95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060216 Oct 28 17:58:58.868003 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2829/5797] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:58:59.072109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:58:59.090617 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f967db7a-200a-4e02-aa76-44352a44c932 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.297776 Oct 28 17:58:59.093330 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2969/5798] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:58:58 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:00.119714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:00.121250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:00.130379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:00.131324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:00.132078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:00.133039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:00.133717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:00.134383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:00.365910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:00.375209 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-258acf75-3965-4f49-b4e3-6e969a1f4eb2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.260988 Oct 28 17:59:00.376922 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2830/5799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:00 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:01.399776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:01.400542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:01.409023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:01.409480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:01.409926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:01.410762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:01.411340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:01.411820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:01.630702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:01.646136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15747d45-7c5f-4d58-8a13-e649a73fe6ef tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1519 microversion: 2.1 time: 0.250783 Oct 28 17:59:01.646879 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2970/5800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:01 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:02.701796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:02.704590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:02.720242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:02.724169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:02.724816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:02.727058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:02.729339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:02.729952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:02.898470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:02.909181 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-855c4abd-dc13-4fb4-900f-56f5010643cd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.238919 Oct 28 17:59:02.919404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2831/5801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:02 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:02.933225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:02.934409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:02.943541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:02.944580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:02.945176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:02.946047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:02.946767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:02.947348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.128272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:03.136268 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a08660d7-6453-4cd6-b360-5b8d0ec4e965 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.207486 Oct 28 17:59:03.137547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2971/5802] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:02 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:03.177468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:03.178273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:03.186542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.187299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.188254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.189122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.189734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.190999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.365496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:03.379138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6075f6a4-dbd2-4b1c-9fb2-6c02920662d5 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.206443 Oct 28 17:59:03.380183 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2832/5803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:03.431340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f67d87de-5e07-4cc5-b8e5-f48e1b960859 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:03.437900 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f67d87de-5e07-4cc5-b8e5-f48e1b960859 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f67d87de-5e07-4cc5-b8e5-f48e1b960859 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/a5aa31a5-eb17-48b0-9a54-68eea46eddca/action HTTP/1.1 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: {"os-stop": {}} Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a5aa31a5-eb17-48b0-9a54-68eea46eddca', 'body': {'os-stop': {}}} Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:03.455463 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. Oct 28 17:59:03.460368 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:03.462566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f67d87de-5e07-4cc5-b8e5-f48e1b960859 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance a5aa31a5-eb17-48b0-9a54-68eea46eddca has no mapping to a cell. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:03.463678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f67d87de-5e07-4cc5-b8e5-f48e1b960859 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/a5aa31a5-eb17-48b0-9a54-68eea46eddca/action" status: 404 len: 117 microversion: 2.1 time: 0.055061 Oct 28 17:59:03.464551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2972/5804] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:03 2022] POST /compute/v2.1/servers/a5aa31a5-eb17-48b0-9a54-68eea46eddca/action => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:03.474793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:03.476212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:03.484372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.485031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.485627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.486592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.487219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.487832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.664442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:03.673959 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20f405e6-d025-4299-9f98-7991027d4123 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.204193 Oct 28 17:59:03.674999 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2833/5805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:03.698898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:03.699617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:03.728547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.745857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.746969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.749297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:03.750168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:03.750799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:03.989463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:04.000767 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-91985c10-570c-4624-917e-908d95c5c62f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.306141 Oct 28 17:59:04.001971 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2973/5806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:03 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:04.030630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:04.031148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 176cb386-bcae-4c39-997c-b32e40fc9119] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:04.043804 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/176cb386-bcae-4c39-997c-b32e40fc9119/action HTTP/1.1 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 15 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: {"suspend": {}} Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '176cb386-bcae-4c39-997c-b32e40fc9119', 'body': {'suspend': {}}} Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:04.046689 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 176cb386-bcae-4c39-997c-b32e40fc9119 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ee5b3fc-4060-4938-9626-5ea1b69a98b6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/176cb386-bcae-4c39-997c-b32e40fc9119/action" status: 404 len: 111 microversion: 2.1 time: 0.025293 Oct 28 17:59:04.051113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2834/5807] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:04 2022] POST /compute/v2.1/servers/176cb386-bcae-4c39-997c-b32e40fc9119/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:04.058213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:04.058823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:04.074333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.075515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.076586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.077943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.078614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.079248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.319860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:04.330633 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47dbc6ba-5b3f-415c-9c4e-27218ceec97a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.276205 Oct 28 17:59:04.335161 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2974/5808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:04.356690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:04.357838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:04.372616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.373692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.374165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.374870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.375659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.376099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.569650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:04.579021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70489b3a-72a6-4177-bb5c-468b68d577bb tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.227655 Oct 28 17:59:04.584872 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2835/5809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:04.611991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:04.612887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:04.621428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.622270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.622412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.623788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.624307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.624882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.652044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lazy-loading 'flavor' on Instance uuid 5d74c8d2-d52e-49ec-b840-a6d801c7db61 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:04.695205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:04.737959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-58578e1d-45d1-4a92-8618-9787e444e222 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.131859 Oct 28 17:59:04.747683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:04.749144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:04.753500 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2975/5810] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:04 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:04.756312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.756722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.757549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.758808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:04.759609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:04.760262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:04.963111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:04.980000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29544cad-5544-4cd1-900f-2ac13cf84805 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1514 microversion: 2.1 time: 0.236170 Oct 28 17:59:04.981116 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2836/5811] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:04 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:06.007810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:06.008645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:06.017386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.018277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.018919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.020108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.020991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.021949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.198660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:06.208928 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ca36142-8d5c-4695-b380-897b1cb69bbd tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1497 microversion: 2.1 time: 0.208298 Oct 28 17:59:06.211410 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2976/5812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:05 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:06.234709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:06.237140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:06.246754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.247586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.249494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.251493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.252189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.252832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.299524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lazy-loading 'flavor' on Instance uuid 5d74c8d2-d52e-49ec-b840-a6d801c7db61 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:06.315475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'suspend' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state suspended Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 15 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: {"suspend": {}} Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'suspend' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state suspended Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'suspend': {}}} Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 28 17:59:06.317208 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state suspended Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state suspended Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'suspend' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state suspended {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:06.321303 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db993362-259f-440b-8412-54661f145334 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 148 microversion: 2.1 time: 0.088722 Oct 28 17:59:06.322841 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2837/5813] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:06 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 148 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:59:06.330551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:06.331835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:06.339000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.339539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.340257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.343404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.344590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.345307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.434965 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ee9f5c8-ae5b-45a0-a2de-86bb180f698f tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 202 len: 0 microversion: 2.1 time: 0.110370 Oct 28 17:59:06.437056 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2977/5814] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:06 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:59:06.446135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:06.446762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:06.453894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.454936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.455876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.457330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:06.458026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:06.458863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:06.722877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:06.731251 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1966204d-7900-4e52-828d-a2c05db432fa tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1503 microversion: 2.1 time: 0.289394 Oct 28 17:59:06.731868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2838/5815] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:06 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:07.758334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:07.759053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:07.766235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:07.766724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:07.767400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:07.768273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:07.768730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:07.769356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:07.960541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:07.974419 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41c13d00-169c-4de1-a092-1487ad831561 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1503 microversion: 2.1 time: 0.220189 Oct 28 17:59:07.975017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2978/5816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:07 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:09.006021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:09.008027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:09.018879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.019959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.020614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.021880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.022784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.023558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.205332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:09.219839 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1b473bb-0bab-47ce-87ec-fa0f9eb9ba2b tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.218183 Oct 28 17:59:09.219954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2839/5817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:08 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:09.246618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:09.247249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:09.256860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=46 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:09.259199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.259775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.260417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.261643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.262590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.263863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.463977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:09.475786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7af52110-af5c-4b3f-b795-8da32d908a13 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.233451 Oct 28 17:59:09.482574 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2979/5818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:09 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:09.505353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:09.506370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 69fdfe06-50c3-4036-bf8d-459b94aba9a4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:09.514183 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/69fdfe06-50c3-4036-bf8d-459b94aba9a4/action HTTP/1.1 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 15 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: {"unpause": {}} Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '69fdfe06-50c3-4036-bf8d-459b94aba9a4', 'body': {'unpause': {}}} Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:09.516052 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:09.521235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:09.521235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:09.521235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. Oct 28 17:59:09.521235 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:09.522397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 69fdfe06-50c3-4036-bf8d-459b94aba9a4 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:09.523873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-07b1cec8-e7c6-4bfb-a665-c0ff193a9dd0 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/69fdfe06-50c3-4036-bf8d-459b94aba9a4/action" status: 404 len: 111 microversion: 2.1 time: 0.022495 Oct 28 17:59:09.528235 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2840/5819] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:09 2022] POST /compute/v2.1/servers/69fdfe06-50c3-4036-bf8d-459b94aba9a4/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:09.534862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:09.535758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:09.546605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.548715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.549367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.550989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.552632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.553426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.741794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:09.752405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71eb7025-c524-457a-bba5-ce1ddb54b9b1 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.223283 Oct 28 17:59:09.754012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2980/5820] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:09 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:09.785360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:09.785993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:09.800874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.801368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.801831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.802524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:09.802974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:09.803424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:09.969330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-691556701", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "9149ebf8-d313-4a4b-9d37-5f994f130116"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:09.995066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:10.010254 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e68bc63d-e9f1-454d-b096-5b1c727a301a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.235209 Oct 28 17:59:10.012884 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2981/5821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:09 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:10.036381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:10.037043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.044156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.045359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.045914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.046727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.047349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.048126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.063542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] validate_networks() for [('9149ebf8-d313-4a4b-9d37-5f994f130116', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:59:10.077294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'unpause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 15 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: {"unpause": {}} Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: exception: Cannot 'unpause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'unpause': {}}} Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state active. Cannot unpause while the instance is in this state. Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.079149 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'unpause' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e15875c-950e-4f4b-91a5-3b288850c2d7 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 145 microversion: 2.1 time: 0.048334 Oct 28 17:59:10.083932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2982/5822] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:10 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 145 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 17:59:10.094822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:10.094822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.101347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.102479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.103026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.104639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.105294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.106121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.310549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:10.319047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bdab3bc6-324e-4a70-87f5-dee4e967899a tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.233397 Oct 28 17:59:10.320743 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2983/5823] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:10.345697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:10.346496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.352952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.353799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.354335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.375264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.376188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.376882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.613720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:10.632269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa123b22-92dc-4681-9747-58f62472ca73 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.287582 Oct 28 17:59:10.633292 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2984/5824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:10.656303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:10.656906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.669508 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. Oct 28 17:59:10.670415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:59:10.670846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:59:10.671531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:59:10.672088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/87a4c95b-2aa5-40af-a449-c9c3eb03d2e7/action HTTP/1.1 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 18 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: {"unshelve": null} Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '87a4c95b-2aa5-40af-a449-c9c3eb03d2e7', 'body': {'unshelve': None}} Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.672513 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 87a4c95b-2aa5-40af-a449-c9c3eb03d2e7 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b3ea1454-b1e6-4303-b7a9-0c1027d9988d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/87a4c95b-2aa5-40af-a449-c9c3eb03d2e7/action" status: 404 len: 111 microversion: 2.1 time: 0.022992 Oct 28 17:59:10.680190 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2985/5825] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:10 2022] POST /compute/v2.1/servers/87a4c95b-2aa5-40af-a449-c9c3eb03d2e7/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 17:59:10.681011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:59:10.686741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:10.688259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.691391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.692057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.692651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.693837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.694449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.694995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.695361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.695537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.695952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.696858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.697451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.697887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.716087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Getting quotas for project 9ed0df0e4f034f6c9f63ad71a2917f15. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:59:10.722287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Getting quotas for user 4dc25accafc540daa8736dd1496baed2 and project 9ed0df0e4f034f6c9f63ad71a2917f15. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:59:10.737810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:59:10.740471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:59:10.810616 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-80d843a2-e5b8-4e87-b84c-bc567dc87d7f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.196325 Oct 28 17:59:10.818526 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2841/5826] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:59:10.824069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9485ee99-9f2e-43f6-883c-e5db49377488 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:10.824865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9485ee99-9f2e-43f6-883c-e5db49377488 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.911794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:10.923175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c7e4c16a-b023-49f8-8d72-a6d4c91caa2e tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.243484 Oct 28 17:59:10.924377 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2986/5827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:10.947636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9485ee99-9f2e-43f6-883c-e5db49377488 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:10.954099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:10.960240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:10.970563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9485ee99-9f2e-43f6-883c-e5db49377488 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1214 microversion: 2.1 time: 0.150414 Oct 28 17:59:10.972516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.973368 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2842/5828] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:10 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:10.974123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.974858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:10.975819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:10.976358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:10.977142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.167000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:11.176606 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-81f43d24-3f41-4aa6-afab-e9cddda78061 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.227089 Oct 28 17:59:11.178089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2987/5829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:10 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:11.200337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:11.201499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:11.208916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.209930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.210691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.211979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.212959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.213506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.264810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Cannot 'unshelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action HTTP/1.1 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 18 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: {"unshelve": null} Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: exception: Cannot 'unshelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'unshelve': None}} Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 in vm_state active. Cannot unshelve while the instance is in this state. Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 17:59:11.266432 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 409 to user: Cannot 'unshelve' instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 while it is in vm_state active {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:11.271233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2c88977-7fe9-46e3-b6f8-466e802a40f2 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action" status: 409 len: 146 microversion: 2.1 time: 0.072321 Oct 28 17:59:11.272997 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2843/5830] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:11 2022] POST /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61/action => generated 146 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 17:59:11.277422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:11.278038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:11.287055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.287575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.288133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.288908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.289369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.289790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.479077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:11.492380 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b8b4524-6370-4d7b-906d-9fed9162bd20 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.219134 Oct 28 17:59:11.493037 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2988/5831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:11 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:11.517338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:11.517902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:11.525198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.525741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.526182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.526894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.527429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.527939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.782014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:11.790298 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a483137-f282-48c4-ad1a-2f1c929e27bc tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.277656 Oct 28 17:59:11.790884 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2844/5832] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:11 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:11.822547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-204099281_updated"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:11.826402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:11.833941 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: request: PUT /compute/v2.1/servers/c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 HTTP/1.1 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 80 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-204099281_updated"}} Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-204099281_updated'}}} Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 17:59:11.836390 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. Oct 28 17:59:11.840861 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:11.843776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:11.844899 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa430ac4-0d26-49fa-98a1-13f59c2a3179 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "PUT /compute/v2.1/servers/c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22" status: 404 len: 111 microversion: 2.1 time: 0.031324 Oct 28 17:59:11.849382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2989/5833] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:59:11 2022] PUT /compute/v2.1/servers/c6fcfb18-dc27-4b52-b7b3-7ae0c9e7bd22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:11.857373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:11.858884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:11.866969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.867876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.868586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.869719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:11.870880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:11.871795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:11.877673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:12.005116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:12.006320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:12.017747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.023078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.023716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.024519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.025175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.025797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.111216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:12.129142 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3bb7fb6-090c-4999-b6b1-e305d9f83b83 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1266 microversion: 2.1 time: 0.128433 Oct 28 17:59:12.130290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2990/5834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:11 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:12.222723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:12.233235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e7748741-5f9a-4f32-b2f3-4797c6a8b628 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.382576 Oct 28 17:59:12.234378 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2845/5835] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:11 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:12.257114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:12.258130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:12.264951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.265587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.266118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.266899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.267470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.268260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.698394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:12.711287 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1e3cdcdf-1082-4c9e-a4b8-f588968bb132 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.456913 Oct 28 17:59:12.720663 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2991/5836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:12.735806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f63f702-7b4d-4000-96a1-e1b36d732fa6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f63f702-7b4d-4000-96a1-e1b36d732fa6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 HTTP/1.1 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 280 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.739944 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f63f702-7b4d-4000-96a1-e1b36d732fa6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f63f702-7b4d-4000-96a1-e1b36d732fa6 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 400 len: 619 microversion: 2.1 time: 0.010294 Oct 28 17:59:12.744359 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2846/5837] 10.222.0.48 () {60 vars in 1257 bytes} [Fri Oct 28 17:59:12 2022] PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:12.752377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:12.753210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:12.759850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.760367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.760823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.761522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:12.762021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:12.762448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:12.978486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:12.987737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f713ccf9-5232-44d2-ae72-0343a6829a6d tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.240999 Oct 28 17:59:12.988334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2992/5838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:12 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:13.016749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:13.017274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:13.034853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.036625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.037253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.038146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.038756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.039338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.154852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:13.155700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:13.162604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.163405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.164012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.165176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.165840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.166429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.172535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:13.288147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:13.293144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:13.303878 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fa3009ed-752f-4c9b-9be3-409b94d01031 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.291527 Oct 28 17:59:13.304068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c41b494-fa98-4e00-82ab-1a5eb482e5bb tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1272 microversion: 2.1 time: 0.154577 Oct 28 17:59:13.304802 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2847/5839] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:13.319400 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2993/5840] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:13 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:13.330755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd98381e-f7fe-4d97-92d7-08770faf3013 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd98381e-f7fe-4d97-92d7-08770faf3013 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: request: PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 HTTP/1.1 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 24 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: {"server": {"name": ""}} Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61', 'body': {'server': {'name': ''}}} Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise error Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi '' Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 17:59:13.335840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd98381e-f7fe-4d97-92d7-08770faf3013 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:13.341636 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd98381e-f7fe-4d97-92d7-08770faf3013 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 400 len: 108 microversion: 2.1 time: 0.011378 Oct 28 17:59:13.347671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:13.348286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:13.353474 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2848/5841] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:59:13 2022] PUT /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:13.372137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.373012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.373584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.374341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:13.381320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:13.382739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:13.628514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:13.639297 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c25060e-0d39-4113-b3fd-67294e704d22 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1506 microversion: 2.1 time: 0.295065 Oct 28 17:59:13.640503 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2994/5842] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:13 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:14.331230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:14.332070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:14.352182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:14.353683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:14.354325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:14.376692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:14.377193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:14.379981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:14.562825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:14.574104 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a37f7593-5bbd-459a-a312-dba97f8bedc3 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.247315 Oct 28 17:59:14.574971 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2849/5843] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:14 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:15.012305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847285f9-392e-4fbb-a9d4-d276c06e2fce", "tag": "a6459ed1-4439-41bb-a171-747b6d640dbc"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:15.025532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:15.026380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:15.026988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:15.043195 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] Creating event network-changed:a6459ed1-4439-41bb-a171-747b6d640dbc for instance 847285f9-392e-4fbb-a9d4-d276c06e2fce on n-h2-860864-13 Oct 28 17:59:15.050169 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b79d5c3c-c914-4aa4-a9c8-86463d73786b req-8edb20a0-44a8-4399-92ce-63ca4e86aba4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241325 Oct 28 17:59:15.051979 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2995/5844] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:15.598084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:15.598687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:15.609355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:15.620708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:15.623521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:15.625670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:15.629690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:15.630335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:15.630879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:15.853371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:15.862371 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8820c036-82a9-4a47-b891-a03ed6c135f0 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.268116 Oct 28 17:59:15.863108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2850/5845] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:15 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:16.895306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:16.896707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:16.904831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:16.905328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:16.905766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:16.906616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:16.907351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:16.907542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:17.091862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:17.113281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-baa87deb-b3f3-42ba-8129-4db0fc0225bc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.223346 Oct 28 17:59:17.129407 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2996/5846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:16 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:18.145045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:18.151885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:18.172938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:18.173970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:18.174723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:18.175799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:18.176536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:18.177348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:18.399708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:18.413674 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5e88c13-f47d-45ca-8432-9db737c1ca2b tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.272479 Oct 28 17:59:18.415077 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2851/5847] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:18 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:19.454272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:19.454726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:19.464057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:19.464565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:19.465301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:19.466259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:19.467550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:19.467984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:19.693488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:19.702816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c7d52f4-af16-4c9f-9f85-63be4e21b053 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.257107 Oct 28 17:59:19.703639 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2997/5848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:19 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:20.196630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847285f9-392e-4fbb-a9d4-d276c06e2fce", "name": "network-vif-plugged", "status": "completed", "tag": "a6459ed1-4439-41bb-a171-747b6d640dbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:20.209672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.210150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.210579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.238117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] Creating event network-vif-plugged:a6459ed1-4439-41bb-a171-747b6d640dbc for instance 847285f9-392e-4fbb-a9d4-d276c06e2fce on n-h2-860864-13 Oct 28 17:59:20.244023 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-bd1f0ed9-84bb-4ccc-aed6-4033297aaf53 req-79229eb8-dd8b-412a-aa18-6c8718a46e87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.389568 Oct 28 17:59:20.244901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2852/5849] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:20.442282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:20.443243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:20.451257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.452360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.452844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.454166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.454829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.455473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.473294 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa HTTP/1.1 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '09cfe9b7-50fe-4906-a4fd-3499b128f2aa'} Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:20.475303 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.479673 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.482081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:20.483187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-504397da-792d-495e-bf42-3f5e62658845 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 404 len: 111 microversion: 2.1 time: 0.045990 Oct 28 17:59:20.484373 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2998/5850] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:59:20 2022] DELETE /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:20.493111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:20.494193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 09cfe9b7-50fe-4906-a4fd-3499b128f2aa] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:20.514615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.515214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.515744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.516655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.517179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.517678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.532450 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa HTTP/1.1 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '09cfe9b7-50fe-4906-a4fd-3499b128f2aa'} Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:20.534232 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 09cfe9b7-50fe-4906-a4fd-3499b128f2aa could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bc8d9fcc-6d11-4847-b1df-f633e4b1de80 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa" status: 404 len: 111 microversion: 2.1 time: 0.047335 Oct 28 17:59:20.538307 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2853/5851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:20 2022] GET /compute/v2.1/servers/09cfe9b7-50fe-4906-a4fd-3499b128f2aa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:20.544736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:20.545319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:20.552070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.552599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.553105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.553891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.554673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.555349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.584863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:59:20.710587 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e36e9aa6-b149-4edf-a877-25a31fef0f9c tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 204 len: 0 microversion: 2.1 time: 0.169477 Oct 28 17:59:20.711185 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 2999/5852] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:59:20 2022] DELETE /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:59:20.722968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:20.723828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:20.730116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:20.732353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:20.732765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:20.735131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.735939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.736591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.737495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.738241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.739268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.742851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.743441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.744528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.745731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:20.746354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:20.746973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:20.960613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:20.995564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:21.014585 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60fbc971-1eb4-4d13-be66-70e60acc0078 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.298979 Oct 28 17:59:21.017812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2854/5853] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:20 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:21.051984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:21.064759 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f4bc93b-94bb-4200-8eea-ff9c12f65ee4 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1314 microversion: 2.1 time: 0.341826 Oct 28 17:59:21.076948 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3000/5854] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:20 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:22.040535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:22.041699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:22.049369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.050137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.050578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.051280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.051753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.052177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.091649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:22.092369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:22.100240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.100984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.101681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.102388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.103055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.103724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.371348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:22.387712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:22.389054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7784a5cf-fdf8-41ee-bf5b-4ad5e6c33d03 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1512 microversion: 2.1 time: 0.352391 Oct 28 17:59:22.401410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2855/5855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:22 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:22.401613 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f228faa3-e06a-4623-82f7-a231d47f00c6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1500 microversion: 2.1 time: 0.307960 Oct 28 17:59:22.401613 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3001/5856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:22 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1500 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:22.417847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:22.418460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:22.426410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.426901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.427342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.428095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.428550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.429006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.695769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:22.708437 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1d6fab06-a020-4ee0-83de-6aa48801a923 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1500 microversion: 2.1 time: 0.294700 Oct 28 17:59:22.709038 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2856/5857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:22 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1500 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:22.733581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:22.734847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:22.742413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.743354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.744073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.745194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.745725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.746207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.776354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lazy-loading 'flavor' on Instance uuid 847285f9-392e-4fbb-a9d4-d276c06e2fce {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:22.853950 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-307a21e7-5a8b-4f8e-8b57-87ad0b6d5098 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action" status: 202 len: 0 microversion: 2.1 time: 0.124477 Oct 28 17:59:22.854767 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3002/5858] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:22 2022] POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:22.867774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:22.869362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:22.880895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.881767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.882626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:22.884775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:22.885710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:22.886601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:23.055815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:23.063579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8261e21-1c70-45ca-b044-ca019ca94518 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1508 microversion: 2.1 time: 0.203551 Oct 28 17:59:23.064577 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2857/5859] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:22 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:23.413874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:23.414571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:23.421240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:23.422054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:23.422751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:23.423730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:23.424387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:23.424876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:23.507316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86eed03bb1414f038da85d3742f9a9cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667da1a2b1c24fe8807a4af03e7a3b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:23.518328 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-188bd6e9-bd8d-4298-bae2-5f08abd00faf tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 200 len: 1470 microversion: 2.1 time: 0.109452 Oct 28 17:59:23.519605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3003/5860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:23 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 1470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:23.612850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d74c8d2-d52e-49ec-b840-a6d801c7db61", "name": "network-vif-deleted", "tag": "84511947-c6da-4a50-aee3-30f88c1fd9ee"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:23.626192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:23.627101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:23.627621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:23.665054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] Creating event network-vif-deleted:84511947-c6da-4a50-aee3-30f88c1fd9ee for instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 on n-h1-860864-13 Oct 28 17:59:23.677149 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-95a93200-46cc-4f54-8c7f-c4c566d7e120 req-adcd8ac7-128f-47dd-9213-555e8a0628b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068352 Oct 28 17:59:23.678597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2858/5861] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:59:24.087552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:24.088232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.095165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.095769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.096471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.097377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.097828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.098245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.318373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:24.329425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-305226a1-263e-4b22-8cc8-3152e6ea1dff tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1491 microversion: 2.1 time: 0.245817 Oct 28 17:59:24.330533 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3004/5862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:24 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1491 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:24.360895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:24.363277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.373879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.374634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.375280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.376233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.376931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.377549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.453590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0998fb03-f6b3-4650-933f-96ccc0d25291 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action" status: 202 len: 0 microversion: 2.1 time: 0.101448 Oct 28 17:59:24.457893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2859/5863] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:24 2022] POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:24.469431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:24.471109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.482915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.484604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.486175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.488814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.491437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.492659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.546404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:24.547639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] [instance: 5d74c8d2-d52e-49ec-b840-a6d801c7db61] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.562622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.566592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.567465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.568424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.569337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.569972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.627579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] HTTP exception thrown: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Request method failure captured: Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 HTTP/1.1 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBeg3iuHzNCWlFbxu5ZQHxGcQlBHTDsaXA7OcPlSQ3kTtbRxx6Oy2C-6S6FF69b-BYV8D21BAzqmICb2S8SnEhpGmQVKWqqdFu02QYLKTy42xsbEesU9rIaxWxuScTB1-nLB7XgeR-AiKmw52awhIF-GP8EevXllwRrZHCxDdQZOXeY Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_667da1a2b1c24fe8807a4af03e7a3b2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/667da1a2b1c24fe8807a4af03e7a3b2d"}]}] Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 667da1a2b1c24fe8807a4af03e7a3b2d Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1728127651 Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 86eed03bb1414f038da85d3742f9a9cc Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1728127651-project Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '5d74c8d2-d52e-49ec-b840-a6d801c7db61'} Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:24.629135 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] Returning 404 to user: Instance 5d74c8d2-d52e-49ec-b840-a6d801c7db61 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ee5e282-84fd-4596-a0cb-04d9022d5dc9 tempest-ServersNegativeTestJSON-1728127651 tempest-ServersNegativeTestJSON-1728127651-project] 10.222.0.48 "GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61" status: 404 len: 111 microversion: 2.1 time: 0.088973 Oct 28 17:59:24.633291 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2860/5864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:24 2022] GET /compute/v2.1/servers/5d74c8d2-d52e-49ec-b840-a6d801c7db61 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:24.673717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:24.676290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.684614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.685570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.686273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.687309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.688091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.689607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.730321 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-663a9f04-f49b-4aef-b5bd-46a94db67888 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062534 Oct 28 17:59:24.739725 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2861/5865] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Oct 28 17:59:24 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:24.836064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:24.836950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:24.849277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.850203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.850905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.852223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:24.856959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:24.859893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:24.867784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:24.876644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74f76b50-dc4f-470b-8d29-48926c707b72 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1497 microversion: 2.1 time: 0.417892 Oct 28 17:59:24.877583 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3005/5866] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:24 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1497 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:24.917635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:59:25.045801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04622c8e-cc3f-455f-a77a-b8a8ee94d3de tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 204 len: 0 microversion: 2.20 time: 0.212690 Oct 28 17:59:25.050352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2862/5867] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:59:24 2022] DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 17:59:25.062226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:25.067458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:25.077054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:25.078413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:25.080109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:25.081104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:25.081770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:25.084248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:25.323544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:25.338830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:25.344953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:25.346568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0eeb5530-3a67-457f-ab62-a8bb208ba5f5 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.294040 Oct 28 17:59:25.347330 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3006/5868] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:25 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:59:25.903620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:25.904596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:25.915723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:25.916471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:25.917216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:25.918202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:25.919142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:25.920238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:26.144992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:26.149565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:26.156308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4de75c2c-cf05-4677-a150-cc2e9d1e13dc tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1497 microversion: 2.1 time: 0.258112 Oct 28 17:59:26.173160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2863/5869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:25 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:26.376190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:26.376805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:26.406927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:26.407504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:26.407943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:26.408868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:26.410769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:26.411387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:26.792317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:26.800550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:26.808458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:26.811520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:26.818435 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de37513e-5bed-4a42-861a-be2985225a0e tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1722 microversion: 2.20 time: 0.447001 Oct 28 17:59:26.819794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3007/5870] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:26 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:59:27.181638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:27.182329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:27.205669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:27.206364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:27.206882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:27.207724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:27.208240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:27.208819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:27.725381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:27.754878 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05f4aa1f-91f2-477a-8abc-cf4e998c7cea tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1497 microversion: 2.1 time: 0.578237 Oct 28 17:59:27.756081 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2864/5871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:27 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1497 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:27.849293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:27.850476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:27.866846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:27.867865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:27.868614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:27.869046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:27.885017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:27.891762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:28.158578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:28.170652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:28.174207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:28.178394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92a66263-ea0e-4ee6-90aa-fa0503903b93 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1654 microversion: 2.20 time: 0.335455 Oct 28 17:59:28.179002 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3008/5872] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:27 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1654 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:59:28.667585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1904b39e-0bfe-4078-b38a-e461a568348c", "name": "network-vif-deleted", "tag": "bdc51893-3587-4c00-aa05-55e921f3da7c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:28.692559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:28.698600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:28.699057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:28.729534 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] Creating event network-vif-deleted:bdc51893-3587-4c00-aa05-55e921f3da7c for instance 1904b39e-0bfe-4078-b38a-e461a568348c on n-h2-860864-13 Oct 28 17:59:28.744680 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f8557435-a546-4f3b-8fc8-266f488d109d req-3454c67c-5c60-4339-adaf-cb04be08ff81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079282 Oct 28 17:59:28.749014 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2865/5873] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:28.783929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:28.784956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:28.808597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:28.820130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:28.821442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:28.823568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:28.824284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:28.825833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.220286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:29.221433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:29.242562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.243066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.243538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.254597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.256435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.259139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.337432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.337925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.344387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.344866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lazy-loading 'fault' on Instance uuid 1904b39e-0bfe-4078-b38a-e461a568348c {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:29.428436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:29.457822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60f2e2f8-190a-49f3-9188-be3d6da816d6 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1500 microversion: 2.1 time: 0.678263 Oct 28 17:59:29.472155 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3009/5874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:28 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1500 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:29.492915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:29.497564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:29.498112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:29.506507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.507030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.511148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:29.511471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.516494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9009e2acd3345f2a5dd2d609685d0aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2854b7a7ca0948359265d36cb0bf4fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:29.517560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.518100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.518572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.520625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b96786a3-9e6c-45e5-867d-4f97b9e55182 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 200 len: 1370 microversion: 2.20 time: 0.312479 Oct 28 17:59:29.522048 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2866/5875] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:29 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 17:59:29.565339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lazy-loading 'flavor' on Instance uuid 847285f9-392e-4fbb-a9d4-d276c06e2fce {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:29.723418 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f051c6f-3f02-49ec-a520-792bd8cd5378 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action" status: 202 len: 0 microversion: 2.1 time: 0.226574 Oct 28 17:59:29.724443 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3010/5876] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:29 2022] POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:59:29.736735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:29.737536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:29.749657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.751312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.755019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:29.758300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:29.759271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:29.760005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:30.069867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:30.087584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49118091-386f-4ad9-93b0-e2976e4b952f tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1508 microversion: 2.1 time: 0.358516 Oct 28 17:59:30.092759 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2867/5877] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:29 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:30.549747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:30.550461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:30.568014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:30.570090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:30.580161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:30.581243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:30.581900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:30.582552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:30.644395 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c HTTP/1.1 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1904b39e-0bfe-4078-b38a-e461a568348c'} Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:30.658880 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:30.663912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:30.665775 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-360d754c-48cd-484e-ad66-df819c5cdd74 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 404 len: 111 microversion: 2.20 time: 0.119479 Oct 28 17:59:30.665775 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3011/5878] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:30 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:30.676068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1cad973-4ea2-4e38-baa8-603b085021b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '.version_select at 0x7f751f08c9d0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:30.710687 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1cad973-4ea2-4e38-baa8-603b085021b1 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13568021" status: 204 len: 0 microversion: 2.20 time: 0.038841 Oct 28 17:59:30.714844 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2868/5879] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 17:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13568021 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 17:59:31.115870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:31.116490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:31.126046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:31.126534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:31.126961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:31.127694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:31.130513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:31.130956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:31.879217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:31.890012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd474b2d-93f2-4200-8b8d-191785601fce tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1491 microversion: 2.1 time: 0.778171 Oct 28 17:59:31.893927 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3012/5880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:31 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1491 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:31.921471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:31.922295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:31.936639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:31.938221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:31.939836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:31.940745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:31.942981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:31.943694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:32.147686 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6c56e84-e5e4-4183-8a31-ef5ff99aaf26 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action" status: 202 len: 0 microversion: 2.1 time: 0.232033 Oct 28 17:59:32.148661 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2869/5881] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 17:59:31 2022] POST /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:32.156897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:32.158283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:32.170829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:32.171715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:32.176051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:32.177598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:32.179044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:32.179894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:33.130004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:33.141669 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bb77c03-e6d1-42b3-a0ae-a96e4cb88114 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1497 microversion: 2.1 time: 0.987015 Oct 28 17:59:33.143510 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3013/5882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:32 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1497 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:33.815569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa3e157b-08bb-49bb-9f94-676d8f5efa02 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Action: 'create', calling method: .version_select at 0x7f751fae4670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-176333377", "metadata": {"Type": "work"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:34.170109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:34.171832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:34.189812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:34.190458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:34.191765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:34.194235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:34.195975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:34.197944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:34.380504 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa3e157b-08bb-49bb-9f94-676d8f5efa02 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.777265 Oct 28 17:59:34.389593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2870/5883] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Oct 28 17:59:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 788 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 17:59:34.394505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0244f32b-1a35-43bc-bfac-b97311976c2c tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f0e6040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:34.503649 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0244f32b-1a35-43bc-bfac-b97311976c2c tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.112881 Oct 28 17:59:34.504224 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2871/5884] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:34 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:34.783751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:34.795484 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a193e53-df8f-46e9-86a3-ff84883566d1 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1497 microversion: 2.1 time: 0.629849 Oct 28 17:59:34.798726 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3014/5885] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:34 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1497 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:35.604987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b764de24-e3a5-490f-87fe-4770b7b7fac7 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751fae4d30>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:35.766252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b764de24-e3a5-490f-87fe-4770b7b7fac7 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.250877 Oct 28 17:59:35.767103 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2872/5886] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:35 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:35.820685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:35.821292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:35.842429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:35.842938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:35.843409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:35.848412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:35.848892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:35.858167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:36.556381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:36.568209 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37e2cb11-77b9-421a-b9fd-c93bca04dd21 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1500 microversion: 2.1 time: 0.751495 Oct 28 17:59:36.568916 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3015/5887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:35 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1500 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:36.599108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:36.599765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:36.612805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:36.614807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:36.615262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:36.617189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:36.617663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:36.618091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:36.680633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 17:59:36.781030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e0b45643-223d-4390-baea-c4bd29e15c14 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f7524b574c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:36.909514 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e0b45643-223d-4390-baea-c4bd29e15c14 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 353 microversion: 2.1 time: 0.133227 Oct 28 17:59:36.919218 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3016/5888] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:36 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:59:36.924319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23f21ff1-10a8-40f4-99ce-a6ec4239d8fa tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f62ff70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:36.948802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-71cb55bd-6faf-439b-bdaf-d465eeab17d9 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "DELETE /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 204 len: 0 microversion: 2.1 time: 0.354217 Oct 28 17:59:36.951635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2873/5889] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 17:59:36 2022] DELETE /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 17:59:36.965259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:36.969338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:36.987536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:36.988327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:36.988948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:36.989840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:36.995782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:36.996697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:37.048285 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23f21ff1-10a8-40f4-99ce-a6ec4239d8fa tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 353 microversion: 2.1 time: 0.127698 Oct 28 17:59:37.049521 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3017/5890] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:36 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:37.066156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a8fab0b-c457-4031-b185-600a6f94283f tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f62f700>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:37.187723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a8fab0b-c457-4031-b185-600a6f94283f tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 202 len: 0 microversion: 2.1 time: 0.127771 Oct 28 17:59:37.188657 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3018/5891] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 17:59:37 2022] DELETE /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 17:59:37.205552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6cc4fcf1-0778-4a82-9e79-ae90646585b1 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f62f940>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:37.361262 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6cc4fcf1-0778-4a82-9e79-ae90646585b1 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.163972 Oct 28 17:59:37.363068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3019/5892] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:37 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:37.377175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:37.378097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:37.396836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:37.397573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:37.399457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:37.404287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:37.405008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:37.405630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:37.445487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c HTTP/1.1 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1904b39e-0bfe-4078-b38a-e461a568348c'} Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:37.450168 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.455349 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.459596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:37.461591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df85e21d-cccc-4709-8b6f-7216b612ce05 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 404 len: 111 microversion: 2.20 time: 0.097325 Oct 28 17:59:37.465523 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3020/5893] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:59:37 2022] DELETE /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:37.474400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:37.476555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 1904b39e-0bfe-4078-b38a-e461a568348c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:37.493894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:37.494664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:37.495257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:37.500087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:37.501399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:37.502001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:37.516891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:37.526731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3546101b-fbcc-4d18-803b-045f138cbe41 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1506 microversion: 2.1 time: 0.565708 Oct 28 17:59:37.531590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2874/5894] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:36 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1506 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:37.564815 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c HTTP/1.1 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '1904b39e-0bfe-4078-b38a-e461a568348c'} Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.566400 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:37.571543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 1904b39e-0bfe-4078-b38a-e461a568348c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:37.581947 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f90d6f4e-758e-453b-9246-14d274ae5c81 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c" status: 404 len: 111 microversion: 2.20 time: 0.111435 Oct 28 17:59:37.587417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3021/5895] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:37 2022] GET /compute/v2.1/servers/1904b39e-0bfe-4078-b38a-e461a568348c => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 17:59:38.378342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c10a0e4-5932-4d02-a5bc-0693db0561d2 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f081310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:38.514013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c10a0e4-5932-4d02-a5bc-0693db0561d2 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.140118 Oct 28 17:59:38.520771 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2875/5896] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:38 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:38.554184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:38.555464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:38.570703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:38.571526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:38.572186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:38.573112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:38.573763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:38.576340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:38.847619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:38.858378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13c0eb37-998a-4096-9c34-96e44388aa19 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1506 microversion: 2.1 time: 0.308086 Oct 28 17:59:38.869638 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3022/5897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:38 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:39.530753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e391f62-36e6-492e-87b7-485b863ad372 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f0aa940>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:39.648159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e391f62-36e6-492e-87b7-485b863ad372 tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.123341 Oct 28 17:59:39.648738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2876/5898] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:39 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 17:59:39.901317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:39.902014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:39.906640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:39.918435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:39.919039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:39.921912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:39.923215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:39.925204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:39.928863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:40.080375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:40.089485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c2f429cb-01a1-4bc5-8ba9-e0ed67fc54db tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1464 microversion: 2.1 time: 0.196059 Oct 28 17:59:40.090791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3023/5899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:39 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:40.520486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847285f9-392e-4fbb-a9d4-d276c06e2fce", "name": "network-vif-deleted", "tag": "a6459ed1-4439-41bb-a171-747b6d640dbc"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:40.556825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:40.564463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:40.564730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:40.595775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] Creating event network-vif-deleted:a6459ed1-4439-41bb-a171-747b6d640dbc for instance 847285f9-392e-4fbb-a9d4-d276c06e2fce on n-h2-860864-13 Oct 28 17:59:40.630564 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b2be81c8-030b-4691-a95f-8588dd673f96 req-b09d6c7a-03fe-4ef9-af74-a65826df57da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116696 Oct 28 17:59:40.631698 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2877/5900] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:59:40.664855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5799789e-ea62-4cab-a80a-c67406fb31fa tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f740a60>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:40.864766 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5799789e-ea62-4cab-a80a-c67406fb31fa tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 200 len: 352 microversion: 2.1 time: 0.204422 Oct 28 17:59:40.865634 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3024/5901] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:40 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 352 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:59:41.125510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:41.126659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:41.139138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:41.146991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:41.147702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:41.148580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:41.154019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:41.157312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:41.296167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:41.309415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:41.310302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:41.310981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lazy-loading 'fault' on Instance uuid 847285f9-392e-4fbb-a9d4-d276c06e2fce {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:41.488749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dc25accafc540daa8736dd1496baed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed0df0e4f034f6c9f63ad71a2917f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:41.508412 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b64a4e91-824c-4329-9b24-e2d4b029c2c7 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 200 len: 1304 microversion: 2.1 time: 0.388747 Oct 28 17:59:41.528170 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2878/5902] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:41 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 1304 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:41.880515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-149c1ece-4ec2-4c86-85a2-ae5a5e0177dd tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Calling method '.version_select at 0x7f751f8a9280>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:41.943964 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-149c1ece-4ec2-4c86-85a2-ae5a5e0177dd tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] HTTP exception thrown: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-149c1ece-4ec2-4c86-85a2-ae5a5e0177dd tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Request method failure captured: Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 HTTP/1.1 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBiFc5dcpmGws66urLIVaFnH8chP-48hw9l40GPI_pX6ew_E1I3XRq4poVOhXcXbwnC3I-c9_2np2tRAo16aXC1gxbIbRdKArye9V-esxlfdf5megMx6tSixAHSEZlkWBGOTxqt6wza3sRANKDeQROt_vX2LeeWIio9s3fVpsxgAEis Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 065b33650a0149f5b3e731cf335e02d4 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesGetTestJSON-1274938718 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/065b33650a0149f5b3e731cf335e02d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/065b33650a0149f5b3e731cf335e02d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_065b33650a0149f5b3e731cf335e02d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/065b33650a0149f5b3e731cf335e02d4"}]}] Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesGetTestJSON-1274938718 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 065b33650a0149f5b3e731cf335e02d4 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesGetTestJSON-1274938718 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesGetTestJSON-1274938718-project Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 3400949750c54cd5bc4dade87651f2e8 Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesGetTestJSON-1274938718-project Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: method: Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: exception: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '98847d37-668b-48b3-aeaf-2b645adf21c5'} Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. (HTTP 404) (Request-ID: req-7fac0e1b-9576-46d4-8ed3-f7685265c98e) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 17:59:41.946791 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. Oct 28 17:59:41.953975 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:41.962270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-149c1ece-4ec2-4c86-85a2-ae5a5e0177dd tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] Returning 404 to user: Volume 98847d37-668b-48b3-aeaf-2b645adf21c5 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:41.962270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-149c1ece-4ec2-4c86-85a2-ae5a5e0177dd tempest-VolumesGetTestJSON-1274938718 tempest-VolumesGetTestJSON-1274938718-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5" status: 404 len: 109 microversion: 2.1 time: 0.085028 Oct 28 17:59:41.963530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3025/5903] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Oct 28 17:59:41 2022] GET /compute/v2.1/os-volumes/98847d37-668b-48b3-aeaf-2b645adf21c5 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:42.544738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:42.549885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] [instance: 847285f9-392e-4fbb-a9d4-d276c06e2fce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:42.575472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:42.581560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:42.582032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:42.586881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:42.588088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:42.589450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:42.625625 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] HTTP exception thrown: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Request method failure captured: Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce HTTP/1.1 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBhrCkbmsaIXgqNjbi4YaLjaPQrfVrR8-tCZhToqEENxYDIFB-R5R4ltI4iEcae72sMcE-hfuBPsw7xp3VDLZibeKZDSBKOm4V7Fc5fOsc5bXEk4lMaYiDi5mG-ZEIEmFRb6oCs3vNRuvRa8IFrspAmvhPeuRqNrqduih9iBj3ejK84 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9ed0df0e4f034f6c9f63ad71a2917f15 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestServerAdvancedOps-1089818399 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ed0df0e4f034f6c9f63ad71a2917f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ed0df0e4f034f6c9f63ad71a2917f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ed0df0e4f034f6c9f63ad71a2917f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ed0df0e4f034f6c9f63ad71a2917f15"}]}] Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestServerAdvancedOps-1089818399 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9ed0df0e4f034f6c9f63ad71a2917f15 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestServerAdvancedOps-1089818399 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestServerAdvancedOps-1089818399-project Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 4dc25accafc540daa8736dd1496baed2 Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestServerAdvancedOps-1089818399-project Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '847285f9-392e-4fbb-a9d4-d276c06e2fce'} Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:42.627670 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. Oct 28 17:59:42.632565 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:42.636288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] Returning 404 to user: Instance 847285f9-392e-4fbb-a9d4-d276c06e2fce could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:42.640394 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d38809b-fb35-4d34-b9d2-a15182a38556 tempest-TestServerAdvancedOps-1089818399 tempest-TestServerAdvancedOps-1089818399-project] 10.222.0.48 "GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce" status: 404 len: 111 microversion: 2.1 time: 0.110758 Oct 28 17:59:42.644652 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2879/5904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:42 2022] GET /compute/v2.1/servers/847285f9-392e-4fbb-a9d4-d276c06e2fce => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 17:59:44.582469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:44.583215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:44.602076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:44.618621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:44.619499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:44.620429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:44.621934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:44.622560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:44.649525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 HTTP/1.1 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6279d691-97a6-42cc-86bf-a9fe321a7924'} Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:44.657736 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.662491 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.667183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:44.671875 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9bea968-1f35-4eab-bf29-7c7b79033762 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 404 len: 111 microversion: 2.20 time: 0.090830 Oct 28 17:59:44.673818 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3026/5905] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Oct 28 17:59:44 2022] DELETE /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:44.681198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:44.682125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] [instance: 6279d691-97a6-42cc-86bf-a9fe321a7924] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:44.712983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:44.713879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:44.714545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:44.716257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:44.717162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:44.717893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:44.735743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] HTTP exception thrown: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Request method failure captured: Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 HTTP/1.1 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBZRjCnsFy4zgiMqATtV8UK3KekZLYzGUdwVveKZe08v_K3rzV6RIhULqB8py-RDr9cN92pOUo1yv_Idl_BTS7ncgloaGH5pI5tZERFx99ym8B8tTZCSp8NtmcFz5vQPG_kcOTPPd5l5rSS8YI-dHEjRFt3Crxi1RCwTchbPIciyvbw Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2854b7a7ca0948359265d36cb0bf4fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2854b7a7ca0948359265d36cb0bf4fcb"}]}] Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 2854b7a7ca0948359265d36cb0bf4fcb Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867604501 Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d9009e2acd3345f2a5dd2d609685d0aa Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867604501-project Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '6279d691-97a6-42cc-86bf-a9fe321a7924'} Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.737821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. Oct 28 17:59:44.741817 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 17:59:44.747465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] Returning 404 to user: Instance 6279d691-97a6-42cc-86bf-a9fe321a7924 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 17:59:44.749188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70e8b84c-664b-47e6-8a46-25c7853c2e53 tempest-AttachVolumeShelveTestJSON-867604501 tempest-AttachVolumeShelveTestJSON-867604501-project] 10.222.0.48 "GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924" status: 404 len: 111 microversion: 2.20 time: 0.072279 Oct 28 17:59:44.750328 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2880/5906] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Oct 28 17:59:44 2022] GET /compute/v2.1/servers/6279d691-97a6-42cc-86bf-a9fe321a7924 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 17:59:46.134070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1856250031", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "41fd2225-8347-47d3-98a4-314fe2e47ce9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1728383910", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ee01030c-8351-460a-97a1-221241449bc6"]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:46.240082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] validate_networks() for [('41fd2225-8347-47d3-98a4-314fe2e47ce9', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 17:59:48.520711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 17:59:48.522326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 17:59:48.523340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 17:59:48.524510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 17:59:48.529047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 17:59:48.563163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:48.565366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:48.567914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:48.577901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:48.578116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:48.578563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:48.661507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 17:59:48.673857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Getting quotas for user ce67aabadec84b459ec2cb4b465aab4d and project 4837d89d674c4fe6b2124124aa4e32bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 17:59:48.704082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 17:59:48.710989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 17:59:48.877259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55ab6c58-3d64-47e1-a18f-ff2da0556d42 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.747380 Oct 28 17:59:48.882325 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3027/5907] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 17:59:46 2022] POST /compute/v2.1/servers => generated 361 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 17:59:48.895556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fee3464e-be01-4346-9d32-547ef7bf9ff9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:48.897384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fee3464e-be01-4346-9d32-547ef7bf9ff9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:48.923137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:49.330913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fee3464e-be01-4346-9d32-547ef7bf9ff9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:49.353635 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fee3464e-be01-4346-9d32-547ef7bf9ff9 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1242 microversion: 2.1 time: 0.463551 Oct 28 17:59:49.354340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2881/5908] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:48 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1242 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:50.117406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:50.118145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:50.160727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:50.162307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:50.163933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:50.168707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:50.170401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:50.171754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:50.382849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:50.384035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:50.405542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:50.408070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:50.410203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:50.412993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:50.430898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:50.431485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:50.436085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lazy-loading 'services' on Instance uuid 58f432a3-e744-4993-9f97-c3956216eb92 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:50.732622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16328da9-b361-496c-a8a5-305824584052 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments/dc40dcd8-a405-435c-9c82-efe3c6429422" status: 202 len: 0 microversion: 2.1 time: 0.620135 Oct 28 17:59:50.748034 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3028/5909] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:59:50 2022] DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments/dc40dcd8-a405-435c-9c82-efe3c6429422 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:51.303750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:51.318221 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-656e39f5-f9c1-485e-a53d-bc54f4d934a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1294 microversion: 2.1 time: 0.940889 Oct 28 17:59:51.337848 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2882/5910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:50 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1294 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:52.346132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:52.347512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:52.385300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:52.385816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:52.386260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:52.387558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:52.388017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:52.388448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:52.693501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:52.734942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c4fa614f-c0df-443e-aac0-837dd0ca9c35 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.394512 Oct 28 17:59:52.752202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3029/5911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:52 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:53.758009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:53.759351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:53.790512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:53.792598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:53.795465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:53.796162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:53.796614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:53.798945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:54.203772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:54.212976 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-520f5ec3-c271-4d7a-984a-e0a226ef43ce tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.458634 Oct 28 17:59:54.225788 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2883/5912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:53 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:55.244778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:55.245544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:55.268054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:55.268923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:55.271450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:55.274754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:55.275897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:55.279557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:55.918070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:55.936325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b417aa1-897f-489d-9b28-52962275c43a tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.694135 Oct 28 17:59:55.936961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3030/5913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:55 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:56.820906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:56.824896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:56.842946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:56.843652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:56.844538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:56.845391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:56.848832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:56.850033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:56.963181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:56.967317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:56.982237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:56.990352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:56.995123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:56.996429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:56.997150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:56.997840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:57.047955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:57.054196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lazy-loading 'services' on Instance uuid 52e79d28-f126-439b-8f24-c7628e6290ce {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 17:59:57.241769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:57.245744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:57.257396 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4cf97dd4-3a48-40e4-81d0-26aad0f32b61 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "DELETE /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce/os-volume_attachments/c8072cdf-5e05-4814-990e-5d8748e874f8" status: 202 len: 0 microversion: 2.1 time: 0.440574 Oct 28 17:59:57.269382 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2884/5914] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 17:59:56 2022] DELETE /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce/os-volume_attachments/c8072cdf-5e05-4814-990e-5d8748e874f8 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 17:59:57.282000 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cc924f0-0dbb-4492-9ae7-fd9f551d0930 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.322576 Oct 28 17:59:57.283784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3031/5915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:56 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 17:59:58.306907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:58.308331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:58.331269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:58.331969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:58.332618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:58.333759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:58.334376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:58.334963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:58.639357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:58.654637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5eaefcc-68fa-4335-ae49-9bf67ea92a1e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.350863 Oct 28 17:59:58.663277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2885/5916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:58 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 17:59:58.846825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6", "tag": "50d123f2-23e7-4d36-9215-c7d9d8edcbe1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 17:59:58.881722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:58.883427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:58.902402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:58.906156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:58.906877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:58.943572 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] Creating event network-changed:50d123f2-23e7-4d36-9215-c7d9d8edcbe1 for instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 on n-h2-860864-13 Oct 28 17:59:58.960401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-51883ce8-52d3-4744-beab-736720d54ff9 req-9c6c8be3-59f3-4785-a377-cc5c45762473 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112529 Oct 28 17:59:58.961775 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3032/5917] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 17:59:59.688146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 17:59:59.688759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 17:59:59.697550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 17:59:59.699674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:59.700765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:59.706146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:59.707143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 17:59:59.714121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 17:59:59.724356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 17:59:59.923031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 17:59:59.939930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-47d2f27c-d06d-4917-a143-23a85d559929 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.256181 Oct 28 17:59:59.959935 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2886/5918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 17:59:59 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:00.964488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:00.976494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:01.003898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:01.005626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:01.006374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:01.008960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:01.011790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:01.012585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:01.130768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:01.139402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:01.140141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:01.140753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:01.201617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Going to try to stop instance {{(pid=120568) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 18:00:01.290509 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-965e6d5c-bfb4-4a0b-baeb-8e0ebe5020e7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.164151 Oct 28 18:00:01.292124 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2887/5919] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:00:01 2022] POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:00:01.313136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:01.314352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:01.326330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:01.327355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:01.328072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:01.329771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:01.330444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:01.331119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:01.345821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:01.355850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-960a2a7a-9b53-4d44-8d63-190421362dd3 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.395552 Oct 28 18:00:01.356490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3033/5920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:00 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:01.591989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:01.600324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b8f09cd-dbc5-47a1-894f-0ae57a6e16b9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1724 microversion: 2.1 time: 0.301520 Oct 28 18:00:01.608472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2888/5921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:01 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:02.382650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:02.383292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:02.397304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:02.402354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:02.403706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:02.404643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:02.406417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:02.407748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:02.591506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:02.603507 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe3f27e3-19e5-40e9-83ef-68cbf1790ddc tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.225079 Oct 28 18:00:02.604423 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3034/5922] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:02 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:02.638802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:02.640538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:02.675581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:02.676199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:02.676719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:02.677631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:02.680823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:02.681495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:03.281845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:03.320154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa783f6c-1883-4771-aa45-4eb2e19832aa tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.687020 Oct 28 18:00:03.323406 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2889/5923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:02 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:03.627306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:03.628701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:03.639579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:03.640079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:03.640520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:03.645897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:03.646516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:03.647028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:04.235141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:04.247177 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48f3814b-82d8-48b4-8ff7-291a3b9d25df tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.621132 Oct 28 18:00:04.248257 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3035/5924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:03 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:04.347913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:04.348590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:04.371855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:04.380151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:04.387865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:04.392439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:04.393267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:04.395427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:04.674034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:04.684706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51a5ebc7-b74b-412c-a6c1-e5e9bb852c77 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.341558 Oct 28 18:00:04.703061 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2890/5925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:04 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:05.278284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:05.278910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:05.289262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:05.291972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:05.293020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:05.294003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:05.294469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:05.294907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:05.478158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:05.486993 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-147fb922-296f-4028-bd1f-77036fee71e4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.213324 Oct 28 18:00:05.491146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3036/5926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:05 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:05.711125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:05.712694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:05.724432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:05.725180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:05.725887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:05.727182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:05.727845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:05.728500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:06.107693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6", "name": "network-vif-plugged", "status": "completed", "tag": "50d123f2-23e7-4d36-9215-c7d9d8edcbe1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:06.133977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:06.134505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:06.134959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:06.161029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] Creating event network-vif-plugged:50d123f2-23e7-4d36-9215-c7d9d8edcbe1 for instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 on n-h2-860864-13 Oct 28 18:00:06.176337 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5fda360b-ca0d-451f-a98b-f03242db777e req-00b552ac-eb13-44d5-ba13-d904d7e00335 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072416 Oct 28 18:00:06.176966 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3037/5927] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:00:06.269602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:06.281025 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-418f481b-5faf-4c8e-9bc2-9466a49d7594 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.575401 Oct 28 18:00:06.285318 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2891/5928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:05 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:06.525599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:06.543322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:06.575051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:06.575602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:06.580006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:06.584540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:06.588524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:06.591854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:06.843195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:06.853912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f0d7603-5c3f-4302-92c4-bc06ab2150c4 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1300 microversion: 2.1 time: 0.339476 Oct 28 18:00:06.860825 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3038/5929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:06 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:07.318784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:07.320324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:07.334690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:07.335471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:07.338114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:07.339085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:07.340903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:07.341499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:07.881146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:07.882338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:07.894636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:07.897676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:07.898339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:07.899318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:07.902487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:07.903398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.156736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:08.173193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-33cff236-374a-472d-9c06-2bfd84eafca2 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.860273 Oct 28 18:00:08.174424 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2892/5930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:07 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:08.190607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:08.201162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bf7dae39-85f9-4ef1-ba80-dfc21e85fc73 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1473 microversion: 2.1 time: 0.324299 Oct 28 18:00:08.201758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3039/5931] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:07 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1473 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:08.232617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:08.233573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:08.244321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.245003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.246830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.247977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.248685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.249992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.412859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:08.425467 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-70c45214-f511-4831-97d3-bc91618cc9a6 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1473 microversion: 2.1 time: 0.200071 Oct 28 18:00:08.429282 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2893/5932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:08 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:08.457276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:08.458406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:08.486000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.486498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.486932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.494725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.496171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.496702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.822911 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1457e319-38bd-4341-b830-60e8c86ec561 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1626 microversion: 2.1 time: 0.370526 Oct 28 18:00:08.827228 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3040/5933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:08 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1626 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:08.852423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:08.854355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:08.896568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.897646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.898097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.898807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.905237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.905903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.928581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:08.929770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:08.952357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.954404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.956746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:08.957737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:08.962168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:08.962653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.044191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:00:09.240439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f5d976e2-ab12-4bc8-88c6-ac13113f5860 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "DELETE /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 204 len: 0 microversion: 2.1 time: 0.314660 Oct 28 18:00:09.244798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3041/5934] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:00:08 2022] DELETE /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:00:09.260915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:09.262898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:09.285063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.287345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.289970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.290933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.293300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.294848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.302528 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31943b86-3698-4213-a41c-fe411b2df9c7 tempest-TestSecurityGroupsBasicOps-1908123497 tempest-TestSecurityGroupsBasicOps-1908123497-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1916 microversion: 2.1 time: 0.457061 Oct 28 18:00:09.316441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2894/5935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:08 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1916 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:09.337901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:09.338286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:09.354469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.358442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.359156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.360438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.362776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.363509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.826474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:09.841549 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-576179c0-83c1-4def-8669-2119d3b0bb75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.593058 Oct 28 18:00:09.841777 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3042/5936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:09 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:09.866238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:09.866738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:09.878738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:09.897318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd7efeb4-edd2-46c8-b862-e321639a936f tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1469 microversion: 2.1 time: 0.579701 Oct 28 18:00:09.900333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.900812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.915425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2895/5937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:09 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:09.916480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.916480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:09.916480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:09.916480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:09.948409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:00:10.086365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:10.121179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a2b9a12-0368-48be-a9b4-1deefb9f6c28 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 204 len: 0 microversion: 2.1 time: 0.277763 Oct 28 18:00:10.122866 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3043/5938] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:00:09 2022] DELETE /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:00:10.130891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:10.131594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:10.138134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.145241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.145966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:10.147109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.147798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.148454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:10.270374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:10.300034 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76608857-86fb-4d29-b884-0be8cec9b0ac tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1479 microversion: 2.1 time: 0.164796 Oct 28 18:00:10.300723 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2896/5939] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:10 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1479 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:10.846176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1e6f0bc-5a67-4e4b-9751-0c8c14696059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: .version_select at 0x7f75286f05e0>, body: {"keypair": {"name": "tempest-keypair-110524618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKR8CCFkLo2X6MGuegCUBMUAO4kZVJ6gPUbAmi0+XRKrdEOrFZdkcgJ+eZ7W0e5zVbsMhXKxbiyAXKW83Nv2ztVQSa8Bhh4bpf15LNjblJou+dcUhD3xQ+1fKbmTNsiYg=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:10.865599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:10.866398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:10.866633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b1e6f0bc-5a67-4e4b-9751-0c8c14696059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:00:10.874486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.874896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-b1e6f0bc-5a67-4e4b-9751-0c8c14696059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:00:10.875337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.879306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:10.880791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.881256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.881843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:10.906885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1e6f0bc-5a67-4e4b-9751-0c8c14696059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342021 Oct 28 18:00:10.908588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3044/5940] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:00:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:10.932507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:10.933679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:10.946157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.946832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.947506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:10.948435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:10.949630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:10.950223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:11.102048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:11.117850 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-516de825-9b38-44be-831a-deca083fe1eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.252457 Oct 28 18:00:11.127504 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2897/5941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:10 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:00:11.213615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:11.225877 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-26371f41-f538-4630-9ad8-da8037b3a737 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1469 microversion: 2.1 time: 0.302043 Oct 28 18:00:11.228699 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3045/5942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:10 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:11.326168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:11.327095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:11.334309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:11.335247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:11.335891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:11.336821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:11.337505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:11.338085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:11.442346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:11.461560 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d87c040-e98d-4bec-b1d3-1d39504c86f8 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1479 microversion: 2.1 time: 0.140316 Oct 28 18:00:11.479139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2898/5943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:11 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1479 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:12.145240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:12.146040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:12.165433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.170346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.171753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.173425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.175811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.176823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.252423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:12.253749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:12.267726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.271205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.272602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.274206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.275922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.278210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.675277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:12.679254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:12.688512 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3dc992cb-d648-4785-8ea9-ec9d9056acc5 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1469 microversion: 2.1 time: 0.440292 Oct 28 18:00:12.689416 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-299a43d6-3155-42ab-82d4-8d38e62e7229 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1678 microversion: 2.1 time: 0.550372 Oct 28 18:00:12.708232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2899/5944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:12 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:12.708900 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3046/5945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:12 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1678 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:12.725058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:12.726300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:12.753683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.754414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.755012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.755963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:12.756679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:12.758142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:12.791962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:12.916696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:12.944783 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e589d723-9a86-4f2b-8cf5-ccf621368469 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 200 len: 1479 microversion: 2.1 time: 0.219901 Oct 28 18:00:12.947185 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2900/5946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:12 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:13.202633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6", "name": "network-vif-deleted", "tag": "50d123f2-23e7-4d36-9215-c7d9d8edcbe1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:13.221929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:13.235924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:13.236790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:13.241830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:13.251015 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] Creating event network-vif-deleted:50d123f2-23e7-4d36-9215-c7d9d8edcbe1 for instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 on n-h2-860864-13 Oct 28 18:00:13.273269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-1899cedb-e06e-4f93-9318-1de880c43d42 req-4fd3431e-4563-4525-b237-b6fe90818de0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374739 Oct 28 18:00:13.274481 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3047/5947] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:00:13.718536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:13.719763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:13.723114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:13.724202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:13.732941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:13.733441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:13.734646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:13.735646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:13.736297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:13.738252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:13.738964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:13.739665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:13.739805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:13.741403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:13.742065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:13.742950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.484821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaacc8a1b32140aebe109d7c629e443c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696997478771414f8df68ca182bd48a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:14.520693 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7e7a7f0-aa1f-42d5-b370-8aab2102ed07 tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 200 len: 1427 microversion: 2.1 time: 0.808259 Oct 28 18:00:14.546379 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2901/5948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:13 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 1427 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:14.553631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e79d28-f126-439b-8f24-c7628e6290ce", "name": "network-vif-deleted", "tag": "93e010df-9d60-4cf6-9073-660280759e3d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:14.566567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.567532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.568235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.584188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] Creating event network-vif-deleted:93e010df-9d60-4cf6-9073-660280759e3d for instance 52e79d28-f126-439b-8f24-c7628e6290ce on n-h2-860864-13 Oct 28 18:00:14.593011 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-de8148ef-d004-4627-82a0-52c83eb49bc6 req-cd452242-40ca-4c7a-8cd6-e87f800b4ade service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044114 Oct 28 18:00:14.594392 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2902/5949] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:14.603181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:14.604259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:14.614516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.615311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.616090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.617105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.617840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.619049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.626240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:14.637720 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd2142c3-05b7-44c9-8d06-de4d8a73acff tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1655 microversion: 2.1 time: 0.920708 Oct 28 18:00:14.639076 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] HTTP exception thrown: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Request method failure captured: Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 HTTP/1.1 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBgRY8m0lLViQqczauFJiG1DJHeJ02LLkL8SfXK5iskdNYwQm27YT6CuQrPPmBg3a2P8SvnM2aPf3NJCLMZUdc3NDiWehaCsY3LSkFX_seHut6Czw63gAMysqem13muY_DzLAWVLc7a2Em9VJgs7CnPVuhWfToocmZNeZroCJi7d6IQ Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4837d89d674c4fe6b2124124aa4e32bc Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4837d89d674c4fe6b2124124aa4e32bc"}]}] Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4837d89d674c4fe6b2124124aa4e32bc Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestSecurityGroupsBasicOps-1080815288-project Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: ce67aabadec84b459ec2cb4b465aab4d Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1080815288-project Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6'} Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:14.641821 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. Oct 28 18:00:14.646190 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:14.649008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Returning 404 to user: Instance 73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:00:14.650333 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-120f8296-a9fb-4a5e-978b-6f5fe2ef3e7c tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6" status: 404 len: 111 microversion: 2.1 time: 0.054338 Oct 28 18:00:14.652072 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2903/5950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:14 2022] GET /compute/v2.1/servers/73d44eca-0c21-44fc-9f3b-d95c2bf6d4c6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:00:14.669251 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3048/5951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:13 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1655 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:00:14.671667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:14.679571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.680574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.681233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.713251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Going to try to start instance {{(pid=120568) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 18:00:14.770488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-41f8a96b-ac00-457e-b171-1e12a4aa426f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.108487 Oct 28 18:00:14.773333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2904/5952] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:00:14 2022] POST /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:00:14.782005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:14.782942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:14.793147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.793954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.794522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:14.798138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:14.799313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:14.800453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:15.095041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:15.105518 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4b03277e-0426-4bd4-8c34-c4e7f55afbfd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1664 microversion: 2.1 time: 0.328033 Oct 28 18:00:15.111273 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3049/5953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:14 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1664 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:15.555508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:15.556227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] [instance: 52e79d28-f126-439b-8f24-c7628e6290ce] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:15.575169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:15.578105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:15.578816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:15.579846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:15.583821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:15.584538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:15.598213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1614868945", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff41118f-997d-48a4-b03d-71369ebf0429"}], "security_groups": [{"name": "tempest-securitygroup--242906845"}], "key_name": "tempest-keypair-110524618", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:15.606686 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] HTTP exception thrown: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Request method failure captured: Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce HTTP/1.1 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBgeEnLWZJwyIwRU3fWdviB0VCSJgX4fNLJwit4xu9rQK_Q4Ny0p5Db7mYm_LERwY7TuKuy8FUVhFHgQBCF424e0AKEBuNHr64Xgy61kdx4DOUCQ8bjOEw65JIfFpReJLJZ1zT6RGNivI-AYygcPSGRDckyUZVp-m9j3zl8zmeegBK4 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 696997478771414f8df68ca182bd48a3 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesBackupsTest-286771104 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/696997478771414f8df68ca182bd48a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/696997478771414f8df68ca182bd48a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_696997478771414f8df68ca182bd48a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/696997478771414f8df68ca182bd48a3"}]}] Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesBackupsTest-286771104 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 696997478771414f8df68ca182bd48a3 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesBackupsTest-286771104 Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesBackupsTest-286771104-project Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: aaacc8a1b32140aebe109d7c629e443c Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesBackupsTest-286771104-project Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '52e79d28-f126-439b-8f24-c7628e6290ce'} Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:15.608665 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. Oct 28 18:00:15.613606 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:00:15.616541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] Returning 404 to user: Instance 52e79d28-f126-439b-8f24-c7628e6290ce could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:00:15.617535 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6301602a-62ff-4354-91f4-65428648476c tempest-VolumesBackupsTest-286771104 tempest-VolumesBackupsTest-286771104-project] 10.222.0.48 "GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce" status: 404 len: 111 microversion: 2.1 time: 0.068021 Oct 28 18:00:15.618418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2905/5954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:15 2022] GET /compute/v2.1/servers/52e79d28-f126-439b-8f24-c7628e6290ce => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:00:15.903003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] validate_networks() for [('ff41118f-997d-48a4-b03d-71369ebf0429', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:00:16.134244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:16.134834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:16.149898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:16.153931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:16.154451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:16.155208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:16.160112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:16.161514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:16.631576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:16.652041 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23e519d7-5154-426f-b549-9b83be800791 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1664 microversion: 2.1 time: 0.515247 Oct 28 18:00:16.652041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2906/5955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:16 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1664 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:00:17.033202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:00:17.034225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:00:17.035071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:00:17.035690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:00:17.036760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:00:17.052734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:17.053662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:17.054448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:17.055537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:17.056255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:17.057340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:17.091762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:00:17.099924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:00:17.116702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:00:17.119442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:00:17.199223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c723b5d0-a280-444d-9cb2-cb0d1c8622f0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.613064 Oct 28 18:00:17.201027 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3050/5956] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:00:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:00:17.213981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86ee51d8-6846-458e-9cdb-48e52e7078ef tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:17.216911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86ee51d8-6846-458e-9cdb-48e52e7078ef tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:17.312429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86ee51d8-6846-458e-9cdb-48e52e7078ef tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:17.321369 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86ee51d8-6846-458e-9cdb-48e52e7078ef tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1241 microversion: 2.1 time: 0.111983 Oct 28 18:00:17.323981 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2907/5957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:17 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:17.674565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:17.675596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:17.691045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:17.693127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:17.693898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:17.696707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:17.699959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:17.700728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:18.334728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:18.349051 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f918a39b-c6f9-4226-8fc7-304666ce9ad9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1664 microversion: 2.1 time: 0.678944 Oct 28 18:00:18.351561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:18.352214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:18.353785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3051/5958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:17 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1664 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:18.387703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:18.388368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:18.388911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:18.392157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:18.392780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:18.393574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:18.699229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:18.717099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2c53dd76-f64f-46d7-b54b-934d73e256e4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1237 microversion: 2.1 time: 0.370516 Oct 28 18:00:18.718761 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2908/5959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:18 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1237 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:00:19.387650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:19.390023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:19.410213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:19.411838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:19.413275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:19.415575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:19.418272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:19.420870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:19.744626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:19.745929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:19.749379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=60 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:19.761890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:19.768257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:19.768779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:19.769555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:19.770028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:19.770471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:19.836241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:19.851688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a873a203-7e2f-4799-870c-b6693d6b1c03 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1668 microversion: 2.1 time: 0.475704 Oct 28 18:00:19.852992 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3052/5960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:19 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1668 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:19.940793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:19.959354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1bcc8186-212d-4e41-80a4-38021e4ec08f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1299 microversion: 2.1 time: 0.215058 Oct 28 18:00:19.961759 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2909/5961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:19 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:00:20.983649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:20.984268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:20.998586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:21.001646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:21.002257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:21.006176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:21.006975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:21.007615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:21.147144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:21.169302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e56979a7-54a3-4984-8ddf-a708ce4ced8d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1299 microversion: 2.1 time: 0.190433 Oct 28 18:00:21.185479 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3053/5962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:20 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:22.200295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:22.201669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:22.217765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:22.218605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:22.220747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:22.221703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:22.224871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:22.225596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:22.821695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:22.830529 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46ea090c-78fb-46b9-99c5-d412ddaa7fca tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.641626 Oct 28 18:00:22.831146 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2910/5963] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:22 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:23.859247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:23.860294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:23.877925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:23.879900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:23.880534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:23.882169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:23.884825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:23.887166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:24.266677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:24.282301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1addc0b6-134b-4f09-b5bb-8cf460c88d50 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.429276 Oct 28 18:00:24.299914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3054/5964] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:23 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:24.572195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96def022-6b43-4c72-ad96-998cada6c668", "tag": "9aa59503-d158-465b-a111-6ae9de9ccb35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:24.630472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:24.634472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:24.636478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:24.664708 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] Creating event network-changed:9aa59503-d158-465b-a111-6ae9de9ccb35 for instance 96def022-6b43-4c72-ad96-998cada6c668 on n-h2-860864-13 Oct 28 18:00:24.673055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3cca46be-855c-42df-8686-8979d495b95c req-c6427517-583b-415c-a10b-4c9d8b485ba1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110305 Oct 28 18:00:24.673945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2911/5965] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:25.312329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:25.316888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:25.365886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.366460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.366919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.367692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.376110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.382861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.401029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:25.401904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:25.410571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.414537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.415215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.417481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.417985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.418529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.475697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:00:25.666265 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c945968e-fe16-45b5-a72e-331151b3e09b tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 204 len: 0 microversion: 2.1 time: 0.268954 Oct 28 18:00:25.669266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2912/5966] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:00:25 2022] DELETE /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:00:25.679536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee01030c-8351-460a-97a1-221241449bc6", "tag": "eda33f05-9344-448e-a7af-e46d39cadd6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:25.697267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.698691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.699282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.716169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] Creating event network-changed:eda33f05-9344-448e-a7af-e46d39cadd6a for instance ee01030c-8351-460a-97a1-221241449bc6 on n-h1-860864-13 Oct 28 18:00:25.722119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3effa72a-90a1-4792-a948-2770b082b01b req-fc1bd815-d0f3-40bf-ac72-f8ee10235c84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050614 Oct 28 18:00:25.723275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2913/5967] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:25.731082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:25.732000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:25.740347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.741103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.741971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.742851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:25.743482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:25.743770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:25.778212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:25.791184 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bcdceab7-ae9f-435b-9058-b28d2335cd0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.486296 Oct 28 18:00:25.792842 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3055/5968] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:25 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:26.030782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:26.040368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7827731-87e1-4de4-a6b0-50e362d9357e tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1769 microversion: 2.1 time: 0.315212 Oct 28 18:00:26.055328 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2914/5969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:25 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1769 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:26.818997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:26.820682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:26.829257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:26.830114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:26.831055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:26.831996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:26.832974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:26.833606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:27.066345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:27.066962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:27.077753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:27.078097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:27.078242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:27.082988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:27.084199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:27.084911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:27.085115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:27.110848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:27.146049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:27.159824 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b09df5e0-67e3-4e0d-a9b0-c5922fe6799a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.341274 Oct 28 18:00:27.160588 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3056/5970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:26 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:27.325402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:28.046554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:28.056858 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76a28c27-c019-4e9e-bf4d-9da120499098 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1769 microversion: 2.1 time: 0.994418 Oct 28 18:00:28.062161 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2915/5971] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:27 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1769 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:28.186301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:28.186974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:28.199183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:28.199718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:28.200166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:28.200892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:28.201352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:28.201783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:28.513760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:28.531605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b164ff05-0e56-4862-914a-5f84caf5ce55 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.348157 Oct 28 18:00:28.553172 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3057/5972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:28 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:28.806676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee01030c-8351-460a-97a1-221241449bc6", "name": "network-vif-deleted", "tag": "eda33f05-9344-448e-a7af-e46d39cadd6a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:28.834377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:28.835214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:28.835939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:28.865692 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] Creating event network-vif-deleted:eda33f05-9344-448e-a7af-e46d39cadd6a for instance ee01030c-8351-460a-97a1-221241449bc6 on n-h1-860864-13 Oct 28 18:00:28.881026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d8ff600f-5fdc-4c56-8ce4-8e0fc21c8416 req-f0d75fb3-0732-4679-8977-b49b849f73c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082067 Oct 28 18:00:28.884711 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2916/5973] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:29.085331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:29.086582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:29.093768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:29.094994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:29.095718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:29.096666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:29.097366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:29.097895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:29.144074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:29.144921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:29.145607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:29.146448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lazy-loading 'fault' on Instance uuid ee01030c-8351-460a-97a1-221241449bc6 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:00:29.202668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce67aabadec84b459ec2cb4b465aab4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4837d89d674c4fe6b2124124aa4e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:29.211451 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd44a4d4-bdf1-4caa-95dd-36fa3f78d537 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 200 len: 1385 microversion: 2.1 time: 0.131426 Oct 28 18:00:29.212054 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3058/5974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:29 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 1385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:29.554911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:29.564559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:29.575724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:29.576714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:29.577392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:29.579152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:29.579841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:29.580460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:29.769162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:29.779043 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-881941e3-23b8-45e1-9b14-00dfbe13d149 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.228282 Oct 28 18:00:29.781116 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2917/5975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:29 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:30.238187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:30.239354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] [instance: ee01030c-8351-460a-97a1-221241449bc6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:30.247432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:30.248126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:30.248742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:30.249622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:30.250236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:30.250815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:30.267489 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] HTTP exception thrown: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Request method failure captured: Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 HTTP/1.1 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBgRY8m0lLViQqczauFJiG1DJHeJ02LLkL8SfXK5iskdNYwQm27YT6CuQrPPmBg3a2P8SvnM2aPf3NJCLMZUdc3NDiWehaCsY3LSkFX_seHut6Czw63gAMysqem13muY_DzLAWVLc7a2Em9VJgs7CnPVuhWfToocmZNeZroCJi7d6IQ Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4837d89d674c4fe6b2124124aa4e32bc Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4837d89d674c4fe6b2124124aa4e32bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4837d89d674c4fe6b2124124aa4e32bc"}]}] Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4837d89d674c4fe6b2124124aa4e32bc Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1080815288 Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestSecurityGroupsBasicOps-1080815288-project Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: ce67aabadec84b459ec2cb4b465aab4d Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1080815288-project Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ee01030c-8351-460a-97a1-221241449bc6'} Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:00:30.269931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. Oct 28 18:00:30.276877 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:00:30.278285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Returning 404 to user: Instance ee01030c-8351-460a-97a1-221241449bc6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:00:30.279309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d727eeff-232a-49d3-b070-eeb5cef5d136 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6" status: 404 len: 111 microversion: 2.1 time: 0.045415 Oct 28 18:00:30.280759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3059/5976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:30 2022] GET /compute/v2.1/servers/ee01030c-8351-460a-97a1-221241449bc6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:00:30.804519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:30.805126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:30.820502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:30.821942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:30.823135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:30.824253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:30.824898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:30.825573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:31.140906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:31.155252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3be9b817-900f-49ae-bc0d-bf0ef5a9aaf6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.354488 Oct 28 18:00:31.157942 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2918/5977] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:30 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:32.182952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:32.184355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:32.207113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:32.207938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:32.210032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:32.214850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:32.215708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:32.217651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:32.724901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96def022-6b43-4c72-ad96-998cada6c668", "name": "network-vif-plugged", "status": "completed", "tag": "9aa59503-d158-465b-a111-6ae9de9ccb35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:32.749250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:32.753520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:32.754976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:32.791172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] Creating event network-vif-plugged:9aa59503-d158-465b-a111-6ae9de9ccb35 for instance 96def022-6b43-4c72-ad96-998cada6c668 on n-h2-860864-13 Oct 28 18:00:32.809155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7e24824c-1f31-4e81-bc48-e13e77e95b50 req-19ebef3f-1347-48fa-8121-3a178a2bb671 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078538 Oct 28 18:00:32.814715 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2919/5978] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:00:32.916203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:32.927278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7732f432-a66a-498f-ad68-aa5d33a1fca3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.749878 Oct 28 18:00:32.929264 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3060/5979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:32 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:33.953663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:33.954368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:33.966993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:33.967509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:33.967958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:33.968829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:33.969141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:33.969568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:33.990844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:00:34.488705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:34.531486 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5c2dfcf-37da-41e4-bced-7132f5ff0b22 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1366 microversion: 2.1 time: 0.578500 Oct 28 18:00:34.533076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2920/5980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:33 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:35.558827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:35.559655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:35.574456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:35.577967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:35.579242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:35.581595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:35.583214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:35.584465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:35.877663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:00:35.892295 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d0e5657a-6923-4d40-9011-1f90451760cb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1557 microversion: 2.1 time: 0.336753 Oct 28 18:00:35.893656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3061/5981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:00:35 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1557 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:00:35.925023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:35.925593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:00:35.938899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:35.939668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:35.941340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:35.946091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:35.950317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:35.952281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:36.333661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f456c94-3b54-4aaf-a492-8176c579a48f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.413023 Oct 28 18:00:36.334269 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2921/5982] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:00:35 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-interface => generated 285 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:00:36.782772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c5a2fa3-ff6c-475c-b4a3-88f0bbe3c823 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] Calling method '.version_select at 0x7f7524263f70>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:00:36.822412 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c5a2fa3-ff6c-475c-b4a3-88f0bbe3c823 tempest-TestSecurityGroupsBasicOps-1080815288 tempest-TestSecurityGroupsBasicOps-1080815288-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1728383910" status: 202 len: 0 microversion: 2.1 time: 0.041270 Oct 28 18:00:36.828914 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3062/5983] 10.222.0.48 () {58 vars in 1278 bytes} [Fri Oct 28 18:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1728383910 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:00:38.812304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96def022-6b43-4c72-ad96-998cada6c668", "tag": "9aa59503-d158-465b-a111-6ae9de9ccb35"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:00:38.848491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:00:38.849232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:00:38.849651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:00:38.865091 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] Creating event network-changed:9aa59503-d158-465b-a111-6ae9de9ccb35 for instance 96def022-6b43-4c72-ad96-998cada6c668 on n-h2-860864-13 Oct 28 18:00:38.872444 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d4ae77a7-e8a5-4d6d-8d9c-c8ddff51186d req-81df66ac-8515-4140-a8e5-7c37e3749ec6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066217 Oct 28 18:00:38.874220 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2922/5984] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:04.079607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-882150850", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ac2dc7da-2897-495d-98df-bde24961fb38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:04.134148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=79 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:04.135067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:04.274386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:01:05.152924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:01:05.153665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:01:05.154535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:01:05.155137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:01:05.156133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:01:05.170382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:05.171937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:05.176016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:05.177066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:05.177744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:05.178367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:05.221764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:01:05.231851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:01:05.374660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:01:05.376703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac2dc7da-2897-495d-98df-bde24961fb38',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:01:05.709555 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed5b3657-5803-42dd-995f-22893f7a2710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.642859 Oct 28 18:01:05.710820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3063/5985] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:01:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:01:05.723871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-378e6e1e-a61a-4407-9675-0eb4d76564cd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:05.724350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-378e6e1e-a61a-4407-9675-0eb4d76564cd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:05.726994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:05.729510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=11 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:06.123544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-378e6e1e-a61a-4407-9675-0eb4d76564cd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:06.131743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-378e6e1e-a61a-4407-9675-0eb4d76564cd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1056 microversion: 2.1 time: 0.412847 Oct 28 18:01:06.135461 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2923/5986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:05 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1056 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:07.160837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:07.161516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:07.170729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:07.171684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:07.172379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:07.173680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:07.174446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:07.175108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:07.481022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:07.502648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a484846-e3b5-4658-b37f-2f4218324686 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1154 microversion: 2.1 time: 0.346398 Oct 28 18:01:07.523172 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3064/5987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:07 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1154 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:08.532584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:08.533691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:08.552805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:08.556761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:08.557834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:08.560251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:08.561196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:08.564572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:08.708558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:08.780410 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3879adfa-6d0f-4331-834a-ee67f74b43da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1172 microversion: 2.1 time: 0.253188 Oct 28 18:01:08.780943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2924/5988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:08 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1172 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:09.815866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:09.818641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:09.840545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:09.841276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:09.841900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:09.843061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:09.843722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:09.844556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:10.131638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:10.146034 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-84c8969b-e5ce-4e92-81ec-561537192b70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1214 microversion: 2.1 time: 0.342850 Oct 28 18:01:10.146628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3065/5989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:09 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1214 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:11.169497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:11.170109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:11.184642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:11.187543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:11.188623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:11.190956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:11.191900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:11.194158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:11.682061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:11.700216 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a867ec76-5ed9-4440-9ecc-ec588a0b8d54 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1214 microversion: 2.1 time: 0.533892 Oct 28 18:01:11.702302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2925/5990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:11 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1214 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:12.255499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af47b0cd-20a9-4543-8876-4776e2286503", "tag": "e71da08f-e4de-4a73-b373-e9dcfa7be636"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:12.289162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:12.291982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:12.293140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:12.333898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] Creating event network-changed:e71da08f-e4de-4a73-b373-e9dcfa7be636 for instance af47b0cd-20a9-4543-8876-4776e2286503 on n-h1-860864-13 Oct 28 18:01:12.346349 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-bebb6de8-59b1-426f-9075-43c8d2f54e9a req-042eb09b-d12f-4724-b115-04f7a0faa3db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096136 Oct 28 18:01:12.349334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3066/5991] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:12.726864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:12.728374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:12.740537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:12.741439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:12.744275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:12.745333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:12.746467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:12.748598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:13.974312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:13.995313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-45b28bd9-8510-45a7-a74c-46127f43f106 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1214 microversion: 2.1 time: 1.272480 Oct 28 18:01:13.996273 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2926/5992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:12 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1214 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:15.024121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:15.026207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:15.041345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.043043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.043779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.047916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.048686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.049750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.199950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:15.203932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:15.206257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:15.212852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.213413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.213933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.214702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.215217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.215668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.246595 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f034461-4016-41e8-8457-5a7676801f38 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046674 Oct 28 18:01:15.247465 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2927/5993] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:01:15 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:01:15.257584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:15.324529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:15.325746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:15.337999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.339070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.340445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.341333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.341962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.342548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.402549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:01:15.546054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-027d68c4-a927-45ae-b613-8cfcd0bbffb5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 204 len: 0 microversion: 2.1 time: 0.227771 Oct 28 18:01:15.547857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2928/5994] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:01:15 2022] DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:01:15.559644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:15.562003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:15.569825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.570558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.572876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.574322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:15.575096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:15.575742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:15.730176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:15.742724 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-085470b1-3b90-4a70-93b9-8e97dce9ec0a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1214 microversion: 2.1 time: 0.724037 Oct 28 18:01:15.746255 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3067/5995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:15 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1214 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:15.845605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:15.858579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab22fe6b-9ad1-4528-b4ae-29cc73ecf473 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1674 microversion: 2.1 time: 0.304754 Oct 28 18:01:15.860233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2929/5996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:15 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1674 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:16.772912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:16.774652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:16.786533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:16.789044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:16.792160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:16.793078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:16.793713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:16.794331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:16.885102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:16.886347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:16.888525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:16.903419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:16.904177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:16.904829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:16.905707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:16.906328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:16.906924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:17.251973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:17.262634 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ece7c31-a33c-40e7-aca2-2ecc98ce8f2f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.494312 Oct 28 18:01:17.266066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3068/5997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:16 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:17.358505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:17.371484 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d02df330-2d47-4145-9835-11ec4eab1506 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1674 microversion: 2.1 time: 0.489640 Oct 28 18:01:17.373203 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2930/5998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:16 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1674 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:18.289742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:18.291183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:18.298509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:18.299311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:18.300085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:18.301007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:18.301779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:18.302493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:18.396282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:18.397591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:18.406127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:18.406992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:18.407789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:18.408684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:18.409374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:18.410291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:18.553999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:18.567967 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5de71695-71e0-4035-8ca4-c863b89cd648 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1607 microversion: 2.1 time: 0.175360 Oct 28 18:01:18.569291 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2931/5999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:18 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1607 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:18.621642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:18.640672 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c58c512d-133b-4d55-9d17-87ef748ba82a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.351070 Oct 28 18:01:18.641412 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3069/6000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:18 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:18.902716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f432a3-e744-4993-9f97-c3956216eb92", "name": "network-vif-deleted", "tag": "c0078b66-d30f-46a6-a517-ad30858368dd"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:18.934413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:18.936057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:18.937257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:18.996214 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] Creating event network-vif-deleted:c0078b66-d30f-46a6-a517-ad30858368dd for instance 58f432a3-e744-4993-9f97-c3956216eb92 on n-h2-860864-13 Oct 28 18:01:19.008856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ea519df8-8d07-467c-95a0-9c2ed1d9ec98 req-b1892243-7344-42b6-aff3-fe59ea7775f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109156 Oct 28 18:01:19.018603 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2932/6001] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:19.593238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:19.593923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:19.617409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:19.622117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:19.623637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:19.625896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:19.627161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:19.628195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:19.667097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:19.667897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:19.730087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:19.732443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:19.736408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:19.737515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:19.739765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:19.743593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:19.794570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:19.798888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:19.799674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:19.800203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lazy-loading 'fault' on Instance uuid 58f432a3-e744-4993-9f97-c3956216eb92 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:01:20.010821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:20.021228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-755e144c-10d9-4fd0-976b-9ba98cc3f09c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 200 len: 1328 microversion: 2.1 time: 0.432887 Oct 28 18:01:20.021828 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3070/6002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:19 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 1328 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:20.210764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:20.234661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69b73149-daf4-46d7-ab7e-b79f384eaf2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.573714 Oct 28 18:01:20.235650 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2933/6003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:19 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:21.061374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:21.062000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:21.079475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:21.080265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:21.080879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:21.081763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:21.082220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:21.082642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:21.111702 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 HTTP/1.1 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '58f432a3-e744-4993-9f97-c3956216eb92'} Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:01:21.114318 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:01:21.121111 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:01:21.123268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:01:21.124373 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08e96dd6-1d71-4342-b7f1-a5c958b98ee5 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 404 len: 111 microversion: 2.1 time: 0.075236 Oct 28 18:01:21.125237 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3071/6004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:21 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:01:21.152658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d78aad2-8e0d-4771-b41d-b90b830bb81a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '.version_select at 0x7f751f09c670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:21.191919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d78aad2-8e0d-4771-b41d-b90b830bb81a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698402751" status: 202 len: 0 microversion: 2.1 time: 0.058313 Oct 28 18:01:21.193107 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2934/6005] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 18:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698402751 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:01:21.259490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:21.260771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:21.269181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:21.275168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:21.276077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:21.276997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:21.277629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:21.279465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:21.637060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:21.649677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad0717aa-6406-4ca1-83ea-6648f7be37a5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.393898 Oct 28 18:01:21.650966 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3072/6006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:21 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:22.666908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a845936c-932f-40a9-84e4-729e674273d9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: .version_select at 0x7f751f0e6820>, body: {"keypair": {"name": "tempest-keypair-29048865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeGNCXgv0bjGpzckOwE+vwtV6xHV6l0jP7YaCTE2fMQVaxiH3hEG0OvVnRz3DnkHGee5rc0wU3Af4JyqwthoV+twIY3LmvoJrMxGGJ/JuRRDPxJ0V9Id+OV2cCDVFydrw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:22.678642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:22.681769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:22.713522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:22.716783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:22.718845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:22.722051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:22.724581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:22.729887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:22.750893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a845936c-932f-40a9-84e4-729e674273d9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:01:22.784593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a845936c-932f-40a9-84e4-729e674273d9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for user f6f45bc3e1be43878f3d43f3ba870cc6 and project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:01:22.912194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a845936c-932f-40a9-84e4-729e674273d9 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.254205 Oct 28 18:01:22.920153 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2935/6007] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:01:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:23.048960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:23.063774 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eff2f759-e0da-4cbb-b3d6-93035669f136 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.391146 Oct 28 18:01:23.076275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3073/6008] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:22 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:24.091963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:24.092627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:24.107476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:24.107984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:24.108427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:24.109300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:24.109765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:24.110194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:24.533635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:24.545476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db4ac6e5-3acd-4580-9c62-cc7be90638e6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.458907 Oct 28 18:01:24.562488 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2936/6009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:24 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:25.572328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:25.573346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:25.590963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:25.591532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:25.592137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:25.593914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:25.594393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:25.594829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:25.935434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:25.948857 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-600f1a9c-e2c9-4dfe-94bc-8abc536dd79b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.380521 Oct 28 18:01:25.949468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3074/6010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:25 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:26.048065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1038327611", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90955362-9ae1-4331-9c4d-327ae4902862"}], "security_groups": [{"name": "tempest-securitygroup--539535413"}], "key_name": "tempest-keypair-29048865", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:26.264571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] validate_networks() for [('90955362-9ae1-4331-9c4d-327ae4902862', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:01:26.971849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:26.972593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:26.988866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:26.991087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:26.992016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:26.998789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:26.999314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:27.001921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:27.295249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:01:27.296245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:01:27.296916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:01:27.297507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:01:27.298085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:01:27.313030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:27.313528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:27.314088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:27.314683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:27.315143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:27.315636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:27.359808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:27.368671 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0dd982c9-bc94-4ce4-9e16-affe2d12e980 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.399976 Oct 28 18:01:27.370810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:01:27.373026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3075/6011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:26 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:27.378032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Getting quotas for user f6f45bc3e1be43878f3d43f3ba870cc6 and project fe9e3176958b46ffa4b1ccdfaac3466c. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:01:27.398647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:01:27.402797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:01:27.458061 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a0c6212-63f2-4cbc-83fe-df8dc78421b1 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.415545 Oct 28 18:01:27.459078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2937/6012] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:01:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:01:27.473705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd992af8-90ef-493d-97e9-b47d7c8ba123 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:27.474546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd992af8-90ef-493d-97e9-b47d7c8ba123 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:27.544575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd992af8-90ef-493d-97e9-b47d7c8ba123 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:27.554246 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd992af8-90ef-493d-97e9-b47d7c8ba123 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1236 microversion: 2.1 time: 0.086409 Oct 28 18:01:27.557441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3076/6013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:27 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:27.980193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af47b0cd-20a9-4543-8876-4776e2286503", "name": "network-vif-plugged", "status": "completed", "tag": "e71da08f-e4de-4a73-b373-e9dcfa7be636"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:27.997565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:27.998291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:27.998902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:28.032328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] Creating event network-vif-plugged:e71da08f-e4de-4a73-b373-e9dcfa7be636 for instance af47b0cd-20a9-4543-8876-4776e2286503 on n-h1-860864-13 Oct 28 18:01:28.043851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1c58a598-a13f-41e8-905b-f9383b9a2bc8 req-e6026c11-7d8e-45a1-8c02-54524278d149 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068601 Oct 28 18:01:28.046469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2938/6014] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:28.395974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:28.396929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:28.413035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:28.423958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:28.424629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:28.425597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:28.445072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:28.447161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:28.590035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:28.595170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:28.609459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:28.610211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:28.610823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:28.622423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:28.625123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:28.625758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:28.792988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:28.801211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:28.820301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4e0144e-2724-47c8-a160-6e0b4d2f8dcf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1202 microversion: 2.1 time: 0.429120 Oct 28 18:01:28.821135 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3077/6015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:28 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1202 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:28.823215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-33fbc99f-16bb-4125-83b1-af287c41d140 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1232 microversion: 2.1 time: 0.245969 Oct 28 18:01:28.825699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2939/6016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:28 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1232 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:29.851538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:29.852986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:29.855518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:29.856150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:29.874184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:29.874686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:29.875136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:29.875881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:29.876349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:29.876753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:29.880850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:29.884133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:29.884758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:29.885650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:29.891876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:29.892502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.064623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:30.076322 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cdf9f263-b305-4007-bac9-a2891b23441e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1294 microversion: 2.1 time: 0.228797 Oct 28 18:01:30.091798 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2940/6017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:29 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1294 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:30.155392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:30.170685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-449e7ad0-2493-42cd-8552-ad7bae73110d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1390 microversion: 2.1 time: 0.327521 Oct 28 18:01:30.184901 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3078/6018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:29 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:30.197785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:30.198804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:30.205886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.206573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.207172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.208072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.208943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.209801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.433343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:30.453743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d142fc84-f0c7-4917-9e9c-661f36da279f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1390 microversion: 2.1 time: 0.261458 Oct 28 18:01:30.470433 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2941/6019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:30 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:30.476335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:30.477668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:30.495653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.496647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.496647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.497295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.497751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.503053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.753992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:30.765735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c3bf828-1436-4c4a-a0cf-62bf1eff79ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1390 microversion: 2.1 time: 0.293501 Oct 28 18:01:30.767053 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3079/6020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:30 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1390 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:30.792912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:30.793682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:30.815294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.816308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.824075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.824851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:30.825396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:30.825832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:30.877495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:01:30.882614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:31.005472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d00b331-4c89-4991-b6b1-79df73da092a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 204 len: 0 microversion: 2.1 time: 0.217207 Oct 28 18:01:31.007226 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2942/6021] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:01:30 2022] DELETE /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:01:31.016369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:31.018345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:31.027745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:31.029827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:31.030518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:31.031566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:31.032264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:31.033599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:31.103459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:31.104637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:31.116226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:31.121092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:31.121913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:31.123623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:31.124294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:31.140747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:31.605502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:31.619688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6edaf5e-ddbb-40e1-858f-3109b8bfd771 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1396 microversion: 2.1 time: 0.607128 Oct 28 18:01:31.647317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:31.648387 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3080/6022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:31 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1396 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:31.659155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-829e328b-c2cd-400d-bdb8-b886c1bbed5c tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.561463 Oct 28 18:01:31.671639 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2943/6023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:31 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:32.648557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:32.649828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:32.665635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:32.667683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:32.668335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:32.669253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:32.669866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:32.670460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:32.692184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:32.693332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:32.706468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:32.707263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:32.708287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:32.710876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:32.711699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:32.712382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:33.492550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:33.502004 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b9c7767-e9fb-4a71-ab9e-b1984546b06b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1396 microversion: 2.1 time: 0.857344 Oct 28 18:01:33.502605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3081/6024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:32 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1396 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:33.524868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e51d063-527c-473c-bf69-c7e2e8930e2a", "tag": "d182bd50-000a-4f33-ac40-699167605f3b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:33.552035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:33.556636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:33.557109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:33.561621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:33.582371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] Creating event network-changed:d182bd50-000a-4f33-ac40-699167605f3b for instance 8e51d063-527c-473c-bf69-c7e2e8930e2a on n-h2-860864-13 Oct 28 18:01:33.590339 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-92454063-069c-44d5-99ad-a5806b49fa00 req-56f76386-891a-4ade-8606-839ec6a4103a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069620 Oct 28 18:01:33.593402 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3082/6025] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:33.675242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:33.683734 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c48d6dee-e917-4876-aecd-87bbce254b63 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.996513 Oct 28 18:01:33.684315 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2944/6026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:32 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:34.536346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:34.537110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:34.551589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:34.556900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:34.557411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:34.558081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:34.558986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:34.560511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:34.561249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:34.602417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af47b0cd-20a9-4543-8876-4776e2286503", "name": "network-vif-deleted", "tag": "e71da08f-e4de-4a73-b373-e9dcfa7be636"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:34.644261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:34.645161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:34.645780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:34.668250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] Creating event network-vif-deleted:e71da08f-e4de-4a73-b373-e9dcfa7be636 for instance af47b0cd-20a9-4543-8876-4776e2286503 on n-h1-860864-13 Oct 28 18:01:34.696493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-46e0db6b-2d04-4ee3-8638-0b27893c61dd req-61e94ff8-b0d9-4b8a-9c37-37f023974761 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097367 Oct 28 18:01:34.697170 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2945/6027] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:01:34.714691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:34.715607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:34.740138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:34.741448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:34.744382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:34.745399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:34.746653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:34.748733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:34.763923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:34.778924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61dee536-a152-4290-bef6-74ac3d69fc26 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1354 microversion: 2.1 time: 0.253908 Oct 28 18:01:34.782058 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3083/6028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:34 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:35.086945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:35.100179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5efeef05-9101-4a33-81af-998b066fd8eb tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.397694 Oct 28 18:01:35.102485 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2946/6029] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:34 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:35.802399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:35.803010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:35.814133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:35.814707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:35.815066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:35.823463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:35.825138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:35.827791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:36.059287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:36.073425 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66e470b9-61de-4304-ab26-0c836702f241 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.274956 Oct 28 18:01:36.084276 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3084/6030] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:35 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:36.128759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:36.130610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:36.135771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:36.140752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:36.141795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:36.142576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:36.143923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:36.144703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:36.145311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:36.488868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:36.497878 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-615034bb-47dc-4c8f-a658-14154966d1dd tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.374336 Oct 28 18:01:36.515391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2947/6031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:36 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:37.102750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:37.103441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:37.117933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:37.122456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:37.123286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:37.124249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:37.125005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:37.127646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:37.296672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:37.314683 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dce6b3e9-eace-472e-a708-599307376f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.214946 Oct 28 18:01:37.316722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3085/6032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:37 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:37.533153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:37.534584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:37.549779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:37.568620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:37.573307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:37.577100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:37.577815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:37.579685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:37.593737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:37.593737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:38.049558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:38.065004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d4fb67e-986a-4523-a317-5b7c4fa92520 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.538189 Oct 28 18:01:38.065693 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2948/6033] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:37 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:38.342938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:38.345396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:38.356411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:38.359477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:38.362022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:38.362671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:38.365899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:38.367733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:38.371892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:38.579736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:38.592173 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c43616ee-7e13-4b2e-b51f-dd8a59530faf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.255378 Oct 28 18:01:38.593105 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3086/6034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:38 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:39.090778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:39.091615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:39.111608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:39.112116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:39.112563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:39.125755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:39.126751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:39.127228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:39.556855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:39.568685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48282af7-a36e-47fa-bdd3-46c2d85d03cc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.479630 Oct 28 18:01:39.573122 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2949/6035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:39 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:39.620395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:39.622692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:39.638680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:39.639751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:39.640383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:39.642951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:39.644574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:39.646788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:39.807444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:39.818755 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a72297e0-868e-40c6-81e6-b4b24e270838 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.205884 Oct 28 18:01:39.819394 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3087/6036] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:39 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:01:40.599002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:40.599665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:40.617877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:40.618378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:40.618822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:40.619576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:40.620035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:40.620485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:40.858417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:40.860421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:40.876658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:40.877159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:40.877601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:40.878315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:40.878776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:40.879197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:41.250604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:41.261979 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74a70b8e-e9b0-4a6a-a459-1d4685c7b853 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.414006 Oct 28 18:01:41.262904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3088/6037] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:40 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:41.275288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e51d063-527c-473c-bf69-c7e2e8930e2a", "name": "network-vif-plugged", "status": "completed", "tag": "d182bd50-000a-4f33-ac40-699167605f3b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:41.285113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:41.285600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:41.286035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:41.299281 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] Creating event network-vif-plugged:d182bd50-000a-4f33-ac40-699167605f3b for instance 8e51d063-527c-473c-bf69-c7e2e8930e2a on n-h2-860864-13 Oct 28 18:01:41.304476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-415ebed1-9346-4724-bde9-ad35ac9cdc72 req-0ad42d70-897a-4c8d-bd2d-a1654b2f8731 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040266 Oct 28 18:01:41.305731 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3089/6038] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:41.392982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:41.420637 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3aa00801-37a2-4a80-94f0-5b677d75604d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.826217 Oct 28 18:01:41.422968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2950/6039] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:40 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:42.291241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:42.292591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:42.305878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:42.310574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:42.311233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:42.312164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:42.313743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:42.318318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:42.454276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:42.454903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:42.469085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:42.469588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:42.470028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:42.470750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:42.471210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:42.471682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:42.692629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:42.727222 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1dceca2-0944-4941-9e6f-6480878e0753 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1187 microversion: 2.1 time: 0.428379 Oct 28 18:01:42.730060 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3090/6040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:42 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1187 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:43.043478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:43.054963 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d388c35f-7505-417a-84f9-a08123f07677 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1361 microversion: 2.1 time: 0.605877 Oct 28 18:01:43.076019 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2951/6041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:42 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:43.751887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:43.753174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:43.770261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:43.770723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:43.771176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:43.771962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:43.772421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:43.772851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:43.858557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:43.859544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:43.860165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:43.861874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lazy-loading 'fault' on Instance uuid af47b0cd-20a9-4543-8876-4776e2286503 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:01:43.908374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:43.908979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:43.937110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:43.937920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:43.939462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:43.939462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:43.939730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:43.940052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:44.024320 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-141298aa-767f-45a1-ac79-ba579735eaf8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/ips" status: 200 len: 151 microversion: 2.1 time: 0.120431 Oct 28 18:01:44.031540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2952/6042] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 18:01:43 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/ips => generated 151 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:44.091343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:44.091984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:44.110776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:44.111717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:44.114762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:44.118722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:44.120157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:44.122336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:44.156128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:44.164287 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03c9422e-4445-476b-9bca-284297db391c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 200 len: 1146 microversion: 2.1 time: 0.415427 Oct 28 18:01:44.164578 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3091/6043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:43 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 1146 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:44.714145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:44.750988 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61d506b6-6fa5-434d-8d44-bea1a261f0c7 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1548 microversion: 2.1 time: 0.663710 Oct 28 18:01:44.752328 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2953/6044] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:44 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1548 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:44.789825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:44.790548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:44.809648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:44.811105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:44.811835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:44.812726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:44.813350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:44.813939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:45.188441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:45.189102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: af47b0cd-20a9-4543-8876-4776e2286503] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:45.210147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:45.211226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:45.211835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:45.212705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:45.213167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:45.228496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:45.304024 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 HTTP/1.1 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'af47b0cd-20a9-4543-8876-4776e2286503'} Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:01:45.307580 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. Oct 28 18:01:45.313269 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:01:45.323555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance af47b0cd-20a9-4543-8876-4776e2286503 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:01:45.327058 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28e5f0a2-ebb3-44b6-ab8a-d07f06257fe0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503" status: 404 len: 111 microversion: 2.1 time: 0.141114 Oct 28 18:01:45.328290 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2954/6045] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:45 2022] GET /compute/v2.1/servers/af47b0cd-20a9-4543-8876-4776e2286503 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:01:45.509654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-daf57b20-272f-45ee-a341-f2b157e4aa29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.737090 Oct 28 18:01:45.523165 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3092/6046] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:01:44 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-interface => generated 285 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:46.947201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e781aa-7096-4433-b230-e26b4efe6e05"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:46.950711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:46.964414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:46.965157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:46.966003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:46.966970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:46.967697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:46.968353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:47.406095 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-92747e24-4435-43da-aab4-3dec784146ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464752 Oct 28 18:01:47.407928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2955/6047] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:01:46 2022] POST /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:48.793729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e51d063-527c-473c-bf69-c7e2e8930e2a", "tag": "d182bd50-000a-4f33-ac40-699167605f3b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:48.818222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:48.822925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:48.823502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:48.879715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] Creating event network-changed:d182bd50-000a-4f33-ac40-699167605f3b for instance 8e51d063-527c-473c-bf69-c7e2e8930e2a on n-h2-860864-13 Oct 28 18:01:48.894116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2bb3bef0-839d-425d-ae01-0a5f3e9e71f5 req-3d20aa1e-2f17-4727-ae85-2808900a3727 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104051 Oct 28 18:01:48.911778 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3093/6048] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:01:56.300795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-269105137", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bca1bc52-5cc9-473a-8efc-f77958a86e72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:01:56.424565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:01:57.103548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:01:57.104212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:01:57.105188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:01:57.105821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:01:57.106624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:01:57.121349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:57.122237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:57.123132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:57.124299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:57.124869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:57.125392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:57.149860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:01:57.157063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:01:57.230137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:01:57.232331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bca1bc52-5cc9-473a-8efc-f77958a86e72',volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:01:57.490235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a31d565-613c-4f77-9a1f-d118f836e11f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193618 Oct 28 18:01:57.497857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2956/6049] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:01:57.516319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b1d1434-50f0-4d10-8063-81b25e7e303e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:57.517256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8b1d1434-50f0-4d10-8063-81b25e7e303e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:57.658555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8b1d1434-50f0-4d10-8063-81b25e7e303e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:57.678912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b1d1434-50f0-4d10-8063-81b25e7e303e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1056 microversion: 2.1 time: 0.177718 Oct 28 18:01:57.689231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3094/6050] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:57 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1056 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:58.712533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:58.717186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:58.732664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:58.733537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:58.735588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:58.738600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:58.739699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:58.740316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:58.841485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:01:58.870440 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7fc42c07-b078-488f-b80e-7f162a26ab2e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1154 microversion: 2.1 time: 0.164489 Oct 28 18:01:58.871682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2957/6051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:58 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1154 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:01:59.898300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:01:59.899677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:01:59.903490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=58 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:01:59.914251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:59.914716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:59.915159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:01:59.915918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:01:59.916377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:01:59.916809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:00.148138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:00.158816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8da9f302-26e3-4f09-9cc9-f36d313a4af6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1172 microversion: 2.1 time: 0.264304 Oct 28 18:02:00.171869 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3095/6052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:01:59 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1172 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:01.187258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:01.188216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:01.203216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:01.213348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:01.213842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:01.214607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:01.215084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:01.215539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:01.237142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:02.128611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:02.140963 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4ab32e8-a0ad-44c6-8152-57b1dbea97b9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1214 microversion: 2.1 time: 0.962042 Oct 28 18:02:02.142987 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2958/6053] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:01 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1214 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:02.794612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28a69b67-fcea-49b7-b193-7b7037894580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: .version_select at 0x7f751f799ee0>, body: {"keypair": {"name": "tempest-keypair-409375175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH/BODkZ81lgb8PEdaYQzXimXVg/NWZhzrsb2w5JJT8NXFubRGHlcTyQ7jP3II3dCUNHvzqlu+Yxi0I6ryEYdZo9W86pOREponrI0DB6Uak08daL3doxLdtzgHXjac1ew=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:02.837893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-28a69b67-fcea-49b7-b193-7b7037894580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:02:02.861607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-28a69b67-fcea-49b7-b193-7b7037894580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:02:02.937013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28a69b67-fcea-49b7-b193-7b7037894580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146663 Oct 28 18:02:02.938186 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3096/6054] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:02:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:03.170905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:03.173033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:03.174604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e58a29-41a6-44b3-83e3-63c0dd07ad3a", "tag": "33a45454-f85e-49a8-b6ef-7a21eb16a7b1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:03.194004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:03.195060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:03.195563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:03.196282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:03.196735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:03.205911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:03.208028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:03.208755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:03.211087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:03.260775 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] Creating event network-changed:33a45454-f85e-49a8-b6ef-7a21eb16a7b1 for instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a on n-h1-860864-13 Oct 28 18:02:03.274959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-54471a4b-42ca-4368-88f8-d16f6fb409a6 req-a05c3db7-b579-4952-98a2-981a439bb164 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102731 Oct 28 18:02:03.277083 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3097/6055] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:02:03.792384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:03.804470 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5502fd02-295e-4ef0-a140-46d42f95f46f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1214 microversion: 2.1 time: 0.639512 Oct 28 18:02:03.811192 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2959/6056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:03 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1214 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:04.838323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:04.839038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:04.852718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:04.858436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:04.860167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:04.860625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:04.861797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:04.864623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:04.865085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:05.757234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:05.777319 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ddc7ffb-35d0-4d3d-a4c8-1bad312d8520 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1214 microversion: 2.1 time: 0.946193 Oct 28 18:02:05.792290 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3098/6057] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:04 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1214 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:06.807361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:06.810679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:06.814370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:06.826140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:06.828073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:06.834210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:06.835693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:06.841394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:06.844976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:07.138002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:07.167691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:07.461290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-22325962", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff41118f-997d-48a4-b03d-71369ebf0429"}], "security_groups": [{"name": "tempest-securitygroup--1035791044"}], "key_name": "tempest-keypair-409375175", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:07.489379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:07.508474 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30ecbd18-1792-43cb-8a09-962813af2e8f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1214 microversion: 2.1 time: 0.706807 Oct 28 18:02:07.510512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2960/6058] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:06 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1214 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:07.710391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] validate_networks() for [('ff41118f-997d-48a4-b03d-71369ebf0429', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:02:08.533714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:08.534343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:08.536085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:02:08.537782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:02:08.540137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:02:08.540690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:02:08.544184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:02:08.544968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:08.545457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:08.548705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:08.552037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:08.552690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:08.553298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:08.563260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:08.563956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:08.577781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:08.581253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:08.581982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:08.583830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:08.629920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:02:08.638422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:02:08.652983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:02:08.655323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:02:08.722714 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fbd5e221-8f77-4511-9cdf-56bcbb6b8eba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.275161 Oct 28 18:02:08.732361 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3099/6059] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:02:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:02:08.738194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-882e810e-e057-4abb-9f10-4c2c65426875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:08.738821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-882e810e-e057-4abb-9f10-4c2c65426875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:08.911523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-882e810e-e057-4abb-9f10-4c2c65426875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:08.921280 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-882e810e-e057-4abb-9f10-4c2c65426875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1239 microversion: 2.1 time: 0.187642 Oct 28 18:02:08.946444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3100/6060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:08 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:08.988986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:08.999386 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b04490fd-7371-4f50-9adf-8a76e8194f85 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.470870 Oct 28 18:02:09.002803 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2961/6061] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:08 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:09.953678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:09.955163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:09.967687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:09.968920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:09.969764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:09.970768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:09.972581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:09.973719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:10.029415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:10.030186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:10.044405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:10.045566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:10.048362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:10.049169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:10.050965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:10.051765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:10.097597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:10.106567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86ab65b9-fb03-4746-9617-b01fdabd9dd9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1291 microversion: 2.1 time: 0.157718 Oct 28 18:02:10.113354 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3101/6062] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:09 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1291 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:10.298389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:10.321130 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22a30f6d-11b6-4484-978c-10076c0cc9b2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.293935 Oct 28 18:02:10.337983 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2962/6063] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:10 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:11.140097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:11.141064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:11.159234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:11.159234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:11.159779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:11.161998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:11.163721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:11.179243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:11.358600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:11.360082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:11.363336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:11.374858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:11.376670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:11.377439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:11.378654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac8f9559-a8a2-4d2a-a295-7c2033608d66 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1297 microversion: 2.1 time: 0.244902 Oct 28 18:02:11.379331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3102/6064] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:11 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1297 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:11.379773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:11.380394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:11.380992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:11.721994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:11.732058 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-265666bc-bd1c-442e-9e97-c4015c874c7c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.385556 Oct 28 18:02:11.733315 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2963/6065] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:11 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:12.404783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:12.406415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:12.417011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:12.418220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:12.420182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:12.422365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:12.431064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:12.438544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:12.758088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:12.759462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:12.766429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:12.767287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:12.767989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:12.768938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:12.769677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:12.770335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:12.931005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:12.941060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f8b1bcd-2458-4dc3-ae24-7732f259388f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.542013 Oct 28 18:02:12.946004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3103/6066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:12 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:13.286092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:13.304202 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e284a52-c0a9-4884-abf6-dae8375e36b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.549916 Oct 28 18:02:13.327013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2964/6067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:12 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:13.964775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:13.966018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:13.972638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:13.983192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:13.984354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:13.985832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:13.989274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:13.989990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:14.192278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7264c0-9849-4d14-aaa1-87d878eaf8e1", "tag": "852e1145-05a6-414f-9d5d-c975ed80893b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:14.208873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:14.210762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:14.211460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:14.226550 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] Creating event network-changed:852e1145-05a6-414f-9d5d-c975ed80893b for instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 on n-h1-860864-13 Oct 28 18:02:14.232376 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0258b1f9-ee0e-4beb-9cab-3ab0f629c7cd req-7814ebba-dd38-4db8-9944-dd01b4f46a92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049018 Oct 28 18:02:14.233825 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2965/6068] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:14.335795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:14.337148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:14.357329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:14.358540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:14.359160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:14.360898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:14.361780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:14.363250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:14.424470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:14.437074 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-524b9137-ead9-439b-8b8f-fbb2d173328f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.476138 Oct 28 18:02:14.437863 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3104/6069] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:13 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:14.811888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:14.823405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b53940e1-005c-4f17-84b1-73def7ed0b79 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.496653 Oct 28 18:02:14.824721 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2966/6070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:14 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:15.463601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:15.464710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:15.486483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:15.487297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:15.487963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:15.488912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:15.489623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:15.490245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:15.847146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:15.848454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:15.870275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:15.870772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:15.871215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:15.871964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:15.872420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:15.872845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:15.926660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:15.938809 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34e9ce2a-0be5-41a4-aaea-44446d845d26 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.480455 Oct 28 18:02:15.951403 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3105/6071] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:15 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:16.275052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:16.285321 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-733c2f7c-55d0-43b6-96b5-170f6e59fd7f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.442519 Oct 28 18:02:16.295967 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2967/6072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:15 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:16.971878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:16.973386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:16.983620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:16.985907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:16.986648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:16.987651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:16.988565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:16.989390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:17.301079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:17.313935 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-157cf689-de9a-4db6-80f5-ac2a5d03cdd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.349448 Oct 28 18:02:17.314553 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3106/6073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:16 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:17.319087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:17.320027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:17.331499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:17.332307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:17.333080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:17.334961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:17.337036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:17.337656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:17.658499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:17.669527 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6c5a960f-cfaf-4a18-a0b2-df2b84304054 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.355137 Oct 28 18:02:17.671042 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2968/6074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:17 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:18.338099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:18.338749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:18.346015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:18.346515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:18.347051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:18.347790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:18.348410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:18.348847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:18.518990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:18.530563 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffa64fbc-c9e9-4bf6-b319-102eda9e8ca8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.195599 Oct 28 18:02:18.531351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3107/6075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:18 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:18.701455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:18.702774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:18.731266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:18.731788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:18.732224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:18.732931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:18.733382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:18.733806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:18.990474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:19.006078 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dd7bef64-b01f-4cb3-a3ac-c8aeb8d6d1e5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.311809 Oct 28 18:02:19.026689 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2969/6076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:18 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:19.558501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:19.559785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:19.562559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:19.563916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:19.573189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:19.574014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:19.574703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:19.575674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:19.576456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:19.577108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:19.809576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:19.825455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-992c12ec-957b-453b-8e02-33c94b41b875 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.276002 Oct 28 18:02:19.828267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3108/6077] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:19 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:19.875097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e58a29-41a6-44b3-83e3-63c0dd07ad3a", "name": "network-vif-plugged", "status": "completed", "tag": "33a45454-f85e-49a8-b6ef-7a21eb16a7b1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:19.908967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:19.912216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:19.915006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:19.944652 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] Creating event network-vif-plugged:33a45454-f85e-49a8-b6ef-7a21eb16a7b1 for instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a on n-h1-860864-13 Oct 28 18:02:19.957404 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-cf41d1b6-035f-4b7c-a56d-834c6255f322 req-620f8420-efb2-4473-a343-cb3b972c961f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087091 Oct 28 18:02:19.960546 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2970/6078] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:02:20.033640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:20.034675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:20.055105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:20.055892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:20.056589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:20.057479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:20.058147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:20.058880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:20.322055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:20.330567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-471415a0-4abc-4480-b0da-6ef1f7d226d3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.301469 Oct 28 18:02:20.349124 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3109/6079] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:20 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:20.856956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:20.857651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:20.864411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:20.865254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:20.865993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:20.866889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:20.867539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:20.868122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:21.123329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:21.132328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fca9d41b-cba0-463b-8efb-797f0a5c3865 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.278910 Oct 28 18:02:21.135456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2971/6080] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:20 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:21.356633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:21.357869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:21.373598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:21.374094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:21.374541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:21.375251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:21.375735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:21.377159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:21.692164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:21.701350 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c131c5ed-422b-4e56-b711-e9d278bd6eb2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1202 microversion: 2.1 time: 0.348603 Oct 28 18:02:21.707872 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3110/6081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:21 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1202 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:22.156821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:22.157641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:22.174879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:22.175599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:22.176334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:22.177814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:22.179289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:22.180562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:22.407193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:22.416359 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5f6a892-3fa9-404f-8001-1e13eba1f764 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.264170 Oct 28 18:02:22.424331 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2972/6082] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:22 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:22.733207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:22.734431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:22.744338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:22.748005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:22.748457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:22.749185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:22.749651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:22.750074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:22.981290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:22.989884 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ae9aade-081c-4c97-b51d-c9fdbc7022d7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1390 microversion: 2.1 time: 0.261090 Oct 28 18:02:22.996129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3111/6083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:22 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:23.020641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:23.021258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:23.028983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.029491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.029939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.030663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.031122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.031619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.300967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:23.317891 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d8ad775-58b9-4e85-bd0f-3d1f3c98cdf5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1390 microversion: 2.1 time: 0.301200 Oct 28 18:02:23.336177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2973/6084] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:23 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1390 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:23.348474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:23.349463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:23.359110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.362261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.362895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.363839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.366099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.366723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.453375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:23.454003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:23.472629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.484065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.484543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.485296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.485756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.486189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.663713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:23.675678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae3d15db-0993-4d25-9145-070a168787b4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1390 microversion: 2.1 time: 0.331237 Oct 28 18:02:23.678982 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3112/6085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:23 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1390 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:23.730672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:23.733520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:23.755247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.756522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.757448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.758831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:23.759405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:23.759908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:23.808429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:23.813618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:02:23.861482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0393e3c8-b1d5-4e55-bd1a-d63cc3477975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.399441 Oct 28 18:02:23.875529 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2974/6086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:23 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:23.938854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:24.043667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7264c0-9849-4d14-aaa1-87d878eaf8e1", "name": "network-vif-plugged", "status": "completed", "tag": "852e1145-05a6-414f-9d5d-c975ed80893b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:24.047771 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78463912-12ad-493d-81e6-52bda5d63842 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 204 len: 0 microversion: 2.1 time: 0.350225 Oct 28 18:02:24.048587 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3113/6087] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:02:23 2022] DELETE /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:02:24.057018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:24.057795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:24.058502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:24.059621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:24.072855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] Creating event network-vif-plugged:852e1145-05a6-414f-9d5d-c975ed80893b for instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 on n-h1-860864-13 Oct 28 18:02:24.074107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:24.083771 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-94fbef47-03da-44c4-a7b8-83e99fdd03ab req-715d4f7b-d314-4155-a2cf-8c7e295157ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047830 Oct 28 18:02:24.085718 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2975/6088] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:24.102059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:24.102961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:24.103778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:24.106074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:24.106554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:24.107057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:24.322934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:24.339975 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78532459-6082-42bf-8c1d-fd43f0b9b9d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1396 microversion: 2.1 time: 0.285388 Oct 28 18:02:24.358051 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3114/6089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:24 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1396 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:24.890300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:24.892004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:24.900846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:24.901337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:24.901826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:24.902543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:24.902995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:24.903441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:25.229097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:25.244850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:25.250610 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7571567f-84bc-4022-9679-dde204f9bba3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.364873 Oct 28 18:02:25.262094 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2976/6090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:24 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:25.375594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:25.378407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:25.400818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:25.409210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:25.411306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:25.412676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:25.414438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:25.417953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:25.738971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:25.751398 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b0dc42c-ad04-4508-8757-4d76802d57b6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1396 microversion: 2.1 time: 0.388321 Oct 28 18:02:25.752015 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3115/6091] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:25 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1396 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:26.277769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:26.278511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:26.293593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:26.294247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:26.295745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:26.296772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:26.299664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:26.300553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:26.777139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:26.777883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:26.793582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:26.805139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:26.805730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:26.806501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:26.815847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:26.816289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:26.978547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:27.004593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d964dab-83ea-463b-a1b5-8406a1f215dd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1365 microversion: 2.1 time: 0.731255 Oct 28 18:02:27.011397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:27.013080 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2977/6092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:26 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1365 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:27.022577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e58a29-41a6-44b3-83e3-63c0dd07ad3a", "name": "network-vif-deleted", "tag": "33a45454-f85e-49a8-b6ef-7a21eb16a7b1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:27.023025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51c2c969-8c48-4826-88e4-df45b03d0065 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1354 microversion: 2.1 time: 0.250856 Oct 28 18:02:27.032055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3116/6093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:26 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1354 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:27.037810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:27.038781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:27.039488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:27.078162 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] Creating event network-vif-deleted:33a45454-f85e-49a8-b6ef-7a21eb16a7b1 for instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a on n-h1-860864-13 Oct 28 18:02:27.085308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7cdfa397-0dcf-49f1-ab55-c2f1e9372ddd req-86308ca5-adf1-41ed-b9fe-d581dfe66c44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069408 Oct 28 18:02:27.086197 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2978/6094] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:28.035689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:28.049903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:28.050389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:28.052619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:28.069970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.071553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.072026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.074197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.074690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.074827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.075962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.077413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.078073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.078983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.080667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.083261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.415531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:28.437279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d237b06a-3dae-424b-b276-a5874aa24409 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1187 microversion: 2.1 time: 0.393393 Oct 28 18:02:28.438526 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2979/6095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:28 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1187 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:02:28.577564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:28.588659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-894b569a-0b2f-4f60-90e3-b29ed78fb355 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1556 microversion: 2.1 time: 0.556758 Oct 28 18:02:28.590709 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3117/6096] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:28 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1556 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:28.615912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:28.616465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:28.638319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.639134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.639803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.640725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:28.641359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:28.641957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:28.812271 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-849ab7d2-fd61-436f-ac6c-7a5d646ff738 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200696 Oct 28 18:02:28.822514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2980/6097] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:02:28 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:29.468150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:29.468891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:29.476426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:29.476919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:29.477358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:29.478069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:29.485698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:29.487629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:29.629069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:29.638308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd0f8c45-ddb7-47e1-b64c-7d50e463bb5b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1187 microversion: 2.1 time: 0.174040 Oct 28 18:02:29.639523 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3118/6098] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:29 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:30.656968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7264c0-9849-4d14-aaa1-87d878eaf8e1", "tag": "852e1145-05a6-414f-9d5d-c975ed80893b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:30.675799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:30.676344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:30.683171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:30.683680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:30.684111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:30.699200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:30.699727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:30.700250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:30.700855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:30.701304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:30.701726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:30.749207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] Creating event network-changed:852e1145-05a6-414f-9d5d-c975ed80893b for instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 on n-h1-860864-13 Oct 28 18:02:30.756768 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ed7b9953-9292-4303-a9a2-58491e57b4c9 req-a9528f1c-a823-4a52-93f8-a27b48531377 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102923 Oct 28 18:02:30.758380 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2981/6099] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:02:30.825968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:30.836648 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f3137648-c512-441c-bf4f-e7f9ac392965 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1187 microversion: 2.1 time: 0.166968 Oct 28 18:02:30.838737 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3119/6100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:30 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:31.864067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:31.864754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:31.874446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:31.880323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:31.881071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:31.882087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:31.884658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:31.885939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:31.997611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:32.009099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01e2d36f-21bc-4d59-ba05-698cbd7f52d8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1187 microversion: 2.1 time: 0.150095 Oct 28 18:02:32.010009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2982/6101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:31 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1187 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:33.036821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:33.038263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:33.057239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:33.058284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:33.059144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:33.060062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:33.063027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:33.063700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:33.242380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:33.254709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97bca3fb-113f-461d-9346-0e6280aad714 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1187 microversion: 2.1 time: 0.221671 Oct 28 18:02:33.256589 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3120/6102] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:33 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1187 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:34.281794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:34.282977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:34.296685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:34.297405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:34.305599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:34.306780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:34.307449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:34.308161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:34.374764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:34.375359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:34.375895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:34.379547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lazy-loading 'fault' on Instance uuid c1e58a29-41a6-44b3-83e3-63c0dd07ad3a {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:02:34.446126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:02:34.454387 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eb0cd59a-8c52-4ba6-ab4d-86b953fc0d74 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 200 len: 1192 microversion: 2.1 time: 0.176322 Oct 28 18:02:34.454994 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2983/6103] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:34 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 1192 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:02:35.479609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:35.480940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: c1e58a29-41a6-44b3-83e3-63c0dd07ad3a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:35.485117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:35.504078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:35.504659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:35.505104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:35.505867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:35.506329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:35.506751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:35.539541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a HTTP/1.1 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'c1e58a29-41a6-44b3-83e3-63c0dd07ad3a'} Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:02:35.541985 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. Oct 28 18:02:35.546909 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:02:35.558390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance c1e58a29-41a6-44b3-83e3-63c0dd07ad3a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:02:35.559826 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fd5b2202-33bc-441f-93e6-7140f9f8642d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a" status: 404 len: 111 microversion: 2.1 time: 0.085181 Oct 28 18:02:35.560628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3121/6104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:02:35 2022] GET /compute/v2.1/servers/c1e58a29-41a6-44b3-83e3-63c0dd07ad3a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:02:50.449664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:02:50.451012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:50.472729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=49 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:50.475893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=35 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:50.478059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:50.483244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:50.484705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:50.486914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:50.494380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:50.495107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:50.584759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f3289ee-cab2-4414-bb29-9d9b01b7575f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/ips" status: 200 len: 146 microversion: 2.1 time: 0.139067 Oct 28 18:02:50.587581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2984/6105] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 18:02:50 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/ips => generated 146 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:02:53.609476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed366e8b-d110-410c-855c-ab98c4f17856"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:02:53.612269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:02:53.615897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:02:53.628656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:53.629218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:53.629683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:53.631178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:02:53.631702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:02:53.632135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:02:54.241507 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-162f62d4-0af1-4da9-9857-a8d5994f5b5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635065 Oct 28 18:02:54.262803 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3122/6106] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:02:53 2022] POST /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:10.916241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:10.918979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:10.927549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.928419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.930339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:10.930969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:10.931869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:10.933276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:10.933870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:10.934416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:10.973691 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bdab47b3-da98-4fc5-9b9b-4d1bb1ba6ed0 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082163 Oct 28 18:03:10.974295 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2985/6107] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:10 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:10.984054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.984823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:10.989905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:10.990545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:10.998979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:10.999605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:11.000215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:11.001143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:11.001762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:11.002510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:11.039955 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0b35a55-04bb-4bcc-82ca-0fb6fdf6a1dc tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856" status: 200 len: 194 microversion: 2.1 time: 0.058058 Oct 28 18:03:11.056897 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3123/6108] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Oct 28 18:03:10 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:13.892490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb242001-5eca-45c3-a7e5-504d4530b8de"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:13.895707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:13.916424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.917134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.917727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:13.918591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:13.919201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:13.925370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:14.955747 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-563db4fe-8870-4c10-a53d-c905b6866a66 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "POST /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067636 Oct 28 18:03:14.956708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2986/6109] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:03:13 2022] POST /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 194 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:20.716452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-258608711", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0f7d769c-0b8f-4cb1-acad-673b480cec02", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:21.036313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:21.173494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:03:21.900954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:03:21.901859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:03:21.902632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:03:21.903052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:03:21.903526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:03:21.917605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.918210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.920105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.920877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:21.921338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:21.921955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:21.948833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:03:21.955815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:03:21.990102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:03:21.993905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0f7d769c-0b8f-4cb1-acad-673b480cec02',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:03:22.177672 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db3b48e0-4460-4667-b369-7ccac466d7ea tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.465045 Oct 28 18:03:22.180535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3124/6110] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:03:22.193477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-902f8939-f565-4e98-930c-aea3f42b7033 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:22.195183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-902f8939-f565-4e98-930c-aea3f42b7033 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:22.341615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-902f8939-f565-4e98-930c-aea3f42b7033 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:22.368425 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-902f8939-f565-4e98-930c-aea3f42b7033 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1056 microversion: 2.1 time: 0.180525 Oct 28 18:03:22.370534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2987/6111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:22 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1056 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:23.395213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:23.395899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:23.407733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:23.408237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:23.408675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:23.410220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:23.412901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:23.414385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:23.845785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:23.863852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-82a3918b-4434-4e85-906b-09fd0d46fcd8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1108 microversion: 2.1 time: 0.473263 Oct 28 18:03:23.864471 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3125/6112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:23 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1108 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:24.890254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:24.891048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:24.902578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:24.903339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:24.904146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:24.905065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:24.905773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:24.906407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:25.079578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:25.091704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bdda5b80-c3dd-4f92-a079-b062951a8aa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1126 microversion: 2.1 time: 0.205432 Oct 28 18:03:25.097274 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2988/6113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:24 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1126 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:26.117117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:26.118644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:26.151575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:26.152253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:26.152865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:26.153793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:26.154399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:26.154988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:26.459629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:26.471258 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a1bb589-2160-4ea7-986c-f0ab88d5511c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.358585 Oct 28 18:03:26.471889 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3126/6114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:26 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:27.505195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:27.505860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:27.540504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:27.545368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:27.551079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:27.552045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:27.552571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:27.559324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:27.564559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe0a9f1-9767-402d-b68b-5dac2368b83d", "tag": "ea20ecd0-6ad0-474e-b147-3f06c6902850"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:27.592202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:27.600215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:27.600764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:27.640930 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] Creating event network-changed:ea20ecd0-6ad0-474e-b147-3f06c6902850 for instance dbe0a9f1-9767-402d-b68b-5dac2368b83d on n-h1-860864-13 Oct 28 18:03:27.652190 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c03480af-3023-483c-ba5a-e6fc937aa47b req-46327ee4-b399-4ee7-9b47-0a783e986359 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091566 Oct 28 18:03:27.655546 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3127/6115] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:28.222699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:28.235150 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-954c5b84-d4e3-4768-8a94-2b9b7f37f852 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.740966 Oct 28 18:03:28.237381 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2989/6116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:27 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:29.268971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:29.270760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:29.286206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.286700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.289254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.291254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:29.300268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:29.300268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:29.804584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:29.822745 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8de12435-5502-4d91-a835-8ffad1348e5c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.561303 Oct 28 18:03:29.823609 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3128/6117] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:29 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:30.866084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:30.868310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:30.903311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:30.911361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:30.912334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:30.913668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:30.919023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:30.919720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:31.405397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:31.445790 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18f6d298-9fc2-4be1-9c87-6e1fbba57d55 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.591901 Oct 28 18:03:31.447991 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2990/6118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:30 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:32.087320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:32.090293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:32.097641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:32.099300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:32.101893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.102645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.103475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.104445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.105214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.106360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.169009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8cc68eab-b083-499f-97d4-7ae749a1960d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.086890 Oct 28 18:03:32.178155 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3129/6119] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:32 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:32.328701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:32.331080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:32.351121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.352582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.353305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.355290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.356065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.356706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.357604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:32.414221 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61c25937-b49a-4e08-992b-fb1ea74db43a tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856" status: 200 len: 194 microversion: 2.1 time: 0.096314 Oct 28 18:03:32.415177 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2991/6120] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Oct 28 18:03:32 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856 => generated 194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:32.428910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:32.429827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:32.440446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.447805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.448988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.451413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.452265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.453816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.482622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:32.483732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:32.496282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.496885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.497398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.501651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:32.501651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:32.501651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:32.667657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lazy-loading 'services' on Instance uuid 8e51d063-527c-473c-bf69-c7e2e8930e2a {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:32.820114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d3c5ec1-23c3-4898-91eb-0e86ef000793 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856" status: 202 len: 0 microversion: 2.1 time: 0.396389 Oct 28 18:03:32.821488 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3130/6121] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:03:32 2022] DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/ed366e8b-d110-410c-855c-ab98c4f17856 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:32.942764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:32.952404 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4adbead9-3911-4ce8-a06a-a9b4f2de6766 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.474170 Oct 28 18:03:32.960169 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2992/6122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:32 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:33.990315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:33.991787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:34.009398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.020536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.021221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.028428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.029142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.032953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.055068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:34.055598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:34.078336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.079011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.083695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.084455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.084924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.085365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.249355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da9ba6d8-8a8b-4717-b97a-50a1349164ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.199229 Oct 28 18:03:34.249966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2993/6123] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 18:03:34 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/ips => generated 150 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:34.266206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08e781aa-7096-4433-b230-e26b4efe6e05"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:34.283904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:34.309671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.312503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.315126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.316138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.329240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.330149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.736400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:34.751832 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4a0462e0-f4b9-416f-b614-543935718b89 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.766838 Oct 28 18:03:34.754897 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 Oct 28 18:03:34.761511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3131/6124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:33 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/os-volume_attachments HTTP/1.1 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 74 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: {"volumeAttachment": {"volumeId": "08e781aa-7096-4433-b230-e26b4efe6e05"}} Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': 'de7264c0-9849-4d14-aaa1-87d878eaf8e1', 'body': {'volumeAttachment': {'volumeId': '08e781aa-7096-4433-b230-e26b4efe6e05'}}} Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:34.777617 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 Oct 28 18:03:34.780996 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:03:34.789136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 400 to user: Invalid volume: volume 08e781aa-7096-4433-b230-e26b4efe6e05 is already attached to instances: 96def022-6b43-4c72-ad96-998cada6c668 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:34.798948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7451ee8c-520b-473a-a442-42fa17aa0038 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.531516 Oct 28 18:03:34.805744 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2994/6125] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:03:34 2022] POST /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1/os-volume_attachments => generated 174 bytes in 543 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:03:34.816880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:34.817950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:34.843922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.844804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.848065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.853473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:34.854857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:34.855514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:34.979121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:03:35.243427 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08513258-a8b0-4e18-b560-a0205ba75e43 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 204 len: 0 microversion: 2.1 time: 0.435186 Oct 28 18:03:35.252110 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3132/6126] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:03:34 2022] DELETE /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:03:35.269334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:35.270962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:35.305704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.309246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.310081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.311030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.317977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.319004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.786272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:35.787124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:35.802029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.805468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.806133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:35.807199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:35.808118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:35.811958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:36.266657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:36.295317 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49f305d8-675d-4e2f-bf91-e57630fbb67e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1680 microversion: 2.1 time: 1.032109 Oct 28 18:03:36.303680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2995/6127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:35 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1680 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:36.581208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:36.603891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a399db5-4a86-48b5-a73b-bdd6646018d2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.819278 Oct 28 18:03:36.605157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3133/6128] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:35 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:37.328892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:37.331593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:37.362819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.371835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.372410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:37.373194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.373723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.374100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:37.631878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:37.632353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:37.649658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.650161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.651702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:37.652086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:37.652973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:37.653546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:38.524166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:38.562301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c80b1568-4f72-44b6-b8f8-12bc05b003be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.935932 Oct 28 18:03:38.575315 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3134/6129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:37 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:39.022625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:39.038716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7298b717-c1ac-4e57-80ab-5cff3eeb1914 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1680 microversion: 2.1 time: 1.717269 Oct 28 18:03:39.044418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2996/6130] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:37 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1680 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:39.603590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:39.604924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:39.647222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.648532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.648995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:39.652866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:39.653481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:39.657137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:40.064228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:40.064852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:40.077429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:40.077934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:40.078374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:40.079103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:40.083696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:40.084196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:40.204795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:40.220441 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e466da69-5a2b-47a8-9e6c-74fd5b868a48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.623401 Oct 28 18:03:40.223623 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3135/6131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:39 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:40.226488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:40.234498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76a0d77b-d22b-4465-bd13-c7b2d68c0cc5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1612 microversion: 2.1 time: 0.174875 Oct 28 18:03:40.243774 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2997/6132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:40 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1612 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:40.786463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7264c0-9849-4d14-aaa1-87d878eaf8e1", "name": "network-vif-deleted", "tag": "852e1145-05a6-414f-9d5d-c975ed80893b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:03:40.816008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:40.816600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:40.819458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:40.907018 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] Creating event network-vif-deleted:852e1145-05a6-414f-9d5d-c975ed80893b for instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 on n-h1-860864-13 Oct 28 18:03:40.927670 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-959bb95d-f452-4586-87e0-f9e081847aab req-4d4e65c4-657f-4ce5-a124-d9e0bdac4833 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146986 Oct 28 18:03:40.932689 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3136/6133] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:41.250997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:41.251645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:41.261029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=29 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:41.269490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:41.271004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:41.293758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.294296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.302200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.302450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:41.303390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.304558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.306904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.307327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.310135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.311334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.313655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.314333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.317181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.418203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:41.452826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:41.457431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:41.459403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:41.461778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'fault' on Instance uuid de7264c0-9849-4d14-aaa1-87d878eaf8e1 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:41.544720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:41.562342 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b44d2c7d-bd0f-48c7-bbbf-074b5cf558da tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 200 len: 1329 microversion: 2.1 time: 0.304451 Oct 28 18:03:41.572840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3137/6134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:41 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 1329 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:41.815231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:41.832226 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-43ce1c0e-6e27-466f-b6e8-068eb3799db7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.584847 Oct 28 18:03:41.846396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2998/6135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:41 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:42.593204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:42.593783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:42.611758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.612247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.613532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.613881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.614343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.614776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.669148 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 HTTP/1.1 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'de7264c0-9849-4d14-aaa1-87d878eaf8e1'} Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:03:42.676018 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:03:42.679951 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ea6a13ce-c2aa-4b2a-9fb5-7a66da9daa47 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 404 len: 111 microversion: 2.1 time: 0.089289 Oct 28 18:03:42.687472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7b402e1-7c3d-4b25-b77a-3c3588b23eaa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '.version_select at 0x7f751f0beca0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:42.689839 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3138/6136] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:42 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:03:42.757629 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7b402e1-7c3d-4b25-b77a-3c3588b23eaa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409375175" status: 202 len: 0 microversion: 2.1 time: 0.074492 Oct 28 18:03:42.766744 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 2999/6137] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 18:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409375175 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:03:42.869869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:42.870875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:42.877570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.884258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.884831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:42.885690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:42.886343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:42.888771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:43.687447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:43.698807 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74a01463-9232-467f-9540-2343a27277a9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.833097 Oct 28 18:03:43.699784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3139/6138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:42 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:44.724492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:44.725192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:44.741915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.742413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.742852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.743600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.763118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.763830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.783976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:44.785163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:44.810597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.811116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.814878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.815835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.820483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.821008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.898391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:44.927612 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d4960d6-d66a-4ef9-915e-aa299028701d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/bb242001-5eca-45c3-a7e5-504d4530b8de" status: 200 len: 194 microversion: 2.1 time: 0.147527 Oct 28 18:03:44.932576 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3140/6139] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Oct 28 18:03:44 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/bb242001-5eca-45c3-a7e5-504d4530b8de => generated 194 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:44.939880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:44.941181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:44.951048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.951981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.952564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:44.953631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:44.954244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:44.954826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.163279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:45.176229 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce3879c6-c01d-4e69-821c-0a973d82ed02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.457773 Oct 28 18:03:45.179003 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3000/6140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:44 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:45.184654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:45.189123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:45.199643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.200437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.201084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.201986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:45.202620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:45.203222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:45.665320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lazy-loading 'services' on Instance uuid 8e51d063-527c-473c-bf69-c7e2e8930e2a {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:45.829228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'services' on Instance uuid 96def022-6b43-4c72-ad96-998cada6c668 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:03:46.020772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50a30f91-afc5-4fb9-b8c8-a58ded2eb92d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/bb242001-5eca-45c3-a7e5-504d4530b8de" status: 202 len: 0 microversion: 2.1 time: 1.084037 Oct 28 18:03:46.022249 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3141/6141] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:03:44 2022] DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments/bb242001-5eca-45c3-a7e5-504d4530b8de => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:46.208078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.208810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:46.224941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.225434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.229175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.229972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.232879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.233486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.235347 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b793c32c-c6d2-4d43-8a1f-578b7b75a228 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments/08e781aa-7096-4433-b230-e26b4efe6e05" status: 202 len: 0 microversion: 2.1 time: 1.054415 Oct 28 18:03:46.236003 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3001/6142] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:03:45 2022] DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments/08e781aa-7096-4433-b230-e26b4efe6e05 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:03:46.245945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:46.251623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:46.266688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.267170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.274159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.278962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:46.281527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:46.281996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:46.392649 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f6711da-1210-4b49-921d-f4349afae9cc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150041 Oct 28 18:03:46.399116 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3002/6143] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:46.554987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:46.575589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e397f936-e650-4d00-8604-ac1265add100 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.374934 Oct 28 18:03:46.580895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3142/6144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:46 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:47.407267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.409845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:47.419412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.420323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.421128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.422127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.422834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.423491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.470062 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72577690-cc24-4f90-abef-24b7e7d8312d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068062 Oct 28 18:03:47.476768 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3003/6145] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:47 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:47.606372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:47.608491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:47.649072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.649737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.650373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.653880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:47.656535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:47.658085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:47.822577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:47.832320 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07a993ab-a3e7-412b-ba0b-c7611d5e597b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.232318 Oct 28 18:03:47.855561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3143/6146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:47 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:48.484991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.488452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:48.501851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.509084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.509765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.510757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.511518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.512257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.562989 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-456fa180-eaea-463d-af28-898eac67812a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082504 Oct 28 18:03:48.570513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3004/6147] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:48 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:48.856508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:48.857232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:48.877322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.878690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.879282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:48.880932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:48.881520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:48.882104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.097198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:49.110092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de0895d3-61e7-4b53-a6ca-4c3d37af3fbf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.257391 Oct 28 18:03:49.111056 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3144/6148] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:48 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:49.577385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:49.579642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:49.587743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.588239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.588683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.589400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:49.589853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:49.590277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:49.629153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7a5e21b-66df-4fa5-a600-5c2591e6b41f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056318 Oct 28 18:03:49.629740 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3005/6149] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:49 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:50.137185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:50.137798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:50.149534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.150146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.154553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.155352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.155857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.156293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.648590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:50.652449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:50.665613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.666628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.667288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.669457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:50.670212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:50.670803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:50.718997 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac7570d9-4c0a-430a-a85e-6a6ce516b3a9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080433 Oct 28 18:03:50.725838 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3006/6150] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:50 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:50.791288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:50.801673 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1771205-4526-45e4-8c08-98c16fbefa1a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.670041 Oct 28 18:03:50.802371 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3145/6151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:50 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:51.733346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:51.735650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:51.744059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.744845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.745475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.746426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.746950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.747476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.783607 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-41143d18-a14e-4133-885d-2f8333bc127c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054550 Oct 28 18:03:51.785463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3007/6152] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:51 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:51.827684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:51.828909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:51.837370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.838082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.838812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:51.839696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:51.840301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:51.840903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:52.072513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:52.082449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c7e609b-082c-4d09-beab-9f007886de16 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.258692 Oct 28 18:03:52.083304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3146/6153] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:51 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:52.799069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:52.802959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:52.811051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:52.811858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:52.812696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:52.813823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:52.814321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:52.815170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:52.850788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdf0c9c1-6095-4b31-b8a3-08fd72b1ebad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057124 Oct 28 18:03:52.851410 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3008/6154] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:52 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:53.106245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:53.107484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:53.115077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.115797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.116225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:53.117079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.117778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.118347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:53.340793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:53.353984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4027e4da-6087-42ff-b850-dccfb488ccf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.251276 Oct 28 18:03:53.373546 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3147/6155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:53 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:53.863114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:53.865497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:53.872765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.873298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.873856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:53.874654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:53.875142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:53.875834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:53.909859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d4ebc8d-1cb8-42e5-8b7b-eee3fd4ab594 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050693 Oct 28 18:03:53.910507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3009/6156] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:53 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:54.380247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:54.380802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:54.389827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:54.390529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:54.391143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:54.392177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:54.392788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:54.393886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:54.640999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:54.654007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-87be29f5-f9f0-4c77-8627-e9fe085958f8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1168 microversion: 2.1 time: 0.277952 Oct 28 18:03:54.673420 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3148/6157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:54 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1168 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:54.922716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:54.926991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:54.934715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:54.935477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:54.936065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:54.937019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:54.937623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:54.938201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:54.977926 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01c69c61-a695-4897-8b31-f7f02b14b923 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059444 Oct 28 18:03:54.979213 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3010/6158] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:54 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:55.681202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:55.682484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:55.697650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:55.698504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:55.699089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:55.702557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:55.704113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:55.705011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:55.705507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:55.709600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:55.712941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:55.713806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:55.714720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:55.718013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:55.719560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:55.723962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:55.765020 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e16df66d-421c-4d4f-9697-5c8aa1173c3e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072653 Oct 28 18:03:55.773114 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3011/6159] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:55 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:03:55.991516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:55.996180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:56.004944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.005837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.006499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.007546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.008251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.008901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.037675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:56.050316 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b22fb9a1-5024-4c60-bc29-1cf077914e59 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1214 microversion: 2.1 time: 0.373191 Oct 28 18:03:56.050929 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3149/6160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:55 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:56.063033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7df08c2d-82c2-4b6f-8f22-b138ab16a48e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075716 Oct 28 18:03:56.067310 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3012/6161] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:55 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:56.681629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:56.684013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:56.696266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.697932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.698630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.700000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.700675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.701321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.745115 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-34b2daab-afe0-41c5-894c-384c2098b332 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067458 Oct 28 18:03:56.746415 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3150/6162] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:56 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:03:56.852569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:56.853376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:56.862192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.863243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.864473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.868240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:56.870898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:56.873173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:56.951704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:03:57.074292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:57.075046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:57.090704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.092672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:03:57.094931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.095555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.098337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.099893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.101943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.164206 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30cfcb2d-5e1e-4162-96ff-0cf3ee01db58 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 204 len: 0 microversion: 2.1 time: 0.315565 Oct 28 18:03:57.168732 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3013/6163] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:03:56 2022] DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:03:57.180877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:57.189724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:57.218862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.227681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.228237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.228996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.229483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.229919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.319400 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-56f56881-a0ad-4698-bcb3-fe4f70152422 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149213 Oct 28 18:03:57.331961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3014/6164] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:57 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:57.347332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:57.348015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:57.365509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.366192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.366809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.367708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:57.370648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:57.371275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:57.467186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:57.477003 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4a408ce-691e-4230-8920-bc06c303723a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.407142 Oct 28 18:03:57.484773 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3151/6165] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:57 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:57.691664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:57.700550 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-93a765d4-03b8-467d-9896-06afadfe65b6 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1672 microversion: 2.1 time: 0.367421 Oct 28 18:03:57.703205 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3015/6166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:57 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:58.344110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:58.346505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:58.353816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.354610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.355262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.356206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.356869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.357549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.397162 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed0528b5-b64d-480c-b5f3-08ebc4be0975 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057016 Oct 28 18:03:58.398198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3152/6167] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:58 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:03:58.504701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:58.505560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:58.522895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.523893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.524347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.525833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.526494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.527173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.733367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:58.734294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:58.741087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.741738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.742836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.743744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:58.744396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:58.744983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:58.895475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:58.919010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c021c41e-7da3-4a75-bc6e-fb6896bd0dc4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.419098 Oct 28 18:03:58.920045 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3016/6168] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:58 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:03:58.988189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:03:59.005488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7017bc29-ada7-4f0d-be45-ac12f9352790 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1672 microversion: 2.1 time: 0.276574 Oct 28 18:03:59.007269 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3153/6169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:58 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:03:59.410724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:59.414138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:59.440489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.444698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.446930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.452725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.455049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.457583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.528188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6b6c6a19-b8f7-4910-b4dd-1a9bafc68532 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122009 Oct 28 18:03:59.529212 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3017/6170] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:03:59 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:03:59.950186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:03:59.952044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:03:59.961805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.962580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.963178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:03:59.964140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:03:59.965009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:03:59.965603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.031171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:00.031832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:00.060216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.060891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.061623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.062768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.063460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.064043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.357009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.368424 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0c00d0f-30df-4d68-9143-dea11e850a70 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.422636 Oct 28 18:04:00.373120 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3154/6171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:03:59 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:00.383787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:00.394508 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f82e320c-9ac7-44fe-8610-5995b00077df tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1672 microversion: 2.1 time: 0.368111 Oct 28 18:04:00.407796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3018/6172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:00 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1672 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:00.543974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:00.547199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:00.569365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.570069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.571481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.572389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:00.573278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:00.574040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:00.647689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-977442a6-dd09-4294-8175-1d2fbb3eb368 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110835 Oct 28 18:04:00.648209 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3155/6173] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:04:00 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:01.312493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e51d063-527c-473c-bf69-c7e2e8930e2a", "name": "network-vif-deleted", "tag": "d182bd50-000a-4f33-ac40-699167605f3b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:01.337055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.338165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.338772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.386499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] Creating event network-vif-deleted:d182bd50-000a-4f33-ac40-699167605f3b for instance 8e51d063-527c-473c-bf69-c7e2e8930e2a on n-h2-860864-13 Oct 28 18:04:01.394407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.395771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:01.404923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.416154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.418189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.419151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.420793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.421507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.424026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-79584ed2-2863-4b94-ac99-6fa06545f986 req-fb6f1f9b-1d6c-46a6-8a40-2ff13919746d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109718 Oct 28 18:04:01.429613 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3019/6174] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:01.436947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.438570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:01.450303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.451108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.451997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.453089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.453971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.454735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.482784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:01.535525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.536285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.536928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.537817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lazy-loading 'fault' on Instance uuid 8e51d063-527c-473c-bf69-c7e2e8930e2a {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:01.623588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f45bc3e1be43878f3d43f3ba870cc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9e3176958b46ffa4b1ccdfaac3466c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:01.634071 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b990600f-aa71-46eb-846a-8629ea92ef5e tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 200 len: 1326 microversion: 2.1 time: 0.202307 Oct 28 18:04:01.634868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3020/6175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:01 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 1326 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:01.661125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.663761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:01.683959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.684713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.685582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.686676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.688125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.689493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.770858 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90a24e19-ae1b-44c2-8834-f3da6ddca371 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111164 Oct 28 18:04:01.777768 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3021/6176] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:04:01 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:04:01.888437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:01.898827 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66bbc534-a05e-4121-937d-18adb961cec2 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.508240 Oct 28 18:04:01.900210 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3156/6177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:01 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:01.917371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:01.918019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:01.933623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.937957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.939318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:01.941187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:01.942140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:01.943651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.048036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:04:02.260234 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0988749f-b5e3-4a2b-9059-92a2c0c987be tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 204 len: 0 microversion: 2.1 time: 0.346638 Oct 28 18:04:02.261705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3022/6178] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:01 2022] DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:04:02.271154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.271943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:02.288055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.291577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.296146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.297523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.300587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.301117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.571955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:02.585798 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c3b0f3c3-d9f4-4887-a784-0a04cb5c881c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1682 microversion: 2.1 time: 0.319813 Oct 28 18:04:02.595205 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3157/6179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:02.664618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.665335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:02.678854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.680772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.681401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.686011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.686757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.687188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.708566 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a HTTP/1.1 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8e51d063-527c-473c-bf69-c7e2e8930e2a'} Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:02.710541 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:02.714614 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:02.715990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:02.717050 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40234126-b38f-4ddf-b764-51322824ad0d tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 404 len: 111 microversion: 2.1 time: 0.058631 Oct 28 18:04:02.718254 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3023/6180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:02.729316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d09c6f9-c565-4f8b-95aa-45d46dbc950f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '.version_select at 0x7f75242634c0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.778920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d09c6f9-c565-4f8b-95aa-45d46dbc950f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29048865" status: 202 len: 0 microversion: 2.1 time: 0.055522 Oct 28 18:04:02.779955 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3158/6181] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Oct 28 18:04:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29048865 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:04:02.923984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:02.925231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:02.934492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.937149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.939289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:02.940744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:02.946716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:02.947313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.200807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:03.212014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-245ef6f7-032b-455b-ad4c-e3dc1d4b238e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.291926 Oct 28 18:04:03.214797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3024/6182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:02 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:03.621308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:03.622022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:03.639301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.639979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.640546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:03.641355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:03.644201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:03.644718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.189991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:04.199930 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6d9537b2-7c42-4205-a33d-5620c71ca87b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1682 microversion: 2.1 time: 0.585464 Oct 28 18:04:04.211537 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3159/6183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:03 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1682 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:04.242166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:04.242935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:04.274554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:04.275052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:04.275527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.276248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:04.276706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:04.277135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:04.638419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:04.648755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3477e809-ef9a-4617-9f7b-a80b556e7eff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.411203 Oct 28 18:04:04.649272 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3025/6184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:04 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:05.232612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:05.233813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:05.246236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.246953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.248786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.249730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.251837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.252984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.389656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:05.399570 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a5cefbf-e301-43b5-96a5-9413081066aa tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1615 microversion: 2.1 time: 0.170743 Oct 28 18:04:05.403730 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3160/6185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:05 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1615 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:05.691582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:05.694346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:05.708633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.709138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.711459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.712484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.714390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.715281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.763952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96def022-6b43-4c72-ad96-998cada6c668", "name": "network-vif-deleted", "tag": "9aa59503-d158-465b-a111-6ae9de9ccb35"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:05.786619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:05.792168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:05.794513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:05.829228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] Creating event network-vif-deleted:9aa59503-d158-465b-a111-6ae9de9ccb35 for instance 96def022-6b43-4c72-ad96-998cada6c668 on n-h2-860864-13 Oct 28 18:04:05.849356 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-990d76e7-5107-422c-9d7b-8aae109b2b26 req-32fc0475-9938-4e1a-8b1b-e43895b7e8f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089161 Oct 28 18:04:05.856462 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3161/6186] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:06.053927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.069802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-17630551-9279-43f3-a55f-13fdd7dbabcc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.383176 Oct 28 18:04:06.070408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3026/6187] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:05 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:06.433200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:06.434083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:06.458300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.458856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.460258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.462686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.463172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.465814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.505284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0a9f1-9767-402d-b68b-5dac2368b83d", "name": "network-vif-plugged", "status": "completed", "tag": "ea20ecd0-6ad0-474e-b147-3f06c6902850"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:06.540901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.550602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.551295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.583487 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] Creating event network-vif-plugged:ea20ecd0-6ad0-474e-b147-3f06c6902850 for instance dbe0a9f1-9767-402d-b68b-5dac2368b83d on n-h1-860864-13 Oct 28 18:04:06.609067 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e5cbe4cf-5311-42d7-aa05-164d8d6402b1 req-277841fb-e5b5-4011-8d20-e674d7c1bc66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122164 Oct 28 18:04:06.616750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3027/6188] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:06.618842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:06.621490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:06.623266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:06.624297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'fault' on Instance uuid 96def022-6b43-4c72-ad96-998cada6c668 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:06.707159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:06.732302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8106f338-1759-4267-b0c1-f1c5316f067e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 200 len: 1331 microversion: 2.1 time: 0.293046 Oct 28 18:04:06.733761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3162/6189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:06 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 1331 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:07.096314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:07.097976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:07.118533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.119405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.123058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.124792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.125527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.126650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.476204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:07.489304 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc87d11d-58a7-4292-b5f1-88f85dda382f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.398768 Oct 28 18:04:07.490198 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3028/6190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:07 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:07.757684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:07.758463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:07.768656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.769361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.771049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.772803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:07.773959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:07.775282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:07.816363 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 HTTP/1.1 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '96def022-6b43-4c72-ad96-998cada6c668'} Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:07.821099 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcea1f0a-7879-4a2b-9375-e384013539ab tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 404 len: 111 microversion: 2.1 time: 0.070796 Oct 28 18:04:07.828735 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3163/6191] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:07 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:07.835108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc6e287c-1896-407b-b222-262d735eb989 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '.version_select at 0x7f751faee670>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:07.882662 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc6e287c-1896-407b-b222-262d735eb989 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110524618" status: 202 len: 0 microversion: 2.1 time: 0.052425 Oct 28 18:04:07.885610 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3029/6192] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 18:04:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110524618 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:04:08.514819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:08.515468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:08.537983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.538481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.538917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:08.539658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:08.540110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:08.540534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:09.262638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:09.274488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51e63207-c802-443d-b982-9ad8cf886e0c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1202 microversion: 2.1 time: 0.764036 Oct 28 18:04:09.288813 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3164/6193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:08 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1202 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:09.506656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d03df0d8-2af3-4cc4-a364-4014c79eb740 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: .version_select at 0x7f752863cee0>, body: {"keypair": {"name": "tempest-keypair-202510355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuAr0eXMxa0VNw2adKdNilwrhvWNz1BnjQUAhni6Y1DP3fSIc2ziMMRdbnqzNcKQqfcNuz3MSbMbdoHk8/cE+V0XYzGuLv30Mkmsat2NHQQPfven7PT3EYmdZ5UvP6NNQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:09.565185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d03df0d8-2af3-4cc4-a364-4014c79eb740 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:09.575703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d03df0d8-2af3-4cc4-a364-4014c79eb740 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:09.617201 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d03df0d8-2af3-4cc4-a364-4014c79eb740 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119425 Oct 28 18:04:09.619075 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3030/6194] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:04:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:10.300372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:10.301954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:10.313790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:10.314288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:10.315274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:10.316213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:10.316691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:10.322003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.295080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:11.306039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ec0ac2c7-ebe3-49eb-836b-80c2cd84cbfb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1389 microversion: 2.1 time: 1.007223 Oct 28 18:04:11.323324 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3165/6195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:10 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1389 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:11.336428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.337456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:11.351901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:11.354935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.356760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.359359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.362309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.363231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.363891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.720578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:11.734259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d3dde17b-75ad-47e4-901b-fcd7a051ce3a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1389 microversion: 2.1 time: 0.401392 Oct 28 18:04:11.735279 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3031/6196] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1389 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:11.761798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:11.763016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:11.778545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:11.781083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.781777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.782447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:11.783615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:11.790767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:11.793396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.043002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:12.053079 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61dcbf6e-dc93-4bfe-956f-e3c518158ba0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1389 microversion: 2.1 time: 0.295564 Oct 28 18:04:12.061218 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3166/6197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:11 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1389 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:12.225432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.226305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:12.241364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.244124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.246354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.249035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.253503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.256496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.278362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:12.364309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:04:12.638769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-62d1d692-b871-4c53-b412-501d3da0978d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 204 len: 0 microversion: 2.1 time: 0.418252 Oct 28 18:04:12.644381 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3032/6198] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:12 2022] DELETE /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:04:12.651851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:12.654301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:12.666844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.670352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.671898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:12.676345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:12.679646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:12.683823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:13.079001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:13.089433 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03728cae-4b88-45d1-880d-d0e468efe2d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1395 microversion: 2.1 time: 0.443087 Oct 28 18:04:13.105952 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3167/6199] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:12 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1395 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:13.195798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094641534", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff41118f-997d-48a4-b03d-71369ebf0429"}], "security_groups": [{"name": "tempest-securitygroup--1884811945"}], "key_name": "tempest-keypair-202510355", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:13.511838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] validate_networks() for [('ff41118f-997d-48a4-b03d-71369ebf0429', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:04:14.124856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:14.125380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:14.151911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.152615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.154582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.159599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.162194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.163535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.521456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:04:14.521984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:04:14.522363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:04:14.522776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:04:14.523195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:04:14.542037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.542535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.542988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.543761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:14.544220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:14.544645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:14.625855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:04:14.639738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:04:14.684408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:04:14.695212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:04:14.831706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-acb7055e-56c8-448b-9e03-74c8633a9fbe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.640495 Oct 28 18:04:14.841957 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3033/6200] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:04:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:04:14.851053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b2cb74b-1342-4edc-8533-0095bc8d4a79 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:14.862584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b2cb74b-1342-4edc-8533-0095bc8d4a79 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:15.362702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b2cb74b-1342-4edc-8533-0095bc8d4a79 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:15.378530 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b2cb74b-1342-4edc-8533-0095bc8d4a79 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1241 microversion: 2.1 time: 0.535125 Oct 28 18:04:15.381466 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3034/6201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:14 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1241 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:15.510311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:15.529075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3419e93a-e91a-479e-9b28-45797bfed4de tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1395 microversion: 2.1 time: 1.409859 Oct 28 18:04:15.529675 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3168/6202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:14 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1395 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.414112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a764566e-dabe-488d-be6a-5a650843143e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:16.414731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a764566e-dabe-488d-be6a-5a650843143e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:16.573253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:16.577421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:16.629025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.629538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.629985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.658088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.660128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.664540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.691578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a764566e-dabe-488d-be6a-5a650843143e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.715284 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a764566e-dabe-488d-be6a-5a650843143e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1241 microversion: 2.1 time: 0.305281 Oct 28 18:04:16.724447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3035/6203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:16 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1241 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.793973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0a9f1-9767-402d-b68b-5dac2368b83d", "name": "network-vif-deleted", "tag": "ea20ecd0-6ad0-474e-b147-3f06c6902850"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:16.841112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:16.841942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:16.842415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:16.875723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:16.902913 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] Creating event network-vif-deleted:ea20ecd0-6ad0-474e-b147-3f06c6902850 for instance dbe0a9f1-9767-402d-b68b-5dac2368b83d on n-h1-860864-13 Oct 28 18:04:16.908238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27c88d65-5981-45d1-9df9-ef6e3f12a392 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1353 microversion: 2.1 time: 0.343967 Oct 28 18:04:16.912798 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3169/6204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:16 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1353 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:16.925653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8423303f-5e16-43c7-9998-503ab0e6f587 req-cd9f6e54-a6f6-4e3f-9fa5-eeb8217e4830 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135653 Oct 28 18:04:16.926472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3036/6205] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:04:17.761408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:17.764892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:17.799233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.804866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.811867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.812648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.816799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.817441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.940303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:17.941156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:17.962243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.971510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.980218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:17.981154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:17.981744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:17.983783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:18.022273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:18.033557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a125b131-1eaa-4262-bf00-c6b70e067e89 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1301 microversion: 2.1 time: 0.281422 Oct 28 18:04:18.040810 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3037/6206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:17 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1301 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:18.164255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:18.175878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54539c48-0166-401d-9abf-e95b547b1407 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.237926 Oct 28 18:04:18.177158 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3170/6207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:17 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:19.066004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:19.067394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:19.074750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.092393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.093249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.099661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.100503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.101208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.206312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:19.206878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:19.257593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.258120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.258563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.259286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:19.259778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:19.260208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:19.409728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.421053 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7de8e356-38ea-4a07-8815-88cba4e5ccd3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1299 microversion: 2.1 time: 0.357646 Oct 28 18:04:19.422477 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3038/6208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:19 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1299 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:19.599259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:19.615758 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e22b9c07-894f-4b96-b448-3fb592553b47 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.417226 Oct 28 18:04:19.616890 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3171/6209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:19 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:20.448933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:20.449661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:20.463265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.463796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.464233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:20.464951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.465399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.465824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:20.645575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:20.646797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:20.681206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.687612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.688353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:20.690236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:20.690982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:20.691787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:20.985577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:21.005619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9bee62c0-e0fa-4767-8712-8dd1c0f10fd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.364275 Oct 28 18:04:21.006576 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3172/6210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:20 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:21.093579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:21.113561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8b16b01-a74a-40c3-9841-b03ad440e9fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.668785 Oct 28 18:04:21.125936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3039/6211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:20 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:21.152400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:21.160279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:21.176536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.180058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.180727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.181667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.185645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.186418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.221039 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a HTTP/1.1 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8e51d063-527c-473c-bf69-c7e2e8930e2a'} Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:21.223837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.227662 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.229804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:21.230888 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c49bdc9d-da26-4f48-9c08-24f8a6952f29 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 404 len: 111 microversion: 2.1 time: 0.082403 Oct 28 18:04:21.232019 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3173/6212] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:21 2022] DELETE /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:21.240470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:21.241387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 8e51d063-527c-473c-bf69-c7e2e8930e2a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:21.250812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.259241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.260041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.261000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:21.261675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:21.262303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:21.305193 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a HTTP/1.1 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8e51d063-527c-473c-bf69-c7e2e8930e2a'} Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:21.316950 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 8e51d063-527c-473c-bf69-c7e2e8930e2a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:21.320409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4220b81-f386-41a4-afe3-4e1bfa67539f tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a" status: 404 len: 111 microversion: 2.1 time: 0.082640 Oct 28 18:04:21.323953 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3040/6213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:21 2022] GET /compute/v2.1/servers/8e51d063-527c-473c-bf69-c7e2e8930e2a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:22.032270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:22.033548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:22.056209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.056914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.057524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.060202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.064925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.065558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.149014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:22.151764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:22.159172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.172699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.174679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.178708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.183670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.188141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.437688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:22.451136 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57cecb23-fc2b-4f0b-b126-1a95dfde3f50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.418360 Oct 28 18:04:22.478553 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3174/6214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:22 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:22.590092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:22.620504 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-95c45852-9015-44d5-b986-cfd798c946a3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.475182 Oct 28 18:04:22.633411 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3041/6215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:22 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:04:22.880359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e45b8a1-808e-4995-8a08-24c7224629e1", "tag": "1a1e6270-1005-4888-b93a-56922cf0148e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:22.901211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:22.902005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:22.902602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:22.925685 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] Creating event network-changed:1a1e6270-1005-4888-b93a-56922cf0148e for instance 7e45b8a1-808e-4995-8a08-24c7224629e1 on n-h2-860864-13 Oct 28 18:04:22.940475 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9d47e1ec-6cca-4e16-8f68-576aa4dba48f req-61aefba3-b799-4e80-950c-fdb1e9346eea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324233 Oct 28 18:04:22.948825 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3175/6216] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:04:23.478384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.479602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:23.498300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.498805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.499292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.500549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.501357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.502382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.612426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.623860 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee3d0871-84a0-47da-be0f-9ed3f6fb3374 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.150011 Oct 28 18:04:23.624471 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3042/6217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:23.650696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:23.651433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:23.666954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.668130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.668787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.669801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:23.671717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:23.672326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:23.705433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:23.929322 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:23.940290 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5798ae89-7ac3-4b82-aa35-4c2c71081d24 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.294704 Oct 28 18:04:23.941034 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3176/6218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:23 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:24.650368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:24.650982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:24.654001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:24.669047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.669239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.671253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.672347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.674060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:24.675682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:24.805366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:24.816021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22a74983-8ac4-4596-aa2a-fe61cb9ef2ad tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1187 microversion: 2.1 time: 0.169831 Oct 28 18:04:24.816619 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3043/6219] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:24 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:24.974921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:24.976881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:24.993635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:24.998684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.008313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.010419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.012388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.013328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.330450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:25.341093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e22603d-279f-4674-bbd7-c892dd9ab53e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.376821 Oct 28 18:04:25.382792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3177/6220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:24 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:25.839248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:25.841137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:25.855570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.856416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.859567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.861193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.862983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.865069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.984440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:25.985119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:25.985709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:25.986362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lazy-loading 'fault' on Instance uuid dbe0a9f1-9767-402d-b68b-5dac2368b83d {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:04:26.098438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:26.113419 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f052596-32e3-48ab-bd32-a613a3a67dd6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 200 len: 1192 microversion: 2.1 time: 0.279067 Oct 28 18:04:26.130893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3044/6221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:25 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 1192 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:26.378530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:26.379701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:26.391305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:26.394295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:26.394947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:26.395890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:26.397810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:26.399121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:26.938428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:26.948219 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2dceb355-349c-40a2-b71c-b1031fff773f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.579713 Oct 28 18:04:26.949370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3178/6222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:26 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:27.139979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:27.140910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:27.147058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:04:27.160006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.160521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.161689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.164049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.165016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:27.166676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:27.217443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d HTTP/1.1 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'dbe0a9f1-9767-402d-b68b-5dac2368b83d'} Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:27.220398 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:27.226131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:27.229000 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4dc357d-07ad-4cc2-b860-a351bf985542 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 404 len: 111 microversion: 2.1 time: 0.093101 Oct 28 18:04:27.231632 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3045/6223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:27 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:27.975949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:27.977017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:27.998750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:27.999570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.000280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.001220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:28.002027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:28.002670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:28.221622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:28.232307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0daeca87-15ae-4415-a3d3-e84241320f4b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.261182 Oct 28 18:04:28.233543 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3179/6224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:27 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:29.275082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:29.276418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:29.285503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.286357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.286998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.288794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:29.289472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:29.290105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:29.510408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:29.524517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7f19ef1-e85f-48bc-900b-62326514c154 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 0.265465 Oct 28 18:04:29.528789 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3046/6225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:29 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:30.345030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45b8a1-808e-4995-8a08-24c7224629e1", "name": "network-vif-plugged", "status": "completed", "tag": "1a1e6270-1005-4888-b93a-56922cf0148e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:30.375001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.375841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.376156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.405651 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] Creating event network-vif-plugged:1a1e6270-1005-4888-b93a-56922cf0148e for instance 7e45b8a1-808e-4995-8a08-24c7224629e1 on n-h2-860864-13 Oct 28 18:04:30.434442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5546b18f-6485-4d6d-929f-726edf38085d req-408a640a-cf60-4820-a286-20c4107ad1e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.511501 Oct 28 18:04:30.438917 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3180/6226] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:30.557229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:30.558855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:30.582260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:30.583026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:30.593499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.599645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.599961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.600706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.601666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.606795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.608405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.610155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.611241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.620732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.622079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.624198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.745185 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 HTTP/1.1 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '58f432a3-e744-4993-9f97-c3956216eb92'} Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:30.749143 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.753559 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.757284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:30.758852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-597e1c80-f619-438d-af17-f982b4835d75 tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 404 len: 111 microversion: 2.1 time: 0.183360 Oct 28 18:04:30.765298 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3181/6227] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:30 2022] DELETE /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:30.790638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:30.791351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] [instance: 58f432a3-e744-4993-9f97-c3956216eb92] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:30.809188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.809685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.819855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.828219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:30.836979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:30.838236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:30.884920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] HTTP exception thrown: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Request method failure captured: Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 HTTP/1.1 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBe5-5PRfmKzdq3ESpB8qF6aVE6SE7St7estMLwEhDwnmVwiYch5vtfgBUe2snnTl06arlWIWd7TVQeO2CEfgqfwnvKCBZirAqHrd5N9ARNXR9vPp5Zlre8hC-aqWvymwD_ALfkATxi4Km-vIsCLo--RU2n_gPPDdrT3Ynvi9tb5Hpg Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fe9e3176958b46ffa4b1ccdfaac3466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fe9e3176958b46ffa4b1ccdfaac3466c"}]}] Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fe9e3176958b46ffa4b1ccdfaac3466c Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-7327630 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f6f45bc3e1be43878f3d43f3ba870cc6 Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeTestJSON-7327630-project Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '58f432a3-e744-4993-9f97-c3956216eb92'} Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:30.888722 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. Oct 28 18:04:30.893705 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:04:30.901689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] Returning 404 to user: Instance 58f432a3-e744-4993-9f97-c3956216eb92 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:30.903329 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd2e0667-6e70-42bc-acb1-6ec5c50702ed tempest-AttachVolumeTestJSON-7327630 tempest-AttachVolumeTestJSON-7327630-project] 10.222.0.48 "GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92" status: 404 len: 111 microversion: 2.1 time: 0.131600 Oct 28 18:04:30.906985 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3182/6228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:30 2022] GET /compute/v2.1/servers/58f432a3-e744-4993-9f97-c3956216eb92 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:31.541284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:31.551594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0888cf32-15c7-4891-b02f-ae48e6f5402b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1367 microversion: 2.1 time: 1.000954 Oct 28 18:04:31.554238 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3047/6229] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:30 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1367 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:32.584706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:32.585384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:32.604416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.605161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.605756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:32.614170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:32.615970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:32.624577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.060129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:33.060685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:33.097742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:04:33.102677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.110217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.113631 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-91652b6c-11b4-49b6-85bb-a8fbebcd8aba tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1558 microversion: 2.1 time: 0.532946 Oct 28 18:04:33.113907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.114791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.120558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.121725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.140842 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3183/6230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:32 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1558 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:04:33.159666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:33.160439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:33.171303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.175282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.175964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.177780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.182051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.182878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.212497 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d HTTP/1.1 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'dbe0a9f1-9767-402d-b68b-5dac2368b83d'} Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:33.216253 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.221073 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.223319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:33.226810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c096ff33-b480-471e-a0a2-495da91447b0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 404 len: 111 microversion: 2.1 time: 0.175514 Oct 28 18:04:33.227962 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3048/6231] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:04:33 2022] DELETE /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:33.258143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:04:33.259558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: dbe0a9f1-9767-402d-b68b-5dac2368b83d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:04:33.274653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.278845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.279981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.282654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:33.285298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:33.287542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:33.335389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d HTTP/1.1 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'dbe0a9f1-9767-402d-b68b-5dac2368b83d'} Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:04:33.342359 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. Oct 28 18:04:33.346706 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:04:33.352213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance dbe0a9f1-9767-402d-b68b-5dac2368b83d could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:04:33.353336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6cc8f0f-94e2-4f38-9c84-458d11278710 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d" status: 404 len: 111 microversion: 2.1 time: 0.120069 Oct 28 18:04:33.394939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3049/6232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:04:33 2022] GET /compute/v2.1/servers/dbe0a9f1-9767-402d-b68b-5dac2368b83d => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:04:33.488251 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb0d3fc1-3bdb-48b3-8844-62db83907843 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.345357 Oct 28 18:04:33.497441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3184/6233] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:04:33 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-interface => generated 285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:04:37.169596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e45b8a1-808e-4995-8a08-24c7224629e1", "tag": "1a1e6270-1005-4888-b93a-56922cf0148e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:04:37.200769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:04:37.201275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:04:37.205949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:04:37.237841 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] Creating event network-changed:1a1e6270-1005-4888-b93a-56922cf0148e for instance 7e45b8a1-808e-4995-8a08-24c7224629e1 on n-h2-860864-13 Oct 28 18:04:37.252508 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2c452692-36a4-4a0b-8e04-471d17e61c5c req-d9a2d7e6-34c2-48d0-9a2c-30c343d25853 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086849 Oct 28 18:04:37.253713 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3050/6234] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:13.776071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=37 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:13.777188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=36 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:13.783443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-826887091", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7a39ab8b-8049-4a24-ae40-a9bc58a22744", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:13.899436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:14.471574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:14.471996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:14.472702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:14.474112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:14.474590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:14.496339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:14.499250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:14.500567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:14.505903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:14.506582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:14.507329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:14.553713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:14.562456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:14.652896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:14.656070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a39ab8b-8049-4a24-ae40-a9bc58a22744',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:14.885436 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2de0ed88-c59c-49fc-8567-df50a1fd5d82 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112410 Oct 28 18:05:14.888159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3185/6235] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:05:14.897732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:14.898502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:14.903779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aab7d194-8c6e-4017-806a-e882f7326861 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:14.904516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aab7d194-8c6e-4017-806a-e882f7326861 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:15.012337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aab7d194-8c6e-4017-806a-e882f7326861 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:15.024645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aab7d194-8c6e-4017-806a-e882f7326861 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1070 microversion: 2.1 time: 0.129054 Oct 28 18:05:15.028053 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3051/6236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:14 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1070 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:16.054657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:16.055351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:16.067247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:16.067779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:16.068220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:16.068938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:16.069388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:16.069814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:16.178840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:16.190859 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a7fe480-367b-41c2-b33c-ce7b35f91b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1168 microversion: 2.1 time: 0.141168 Oct 28 18:05:16.191468 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3186/6237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:16 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1168 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:17.214818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:17.215579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:17.232600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.233111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.233559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.241872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:17.243030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:17.244648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:17.402461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:17.412030 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a74d588-a2cd-4789-af9f-419ff6396be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1186 microversion: 2.1 time: 0.201548 Oct 28 18:05:17.418383 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3052/6238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:17 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1186 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:18.454715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:18.456139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:18.482408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.486437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.487126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.488120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:18.488731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:18.489313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:18.944670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:18.955602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b8a23e7-201f-49ba-9042-dd7c9c4dc11e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.515129 Oct 28 18:05:18.959283 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3187/6239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:18 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:19.945262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8082ed23-cd7a-43e9-b757-1e8773bb1a60", "tag": "a2d5e040-692e-4603-ba20-4af441177916"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:19.959258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:19.962970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:19.963485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:19.987652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:19.987652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:20.002363 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] Creating event network-changed:a2d5e040-692e-4603-ba20-4af441177916 for instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 on n-h1-860864-13 Oct 28 18:05:20.004433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.005115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.005708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.008052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:20.008682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:20.009269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:20.016187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-12e691e5-6a44-4214-9e59-8137bc1f4e22 req-9e9879f8-e4fe-465c-9c70-5cc4521ae66e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575643 Oct 28 18:05:20.021195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3053/6240] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:20.511891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:20.535660 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2da3f8ce-7d84-4145-8f56-67f3197c3c41 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.552669 Oct 28 18:05:20.541274 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3188/6241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:19 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:21.570902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:21.582803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:21.629211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.632115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.635273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.637446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:21.639812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:21.641211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:21.994574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:22.003402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8a70d75-02c3-46f4-abd6-613cfdf20145 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.441340 Oct 28 18:05:22.004398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3054/6242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:21 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:23.029443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:23.030327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:23.055048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.057387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.057830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.058556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:23.059015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:23.059472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:23.341554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:23.357428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0eb42bff-c679-4c55-8504-fed21523c45f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.332832 Oct 28 18:05:23.360147 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3189/6243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:23 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:24.382284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:24.382983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:24.396467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.397053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.397575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.398369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:24.401790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:24.402334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:24.717779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:24.759775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-24aa26bb-74b9-4fe5-8372-a5026a43ead0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.381775 Oct 28 18:05:24.762596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3055/6244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:24 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:25.797180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:25.798611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:25.808140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:25.816900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:25.819062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.819823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.820533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:25.821455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:25.822107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:25.822730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:26.167281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:26.176524 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a132e18-1c09-4023-9990-0f1e1e0f646c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.383724 Oct 28 18:05:26.180113 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3190/6245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:25 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:27.207848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:27.208459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:27.210687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:27.226644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.227343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.227979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.240447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:27.240997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:27.241551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:27.449988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:27.468016 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1572405-4f56-4fbb-801b-d6716739cf56 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.263889 Oct 28 18:05:27.469274 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3056/6246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:27 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:28.493675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:28.495036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:28.509137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.510843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.512324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.515489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:28.516248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:28.522884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:28.769898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:28.784588 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f0375d70-38b3-49f0-8f83-a8540f0a4a44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.297736 Oct 28 18:05:28.788591 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3191/6247] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:28 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:29.816606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:29.818259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:29.832028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.833650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.834262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:29.835902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:29.837955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:29.838556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:30.104970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:30.119810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e7ad07e4-c2e6-425d-b521-a4d030e86e7a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.310042 Oct 28 18:05:30.120936 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3057/6248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:29 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:31.147713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:31.148391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:31.157457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.157951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.158391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.159468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:31.160463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:31.160904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:31.470275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:31.481377 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e7ae4e17-f02d-4b29-885f-ba7ae1866027 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1228 microversion: 2.1 time: 0.337722 Oct 28 18:05:31.501300 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3192/6249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:31 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1228 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:32.523312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:32.526611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:32.553826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.554328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.554773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.555538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:32.555999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:32.556429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:32.919223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:32.929628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-810525d6-ff13-4727-b8dd-02fc75eb40aa tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.409800 Oct 28 18:05:32.945649 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3058/6250] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:32 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:33.956142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:33.957513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:33.967031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.968122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.969044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:33.970021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:33.971204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:33.972351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:34.198751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:34.209021 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6fcf6711-c11d-408b-b4c5-66c4308e4721 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.257399 Oct 28 18:05:34.210278 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3193/6251] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:33 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:35.234607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:35.235877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:35.248167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.250972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.251709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.257835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:35.259934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:35.276015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:35.657383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:35.667028 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-569cb419-0e3c-4be8-8528-ba2cf5012dd5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.436997 Oct 28 18:05:35.671722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3059/6252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:35 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:36.693994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:36.695195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:36.711638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.712348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.712962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:36.714937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:36.727388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:36.728121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:37.081144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:37.089909 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17d60ee4-0ba5-4152-8d7a-0c1ff3911d91 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.399976 Oct 28 18:05:37.095447 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3194/6253] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:36 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:38.134409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:38.136893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:38.153625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.154606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.156353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.158612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:38.159338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:38.160030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:38.414659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:38.424598 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e81296aa-44d1-4989-b291-04b7e7c54202 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.312340 Oct 28 18:05:38.428293 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3060/6254] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:38 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:39.459948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:39.461561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:39.470277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.470916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.471592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.472537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:39.473501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:39.474132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:39.675150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:39.690141 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-184f6609-dbea-4d8f-8111-0f7b89ee388e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.238846 Oct 28 18:05:39.704055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3195/6255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:39 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:40.721124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:40.721815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:40.744022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.744525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.744961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:40.745874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:40.746421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:40.746849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.016498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:41.032179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-484457ff-5163-4f6e-9cb2-cd0a93fc2dd7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.317269 Oct 28 18:05:41.033881 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3061/6256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:41.377692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:41.378250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:41.386207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.386707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.387143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.388152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:41.389089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:41.390241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:41.420243 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-722be50d-c4f6-4954-ab53-14b9f90e5fb5 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/ips" status: 200 len: 151 microversion: 2.1 time: 0.474902 Oct 28 18:05:41.442984 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3196/6257] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 18:05:40 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/ips => generated 151 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:42.057367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:42.057977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:42.081433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.100299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.102002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.102792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.103272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.124609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.484022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:42.493248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2d4ab54-c92b-43e4-b8a8-6d2cf3e58aba tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.440691 Oct 28 18:05:42.502018 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3062/6258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:42 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:42.864031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082ed23-cd7a-43e9-b757-1e8773bb1a60", "name": "network-vif-plugged", "status": "completed", "tag": "a2d5e040-692e-4603-ba20-4af441177916"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:42.884765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:42.886858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:42.887625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:42.917075 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] Creating event network-vif-plugged:a2d5e040-692e-4603-ba20-4af441177916 for instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 on n-h1-860864-13 Oct 28 18:05:42.933531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-905fa5e4-91c4-4604-8df9-daf98046bc07 req-a166afe9-f6e3-4827-98bd-3f14624c1a40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073122 Oct 28 18:05:42.934879 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3197/6259] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:43.556488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:43.557388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:43.573311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.574194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.574749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.575714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:43.579477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:43.580042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:43.857086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:43.883274 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1fe3d5ae-0336-4f9b-abdd-564680f48831 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1216 microversion: 2.1 time: 0.330781 Oct 28 18:05:43.887264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3063/6260] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:43 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1216 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:05:44.913185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:44.917541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:44.919850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:44.937714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.941872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.943163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.944038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:44.946264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:44.946938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:44.955582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=69 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:45.252831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.262816 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64f9240f-cfbb-400e-9d3a-dbb86cb9a906 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1403 microversion: 2.1 time: 0.354865 Oct 28 18:05:45.264639 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3198/6261] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:44 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1403 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:45.304483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:45.305151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:45.321354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=29 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:45.323011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.323732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.324340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.325230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.325856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.327686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.368047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e2421fc-727b-4880-acdc-0dc102996a2d"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:45.393602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:45.399278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=69 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:05:45.411442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.412319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.412945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.413841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.414447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.415048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.828783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:45.841234 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7bde321d-f846-475f-b38f-cbdb851b69c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1403 microversion: 2.1 time: 0.542152 Oct 28 18:05:45.860396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3064/6262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:45 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1403 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:45.868660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1233041378"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:45.875897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:45.907525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.908334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.908995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.912722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:45.933831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:45.938456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:45.993129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1e05d70-62bd-4e0e-be19-0b6c194420b9 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.618423 Oct 28 18:05:45.994130 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3199/6263] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:05:45 2022] POST /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:46.297232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Attempting to quiesce instance before volume snapshot. Oct 28 18:05:46.378018 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 28 18:05:46.564417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Creating snapshot from volume 7a39ab8b-8049-4a24-ae40-a9bc58a22744. {{(pid=120568) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 28 18:05:48.896569 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a0238a0-3228-4e3d-852f-5a4ccd755427 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60/action" status: 202 len: 0 microversion: 2.1 time: 3.031968 Oct 28 18:05:48.897381 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3065/6264] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:05:45 2022] POST /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60/action => generated 0 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 18:05:51.320773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1446268543", "imageRef": "a48531cb-19cf-4b3c-8f85-5f9d77d1761c", "flavorRef": "452", "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:51.451805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:05:52.198754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:05:52.199651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:05:52.200311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:05:52.201143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:05:52.201760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:05:52.212065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.212610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.213914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.215254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:52.215988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:52.216781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:52.247056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:05:52.254627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:05:52.269951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:05:52.273568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='618f3318-6c6e-4324-95f1-5e26b5c61eca',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:05:52.470626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8294139c-865d-45a2-a3cb-8123ed640ca5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154462 Oct 28 18:05:52.473723 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3200/6265] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:05:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:05:52.486176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-502825b3-1d49-44cb-9f56-6f560ac4eb3e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:52.486891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-502825b3-1d49-44cb-9f56-6f560ac4eb3e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:52.590937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-502825b3-1d49-44cb-9f56-6f560ac4eb3e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:52.600955 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-502825b3-1d49-44cb-9f56-6f560ac4eb3e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1230 microversion: 2.1 time: 0.119724 Oct 28 18:05:52.613628 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3066/6266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:52 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1230 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:53.627581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:53.629008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:53.635786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.636488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.637692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.638551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:53.640446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:53.641045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:53.746089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:53.761974 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61700ea2-67e3-4dfc-beb8-fd0d68bd4a13 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1226 microversion: 2.1 time: 0.140363 Oct 28 18:05:53.771644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3201/6267] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:53 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1226 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:54.796811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:54.798259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:54.821507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.822023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.834991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:54.836020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:54.836706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:54.848469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:55.186255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:55.218903 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5babb05-6edd-47e4-93df-94499b26d5d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1300 microversion: 2.1 time: 0.426883 Oct 28 18:05:55.219699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3067/6268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:54 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1300 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:56.251285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:56.251887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:56.280822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.281851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.283942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:56.284994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:56.286840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:56.290141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:57.022447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:57.038164 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f59821a-6725-4cf7-9c37-51d3ba311c64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.793708 Oct 28 18:05:57.043141 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3202/6269] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:56 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:58.028619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae3be84c-c0f5-47e7-87c4-0639eba62968", "tag": "c95969a8-290c-4fec-b608-f2ab1b909b77"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:05:58.068693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:58.069505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:58.081994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.091656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.091876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.092360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.092574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.095096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:58.095430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.096186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:58.097729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:58.139806 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] Creating event network-changed:c95969a8-290c-4fec-b608-f2ab1b909b77 for instance ae3be84c-c0f5-47e7-87c4-0639eba62968 on n-h2-860864-13 Oct 28 18:05:58.151624 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-053b49a3-8760-4e7b-9323-b38719ab422f req-cf579b8f-111b-4bf8-b47f-23f06a86155d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148051 Oct 28 18:05:58.154738 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3068/6270] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:05:58.414898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:05:58.432943 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e8dd44e-8c15-47f5-a910-b3e5e13fe879 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.363364 Oct 28 18:05:58.434106 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3203/6271] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:58 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:05:59.459141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:05:59.460931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:05:59.469978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.471059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.471893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:05:59.477277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:05:59.478378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:05:59.479029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:00.369561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:00.386837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b70b10d5-cf55-46e8-9512-ead727cbac4b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.932732 Oct 28 18:06:00.390762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3069/6272] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:05:59 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:01.982013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:01.982895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:01.998478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:01.999119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.000982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.006082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:02.006604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:02.007061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:02.231283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:02.265346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:02.393535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:02.409428 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4c00a72d-85ee-41f6-94bf-9a878c0ed17f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.989630 Oct 28 18:06:02.413181 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3204/6273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:01 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:03.436877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:03.437369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:03.442651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:03.484585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.485288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.486840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:03.496855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:03.498129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:03.498901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:04.543822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:04.561785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b31505fb-2996-4af9-9e6d-1592d175693b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 1.130831 Oct 28 18:06:04.566218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3070/6274] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:03 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:05.600133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:05.600825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:05.616967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.621185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.622170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:05.633424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:05.634192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:05.634797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.001725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:06.012380 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da7b5eb6-4ba7-47bf-800a-93e47f222fe9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.415750 Oct 28 18:06:06.017567 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3205/6275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:05 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:06.167220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e2421fc-727b-4880-acdc-0dc102996a2d"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:06.170871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:06.188267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.191338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.192166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.193231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.195099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.195914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.384054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments HTTP/1.1 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 74 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: {"volumeAttachment": {"volumeId": "2e2421fc-727b-4880-acdc-0dc102996a2d"}} Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: exception: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '7e45b8a1-808e-4995-8a08-24c7224629e1', 'body': {'volumeAttachment': {'volumeId': '2e2421fc-727b-4880-acdc-0dc102996a2d'}}} Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:06:06.390512 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 Oct 28 18:06:06.395410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:06.399172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 400 to user: Invalid volume: volume 2e2421fc-727b-4880-acdc-0dc102996a2d is already attached to instances: 7e45b8a1-808e-4995-8a08-24c7224629e1 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:06.400367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5fbb57c-50a2-4c1f-ad02-f742f7154059 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.238212 Oct 28 18:06:06.401530 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3071/6276] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:06:06 2022] POST /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 174 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:06:06.572787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:06.573557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:06.585869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.586377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.586821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.587586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:06.588050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:06.588893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:06.842338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'services' on Instance uuid 7e45b8a1-808e-4995-8a08-24c7224629e1 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:07.041815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:07.042547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:07.059095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.059897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.064563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.066776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.068618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.071873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.104147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2debb40d-8d5f-48b1-b342-467fc334f08b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments/2e2421fc-727b-4880-acdc-0dc102996a2d" status: 202 len: 0 microversion: 2.1 time: 0.535506 Oct 28 18:06:07.129826 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3206/6277] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:06:06 2022] DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments/2e2421fc-727b-4880-acdc-0dc102996a2d => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:07.189255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:07.207554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:07.256849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.260647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.264764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.265668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:07.266303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:07.266742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:07.401724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:07.414973 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d96449d3-2169-4b44-b942-aaae13189493 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.377975 Oct 28 18:06:07.421245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3072/6278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:07.456016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e8d3edb6-c9c7-4b09-9f6a-2a271828e0b4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.321758 Oct 28 18:06:07.461600 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3207/6279] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:07 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:08.445258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:08.446757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:08.462378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.465097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.465985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.469510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.470257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.471799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.476455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:08.479834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:08.506304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.507426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.509681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.512099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:08.513897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:08.516582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:08.595727 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-57dc3fe4-8d5d-4186-8b27-4cab6b5033f4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126154 Oct 28 18:06:08.597011 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3208/6280] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:08 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:08.905755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:08.926823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c2da259-d7fa-4cba-b50d-1208ed8219dc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.486444 Oct 28 18:06:08.928402 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3073/6281] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:08 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:09.623123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:09.624891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:09.648175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.656360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.665367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.666228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.666775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.667553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.734401 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86f9e407-eb8d-41e0-b0ab-bcb193e0b4d7 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127082 Oct 28 18:06:09.735729 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3209/6282] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:09 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:09.954366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:09.955438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:09.965689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.966847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.967574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:09.968605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:09.969292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:09.969955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.289723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:10.308416 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89984e33-f050-4b48-9c62-52d905ae685f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.358028 Oct 28 18:06:10.312277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3074/6283] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:09 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:10.746507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:10.749610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:10.766706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.767192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.767738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.768441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:10.784177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:10.784867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:10.863178 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4c87e74-2573-4ac1-82b4-61f27c8b5395 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120711 Oct 28 18:06:10.864659 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3210/6284] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:10 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:11.343352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:11.344780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:11.361492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.362397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.364205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.365494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.367398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.369523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.587510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:11.597038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c6fcef7e-fb57-435a-b666-9f9a64cfb3ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.262046 Oct 28 18:06:11.597941 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3075/6285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:11 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:11.879241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:11.899610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:11.915131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.916380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.917062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.918363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:11.919061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:11.921205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:11.965556 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd3c63b9-5dd4-4093-b045-356c9b3c4d3a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093361 Oct 28 18:06:11.968220 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3211/6286] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:11 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:12.623824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:12.625251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:12.642654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.644742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.645511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.649330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:12.650066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:12.651911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:12.981521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:12.983977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:12.998818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.005304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.007403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.008209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:13.008685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:13.011271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:13.023108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:13.041414 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-489cd6db-7306-4671-863d-eed398e3a11c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.421079 Oct 28 18:06:13.064769 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3076/6287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:12 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:13.093198 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d10da17f-8a81-493c-a998-83a0fa2d815a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111249 Oct 28 18:06:13.094318 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3212/6288] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:12 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:14.071075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.072138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:14.090264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.090992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.093460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.094478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.096039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.096880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.106231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:14.109228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:14.131851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.132376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.132841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.133594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:14.134041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:14.134494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:14.184335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:14.210453 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-66207197-b3ef-4215-83d8-e61b86d9a180 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108138 Oct 28 18:06:14.211837 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3213/6289] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:14 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:14.500739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:14.514446 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-08708bc0-ba4d-4dad-94c3-3cea53692788 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.447524 Oct 28 18:06:14.516216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3077/6290] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:14 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:15.224021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.227134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:15.233275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:15.252453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.253415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.254020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.256130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.257069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.258977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.354413 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-450299b9-9c57-4db2-abc4-9ad1c5d3ca4a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130381 Oct 28 18:06:15.358084 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3214/6291] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:15.545314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:15.546072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:15.551541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=30 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:15.561881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.562398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.562853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.563605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:15.564072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:15.564512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:15.587239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:15.990233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:16.003959 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8714da43-af2f-4f60-a970-9ff83927faf1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.463965 Oct 28 18:06:16.004566 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3078/6292] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:15 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:16.376178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:16.380165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:16.400541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.401596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.404004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.405814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:16.408726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:16.409703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:16.525601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-15d9955a-89b0-4c31-96a9-78dcd4f976ad tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159315 Oct 28 18:06:16.532456 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3215/6293] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:16 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:17.033284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.033896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:17.048172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.048900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.049512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.050353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.051687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.052237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.280370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:17.298085 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76ebc7a2-18e5-4d32-9b60-92c48d65a858 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.268246 Oct 28 18:06:17.309441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3079/6294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:17.538375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:17.540591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:17.554184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.554656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.555090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.568370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:17.568861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:17.569368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:17.613961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d7a55e4-ddb2-4bab-9213-dbbf90bc0bc0 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079506 Oct 28 18:06:17.615215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3216/6295] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:17 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:18.325172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:18.326597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:18.346237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.346791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.347743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.351690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.352177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.353324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.626572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:18.628785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:18.648495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.649543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.650017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.650727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:18.651245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:18.651737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:18.706259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7f7699b-f165-4887-bc3b-e9c642fd3a14 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083806 Oct 28 18:06:18.711559 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3217/6296] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:18 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:18.811000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:18.822775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46f3b6bb-4df2-4028-966b-b286a2e559bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.501819 Oct 28 18:06:18.823354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3080/6297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:18 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:19.720097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:19.722804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:19.732290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.732847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.733285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.734167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.734627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.735340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.770635 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3a14382-126e-4d9b-b793-89e33bb8996e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055778 Oct 28 18:06:19.771595 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3218/6298] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:19 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:19.856478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:19.858174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:19.866908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.867422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.868204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:19.869203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:19.869836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:19.870700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.026398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:20.038138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e39ebdc5-ba84-433c-9481-40da7d59ea64 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.187441 Oct 28 18:06:20.057729 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3081/6299] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:19 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:20.785530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:20.789217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:20.800558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.801248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.801820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.802814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:20.803347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:20.803994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:20.859415 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4895f728-d7cf-45d4-98ca-6a9f7dd0c4c4 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080821 Oct 28 18:06:20.860055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3219/6300] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:06:20 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 18:06:21.032119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.032682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:21.046046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.048361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.048936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.050178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.051787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.058218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.066369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.067084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:21.080410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.080991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.081435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.082212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.082668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.083118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.132883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:06:21.304568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f71f5864-55f4-434d-a91a-bd0e71c1c939 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 204 len: 0 microversion: 2.1 time: 0.276680 Oct 28 18:06:21.308885 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3082/6301] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:06:21 2022] DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:21.318411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:21.321166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:21.331096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.331847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.332338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.334500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:21.335232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:21.335917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:21.767128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.775047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:21.780044 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad1912d9-9728-4af1-addd-bd3007ad10ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.717562 Oct 28 18:06:21.781227 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3220/6302] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:21.796010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31199f65-6f7f-4cf3-8cc5-d45479895dd6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1683 microversion: 2.1 time: 0.483860 Oct 28 18:06:21.796920 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3083/6303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:21 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1683 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:22.811445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.812152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:22.826778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:22.829462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:22.853283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.854882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.855323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.856064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.857298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.858044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.863428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.863929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.864373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:22.869738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:22.870289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:22.870969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:24.068841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.078680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:24.083715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fc08b9fb-68a4-454f-9b1d-2e83ccf03292 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 1.280221 Oct 28 18:06:24.084515 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3221/6304] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:24.102679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8280c7e-bf8e-42b0-80d1-1363a2a6defe tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1683 microversion: 2.1 time: 1.281857 Oct 28 18:06:24.116129 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3084/6305] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:22 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1683 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:25.113452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.117794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:25.128310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.129228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.142181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.144792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.148749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:25.149638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:25.150768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.151340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.188343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.188887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.189350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.195485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.196011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.196474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.420528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.438080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b0c8e86-16ef-4290-afef-87e0f7323386 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1615 microversion: 2.1 time: 0.294342 Oct 28 18:06:25.441417 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3085/6306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1615 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:25.632576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45b8a1-808e-4995-8a08-24c7224629e1", "name": "network-vif-deleted", "tag": "1a1e6270-1005-4888-b93a-56922cf0148e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:25.677905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:25.678413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:25.678868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:25.709025 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] Creating event network-vif-deleted:1a1e6270-1005-4888-b93a-56922cf0148e for instance 7e45b8a1-808e-4995-8a08-24c7224629e1 on n-h2-860864-13 Oct 28 18:06:25.723704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-90b6a490-f4c8-4e0d-97c1-3daf0d4b57ea req-10a18773-fdb4-4850-b177-04335c9ddfc5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092300 Oct 28 18:06:25.724873 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3086/6307] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:25.796498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:25.831600 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a10c8cd-a8a2-49ca-8f22-48845e696e02 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.722633 Oct 28 18:06:25.843464 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3222/6308] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:25 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:26.476106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.477383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:26.511805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.514332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.517185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.518041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.522023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.522575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.628790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.630419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.631537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.632216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'fault' on Instance uuid 7e45b8a1-808e-4995-8a08-24c7224629e1 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:26.766256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:26.777270 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03c630fd-bdff-4c72-bf32-0995de7f006e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 200 len: 1331 microversion: 2.1 time: 0.310003 Oct 28 18:06:26.777757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3087/6309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:26 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 1331 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:26.860692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:26.861412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:26.880420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.881557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.885839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:26.886764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:26.890583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:26.893043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.262912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:27.272300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a9b306d5-79ef-486c-9bf3-1f71d44df024 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.416137 Oct 28 18:06:27.277334 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3223/6310] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:26 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:27.805239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:27.806389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:27.829928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.830630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.831312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.838048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:27.839945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:27.847491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:27.888159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 HTTP/1.1 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7e45b8a1-808e-4995-8a08-24c7224629e1'} Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:27.889803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:27.894784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-00bb08a0-bb81-4501-a010-37b6d608103f tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 404 len: 111 microversion: 2.1 time: 0.090011 Oct 28 18:06:27.927721 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3088/6311] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:27 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:06:27.938019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72591657-04e1-41e3-a4ab-22138d04cac6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '.version_select at 0x7f751ef2ce50>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.016859 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72591657-04e1-41e3-a4ab-22138d04cac6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202510355" status: 202 len: 0 microversion: 2.1 time: 0.083677 Oct 28 18:06:28.017474 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3224/6312] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Oct 28 18:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202510355 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:06:28.306060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:28.306816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:28.326251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.326857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.327324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.336723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:28.337420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:28.340059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:28.835623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:28.849469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5135100-1415-4071-bc8f-72fa7529ed50 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1342 microversion: 2.1 time: 0.549015 Oct 28 18:06:28.850714 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3089/6313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:28 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1342 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:29.682387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92fcf1a5-0981-466d-8e6e-73824df8ba33 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: .version_select at 0x7f751f6c6670>, body: {"keypair": {"name": "tempest-keypair-1130940338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJoaYkJOR2fHY//NpRmKQ25euYxXuMgNHpD91+Pi/c+CScZcvxVpyYgeKAdAwQmZeKW7wv4ohU2xuqEyNf+sxVxN2C/bLEE4iok7edTaAc3s5qe4+hdc9ym8mYvdn9eSg=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:29.700592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-92fcf1a5-0981-466d-8e6e-73824df8ba33 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:29.706828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-92fcf1a5-0981-466d-8e6e-73824df8ba33 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:29.732639 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92fcf1a5-0981-466d-8e6e-73824df8ba33 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055252 Oct 28 18:06:29.733494 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3225/6314] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:06:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:29.874372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:29.875051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:29.884766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.885282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.885720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:29.886440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:29.886901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:29.887922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:30.114995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:30.127979 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9253975b-c261-4ab9-bfea-5b1be5cdb1ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.257258 Oct 28 18:06:30.129635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3090/6315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:29 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:31.156579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:31.157966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:31.165534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.166159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.167031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.168038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:31.169038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:31.169824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:31.618644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:31.631405 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd0a8bf9-0725-49c5-9675-26822e4d88ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.480927 Oct 28 18:06:31.649728 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3226/6316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:31 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:32.210827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024268637", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff41118f-997d-48a4-b03d-71369ebf0429"}], "security_groups": [{"name": "tempest-securitygroup--72440523"}], "key_name": "tempest-keypair-1130940338", "user_data": "}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:32.583459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] validate_networks() for [('ff41118f-997d-48a4-b03d-71369ebf0429', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:06:32.664837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:32.665495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:32.690975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.692832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.696675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:32.702030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:32.703186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:32.704103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:33.337794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:33.359765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-48f58d7d-881a-48f0-bc4f-a8b5d80999c1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.702694 Oct 28 18:06:33.371629 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3227/6317] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:32 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:33.977659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:33.978252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:33.979788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:33.980347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:33.981896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:34.002949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.005031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.005945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.006917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.008140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.008779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.042826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:34.050290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Getting quotas for user 7e5586b74590494f840a5644df401ddd and project c7356b6f95fe4f0c9c6cbaf02cbe3522. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:34.080421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:34.083692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:34.180289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23e7b4e6-68be-4e80-9808-3ee162b785f8 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.974561 Oct 28 18:06:34.192764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5eb4bb9-0afb-41fe-8f25-0af85fe9a6ae tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:34.193444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e5eb4bb9-0afb-41fe-8f25-0af85fe9a6ae tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:34.208096 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3091/6318] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:06:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:06:34.332620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e5eb4bb9-0afb-41fe-8f25-0af85fe9a6ae tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.341614 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5eb4bb9-0afb-41fe-8f25-0af85fe9a6ae tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1242 microversion: 2.1 time: 0.152982 Oct 28 18:06:34.355430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3228/6319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:34 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:34.385633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:34.386851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:34.395444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.396168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.396746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.397612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:34.398918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:34.399731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:34.724294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:34.742442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28ebf450-e4d5-4cee-a0c8-447d1ef86333 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.359486 Oct 28 18:06:34.743484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3092/6320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:34 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:35.365936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:35.367709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:35.394455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.397521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.398398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.400798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.406025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.410537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.711508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:35.733701 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d12013eb-5a6a-44ab-a8f1-50a137eb1049 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1238 microversion: 2.1 time: 0.369537 Oct 28 18:06:35.739868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3229/6321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:35 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1238 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:35.770677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:35.790658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:35.857362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.857933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.866053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:35.872574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:35.873794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:35.876917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.663219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:36.676173 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2cff571e-29b0-4b61-85b9-ba4aa685f0c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.911150 Oct 28 18:06:36.676893 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3093/6322] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:35 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:36.765678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:36.766524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:36.780574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.782840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.783341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:36.786695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:36.787291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:36.787844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.100721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:37.112644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d965b18d-a84b-4897-9679-df525d553146 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1300 microversion: 2.1 time: 0.351547 Oct 28 18:06:37.115686 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3230/6323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:36 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:37.709662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:37.710729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:37.734214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.742471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.743875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:37.749430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:37.750851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:37.752204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.143838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:38.147597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:38.192501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.193263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.193908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.195618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:38.196359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:38.196920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:38.860471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.871321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:38.874016 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2a512baf-7bfc-46b5-943a-cad2c000ff48 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 1.170319 Oct 28 18:06:38.880767 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3094/6324] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:37 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:38.971942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:38.989290 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d2097cc9-1d50-4804-b4fd-0583492f80b3 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.847994 Oct 28 18:06:38.991514 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3231/6325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:38 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:39.906198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:39.911111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:39.940943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:39.942109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:39.943832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:39.944585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:39.945089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:39.951304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.018335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:40.019584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:40.036576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.041084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.041535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.042282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.042735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.043546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.316109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:40.328803 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65fa3620-dc7e-4829-87a2-e19ed524437b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.314764 Oct 28 18:06:40.329626 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3232/6326] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:40 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:40.479617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3be84c-c0f5-47e7-87c4-0639eba62968", "name": "network-vif-plugged", "status": "completed", "tag": "c95969a8-290c-4fec-b608-f2ab1b909b77"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:40.503256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.512933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.513106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.518608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:40.528379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:40.538746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7ff54eec-c22b-4bb1-9b44-8eed77b50921 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.641962 Oct 28 18:06:40.548692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3095/6327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:39 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:40.568029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] Creating event network-vif-plugged:c95969a8-290c-4fec-b608-f2ab1b909b77 for instance ae3be84c-c0f5-47e7-87c4-0639eba62968 on n-h2-860864-13 Oct 28 18:06:40.576597 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f3aa6070-e427-4c9e-bd2b-04d59cb8d8b0 req-6fa0f25e-f16e-4f5c-96db-949740a5954a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102283 Oct 28 18:06:40.577502 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3233/6328] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:40.711329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f97b2d5-73bb-4c44-944e-c46df2b50595", "tag": "032fc75a-c5f3-4ddf-a5e3-f244627c4c1a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:40.728313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:40.731671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:40.732248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:40.769651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] Creating event network-changed:032fc75a-c5f3-4ddf-a5e3-f244627c4c1a for instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 on n-h1-860864-13 Oct 28 18:06:40.785802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9959ebcc-6a10-4ab0-a9e2-52aee981b8fb req-8f2bddc5-750c-4871-94d0-3bc2feeffc49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079562 Oct 28 18:06:40.786440 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3096/6329] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:41.228300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1454535506", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:41.300350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] validate_networks() for None {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:06:41.380058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:41.380797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:41.394892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.397496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.399488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.400241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.400719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.401164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.885710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:41.901617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-950ef13c-9fa4-4a30-963b-e00e93645269 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.550613 Oct 28 18:06:41.904176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:06:41.904836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:06:41.905549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:06:41.906196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:06:41.906990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:06:41.920363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.921472 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3097/6330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:41 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:41.921893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.922674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.923782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.924774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.925431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.941464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:41.943707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:41.949738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Getting quotas for project 23e44ca4b42f4be98893d88fb913e0a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:06:41.956384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Getting quotas for user d6c2f11d2d3e41858d8ab89b8b6ca2e3 and project 23e44ca4b42f4be98893d88fb913e0a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:06:41.962350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.963440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.966784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.969025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:41.971622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:41.972280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:41.973386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:06:41.976138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:06:42.044658 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3670c00-63b5-49cb-b3d7-e1029a389c44 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822448 Oct 28 18:06:42.046113 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3234/6331] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:06:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:06:42.057581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca2272f4-cda3-4990-9476-24d1a05d66ac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:42.058460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca2272f4-cda3-4990-9476-24d1a05d66ac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:42.292462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca2272f4-cda3-4990-9476-24d1a05d66ac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:42.309651 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca2272f4-cda3-4990-9476-24d1a05d66ac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1215 microversion: 2.1 time: 0.253724 Oct 28 18:06:42.310481 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3235/6332] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:42 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:42.439216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:42.456739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13120b1b-8fb8-4df4-8521-36b1d570e414 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1376 microversion: 2.1 time: 0.533988 Oct 28 18:06:42.457337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3098/6333] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:41 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1376 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:42.931287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:42.931967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:42.948114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.949051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.949759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:42.951126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:42.954623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:42.955264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.339689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.341622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:43.364570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.367968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.368610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.373360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.374080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.374739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.384677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.396450 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73584582-f013-479a-81b4-0ee3e60c1510 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.469362 Oct 28 18:06:43.413761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3236/6334] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:42 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:43.489677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.491268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:43.500019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.500820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.501453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.502352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.503132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.503784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.512502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.530851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6c64630-e926-4f23-92cf-d16fd03512ae tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1211 microversion: 2.1 time: 0.196385 Oct 28 18:06:43.531966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3099/6335] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1211 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:43.744036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:43.767891 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b005ba5-9089-4130-ade3-cbe81554cfc6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1564 microversion: 2.1 time: 0.282221 Oct 28 18:06:43.783808 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3237/6336] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1564 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:43.798990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:43.799961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:43.816901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.817580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.818216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:43.818950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:43.819494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:43.819909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.029463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:44.073088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:44.125389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:44.146178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7931ec9d-f6cb-4a8c-bbf0-f68bb66d1512 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1564 microversion: 2.1 time: 0.352703 Oct 28 18:06:44.147675 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3100/6337] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:43 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1564 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:44.368405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.369477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:44.384766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.390767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.391715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.392712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.395883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.397697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.422505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.423293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:44.452647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.460747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.461607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.467150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.468618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.473088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.528246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:06:44.732683 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b049e06-f16d-4a52-aeff-ee774bd8a694 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 204 len: 0 microversion: 2.1 time: 0.365232 Oct 28 18:06:44.733964 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3238/6338] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:06:44 2022] DELETE /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:06:44.751401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:44.754017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:44.766704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.769984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.770444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.773197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:44.773667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:44.775499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:44.985820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.000910 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ebcd182b-f669-4e25-8db0-1f2fe99c3152 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1273 microversion: 2.1 time: 0.265397 Oct 28 18:06:45.002701 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3239/6339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:44 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:45.026768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:45.028242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:45.036590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:45.037334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:45.037935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:45.038813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:45.039510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:45.040111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:45.264771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.279030 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42a4808d-cacc-4fa4-afa7-f718d72c0580 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.861444 Oct 28 18:06:45.280322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3101/6340] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:44 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:45.368775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:45.381058 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bbd121d7-e169-4ada-abcd-ffe651c9961b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1570 microversion: 2.1 time: 0.360820 Oct 28 18:06:45.395278 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3240/6341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:45 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1570 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:46.024679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:46.025289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:46.028479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:46.039799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.040307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.040756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.041475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.041942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.042376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.164913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.176874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a5e545c-0032-4fd5-b708-e7d6f3920587 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1273 microversion: 2.1 time: 0.155494 Oct 28 18:06:46.178443 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3102/6342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:46 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:46.304537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:46.305216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:46.310258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:46.319564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.320591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.326194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.327628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.328914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.329964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.425364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:46.425992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:46.444009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.444540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.445001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.445758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.446257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.453375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.721535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.729671 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3444788a-208f-48e4-828a-52f88cb4c9ff tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.431307 Oct 28 18:06:46.734436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3241/6343] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:46 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:46.787340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:46.798672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7da8b8bf-c9f8-434f-a268-8b9c214c9ce9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1570 microversion: 2.1 time: 0.380356 Oct 28 18:06:46.800217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f97b2d5-73bb-4c44-944e-c46df2b50595", "name": "network-vif-plugged", "status": "completed", "tag": "032fc75a-c5f3-4ddf-a5e3-f244627c4c1a"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:46.801979 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3103/6344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:46 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1570 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:46.828874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:46.830119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:46.830579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:46.865674 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] Creating event network-vif-plugged:032fc75a-c5f3-4ddf-a5e3-f244627c4c1a for instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 on n-h1-860864-13 Oct 28 18:06:46.873742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3b11a2cd-b1be-44be-9804-52e91e9ad9e0 req-a4f463a6-2781-4552-8766-8b3e6f7218ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078581 Oct 28 18:06:46.877166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3242/6345] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:47.203565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:47.204214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:47.220167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.220681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.223636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.224605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.227777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.228417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.339057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:47.350872 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-193317bd-3767-4d0b-8640-32ef566a5c18 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1273 microversion: 2.1 time: 0.152706 Oct 28 18:06:47.354452 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3104/6346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:47 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:47.762800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:47.764240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:47.774046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.774694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.775581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.777031 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.777892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.778483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.819809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae3be84c-c0f5-47e7-87c4-0639eba62968", "name": "network-vif-deleted", "tag": "c95969a8-290c-4fec-b608-f2ab1b909b77"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:47.848359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.852243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.853595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.893876 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] Creating event network-vif-deleted:c95969a8-290c-4fec-b608-f2ab1b909b77 for instance ae3be84c-c0f5-47e7-87c4-0639eba62968 on n-h2-860864-13 Oct 28 18:06:47.935448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-319870ce-eb16-4d58-b8f0-0113c8498088 req-174df4ba-53f8-4849-a210-9ce69df5b85b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120753 Oct 28 18:06:47.943819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3105/6347] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:47.970970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:47.972026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:47.988414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:47.994292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:47.994935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:47.995757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.003919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.004527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.235163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.248861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b038deb5-9063-4c98-aae8-a5aa069f7fdd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1366 microversion: 2.1 time: 0.491153 Oct 28 18:06:48.273143 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3243/6348] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:47 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:48.309314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.318911 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c757976-a270-4d3c-bd49-b17cb4fd19f3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.370868 Oct 28 18:06:48.320266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3106/6349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:47 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:48.384537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:48.391543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:48.406546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.408414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.409089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.410200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:48.411632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:48.412743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:48.729455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:48.742896 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-969f0e2f-7243-4c88-99f0-25473c6a0d29 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.368424 Oct 28 18:06:48.743537 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3244/6350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:48 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:49.288424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.289057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:49.296561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.299255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.300122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.303572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.305766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.307699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.347398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.349090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:49.359778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.364639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.365266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.366180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.367655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.372867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.551520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.568320 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0408c9ba-4b02-4a68-8f82-f64537098287 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.224558 Oct 28 18:06:49.570026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3245/6351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:49.634335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:49.650368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1c179eb-89ce-4816-9581-51e91fe7d46d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1557 microversion: 2.1 time: 0.366829 Oct 28 18:06:49.651819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3107/6352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1557 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:49.683085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.683989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:49.705898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.706937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.708228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.710733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.720445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.721446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.772987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:49.773890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:49.795333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.796979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.797619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.799248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:49.801253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:49.804225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:49.973958 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd799418-321f-4e0c-bf0a-7cbc71c17098 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.298929 Oct 28 18:06:49.975007 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3246/6353] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:50.146733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.168335 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60adc270-f23c-4ddd-a7f7-3fa515bad0a5 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.399406 Oct 28 18:06:50.169532 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3108/6354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:49 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:50.595903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:50.596526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:50.611412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.620631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.621885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.622903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:50.623569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:50.624176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:50.770032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:50.785501 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cada36d2-f4ca-432a-bd9e-4e96723530a3 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.193381 Oct 28 18:06:50.803402 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3247/6355] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:50 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:51.126300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95931339-97fb-4177-83d0-c77f8cf6c398", "tag": "5ab5bc1d-2ff1-4c9e-850c-1c225b65634e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:51.145965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.146485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.149298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.186314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] Creating event network-changed:5ab5bc1d-2ff1-4c9e-850c-1c225b65634e for instance 95931339-97fb-4177-83d0-c77f8cf6c398 on n-h2-860864-13 Oct 28 18:06:51.192050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:51.192920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:51.227335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.232149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.233299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.235290 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-14bbb863-e990-4bf0-a7b7-3705866aad78 req-d4804f7f-e10d-42b7-baf8-4f3476a4ab9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124611 Oct 28 18:06:51.236384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.237717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.239166 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3109/6356] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:51.239903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.546740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.558142 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95c83e08-f5cb-4835-90a9-eb5eb1847390 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.369774 Oct 28 18:06:51.559426 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3248/6357] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:51 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:51.816304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:51.817023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:51.823689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.825037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.825686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.826597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:51.827074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:51.827827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:51.969163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:51.980810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9d31446-40b2-47aa-9cbb-4bf75f7d4540 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.168185 Oct 28 18:06:51.982578 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3110/6358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:51 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:52.582183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:52.582946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:52.586044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:52.588601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=14 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:52.602560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.603716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.604152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.604871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:52.607991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:52.610308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:52.929799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:52.945608 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f6c1887-1169-43c2-95c0-1f76490c4ae6 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.361950 Oct 28 18:06:52.946490 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3249/6359] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:52 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:53.007669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.009139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:53.022874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.028827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.029796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.030753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.031433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.032050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.168475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:53.185198 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78b68c74-e287-4ad6-a67b-9661a587c812 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.180064 Oct 28 18:06:53.202575 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3111/6360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:53.971067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:53.972243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:53.989706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.990315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.990771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:53.991688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:53.993665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:53.994110 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.128383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f97b2d5-73bb-4c44-944e-c46df2b50595", "tag": "032fc75a-c5f3-4ddf-a5e3-f244627c4c1a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:54.151319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.158170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.158646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.191335 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] Creating event network-changed:032fc75a-c5f3-4ddf-a5e3-f244627c4c1a for instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 on n-h1-860864-13 Oct 28 18:06:54.202978 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-64ec6635-c08b-44f1-9c48-810f6c770de8 req-9fb57389-fedd-439a-a990-6351b2293109 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076478 Oct 28 18:06:54.205416 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3112/6361] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:06:54.221747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:54.225550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:54.243463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.243980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.244431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.250131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:54.250669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:54.251135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:54.328214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.340825 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7841aacc-6ed1-4c2c-9a5b-8c1e97692751 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.373331 Oct 28 18:06:54.348275 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3250/6362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:53 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:54.540860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:54.550867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c8298f4-56df-4bdf-93c5-e7c84faf685e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1361 microversion: 2.1 time: 0.339900 Oct 28 18:06:54.555478 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3113/6363] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:54 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:55.373078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:55.374312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:55.394796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.395309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.403413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.406567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.409130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.409763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.461665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:55.584586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:55.585214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:55.595281 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:06:55.595533 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:06:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 (ip 10.222.0.48) !!! Oct 28 18:06:55.604386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.610629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.611591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.612586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.617750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.618313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.638010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:06:55.719910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:55.725281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:55.725870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:55.732182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lazy-loading 'fault' on Instance uuid ae3be84c-c0f5-47e7-87c4-0639eba62968 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:06:56.012901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.029709 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b77cec6-e06d-49e0-b436-fbe0b034580f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 200 len: 1320 microversion: 2.1 time: 0.446201 Oct 28 18:06:56.030634 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3114/6364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:55 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:06:56.123768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:56.146919 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29ae4c8f-a65c-481d-8772-4e44e02cde58 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.778084 Oct 28 18:06:56.163779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3251/6365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:55 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:57.055329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.056886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:57.070565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.071426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.072296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.073569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.075803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.076549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.094457 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 HTTP/1.1 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ae3be84c-c0f5-47e7-87c4-0639eba62968'} Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:06:57.096864 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:06:57.102104 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:06:57.104522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:06:57.106118 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a205e029-34f0-4583-8a45-657981b9483e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 404 len: 111 microversion: 2.1 time: 0.056026 Oct 28 18:06:57.107016 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3115/6366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:06:57.178582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:57.179850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:57.196973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.199495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.201135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.202816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:57.205220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:57.206635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:57.544789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:57.561068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-886b4b6c-474a-4ad4-aa3a-df0652150dfc tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.386513 Oct 28 18:06:57.565340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3252/6367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:57 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:58.586591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:58.587358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:58.601767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.602288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.602740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.608703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:58.610513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:58.614050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:58.882599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:06:58.896910 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d7c4826-4c9c-46d9-aa8d-58f010ee481c tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.314591 Oct 28 18:06:58.897523 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3116/6368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:58 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:06:59.665310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95931339-97fb-4177-83d0-c77f8cf6c398", "name": "network-vif-plugged", "status": "completed", "tag": "5ab5bc1d-2ff1-4c9e-850c-1c225b65634e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:06:59.707659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.709366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.710929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.752994 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] Creating event network-vif-plugged:5ab5bc1d-2ff1-4c9e-850c-1c225b65634e for instance 95931339-97fb-4177-83d0-c77f8cf6c398 on n-h2-860864-13 Oct 28 18:06:59.768886 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-27612eda-0f10-4cd9-a962-a88e010e4d41 req-ebb42b1f-5a89-4464-83a2-ac4ddf1c527d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120535 Oct 28 18:06:59.769781 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3253/6369] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:06:59.921501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:06:59.922789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:06:59.939727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.947705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.948385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:06:59.952502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:06:59.954352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:06:59.956803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:00.298060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:00.311767 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-29bdb39f-75b9-4be2-ad65-0cad21c5fa66 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1315 microversion: 2.1 time: 0.394764 Oct 28 18:07:00.327391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3117/6370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:06:59 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:01.344178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.362111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:01.451545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.452508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.453195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.454407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.455985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.456937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.734962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:01.766187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-abc71905-cd63-4124-a26f-1bb095115710 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1465 microversion: 2.1 time: 0.430467 Oct 28 18:07:01.771794 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3254/6371] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:01 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1465 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:01.845681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:01.846862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:01.855671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.856504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.857195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.858608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:01.859605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:01.860407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:01.896254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:07:02.042314 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-180c4db1-aa50-4417-88f6-4660f87ee667 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 204 len: 0 microversion: 2.1 time: 0.199257 Oct 28 18:07:02.044216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3118/6372] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:01 2022] DELETE /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:02.056565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:02.057309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:02.069648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.071233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.071989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.073252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:02.074428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:02.076588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:02.394084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:02.414616 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e66b11a4-7e10-4ebc-8f3c-70e177a7f18e tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1471 microversion: 2.1 time: 0.365774 Oct 28 18:07:02.416163 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3255/6373] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:02 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:03.441495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:03.442229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:03.460942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.464840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.465692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.472178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:03.475094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:03.477589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:03.930976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:03.948584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4541d7cd-c9a5-4d81-8ec0-a54920bc47ea tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1471 microversion: 2.1 time: 0.511563 Oct 28 18:07:03.950262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3119/6374] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:03 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:04.978082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:04.991780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:05.027053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.032003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.033387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.035576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.037695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.045305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.049728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:05.050232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:05.068213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.069412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.070096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.071290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.071944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.072733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.127960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:07:05.264150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.275593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-09e143ec-1d93-4978-8620-f503ec014aac tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1471 microversion: 2.1 time: 0.303846 Oct 28 18:07:05.280534 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3256/6375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:04 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:05.296417 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f735f92b-df67-47fb-aec1-52630247f94f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 204 len: 0 microversion: 2.1 time: 0.250585 Oct 28 18:07:05.301050 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3120/6376] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:05 2022] DELETE /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:07:05.306444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:05.307273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:05.315602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.316342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.317478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.318472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.319522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.320115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.527899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:05.549636 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c5f9ba0-cf2f-41de-b7a3-a9549c33959a tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1409 microversion: 2.1 time: 0.247750 Oct 28 18:07:05.553628 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3257/6377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:05 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1409 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:05.629538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95931339-97fb-4177-83d0-c77f8cf6c398", "name": "network-vif-deleted", "tag": "5ab5bc1d-2ff1-4c9e-850c-1c225b65634e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:05.667983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:05.668495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:05.676641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:05.720378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] Creating event network-vif-deleted:5ab5bc1d-2ff1-4c9e-850c-1c225b65634e for instance 95931339-97fb-4177-83d0-c77f8cf6c398 on n-h2-860864-13 Oct 28 18:07:05.743284 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-623fd98f-dcde-4fbd-aa27-9d78a00cc79c req-d401cc77-69d3-4d45-b020-f540449d1a3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118337 Oct 28 18:07:05.746591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3121/6378] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:06.304195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:06.305573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:06.318908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.319495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.320193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.324481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.325357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.326013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.421399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.422503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.425127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.425732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lazy-loading 'fault' on Instance uuid 95931339-97fb-4177-83d0-c77f8cf6c398 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:06.513023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2f11d2d3e41858d8ab89b8b6ca2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e44ca4b42f4be98893d88fb913e0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.523651 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74e96da1-dc96-4e41-84f1-8d091141db75 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 200 len: 1305 microversion: 2.1 time: 0.223191 Oct 28 18:07:06.524278 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3258/6379] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:06 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 1305 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:06.579868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:06.580587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:06.598873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.599404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.600582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.601268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:06.601732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:06.602423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:06.889741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:06.897990 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed6dc1ba-a2a1-4cd0-8c35-2df47fffb6d5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1409 microversion: 2.1 time: 0.323977 Oct 28 18:07:06.911728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3122/6380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:06 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:07.552296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.552896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] [instance: 95931339-97fb-4177-83d0-c77f8cf6c398] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:07.570022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.570525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.570963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.571698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.572161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.572583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.614061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] HTTP exception thrown: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Request method failure captured: Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 HTTP/1.1 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBotvouGbXMpQ82gYYTpf03BEnmGKCOZomeTGDaACkCDNQTWxzbGc808bQbpI30tJ8UJaTB0ki6o2z2kDc9Fcgl1oTP7WgAZIeNnMh75_mYV20Au7rE5GHCLZ3aHhybNCxSeraczeGu1DxtHSwZGOdK844OsWUjQmn-baisGCAMt0Ek Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 23e44ca4b42f4be98893d88fb913e0a0 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesNegativeTest-1388536937 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23e44ca4b42f4be98893d88fb913e0a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23e44ca4b42f4be98893d88fb913e0a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23e44ca4b42f4be98893d88fb913e0a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23e44ca4b42f4be98893d88fb913e0a0"}]}] Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesNegativeTest-1388536937 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 23e44ca4b42f4be98893d88fb913e0a0 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesNegativeTest-1388536937 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesNegativeTest-1388536937-project Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: d6c2f11d2d3e41858d8ab89b8b6ca2e3 Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesNegativeTest-1388536937-project Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '95931339-97fb-4177-83d0-c77f8cf6c398'} Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:07.626005 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] Returning 404 to user: Instance 95931339-97fb-4177-83d0-c77f8cf6c398 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-79b3f229-189b-47b6-922f-9c2046c63e90 tempest-VolumesNegativeTest-1388536937 tempest-VolumesNegativeTest-1388536937-project] 10.222.0.48 "GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398" status: 404 len: 111 microversion: 2.1 time: 0.079274 Oct 28 18:07:07.633442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3259/6381] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/95931339-97fb-4177-83d0-c77f8cf6c398 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:07.924560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:07.925971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:07.958000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8082ed23-cd7a-43e9-b757-1e8773bb1a60", "name": "network-vif-deleted", "tag": "a2d5e040-692e-4603-ba20-4af441177916"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:07.966956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.967493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.967942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.980421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.982946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:07.983726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.984428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:07.988151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:07.994490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:08.050248 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] Creating event network-vif-deleted:a2d5e040-692e-4603-ba20-4af441177916 for instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 on n-h1-860864-13 Oct 28 18:07:08.070947 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-d96c39fa-ea06-4a2a-a27c-b72d21aa4115 req-9d718804-22ec-48b2-864a-d9253fe3b33d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110511 Oct 28 18:07:08.073473 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3260/6382] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:08.191003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:08.203894 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c33d03b0-0625-40a4-9bcb-01df5a56027c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.281991 Oct 28 18:07:08.204803 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3123/6383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:07 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:09.233405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.235328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:09.244529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.245277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.245887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.246820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.247459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.248032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.373030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:09.390910 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d250d3a4-7ad2-42b9-9df6-e4f1d0be324d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.163802 Oct 28 18:07:09.398594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3261/6384] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:09 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:09.915036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:09.916808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.918074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.920798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.925529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:09.926307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:09.927362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:09.995975 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-092e24f8-5f06-47f7-8b58-337028912bf6 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.602000 Oct 28 18:07:10.003423 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3124/6385] 10.222.0.48 () {58 vars in 1185 bytes} [Fri Oct 28 18:07:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:10.163159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2120973475", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "availability_zone": "nova:n-h1-860864-13", "networks": [{"uuid": "54fa19e2-0e1c-416b-aaee-0d9ce8f76afa"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:10.300203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] validate_networks() for [('54fa19e2-0e1c-416b-aaee-0d9ce8f76afa', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:07:10.416613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:10.418164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:10.454748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.466630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.467305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.469851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:10.471844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:10.472306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:10.871461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:10.888991 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb88d339-0a71-45b2-ab4e-a5374ca82b04 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.477702 Oct 28 18:07:10.892326 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3125/6386] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:10 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:11.061594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:11.062254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:11.062898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:11.063493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:11.064183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:11.088189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.088681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.089656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.090392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.090849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.091276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.127267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Getting quotas for project 8d9e03f0ce4d4491ae3c679be258878e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:11.138736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Getting quotas for user 07d9875f57154baaa808a31f56b20333 and project 8d9e03f0ce4d4491ae3c679be258878e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:11.170866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:07:11.177639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:07:11.281630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-51d69440-773d-4730-b32d-8a04cb34fc3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122344 Oct 28 18:07:11.285558 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3262/6387] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:07:11.300442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-19df022b-8b5a-44b4-a98a-d1ba4e74f614 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.301665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-19df022b-8b5a-44b4-a98a-d1ba4e74f614 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:11.461435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-19df022b-8b5a-44b4-a98a-d1ba4e74f614 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1329 microversion: 2.1 time: 0.167048 Oct 28 18:07:11.462327 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3126/6388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1329 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:11.915827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:11.916453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:11.937788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.940898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.942506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:11.943258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:11.947313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:11.950981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.237474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:12.256198 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0a354316-2990-423d-ba35-b1427b98d900 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.345171 Oct 28 18:07:12.264817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3263/6389] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:11 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:12.487233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:12.489267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:12.512447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.513458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.514131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.515039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:12.515758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:12.516792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:12.629252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6c7b58d2-97f6-4950-a0e3-468b426983c1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1338 microversion: 2.1 time: 0.146745 Oct 28 18:07:12.630631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3127/6390] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:12 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:13.290042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.290777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:13.303674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.304498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.306670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.307724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.308978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.310892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.412632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:13.424346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1ea98f82-4187-483e-a7ee-9865f671a8d4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.138151 Oct 28 18:07:13.429054 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3264/6391] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:13.657569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:13.658190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:13.680030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.680810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.682744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.683711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:13.686516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:13.686974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:13.809785 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfd15cd7-b205-45c0-93ea-9d38c8f4ca84 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1424 microversion: 2.1 time: 0.157222 Oct 28 18:07:13.819764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3128/6392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:13 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1424 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:14.450063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:14.450774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:14.471789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.472287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.472971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.476237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.478951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.483010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.748877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:14.758621 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcf5ba9f-109a-4b9d-b838-28f2574aaf17 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.313259 Oct 28 18:07:14.765780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3265/6393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:14 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:14.845939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:14.847271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:14.859652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.860466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.861288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:14.862249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:14.862913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:14.863585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.792015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:15.793485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:15.802159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ce9dc32-065b-47e7-bb3f-81828758b587 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.959840 Oct 28 18:07:15.803129 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3129/6394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:14 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:15.805740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.806378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.806948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:15.809244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:15.809852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:15.810416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.027557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:16.035570 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0919ce5-e5e7-4d5f-be7a-3ded78553cbb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1201 microversion: 2.1 time: 0.248264 Oct 28 18:07:16.047854 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3266/6395] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:15 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1201 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:16.462678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85087d82-8363-4e8d-8fe1-5fab41144099", "tag": "21b6dd1c-5a12-41f1-81b1-ea386fac85a5"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:16.491394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:16.499759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.500393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.501997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.540374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:16.546485 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] Creating event network-changed:21b6dd1c-5a12-41f1-81b1-ea386fac85a5 for instance 85087d82-8363-4e8d-8fe1-5fab41144099 on n-h1-860864-13 Oct 28 18:07:16.579684 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-17f6b9d5-b307-4b38-8b4b-7607492c3cd6 req-b389547e-39d8-4190-9869-c9b14743a6b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120644 Oct 28 18:07:16.587186 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3130/6396] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:16.833808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:16.834752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:16.837683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:16.859545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.859994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.860436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:16.863445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:16.865000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:16.865632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.060456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:17.061294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:17.074885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.083141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.085937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.086927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.087883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.090142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.186909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:17.188106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:17.188916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:17.189632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lazy-loading 'fault' on Instance uuid 8082ed23-cd7a-43e9-b757-1e8773bb1a60 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:07:17.268254 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1316a574-1170-4ed1-8e67-92405d98863d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.440170 Oct 28 18:07:17.273032 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3267/6397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:16 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:17.422726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:07:17.432814 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b5730daa-fd1a-4b2a-b72b-3f924d9fc030 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 200 len: 1206 microversion: 2.1 time: 0.377899 Oct 28 18:07:17.433819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3131/6398] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:17 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 1206 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:18.298593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.301429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:18.312813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.314042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.314695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.316021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.316849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.319986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.466910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:18.468049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:18.486517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.491639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.492267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.499068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:18.499899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:18.500532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:18.529719 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 HTTP/1.1 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8082ed23-cd7a-43e9-b757-1e8773bb1a60'} Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:18.531716 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:18.536550 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:18.540265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:18.541431 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-008a924d-b348-42f4-8380-6db9fbf49c1b tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 404 len: 111 microversion: 2.1 time: 0.080235 Oct 28 18:07:18.552674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3132/6399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:18.583722 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6779b47b-f775-47d1-9c5a-a92b5d6c73cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.291417 Oct 28 18:07:18.584437 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3268/6400] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:18 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:19.608740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:19.609365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:19.629241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.630149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.632806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.634851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:19.636699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:19.637570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:19.955600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:20.099995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4b39930e-459d-4967-95a8-102dfdb185bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.496560 Oct 28 18:07:20.101819 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3133/6401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:19 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:21.126163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:21.132879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.133506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:21.141060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.141562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.152787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.155493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:21.156006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:21.156481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:21.159997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:21.334501 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c39ef0a2-7d72-47cc-bb30-8ff0dc9c83bf tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.209612 Oct 28 18:07:21.352665 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3269/6402] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:21 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:21.958153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:21.973887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:22.013824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:22.040209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.044291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.045196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.048516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.049169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.050064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.112381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 HTTP/1.1 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ae3be84c-c0f5-47e7-87c4-0639eba62968'} Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:22.117257 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.121899 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.124268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:22.127196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8964bb2a-b6ab-4f6c-9ff4-d1cb64ccc8be tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 404 len: 111 microversion: 2.1 time: 0.175528 Oct 28 18:07:22.129669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3134/6403] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:21 2022] DELETE /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:07:22.137120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.137764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: ae3be84c-c0f5-47e7-87c4-0639eba62968] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:22.144979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.145520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.146022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.146812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.147491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.147963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.176472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 HTTP/1.1 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ae3be84c-c0f5-47e7-87c4-0639eba62968'} Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:22.180875 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. Oct 28 18:07:22.185510 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:22.190491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance ae3be84c-c0f5-47e7-87c4-0639eba62968 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:22.193189 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3b15695-d64d-4079-8ec6-4931031c768e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968" status: 404 len: 111 microversion: 2.1 time: 0.060916 Oct 28 18:07:22.200187 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3270/6404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/ae3be84c-c0f5-47e7-87c4-0639eba62968 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:22.359160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:22.360660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:22.386580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.399451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.400271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:22.409171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:22.410740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:22.411997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.132983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85087d82-8363-4e8d-8fe1-5fab41144099", "name": "network-vif-plugged", "status": "completed", "tag": "21b6dd1c-5a12-41f1-81b1-ea386fac85a5"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:23.165745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a14f2316-1089-42af-90c6-f9ffa9f1e4f4 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.810239 Oct 28 18:07:23.167796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3135/6405] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:22 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:23.169298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.170345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.170345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.196534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=100 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:23.200780 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] Creating event network-vif-plugged:21b6dd1c-5a12-41f1-81b1-ea386fac85a5 for instance 85087d82-8363-4e8d-8fe1-5fab41144099 on n-h1-860864-13 Oct 28 18:07:23.214869 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0e823b00-ec2c-453d-9bc6-a68cb346e66a req-1171d526-6764-40fa-a487-963798468255 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086004 Oct 28 18:07:23.218204 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3271/6406] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:23.680674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.681176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:23.688272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.688991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.689624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.690496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.691213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.692270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.711744 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 HTTP/1.1 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '8082ed23-cd7a-43e9-b757-1e8773bb1a60'} Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:23.713859 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2936f908-b241-4b5d-97b0-598611c6b867 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 404 len: 111 microversion: 2.1 time: 0.041769 Oct 28 18:07:23.726013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3136/6407] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:23 2022] DELETE /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:23.736337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:23.738804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 8082ed23-cd7a-43e9-b757-1e8773bb1a60] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:23.749634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.750454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.754861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.760333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:23.761113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:23.761877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:23.781224 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 HTTP/1.1 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '8082ed23-cd7a-43e9-b757-1e8773bb1a60'} Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:23.784316 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. Oct 28 18:07:23.790082 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:23.792521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance 8082ed23-cd7a-43e9-b757-1e8773bb1a60 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:23.794267 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df76f4b4-3f5a-452e-8caf-38868099c9df tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60" status: 404 len: 111 microversion: 2.1 time: 0.069988 Oct 28 18:07:23.796205 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3272/6408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:23 2022] GET /compute/v2.1/servers/8082ed23-cd7a-43e9-b757-1e8773bb1a60 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:23.927008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b90f4069-9641-4f74-bc41-517e399ebcdb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: .version_select at 0x7f751f59daf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1486031842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxc1++x+UStwcuuW05J0NTXlKUVINWWyqGgMds88AZg/1T8RBCHrrhNygloaHgJFh3rE0r7uRLPu+5OYOeCAgoyLvgoO2wVwzy1wa/rJwPGFpU8TjAHoHy4Vee8vBviOg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:23.965292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b90f4069-9641-4f74-bc41-517e399ebcdb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:23.971484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b90f4069-9641-4f74-bc41-517e399ebcdb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:24.053660 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b90f4069-9641-4f74-bc41-517e399ebcdb tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.130732 Oct 28 18:07:24.055570 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3137/6409] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:07:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:24.196385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:24.198295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:24.213245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.213676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.214100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.216570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:24.218184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:24.220830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:24.553251 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7761536-84de-4b05-845b-11a74d1ed5f9 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1466 microversion: 2.1 time: 0.356098 Oct 28 18:07:24.569234 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3273/6410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:24 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1466 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:25.599789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:25.609328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:25.622131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.623020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.623919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:25.625171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:25.626031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:25.627102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.049518 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ceca3d61-42ae-4bfd-b88b-d6f4e5f697ef tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1652 microversion: 2.1 time: 0.455380 Oct 28 18:07:26.064133 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3138/6411] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:25 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1652 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:26.080903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.081547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:26.099716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.104231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.105237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.117965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.118584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.119094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.638747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3df9aff7-02b1-4a01-8077-cc243966bd2d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1652 microversion: 2.1 time: 0.547215 Oct 28 18:07:26.640646 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3274/6412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1652 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:26.679393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:26.684773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:26.702662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.704479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.706252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:26.707161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:26.708790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:26.709440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:27.047810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4c09039-7d27-4f54-adde-3ef39a5aa106 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1652 microversion: 2.1 time: 0.372837 Oct 28 18:07:27.068437 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3139/6413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:26 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1652 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:27.332582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-51612709", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "availability_zone": "nova:n-h2-860864-13", "networks": [{"uuid": "54fa19e2-0e1c-416b-aaee-0d9ce8f76afa"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:27.489584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] validate_networks() for [('54fa19e2-0e1c-416b-aaee-0d9ce8f76afa', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:07:28.676325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:07:28.676913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:07:28.677217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:07:28.677630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:07:28.678045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:07:28.713377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.715306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.716083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.719447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:28.720234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:28.722575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:28.766559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Getting quotas for project 8d9e03f0ce4d4491ae3c679be258878e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:07:28.777878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Getting quotas for user 07d9875f57154baaa808a31f56b20333 and project 8d9e03f0ce4d4491ae3c679be258878e. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:07:28.810898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:07:28.816902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:07:28.972033 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d814dce-aca6-4974-baa9-36e74b5937d0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648369 Oct 28 18:07:28.978679 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3275/6414] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:07:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:07:29.004391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f119de6-25e9-412a-aa9d-b4d461b07c3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:29.006357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f119de6-25e9-412a-aa9d-b4d461b07c3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:29.222514 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f119de6-25e9-412a-aa9d-b4d461b07c3d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1327 microversion: 2.1 time: 0.223374 Oct 28 18:07:29.223482 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3140/6415] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:28 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1327 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:30.253419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:30.255140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:30.266344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:30.267224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:30.267971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:30.268922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:30.269776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:30.270414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:30.481533 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d15dacf-bd66-4344-a4fa-f541c7894823 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1336 microversion: 2.1 time: 0.233088 Oct 28 18:07:30.487520 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3276/6416] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:30 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1336 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:31.512947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:31.514244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:31.547913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.548444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.548900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.549721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:31.550194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:31.550640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:31.706867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59931c3c-863d-4c26-b3a0-f3ea6fee61ee tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1422 microversion: 2.1 time: 0.198998 Oct 28 18:07:31.708923 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3141/6417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:31 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1422 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:32.736273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:32.737057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:32.767606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.767606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.768589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:32.769453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:32.774388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:32.776910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:33.252879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a25d1380-7f47-4626-b91c-b8c210b8773f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.520656 Oct 28 18:07:33.272429 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3277/6418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:32 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:34.289023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:34.289937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:34.310564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.311530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.328764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.329777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.330383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.330919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.719262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5eb99a84-ab37-48a8-9ecb-ea4007d87cd2 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.434743 Oct 28 18:07:34.720521 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3142/6419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:34 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:34.784754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770369d5-5629-4caa-a632-ce5b3b21b242", "tag": "16802d9f-804d-4983-a1c8-3abbe75af115"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:34.816856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:34.820429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:34.821060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:34.850550 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] Creating event network-changed:16802d9f-804d-4983-a1c8-3abbe75af115 for instance 770369d5-5629-4caa-a632-ce5b3b21b242 on n-h2-860864-13 Oct 28 18:07:34.864862 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-8af0453a-5024-4b02-a80c-788f6c0d6779 req-647698d4-f791-4e22-b126-f6d3a8efae8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090193 Oct 28 18:07:34.867724 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3278/6420] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:35.743552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:35.745329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:35.755904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.759336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.765476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:35.766669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:35.767396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:35.768081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:36.098334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26923026-990a-4978-bd86-36c98d0bfa8e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.358282 Oct 28 18:07:36.102378 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3143/6421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:35 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:37.130667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:37.131519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:37.166018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.166712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.168245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.177690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:37.179462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:37.187650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:37.573605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bb56c1b-5e0c-4184-a46b-8521afa56407 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.445411 Oct 28 18:07:37.575425 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3279/6422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:37 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:38.598944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:38.605570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:38.623102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.627622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.628303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.629237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:38.629900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:38.630565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:38.983408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d28bac7f-b786-43f2-9f83-c0ddd81c90e1 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.388922 Oct 28 18:07:39.005302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3144/6423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:38 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:40.017726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:40.018575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:40.029692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:40.031490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:40.037928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.039823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.041671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.042470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:40.043993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:40.044642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:40.373769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4eb017aa-213a-4052-ab57-d1282fd94390 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.359955 Oct 28 18:07:40.380388 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3280/6424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:40 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:41.412144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:41.413505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:41.423290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:41.429891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.432937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.433684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.435413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:41.436807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:41.445339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:41.778146 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bfda01cf-7855-4cf2-860f-65825ccc9c06 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.375184 Oct 28 18:07:41.786917 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3145/6425] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:41 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:42.824658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:42.825900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:42.840653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.841385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.842001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.858187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.859575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.860911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.875873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770369d5-5629-4caa-a632-ce5b3b21b242", "name": "network-vif-plugged", "status": "completed", "tag": "16802d9f-804d-4983-a1c8-3abbe75af115"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:42.916534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:42.919182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:42.920561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:42.967528 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] Creating event network-vif-plugged:16802d9f-804d-4983-a1c8-3abbe75af115 for instance 770369d5-5629-4caa-a632-ce5b3b21b242 on n-h2-860864-13 Oct 28 18:07:42.997093 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-be40a525-7c95-497f-bb59-339c67f09c0b req-3a139470-1a1b-4369-8b3e-bf0994afcea3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125178 Oct 28 18:07:43.008699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3146/6426] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:43.199721 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bcb8d6e-a3db-4999-b12f-ea908d3227cd tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.393318 Oct 28 18:07:43.200578 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3281/6427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:42 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:44.227800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:44.228833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:44.252945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.255854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.256427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.259191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:44.260789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:44.263533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:44.477982 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-48a23a23-b3ed-467c-8093-c4ec2adebd7f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1464 microversion: 2.1 time: 0.256827 Oct 28 18:07:44.486591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3147/6428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:44 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:44.831659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d788c431-d920-402b-b2c6-3fb71a3e583b tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-675130992", "availability_zone": "foo_zone"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:44.836201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.aggregate [None req-d788c431-d920-402b-b2c6-3fb71a3e583b tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Generated uuid 8695b7fe-aa87-435b-bd26-36070e2b44c4 for aggregate {{(pid=120567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 18:07:44.902245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d788c431-d920-402b-b2c6-3fb71a3e583b tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.276258 Oct 28 18:07:44.903594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3282/6429] 10.222.0.48 () {60 vars in 1164 bytes} [Fri Oct 28 18:07:44 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:44.917333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5341999-3b4a-40ae-ab57-64bbb27cb716 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:45.028472 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5341999-3b4a-40ae-ab57-64bbb27cb716 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.113875 Oct 28 18:07:45.031597 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3148/6430] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 18:07:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:45.046481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.059581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.060302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.060913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.061824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.062566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.063139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.116545 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-816ca30b-dbdf-4b00-8a96-ec9081928fce tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.076089 Oct 28 18:07:45.117413 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3283/6431] 10.222.0.48 () {58 vars in 1176 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:45.129267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d210652a-49d7-42f6-a840-f334d416d932 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.150172 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d210652a-49d7-42f6-a840-f334d416d932 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019377 Oct 28 18:07:45.163700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb02d402-92c4-41fb-887f-9a49cfe82522 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:45.168420 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3149/6432] 10.222.0.48 () {58 vars in 1143 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:45.179719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb02d402-92c4-41fb-887f-9a49cfe82522 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.180502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb02d402-92c4-41fb-887f-9a49cfe82522 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.180939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb02d402-92c4-41fb-887f-9a49cfe82522 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.503943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.504560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:45.514347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.514857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.515309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.516227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.516758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.517541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.630530 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb02d402-92c4-41fb-887f-9a49cfe82522 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.470492 Oct 28 18:07:45.635467 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3284/6433] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 18:07:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:45.643217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-29eb2d76-0379-4111-86a7-8e015ea117a7 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.683950 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-29eb2d76-0379-4111-86a7-8e015ea117a7 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.043017 Oct 28 18:07:45.687059 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3285/6434] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:45.699782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a22d363-72e4-4b08-9a12-5e27d98b2405 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1062953160", "availability_zone": "foo_zone"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:45.786722 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-25a48786-884d-4c5e-8966-ff9a81be4126 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1649 microversion: 2.1 time: 0.287182 Oct 28 18:07:45.799868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3150/6435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1649 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:45.822893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.826490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:45.837175 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a22d363-72e4-4b08-9a12-5e27d98b2405 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.143176 Oct 28 18:07:45.843860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.844861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.845323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.847598 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3286/6436] 10.222.0.48 () {60 vars in 1173 bytes} [Fri Oct 28 18:07:45 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:45.851088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:45.855766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:45.856250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:45.856497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-58a4e804-fe6a-474d-ac47-d410568e69fa tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:45.917289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-58a4e804-fe6a-474d-ac47-d410568e69fa tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.067855 Oct 28 18:07:45.926080 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3287/6437] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 18:07:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:45.932614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0cfee37b-89dc-4a2d-9d2e-e96beb680cbf tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:45.971361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0cfee37b-89dc-4a2d-9d2e-e96beb680cbf tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.043947 Oct 28 18:07:45.973203 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3288/6438] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:46.003143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6711260c-0157-49d6-8b78-0c23de0f41f3 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-13"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:46.037120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6711260c-0157-49d6-8b78-0c23de0f41f3 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.037120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6711260c-0157-49d6-8b78-0c23de0f41f3 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.037120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6711260c-0157-49d6-8b78-0c23de0f41f3 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.077235 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-530f8eb4-e0fe-4270-8f30-8b9ec8a0c29e tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1653 microversion: 2.1 time: 0.269530 Oct 28 18:07:46.096266 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3151/6439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:45 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1653 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:46.110603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.111229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:46.119658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.120533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.121164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.122052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.122667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.123266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.359456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6711260c-0157-49d6-8b78-0c23de0f41f3 tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.364025 Oct 28 18:07:46.364157 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3289/6440] 10.222.0.48 () {60 vars in 1194 bytes} [Fri Oct 28 18:07:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:07:46.386159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3babd85b-fd4c-4892-ba96-ff7fefe4cf0e tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.423658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:46.444086 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3dce3338-acc1-4431-8634-6ba81e2a9d48 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1653 microversion: 2.1 time: 0.342227 Oct 28 18:07:46.445338 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3152/6441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:46 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1653 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:46.459559 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3babd85b-fd4c-4892-ba96-ff7fefe4cf0e tempest-TestAggregatesBasicOps-933391994 tempest-TestAggregatesBasicOps-933391994-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.086790 Oct 28 18:07:46.460516 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3290/6442] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Oct 28 18:07:46 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 18:07:46.472060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.473196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:46.483232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.484029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.484719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.485714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.486663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.487781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.593738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:07:46.596965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:46.859413 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-09157e03-9c4c-4b87-82af-6bf81d0b27a5 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 204 len: 0 microversion: 2.1 time: 0.390815 Oct 28 18:07:46.860294 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3153/6443] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:46 2022] DELETE /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:46.880720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:46.887165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:46.921338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.923820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.924262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:46.930126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:46.930862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:46.931913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:47.274088 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa8f57ea-dead-41b7-9d82-b43313e63248 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1655 microversion: 2.1 time: 0.405686 Oct 28 18:07:47.288589 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3291/6444] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:46 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1655 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:48.304260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:48.305629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:48.313464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:48.317819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.319813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.320537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.323687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:48.328094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:48.329033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:48.829112 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3d1dc87-3e6c-43cf-a430-392b22a3a1ed tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1655 microversion: 2.1 time: 0.528458 Oct 28 18:07:48.841166 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3154/6445] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:48 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1655 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:49.875077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:49.880239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:49.914226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.914668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.915092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:49.924749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:49.925244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:49.932177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.151027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770369d5-5629-4caa-a632-ce5b3b21b242", "name": "network-vif-deleted", "tag": "16802d9f-804d-4983-a1c8-3abbe75af115"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:50.180193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:50.181855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:50.182708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:50.213899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] Creating event network-vif-deleted:16802d9f-804d-4983-a1c8-3abbe75af115 for instance 770369d5-5629-4caa-a632-ce5b3b21b242 on n-h2-860864-13 Oct 28 18:07:50.235780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-131749c5-46f6-44ee-a4b2-1347b3876300 req-4f5a2484-c5bb-413e-97ad-8e0ebe65335c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090000 Oct 28 18:07:50.242120 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3155/6446] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:50.661289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-80416936-1113-4d92-a924-a5198b153fe0 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 200 len: 1613 microversion: 2.1 time: 0.793266 Oct 28 18:07:50.666106 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3292/6447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:49 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 1613 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:51.693749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.694945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 770369d5-5629-4caa-a632-ce5b3b21b242] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:51.706372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.707136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.707920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.709016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.709556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.710093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.740084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] HTTP exception thrown: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Request method failure captured: Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 HTTP/1.1 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBpN4-4gaK359X3z3PfHollTsP1m4JiOjCiqljALlb_hekKqlijHSR8D8E2VMRosBHApmrDZ-lVCwOSfyXqpSmfkwNTzbR6kkrml_qkqnO2wI8sjj_3_swkRoWaXg39rsusONaMlmdfvn4vSKDo5EDVuwS-_nP7e682vWKM-_86PsH8 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 8d9e03f0ce4d4491ae3c679be258878e Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestServerMultinode-1419038093 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8d9e03f0ce4d4491ae3c679be258878e"}]}] Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestServerMultinode-1419038093 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 8d9e03f0ce4d4491ae3c679be258878e Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestServerMultinode-1419038093 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestServerMultinode-1419038093-project-admin Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 07d9875f57154baaa808a31f56b20333 Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestServerMultinode-1419038093-project-admin Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '770369d5-5629-4caa-a632-ce5b3b21b242'} Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:51.742652 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. Oct 28 18:07:51.747803 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:07:51.751101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Returning 404 to user: Instance 770369d5-5629-4caa-a632-ce5b3b21b242 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:51.752261 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-093cecb3-ed7a-401f-af3f-447696ee062f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242" status: 404 len: 111 microversion: 2.1 time: 0.069245 Oct 28 18:07:51.756776 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3156/6448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:51 2022] GET /compute/v2.1/servers/770369d5-5629-4caa-a632-ce5b3b21b242 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:51.762455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:51.763105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:51.777422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.778539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.780043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.782309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:51.783847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:51.784517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:51.987725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:07:52.244291 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-add0bb6b-c0bc-4322-909c-63031f3f5825 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 204 len: 0 microversion: 2.1 time: 0.485192 Oct 28 18:07:52.254304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:52.254937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:52.258224 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3293/6449] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:07:51 2022] DELETE /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:07:52.262304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.262878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.263542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.264324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:52.264820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:52.265861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:52.705853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cfd8c11a-48eb-4f16-aa32-9acd60c37e13 tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1658 microversion: 2.1 time: 0.451479 Oct 28 18:07:52.707736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3157/6450] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:52 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1658 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:07:53.746376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:53.748089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:53.764803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.765834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.767617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.768734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:53.769997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:53.770775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:53.775171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:54.068225 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7756126c-542f-4da2-aa5b-a9af3b24e26d tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1658 microversion: 2.1 time: 0.328020 Oct 28 18:07:54.069083 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3294/6451] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:53 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1658 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:55.093137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:55.093772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:55.103487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85087d82-8363-4e8d-8fe1-5fab41144099", "name": "network-vif-deleted", "tag": "21b6dd1c-5a12-41f1-81b1-ea386fac85a5"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:07:55.116878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.117840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.119086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:07:55.119576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.121632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.122237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.123140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.124351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:55.126418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:55.128539 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:55.161861 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] Creating event network-vif-deleted:21b6dd1c-5a12-41f1-81b1-ea386fac85a5 for instance 85087d82-8363-4e8d-8fe1-5fab41144099 on n-h1-860864-13 Oct 28 18:07:55.172601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7647f79d-cc18-4b8c-ba30-5c864ddf5e44 req-42710e89-09be-4c43-8ba8-d8523a007baf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071964 Oct 28 18:07:55.174839 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3295/6452] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:07:55.256836 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-97bce6c4-6c11-4c6d-a85b-02204654742f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 200 len: 1616 microversion: 2.1 time: 0.167762 Oct 28 18:07:55.257730 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3158/6453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:55 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 1616 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:07:56.281717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:56.282420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] [instance: 85087d82-8363-4e8d-8fe1-5fab41144099] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:56.292622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.294029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.294657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.295664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:56.296700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:56.297668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:56.320942 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] HTTP exception thrown: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Request method failure captured: Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 HTTP/1.1 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBpN4-4gaK359X3z3PfHollTsP1m4JiOjCiqljALlb_hekKqlijHSR8D8E2VMRosBHApmrDZ-lVCwOSfyXqpSmfkwNTzbR6kkrml_qkqnO2wI8sjj_3_swkRoWaXg39rsusONaMlmdfvn4vSKDo5EDVuwS-_nP7e682vWKM-_86PsH8 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 8d9e03f0ce4d4491ae3c679be258878e Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestServerMultinode-1419038093 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8d9e03f0ce4d4491ae3c679be258878e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8d9e03f0ce4d4491ae3c679be258878e"}]}] Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestServerMultinode-1419038093 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 8d9e03f0ce4d4491ae3c679be258878e Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestServerMultinode-1419038093 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestServerMultinode-1419038093-project-admin Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 07d9875f57154baaa808a31f56b20333 Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestServerMultinode-1419038093-project-admin Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '85087d82-8363-4e8d-8fe1-5fab41144099'} Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:07:56.325028 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] Returning 404 to user: Instance 85087d82-8363-4e8d-8fe1-5fab41144099 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3da17ae0-67a7-45f3-826f-3c589e57c96f tempest-TestServerMultinode-1419038093 tempest-TestServerMultinode-1419038093-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099" status: 404 len: 111 microversion: 2.1 time: 0.048972 Oct 28 18:07:56.330130 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3296/6454] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:07:56 2022] GET /compute/v2.1/servers/85087d82-8363-4e8d-8fe1-5fab41144099 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:07:57.238060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:07:57.244809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:07:57.267090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.267997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.268516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.269276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:07:57.269745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:07:57.270383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:07:57.354324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a91b5f4-a694-4977-8043-1f94ecabbf8c tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/ips" status: 200 len: 151 microversion: 2.1 time: 0.127124 Oct 28 18:07:57.362818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3159/6455] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Oct 28 18:07:57 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:01.466630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb77529a-5057-48bf-8e45-0f963ffe51bd"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:01.471146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:01.492640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.495026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.496442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:01.497995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:01.499943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:01.500861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:02.015060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69eedeaa-2f6b-4dee-bd3b-19c420d22156 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "POST /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552040 Oct 28 18:08:02.032351 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3297/6456] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:08:01 2022] POST /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:08:07.136934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2054551182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1486031842", "security_groups": [{"name": "tempest-secgroup-smoke-667960096"}], "block_device_mapping_v2": [{"uuid": "7e8389f0-1418-4471-9681-a0d07e72884d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:07.328333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:07.414817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:08.488087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:08.488672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:08.489002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:08.489431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:08.489857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:08.509600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.510381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.511089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.512049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:08.512705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:08.513313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:08.554376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:08.565437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:08.710677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:08.713418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e8389f0-1418-4471-9681-a0d07e72884d',volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:09.015925 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1ad5eb5d-24d3-428f-a570-bc97c1f545cf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.885447 Oct 28 18:08:09.032535 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3160/6457] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:08:09.059635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1f5ffe3-463e-4952-a591-40529d796dff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:09.061052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1f5ffe3-463e-4952-a591-40529d796dff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:09.167132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1f5ffe3-463e-4952-a591-40529d796dff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:09.174474 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1f5ffe3-463e-4952-a591-40529d796dff tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1095 microversion: 2.1 time: 0.120795 Oct 28 18:08:09.178690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3298/6458] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:09 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:10.205162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:10.206446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:10.252282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.253198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.253933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.255616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:10.259010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:10.259815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:10.432806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:10.443634 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-116a67b9-72c4-4ae9-a664-e727b333e975 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1193 microversion: 2.1 time: 0.246450 Oct 28 18:08:10.452762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3161/6459] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:10 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1193 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:11.484357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:11.484966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:11.500489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.500994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.505263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.506284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:11.506785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:11.512196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:11.598204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:11.611688 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0bbfeab9-bca7-4409-9e1f-4919d48a07ee tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1211 microversion: 2.1 time: 0.132042 Oct 28 18:08:11.613212 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3299/6460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:11 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:12.635952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:12.637563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:12.655837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.656528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.657405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.658325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:12.660688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:12.661321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:12.936432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:12.945519 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-571c478d-ef63-4353-9685-ee79e4b55ee5 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1278 microversion: 2.1 time: 0.314261 Oct 28 18:08:12.946865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3162/6461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:12 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:13.970875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:13.972526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:13.990616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1336a16-61d0-4aa0-8307-408f0f4b062f", "tag": "85a478a5-a7f7-41c8-b1e8-b69fad9bf91d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:14.022622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.026201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.033507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.034563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.035223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.035924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.040257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:14.041444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:14.045407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:14.119929 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] Creating event network-changed:85a478a5-a7f7-41c8-b1e8-b69fad9bf91d for instance a1336a16-61d0-4aa0-8307-408f0f4b062f on n-h2-860864-13 Oct 28 18:08:14.172480 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c0856885-2a17-49af-a3a9-50f4a54596f3 req-a51a0d7a-acf0-4b25-a352-8baebfd70a07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194073 Oct 28 18:08:14.178397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3163/6462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:14.398351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:14.409273 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d48ce7a5-ce62-4e6b-878f-7b588b472acd tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1278 microversion: 2.1 time: 0.443742 Oct 28 18:08:14.410657 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3300/6463] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:13 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1278 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:15.438586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:15.439945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:15.447655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.448459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.449119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:15.450174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:15.451004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:15.451649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:16.003778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:16.012655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12611d78-adbb-47c5-8292-ce6b5fc2a823 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1278 microversion: 2.1 time: 0.579064 Oct 28 18:08:16.013322 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3164/6464] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:15 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1278 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:17.039251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:17.041444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:17.060986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:17.069801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.070299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.071610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.074687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:17.079587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:17.080192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:17.307674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:17.335622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f6eac3b-eadb-4280-ad85-f8dccc94cd76 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1278 microversion: 2.1 time: 0.303390 Oct 28 18:08:17.336478 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3301/6465] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:17 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:18.386356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:18.387539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:18.397620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.398263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.399054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.400483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:18.401231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:18.401885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:18.538408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:18.586291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:18.609743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:18.619899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5de5f615-ec87-4a02-a9ac-eff829a1641d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1278 microversion: 2.1 time: 0.244591 Oct 28 18:08:18.620620 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3165/6466] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:18 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:19.644155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:19.644675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:19.647919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:19.654815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.655329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.655788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.656478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:19.656937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:19.657350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:19.793586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:19.801591 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-342bde8e-8383-40f8-9047-0f52af581fa7 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.161402 Oct 28 18:08:19.802171 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3302/6467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:19 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:20.099725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.100296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:20.103786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:20.109301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.109804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.110264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.110990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.111465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.111910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.193657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lazy-loading 'services' on Instance uuid 7f97b2d5-73bb-4c44-944e-c46df2b50595 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:08:20.266372 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2587c15-fa46-47a1-aea0-d41f2a588d7d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments/cb77529a-5057-48bf-8e45-0f963ffe51bd" status: 202 len: 0 microversion: 2.1 time: 0.170710 Oct 28 18:08:20.267145 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3166/6468] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:08:20 2022] DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments/cb77529a-5057-48bf-8e45-0f963ffe51bd => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:20.276177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.278495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:20.285873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.286370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.286813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.287717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.288186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.288627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.324488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6fecbd4a-9f96-4ccf-9d9e-6cf687d10829 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053167 Oct 28 18:08:20.329596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3303/6469] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:20.826844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:20.827608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:20.839835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.840600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.841044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.841759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:20.842220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:20.842657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:20.995838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:21.004119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cdb67459-9667-436a-9d1f-4625703cfa35 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.181695 Oct 28 18:08:21.004887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3167/6470] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:20 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:21.337681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:21.340037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:21.347463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.347991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.348438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.349143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:21.349600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:21.350145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:21.386351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c0af6d3-c49f-4983-875b-ef13f4575c5e tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052806 Oct 28 18:08:21.386941 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3304/6471] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:21 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:22.027665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.030076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:22.036990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.047644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.048191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.048957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.049437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.049872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.205240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:22.215707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e443d32d-6300-4c00-bc65-6c7a9707a217 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.191700 Oct 28 18:08:22.216528 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3168/6472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:22.398490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:22.400845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:22.408362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.409245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.409686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.410404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:22.410857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:22.411279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:22.444352 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e91fe1a2-c2ed-4f22-beff-4b22e5b29911 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049982 Oct 28 18:08:22.449766 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3305/6473] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:22 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:23.240108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:23.240734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:23.249008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.249491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.250141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.250802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.251265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.251725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.417166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:23.425477 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f04d996-d2fd-405b-9b9b-3a9dfd22d381 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.189512 Oct 28 18:08:23.426069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3169/6474] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:23 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:23.457835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:23.460266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:23.468178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.468751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.469258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.470027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:23.470588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:23.471086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:23.504008 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-43718e53-7b68-4e53-b342-daf01d547abb tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050197 Oct 28 18:08:23.506733 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3306/6475] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:23 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:24.448079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:24.448783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:24.456957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.457599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.458122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.458929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.459663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.460360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.516971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:24.519751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:24.529296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.530043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.530789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.532047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:24.533146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:24.533742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:24.538471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:24.581171 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-198392be-bc23-464e-bb4f-fb6f86b2159d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068127 Oct 28 18:08:24.581770 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3307/6476] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:24 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:08:24.625038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:24.634757 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e90e308-a917-4c7a-8d2f-22d41a566d80 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.190547 Oct 28 18:08:24.635463 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3170/6477] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:24 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:25.593747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:25.596010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:25.604019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.604505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.604942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.605851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.606097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.606515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.636308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ce0c1de5-9289-4cae-8b8b-37edc1e38e58 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046597 Oct 28 18:08:25.636888 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3308/6478] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:08:25 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:08:25.657994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:25.658880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:25.666856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.667693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.668126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.668940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.669494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.670000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.703894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:25.704382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:25.710546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.711084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.711544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.712246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.712701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.713129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.740096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:08:25.843180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:25.845635 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dcbeead4-978f-4fe8-8ffb-e05b4fdc8e87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 204 len: 0 microversion: 2.1 time: 0.145263 Oct 28 18:08:25.846423 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3309/6479] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:25 2022] DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:08:25.856039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0deeffe-fc28-4087-b865-bf91c98bdabf tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.201845 Oct 28 18:08:25.857297 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3171/6480] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:25 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:25.857436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:25.858123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:25.864608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.865096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.865527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:25.866234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:25.866683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:25.867103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.184209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:26.192301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a2a6f3f-4d9c-4d04-a7b7-bcdfcfc33a5b tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1682 microversion: 2.1 time: 0.340608 Oct 28 18:08:26.192963 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3310/6481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:25 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1682 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:26.880157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:26.881353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:26.889481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.889980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.890424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:26.891131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:26.891616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:26.892050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:27.052147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:27.062562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-280de8fc-2af8-484c-990f-2b2f97cc08da tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.186485 Oct 28 18:08:27.068897 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3172/6482] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:26 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:27.217866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:27.219203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:27.227728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:27.228228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:27.228663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:27.229379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:27.229838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:27.230265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:27.381472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:27.389570 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4243ef04-b6a2-4857-98ed-fa2fbb8a1f0d tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1682 microversion: 2.1 time: 0.176206 Oct 28 18:08:27.390146 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3311/6483] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:27 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:28.086856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:28.087533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:28.094995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:28.095616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:28.096136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:28.098896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:28.099553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:28.100257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:28.345096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:28.354450 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-35b06c72-b8f5-43de-a72e-61498baa84c4 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.272135 Oct 28 18:08:28.355968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3173/6484] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:28 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:28.414412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:28.415569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:28.423619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:28.424353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:28.424949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:28.425835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:28.426457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:28.427049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:28.474267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f97b2d5-73bb-4c44-944e-c46df2b50595", "name": "network-vif-deleted", "tag": "032fc75a-c5f3-4ddf-a5e3-f244627c4c1a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:28.496960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:28.497367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:28.498118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:28.524912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] Creating event network-vif-deleted:032fc75a-c5f3-4ddf-a5e3-f244627c4c1a for instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 on n-h1-860864-13 Oct 28 18:08:28.550671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9f551617-251c-4908-8a65-f7a012fdb6eb req-96bb0bfa-56ad-45ed-8ed9-112f5c616911 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080212 Oct 28 18:08:28.559531 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3174/6485] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:08:28.573496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5586b74590494f840a5644df401ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7356b6f95fe4f0c9c6cbaf02cbe3522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:28.582987 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a9c51907-e3e2-406f-b38c-8148d30458d1 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 200 len: 1616 microversion: 2.1 time: 0.173536 Oct 28 18:08:28.583620 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3312/6486] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:28 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 1616 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:28.998257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1336a16-61d0-4aa0-8307-408f0f4b062f", "name": "network-vif-plugged", "status": "completed", "tag": "85a478a5-a7f7-41c8-b1e8-b69fad9bf91d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:29.010260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:29.011155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:29.011879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:29.031414 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] Creating event network-vif-plugged:85a478a5-a7f7-41c8-b1e8-b69fad9bf91d for instance a1336a16-61d0-4aa0-8307-408f0f4b062f on n-h2-860864-13 Oct 28 18:08:29.050252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f57a05d5-beba-4267-93aa-013bca2351fb req-78911c0a-7923-40f0-b6e0-f0d05e4ba91d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054136 Oct 28 18:08:29.051640 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3175/6487] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:29.378202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:29.378954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:29.385788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:29.386360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:29.386931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:29.387813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:29.388390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:29.388885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:29.547987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:29.557358 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-084a2c2b-09e3-4d7a-a9b4-7ec18faecbf0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1266 microversion: 2.1 time: 0.182950 Oct 28 18:08:29.558043 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3313/6488] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:29 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:29.609501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:29.610218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:29.616891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:29.617470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:29.618220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:29.618969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:29.619540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:29.619982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:29.635019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 HTTP/1.1 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7f97b2d5-73bb-4c44-944e-c46df2b50595'} Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:29.637351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f87bd200-0c25-4d24-882c-f99063bb3c9a tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 404 len: 111 microversion: 2.1 time: 0.034595 Oct 28 18:08:29.642294 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3176/6489] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:29 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:29.649957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c0d2de3e-3641-41ec-8d14-baf00fe92262 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '.version_select at 0x7f751eecddc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:29.671374 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c0d2de3e-3641-41ec-8d14-baf00fe92262 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130940338" status: 202 len: 0 microversion: 2.1 time: 0.027014 Oct 28 18:08:29.672398 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3314/6490] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 18:08:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130940338 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:08:30.581079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:30.581980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:30.588337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:30.589058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:30.589512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:30.590223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:30.590688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:30.591122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:30.732330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:30.740361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-170fafe5-db5e-4078-b45b-931705024be1 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1453 microversion: 2.1 time: 0.163454 Oct 28 18:08:30.740879 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3177/6491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:30 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:30.764699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:30.765310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:30.772255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:30.772733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:30.773165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:30.773878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:30.774356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:30.774776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:30.912694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:30.922223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2161029-ab5a-49a4-8106-df18972fe1a0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1453 microversion: 2.1 time: 0.162554 Oct 28 18:08:30.923206 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3315/6492] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:30 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:32.749904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1336a16-61d0-4aa0-8307-408f0f4b062f", "tag": "85a478a5-a7f7-41c8-b1e8-b69fad9bf91d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:32.762975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:32.763484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:32.763932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:32.787726 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] Creating event network-changed:85a478a5-a7f7-41c8-b1e8-b69fad9bf91d for instance a1336a16-61d0-4aa0-8307-408f0f4b062f on n-h2-860864-13 Oct 28 18:08:32.810275 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-932f9013-0734-4b42-96ef-3bdb9b582b98 req-1303dba0-8b70-4760-8eb1-c5bc44c6bd23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055190 Oct 28 18:08:32.815623 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3178/6493] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:34.704571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:34.705078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:34.712516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.712998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.713438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.714136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.714592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.715013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.730578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 HTTP/1.1 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7f97b2d5-73bb-4c44-944e-c46df2b50595'} Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:34.732306 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:34.736984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-613b58f0-2cdc-4d67-a812-593ab3a01569 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 404 len: 111 microversion: 2.1 time: 0.033422 Oct 28 18:08:34.743458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3316/6494] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:34 2022] DELETE /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:34.744663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:34.745384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7f97b2d5-73bb-4c44-944e-c46df2b50595] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:34.751784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.752282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.752726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.753437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:34.753898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:34.754332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:34.768302 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 HTTP/1.1 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7f97b2d5-73bb-4c44-944e-c46df2b50595'} Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:34.769999 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7f97b2d5-73bb-4c44-944e-c46df2b50595 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:34.775138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ecafc22f-40c3-4e05-82d6-df87877bd0f6 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595" status: 404 len: 111 microversion: 2.1 time: 0.032720 Oct 28 18:08:34.777184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3179/6495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:34 2022] GET /compute/v2.1/servers/7f97b2d5-73bb-4c44-944e-c46df2b50595 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:38.749182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-497963411", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e504491c-e40c-4896-9276-358d3da4815b"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:38.806067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] validate_networks() for [('e504491c-e40c-4896-9276-358d3da4815b', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:08:39.172044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:08:39.172679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:08:39.173386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:08:39.174176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:08:39.174770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:08:39.176540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.177231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:39.187010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.187281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.187967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.188118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.188634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.189383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.189758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.189884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.190264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.190962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.191687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.192313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.194307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:39.208159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 HTTP/1.1 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7e45b8a1-808e-4995-8a08-24c7224629e1'} Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:39.209824 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34ee0c1c-3a05-4df3-8737-ecffbc65c2fc tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 404 len: 111 microversion: 2.1 time: 0.039647 Oct 28 18:08:39.214898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3180/6496] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:39 2022] DELETE /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:39.220408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.220968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Getting quotas for project 91358b72b26649a0aa10f32e5df29ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:08:39.221119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 7e45b8a1-808e-4995-8a08-24c7224629e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:39.228214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Getting quotas for user a660b6d39b4d484190f3ed87f8815ac7 and project 91358b72b26649a0aa10f32e5df29ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:08:39.229317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.229822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.230255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.230964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.231603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.232029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.244945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:08:39.247708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:08:39.247995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 HTTP/1.1 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7e45b8a1-808e-4995-8a08-24c7224629e1'} Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.249694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 7e45b8a1-808e-4995-8a08-24c7224629e1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a0730ebb-3f16-4577-aefd-215377b6a5fd tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1" status: 404 len: 111 microversion: 2.1 time: 0.034569 Oct 28 18:08:39.253925 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3181/6497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/servers/7e45b8a1-808e-4995-8a08-24c7224629e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:08:39.263181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.263701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:39.270358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.270846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.271287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.272022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.272483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.272952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.287790 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 HTTP/1.1 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'de7264c0-9849-4d14-aaa1-87d878eaf8e1'} Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:39.290674 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9958457-7619-4509-b59a-977cae6ab731 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 404 len: 111 microversion: 2.1 time: 0.032731 Oct 28 18:08:39.294656 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3182/6498] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:39 2022] DELETE /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:39.300105 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa139730-d766-42cd-a1e6-1356dce8f1a1 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554683 Oct 28 18:08:39.303656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.304896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: de7264c0-9849-4d14-aaa1-87d878eaf8e1] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:39.307972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3317/6499] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:08:39.312162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.312658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.313109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.313665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3ea16b5-6539-482b-9689-b2864358e50a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:39.313807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:39.314284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3ea16b5-6539-482b-9689-b2864358e50a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:39.314645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:39.315236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:39.335889 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 HTTP/1.1 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'de7264c0-9849-4d14-aaa1-87d878eaf8e1'} Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:39.338284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. Oct 28 18:08:39.343001 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:39.344054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance de7264c0-9849-4d14-aaa1-87d878eaf8e1 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:39.345346 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-627d5bc2-b759-4d90-97c3-b0e5295dff87 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1" status: 404 len: 111 microversion: 2.1 time: 0.045151 Oct 28 18:08:39.349135 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3183/6500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/servers/de7264c0-9849-4d14-aaa1-87d878eaf8e1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:08:39.404389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3ea16b5-6539-482b-9689-b2864358e50a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:39.412005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3ea16b5-6539-482b-9689-b2864358e50a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1218 microversion: 2.1 time: 0.102345 Oct 28 18:08:39.412660 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3318/6501] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:39 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:40.436537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:40.438025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:40.446608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:40.447619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:40.448313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:40.449389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:40.450074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:40.450731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:40.874434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:40.882739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c50c290-6ebf-4ad9-89ff-8085fa79601e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1278 microversion: 2.1 time: 0.450079 Oct 28 18:08:40.883956 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3184/6502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:40 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1278 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:41.910283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:41.910952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:41.930738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.931234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.931745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:41.932764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:41.933059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:41.933552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.207656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:42.218035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-171c8e40-8d24-4ce4-972a-3291be9b326e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.311685 Oct 28 18:08:42.218734 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3319/6503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:41 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:42.428209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320015a0-a2e6-4215-9e6f-48356657e088", "tag": "abf42f35-724a-40e3-bde4-fff575529649"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:42.444062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.445580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.446552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.461962 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] Creating event network-changed:abf42f35-724a-40e3-bde4-fff575529649 for instance 320015a0-a2e6-4215-9e6f-48356657e088 on n-h1-860864-13 Oct 28 18:08:42.468318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e5ded205-c40f-4de6-9f2a-27ffa0242a44 req-62c8a6ed-544a-4316-b993-2688c833fc12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044794 Oct 28 18:08:42.469556 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3185/6504] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:08:42.708368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:42.709185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:42.715633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.716667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.717482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.718428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.719090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.719776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.736009 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 HTTP/1.1 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '96def022-6b43-4c72-ad96-998cada6c668'} Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:42.738301 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.742684 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.744927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:42.745988 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f23c69b3-3f0e-49ca-ae11-7418ac313343 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 404 len: 111 microversion: 2.1 time: 0.041947 Oct 28 18:08:42.746758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3320/6505] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:08:42 2022] DELETE /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:42.755282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:42.756060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] [instance: 96def022-6b43-4c72-ad96-998cada6c668] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:42.764743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.765250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.765705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.766438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:42.766906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:42.767347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:42.785180 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] HTTP exception thrown: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Request method failure captured: Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 HTTP/1.1 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBiq05E-OTPFwkT2fHZXbYq6tNw5Tq5DKkv5JLBdMx8d5_dOd9c8Qh-Ep1Cnfa4sSV63hoWd8vq8KfdMC_HQo98zNNGlf6D72kfbQJyoSJscL-mpwfBbXlmPhgEk53--rbDJE0YjDXvVKpYPi6qOt0z0gMi_VBoRsdzpTGNKalYCH8k Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7356b6f95fe4f0c9c6cbaf02cbe3522"}]}] Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: c7356b6f95fe4f0c9c6cbaf02cbe3522 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1795951396 Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7e5586b74590494f840a5644df401ddd Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-AttachVolumeNegativeTest-1795951396-project Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '96def022-6b43-4c72-ad96-998cada6c668'} Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:08:42.787299 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. Oct 28 18:08:42.791801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:08:42.794016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] Returning 404 to user: Instance 96def022-6b43-4c72-ad96-998cada6c668 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:08:42.795320 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-38af5064-2baf-4f82-bb10-7155237a6f13 tempest-AttachVolumeNegativeTest-1795951396 tempest-AttachVolumeNegativeTest-1795951396-project] 10.222.0.48 "GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668" status: 404 len: 111 microversion: 2.1 time: 0.044321 Oct 28 18:08:42.796565 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3186/6506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:42 2022] GET /compute/v2.1/servers/96def022-6b43-4c72-ad96-998cada6c668 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:08:43.243572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:43.244155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:43.251004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.251743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.252403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.253173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:43.253704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:43.254199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:43.473543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:43.482258 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e11e191-9656-49ca-859f-e07143adbfd4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.243551 Oct 28 18:08:43.482820 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3321/6507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:43 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:44.506267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:44.506999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:44.517097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.517694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.518579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.519499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:44.520123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:44.520633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:44.748776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:44.758532 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c68b9a8-edb8-4fea-8e4a-528fcd524a85 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.256241 Oct 28 18:08:44.772430 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3187/6508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:44 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:45.785213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:45.787204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:45.794523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.795034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.795506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:45.796228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:45.796768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:45.797365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:46.146300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:46.155211 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4274b212-6a52-495b-9b70-857b78a8de74 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.376321 Oct 28 18:08:46.155944 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3322/6509] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:45 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:47.156668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320015a0-a2e6-4215-9e6f-48356657e088", "name": "network-vif-plugged", "status": "completed", "tag": "abf42f35-724a-40e3-bde4-fff575529649"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:08:47.169668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.170385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.170841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.180940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:47.181562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:47.187607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:47.191073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.198305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.198823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.200079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:47.200552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:47.201458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:47.211355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] Creating event network-vif-plugged:abf42f35-724a-40e3-bde4-fff575529649 for instance 320015a0-a2e6-4215-9e6f-48356657e088 on n-h1-860864-13 Oct 28 18:08:47.224376 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0a7853f2-3ca0-45f6-9a17-a7f1ed328f55 req-cd5aed95-35c5-4392-bbe4-2b1b7799e30b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071321 Oct 28 18:08:47.225016 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3188/6510] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:08:47.422103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:47.436876 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcc76c2d-35b4-458a-8307-6de9cd20c036 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.262013 Oct 28 18:08:47.437549 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3323/6511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:47 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:08:48.462507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:48.463249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:48.469876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.470375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.470826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.471815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:48.472277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:48.472717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:48.614427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:48.622439 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b6c7b5c-3071-4579-8793-02a93c479b8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1318 microversion: 2.1 time: 0.165881 Oct 28 18:08:48.623166 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3189/6512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:48 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:08:49.645685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:08:49.646314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:08:49.649742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:49.650425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:08:49.656504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:49.656923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:49.657358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:49.658048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:08:49.658497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:08:49.658916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:08:49.794996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:08:49.803596 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-26b761f1-7270-4fe5-b658-c62d1f03d4eb tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1506 microversion: 2.1 time: 0.161759 Oct 28 18:08:49.805180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3324/6513] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:08:49 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:07.528910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aeed25f-c882-447c-8226-04e4b6d0950e", "device": "/dev/sdb"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:07.532007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:07.534804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=47 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:07.535575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=31 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:07.542146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.542710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.543160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.543934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:07.544469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:07.544904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:07.864820 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a74b80c-17e4-45dc-bb46-3e7bb6108dc3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "POST /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340117 Oct 28 18:09:07.866508 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3190/6514] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:09:07 2022] POST /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:33.167258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:33.168415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:33.174407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:33.175587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:33.177441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.179315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.180338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.181178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:33.181672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:33.182245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:33.292807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lazy-loading 'services' on Instance uuid 320015a0-a2e6-4215-9e6f-48356657e088 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:33.402457 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-55ffcfbd-33b1-4f50-a13c-49a255cb2a9d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "DELETE /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088/os-volume_attachments/4aeed25f-c882-447c-8226-04e4b6d0950e" status: 202 len: 0 microversion: 2.1 time: 0.238850 Oct 28 18:09:33.408015 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3325/6515] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:09:33 2022] DELETE /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088/os-volume_attachments/4aeed25f-c882-447c-8226-04e4b6d0950e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:09:38.946674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:38.948033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:09:38.953183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:38.954039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:38.964120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.964924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.965641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:38.966615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:38.967319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:38.968130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.000314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:09:39.116524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15c63b46-e76c-4fab-8a22-060eed320aaf tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "DELETE /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 204 len: 0 microversion: 2.1 time: 0.168801 Oct 28 18:09:39.117352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3191/6516] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:09:38 2022] DELETE /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:09:39.124734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:39.125731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:39.133493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.133988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.134427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.135127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:39.135602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:39.136025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:39.344864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:39.353515 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae1bd422-58ca-4962-9089-07edd2244943 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1512 microversion: 2.1 time: 0.234586 Oct 28 18:09:39.354201 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3326/6517] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:39 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:40.377315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:40.378120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:40.386205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.386771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.387284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.388077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:40.388613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:40.389112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:40.526837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:40.535060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b65ea56-ffbe-47a5-b6a8-6aa1cf67ca47 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1512 microversion: 2.1 time: 0.161941 Oct 28 18:09:40.535890 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3192/6518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:40 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:41.291004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320015a0-a2e6-4215-9e6f-48356657e088", "name": "network-vif-deleted", "tag": "abf42f35-724a-40e3-bde4-fff575529649"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:41.313489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.316703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.318113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.336745 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] Creating event network-vif-deleted:abf42f35-724a-40e3-bde4-fff575529649 for instance 320015a0-a2e6-4215-9e6f-48356657e088 on n-h1-860864-13 Oct 28 18:09:41.342481 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-844f454f-69c9-471d-b515-cd9a3876d781 req-a91cc46c-ae1f-4f88-b2a1-fbfe864317b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055344 Oct 28 18:09:41.343090 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3327/6519] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:41.560384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:41.561045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:41.568279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.568773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.569424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.570306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.570945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.571410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.609657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:41.610669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:41.610669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:41.611034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lazy-loading 'fault' on Instance uuid 320015a0-a2e6-4215-9e6f-48356657e088 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:09:41.661357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:41.672780 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1df67561-19ce-41cf-a7e9-3a77bf031d8b tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 200 len: 1308 microversion: 2.1 time: 0.115843 Oct 28 18:09:41.674149 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3193/6520] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:41 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:42.700285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:42.701089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: 320015a0-a2e6-4215-9e6f-48356657e088] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:42.709970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.710685 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.711286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.713104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:42.714370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:42.714813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:42.731747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] HTTP exception thrown: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Request method failure captured: Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 HTTP/1.1 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXBpQgswOjwredttwgacZXPmPwpVV-nNe4iUai9EJhDzQ02GhucGUt3G2WhMumVFZ2t0NLYHCFeLryPvr_9KxcnAcLkS5p_we_xneFhvqwstdEKEID9_ywnxnARJ44y_h-mOlvNrG4rRS_iGq-a8cGEo5M-UjfUwrPCK70_2dqCadtUk Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 91358b72b26649a0aa10f32e5df29ef9 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91358b72b26649a0aa10f32e5df29ef9"}]}] Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 91358b72b26649a0aa10f32e5df29ef9 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-VolumesSnapshotTestJSON-239773439-project Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a660b6d39b4d484190f3ed87f8815ac7 Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-VolumesSnapshotTestJSON-239773439-project Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '320015a0-a2e6-4215-9e6f-48356657e088'} Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:09:42.735579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Returning 404 to user: Instance 320015a0-a2e6-4215-9e6f-48356657e088 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:09:42.741568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9eef2d79-2090-48a2-8496-74e6d25181e4 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088" status: 404 len: 111 microversion: 2.1 time: 0.042790 Oct 28 18:09:42.743450 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3328/6521] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:42 2022] GET /compute/v2.1/servers/320015a0-a2e6-4215-9e6f-48356657e088 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:09:49.673610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-276277565", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e504491c-e40c-4896-9276-358d3da4815b"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:49.731182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] validate_networks() for [('e504491c-e40c-4896-9276-358d3da4815b', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:09:50.296994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:09:50.297446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:09:50.298586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:09:50.299069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:09:50.299534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:09:50.309503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:50.310030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:50.310478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:50.311219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:50.311934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:50.312438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:50.332228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Getting quotas for project 91358b72b26649a0aa10f32e5df29ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:09:50.338717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Getting quotas for user a660b6d39b4d484190f3ed87f8815ac7 and project 91358b72b26649a0aa10f32e5df29ef9. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:09:50.354818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:09:50.357292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:09:50.415628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20a56ca0-9b89-40ef-8802-6ee5d8c7898a tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745841 Oct 28 18:09:50.416305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3194/6522] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:09:50.428581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b447101-2e61-4230-83d4-37e7ca4c0dd8 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:50.429192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b447101-2e61-4230-83d4-37e7ca4c0dd8 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:50.511273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b447101-2e61-4230-83d4-37e7ca4c0dd8 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:50.520944 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b447101-2e61-4230-83d4-37e7ca4c0dd8 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1218 microversion: 2.1 time: 0.096735 Oct 28 18:09:50.522477 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3329/6523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:50 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:51.547201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:51.548167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:51.559278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.560111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.560746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.562252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:51.563584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:51.564059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:51.630653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:51.639613 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ec0054c-e421-4057-b548-032aaf906d5d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1270 microversion: 2.1 time: 0.097104 Oct 28 18:09:51.640587 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3195/6524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:51 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:52.663801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:52.664562 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:52.672686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.673180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.673624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.674336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:52.674791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:52.675221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:52.940518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:52.949656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dccacab-6f09-4f65-adca-ce82f274accc tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1276 microversion: 2.1 time: 0.289935 Oct 28 18:09:52.950243 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3330/6525] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:52 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:53.973888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:53.975379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:53.982789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:53.983424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:53.984150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:53.985073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:53.985566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:53.985973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.302654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:54.310594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-042af68c-cd61-4dc7-a8f2-3555cd9b9c1f tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.341555 Oct 28 18:09:54.323874 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3196/6526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:53 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:54.548967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db93637d-9ca5-4ea6-ac32-efd9ff8ca312", "tag": "dc73dfbd-920e-4e34-a720-dd29d363a297"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:54.564216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:54.565063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:54.565757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:54.579361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] Creating event network-changed:dc73dfbd-920e-4e34-a720-dd29d363a297 for instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 on n-h1-860864-13 Oct 28 18:09:54.587548 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b8b4015d-32cd-42c1-ad3d-03530cec203a req-eb9bddf1-5d14-43c4-aa88-76166741bca9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042720 Oct 28 18:09:54.588441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3331/6527] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:09:55.335315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:55.336071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:55.343624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:55.344597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:55.345230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:55.346216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:55.346690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:55.347284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:55.491653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:55.500327 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b6b9c7f8-61f6-438f-9398-195043d3b35d tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.169747 Oct 28 18:09:55.501031 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3197/6528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:55 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:56.526009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:56.527478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:56.537081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.537690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.538132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.538839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:56.539289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:56.540216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:56.709091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:56.717192 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d8d0562-e0a9-4f0c-8105-692af3730774 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.195734 Oct 28 18:09:56.717765 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3332/6529] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:56 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:57.742230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:57.743073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:57.749686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.750255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.750763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:57.751905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:57.752437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:57.753056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:58.045868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:58.055397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-16e5f158-6e5e-4367-a2ab-ed4e7d9c126e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.317796 Oct 28 18:09:58.056083 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3198/6530] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:57 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.078611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:09:59.079223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:09:59.086348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.086842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.087307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.088148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.088656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.089080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.282387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:09:59.291308 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b7bc47ac-cbdb-44c1-be40-f704cfd67a8e tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.216765 Oct 28 18:09:59.292162 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3333/6531] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:09:59 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:09:59.569635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db93637d-9ca5-4ea6-ac32-efd9ff8ca312", "name": "network-vif-plugged", "status": "completed", "tag": "dc73dfbd-920e-4e34-a720-dd29d363a297"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:09:59.579767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:09:59.580271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:09:59.580810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:09:59.592551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] Creating event network-vif-plugged:dc73dfbd-920e-4e34-a720-dd29d363a297 for instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 on n-h1-860864-13 Oct 28 18:09:59.597898 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-71b942a1-476e-4793-be9e-873e536ce65a req-e663e6fc-8a15-44e7-99ea-e42745cdab06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180529 Oct 28 18:09:59.598517 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3199/6532] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:00.315632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:00.316246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:00.323262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.323778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.324213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.324911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:00.325363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:00.325847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:00.516661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:00.552481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:00.560652 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e06f5e21-d469-4538-a0f1-73e78593745c tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1318 microversion: 2.1 time: 0.249089 Oct 28 18:10:00.561236 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3334/6533] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:00 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.583396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:01.584213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:01.591493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:01.592447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:01.602445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.602951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.603438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.604158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.604626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.605099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.765371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:01.775519 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-168e1ab9-ceb6-40c0-ab79-273d7607cba9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1507 microversion: 2.1 time: 0.193563 Oct 28 18:10:01.776495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3200/6534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:01 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:01.798949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8855e0dc-28a3-4392-84a6-f7e5a4970365", "device": "/dev/sdb"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:01.803133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:01.811707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.811707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.812506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:01.813344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:01.813985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:01.814520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:02.105719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-286367e2-8fbe-4b85-88d3-571d9d18a3f0 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "POST /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310538 Oct 28 18:10:02.106701 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3335/6535] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:10:01 2022] POST /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:25.124690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:25.125254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:25.127626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:25.128906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:25.130058 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:10:25.130239 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312/os-volume_attachments/8855e0dc-28a3-4392-84a6-f7e5a4970365 (ip 10.222.0.48) !!! Oct 28 18:10:25.145187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.145688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.146138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:25.146857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:25.147352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:25.147819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:25.234683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lazy-loading 'services' on Instance uuid db93637d-9ca5-4ea6-ac32-efd9ff8ca312 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:25.319258 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e4e98a3-3f9b-469f-b2ba-fc09a33eadac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312/os-volume_attachments/8855e0dc-28a3-4392-84a6-f7e5a4970365" status: 202 len: 0 microversion: 2.1 time: 0.198641 Oct 28 18:10:25.319904 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3201/6536] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:10:25 2022] DELETE /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312/os-volume_attachments/8855e0dc-28a3-4392-84a6-f7e5a4970365 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:10:29.504448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:29.505034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:29.517052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=24 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:29.518055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:29.530305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.532586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.533244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.536306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.537270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.538602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.593325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:10:29.739289 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f559793-3946-4f5a-8db8-11acbf637b38 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 204 len: 0 microversion: 2.1 time: 0.239606 Oct 28 18:10:29.741259 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3336/6537] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:29 2022] DELETE /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:29.750682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:29.751429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:29.786432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.788036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.788821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.789742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:29.791464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:29.792105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:29.955103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:29.966653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-57730a85-f004-4937-9e98-26ec2ecf1363 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1577 microversion: 2.1 time: 0.221008 Oct 28 18:10:29.968113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3202/6538] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:29 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:30.868194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.868922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:30.876870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.877353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.878446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.879200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:30.879686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:30.880112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:30.911941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:10:30.991321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:30.993017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:31.000973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.001474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.001925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.002725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.003840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.004534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.032545 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-78981cac-b4a2-4b22-9cdd-7e5fdd0093b3 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 204 len: 0 microversion: 2.1 time: 0.166558 Oct 28 18:10:31.033197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3337/6539] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:10:30 2022] DELETE /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:10:31.042455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:31.043883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:31.051466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.052026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.052372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.053312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:31.053745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:31.054166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:31.302865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.315468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c7d69c2-840d-41fa-9251-2c6993734774 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1577 microversion: 2.1 time: 0.328816 Oct 28 18:10:31.320625 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3203/6540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:30 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1577 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:31.338117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:31.347768 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7a02579-44db-4cf0-a39d-04428a1e1bfa tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1513 microversion: 2.1 time: 0.309613 Oct 28 18:10:31.359590 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3338/6541] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:31 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:32.346252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:32.349022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:32.376371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:32.376980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.377124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.377677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.378229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:32.379709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.380447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.381765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.391091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.391805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.392253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.394791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.395315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.395800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.518339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:32.528116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-822be629-9aac-42a5-80d8-468160b1fd08 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1510 microversion: 2.1 time: 0.186563 Oct 28 18:10:32.543679 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3204/6542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:32 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:32.701909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1336a16-61d0-4aa0-8307-408f0f4b062f", "name": "network-vif-deleted", "tag": "85a478a5-a7f7-41c8-b1e8-b69fad9bf91d"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:32.716924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:32.719350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:32.720107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:32.738087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] Creating event network-vif-deleted:85a478a5-a7f7-41c8-b1e8-b69fad9bf91d for instance a1336a16-61d0-4aa0-8307-408f0f4b062f on n-h2-860864-13 Oct 28 18:10:32.744407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4051d842-be64-475a-92cb-fb3a32596b89 req-4e950a84-9b42-4311-bf67-4202ef3dd4d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199123 Oct 28 18:10:32.745685 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3205/6543] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:32.754334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:32.763485 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97e7d4b1-fe70-4299-bd8e-eacfe83b7bac tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1513 microversion: 2.1 time: 0.394771 Oct 28 18:10:32.764434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3339/6544] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:32 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1513 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:33.559015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.559826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:33.570390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.570904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.571352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.579682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.580198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.580663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.760910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db93637d-9ca5-4ea6-ac32-efd9ff8ca312", "name": "network-vif-deleted", "tag": "dc73dfbd-920e-4e34-a720-dd29d363a297"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:33.774082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.774381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.775019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.790086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:33.796522 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] Creating event network-vif-deleted:dc73dfbd-920e-4e34-a720-dd29d363a297 for instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 on n-h1-860864-13 Oct 28 18:10:33.804221 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-701d2d7a-47dc-4d7a-832a-05c6550834bc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1226 microversion: 2.1 time: 0.248396 Oct 28 18:10:33.819436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3206/6545] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1226 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:33.820644 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f2880035-ae4c-49d5-9c36-f48bf39e1c77 req-4390c1f4-07da-4406-95a5-2016f4c1a780 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199806 Oct 28 18:10:33.820644 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3340/6546] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:33.825021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:33.825646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:33.840378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.841174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.841712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.842525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.842999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.843548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.893132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:33.894463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:33.895783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:33.898247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lazy-loading 'fault' on Instance uuid db93637d-9ca5-4ea6-ac32-efd9ff8ca312 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:10:33.968437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a660b6d39b4d484190f3ed87f8815ac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91358b72b26649a0aa10f32e5df29ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:33.985061 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79bbf0e0-6124-4ba2-8e81-fc99a4954349 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 200 len: 1308 microversion: 2.1 time: 0.174524 Oct 28 18:10:33.986354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3207/6547] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:33 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:34.830664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:34.831550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:34.840493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.841111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.841775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:34.842687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:34.843426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:34.844244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.009590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:35.011464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] [instance: db93637d-9ca5-4ea6-ac32-efd9ff8ca312] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:35.019427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:35.020329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:35.021477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.022511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:35.023765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:35.024640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:35.043069 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] HTTP exception thrown: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Request method failure captured: Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 HTTP/1.1 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBpQgswOjwredttwgacZXPmPwpVV-nNe4iUai9EJhDzQ02GhucGUt3G2WhMumVFZ2t0NLYHCFeLryPvr_9KxcnAcLkS5p_we_xneFhvqwstdEKEID9_ywnxnARJ44y_h-mOlvNrG4rRS_iGq-a8cGEo5M-UjfUwrPCK70_2dqCadtUk Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 91358b72b26649a0aa10f32e5df29ef9 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91358b72b26649a0aa10f32e5df29ef9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91358b72b26649a0aa10f32e5df29ef9"}]}] Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 91358b72b26649a0aa10f32e5df29ef9 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-239773439 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-VolumesSnapshotTestJSON-239773439-project Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a660b6d39b4d484190f3ed87f8815ac7 Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-VolumesSnapshotTestJSON-239773439-project Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'db93637d-9ca5-4ea6-ac32-efd9ff8ca312'} Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:35.045175 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. Oct 28 18:10:35.050410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:35.053072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] Returning 404 to user: Instance db93637d-9ca5-4ea6-ac32-efd9ff8ca312 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:35.054246 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b2435bde-2506-4cf0-b55c-d4e881a872b9 tempest-VolumesSnapshotTestJSON-239773439 tempest-VolumesSnapshotTestJSON-239773439-project] 10.222.0.48 "GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312" status: 404 len: 111 microversion: 2.1 time: 0.048646 Oct 28 18:10:35.058701 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3208/6548] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:35 2022] GET /compute/v2.1/servers/db93637d-9ca5-4ea6-ac32-efd9ff8ca312 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:10:35.283616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:35.295071 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e0d1b0d-dc94-4658-bdeb-84e916fd4a69 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1226 microversion: 2.1 time: 0.468602 Oct 28 18:10:35.298186 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3341/6549] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:34 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1226 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:36.323770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:36.324390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:36.332570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:36.333078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:36.333532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:36.334259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:36.334728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:36.335167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:36.406123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:36.417406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c96c0f90-b31c-4dbf-bb3e-3c838627f623 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1226 microversion: 2.1 time: 0.097525 Oct 28 18:10:36.418613 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3209/6550] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:36 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:37.444286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:37.445571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:37.455616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:37.458700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:37.459882 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:37.461403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:37.463505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:37.465828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:37.931049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:37.939836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5a27013-5a64-4135-b7fc-edcce93ef469 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 200 len: 1226 microversion: 2.1 time: 0.500813 Oct 28 18:10:37.946456 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3342/6551] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:37 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 1226 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:38.963167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:38.964461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:38.972939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.973441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.973895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.974699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:38.975223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:38.975883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:38.994243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f HTTP/1.1 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a1336a16-61d0-4aa0-8307-408f0f4b062f'} Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:10:39.005239 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-322b600a-7fbd-461d-a854-9a0c05aa2ca6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 404 len: 111 microversion: 2.1 time: 0.049875 Oct 28 18:10:39.015170 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3210/6552] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:38 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:10:39.153111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-347569577", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1486031842", "security_groups": [{"name": "tempest-secgroup-smoke-667960096"}], "block_device_mapping_v2": [{"uuid": "7e8389f0-1418-4471-9681-a0d07e72884d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:39.338993 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:10:39.821786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:10:39.822213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:10:39.822920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:10:39.823335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:10:39.823824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:10:39.833986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:39.834716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:39.835343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:39.836254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:39.837073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:39.837715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:39.860563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:10:39.869152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Getting quotas for user 9be4d513f7414f3aa402ec76e41c7cd0 and project 4f1bce62a3904c079de041a3a5f7588d. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:10:39.967071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:10:39.969236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e8389f0-1418-4471-9681-a0d07e72884d',volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:10:40.141161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-823acedb-6231-4f69-8949-3a758cd732c9 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.993729 Oct 28 18:10:40.142262 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3343/6553] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:10:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:10:40.154520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-930007d6-f1ce-4621-bd84-203d557e5393 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:40.156020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-930007d6-f1ce-4621-bd84-203d557e5393 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:40.255663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-930007d6-f1ce-4621-bd84-203d557e5393 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:40.265612 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-930007d6-f1ce-4621-bd84-203d557e5393 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1094 microversion: 2.1 time: 0.115996 Oct 28 18:10:40.266630 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3211/6554] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:40 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:41.293384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:41.294234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:41.305440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.306390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.307231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.327391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:41.328432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:41.329054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:41.451840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:41.469496 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd63c9b4-bce3-4e95-ade9-d1f49f0e3177 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1200 microversion: 2.1 time: 0.183065 Oct 28 18:10:41.477154 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3344/6555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:41 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1200 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:42.503795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:42.504427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:42.526035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.526541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.526994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.527753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:42.528219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:42.528855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:42.831477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:42.843893 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2e78c0e-5c3f-4077-9a11-70b4f67cc3ae tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1277 microversion: 2.1 time: 0.344350 Oct 28 18:10:42.846047 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3212/6556] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:42 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1277 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:43.878914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:43.880268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:43.896599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.898694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.899737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:43.900635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:43.901474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:43.902674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.192063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:44.258161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56ec7a85-e903-4f4b-8a00-32a951cdc2ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1277 microversion: 2.1 time: 0.389743 Oct 28 18:10:44.259456 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3345/6557] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:43 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1277 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:44.397778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180bee57-d371-450f-872c-60969f10a2e6", "tag": "cee6c742-306f-4650-8ca7-65ac3795233c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:44.418619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:44.419562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:44.420264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:44.481044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] Creating event network-changed:cee6c742-306f-4650-8ca7-65ac3795233c for instance 180bee57-d371-450f-872c-60969f10a2e6 on n-h2-860864-13 Oct 28 18:10:44.508899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-483917a9-bce6-4bda-92e9-a681a33ec541 req-3ccbfaf4-b084-4875-8565-0d543cb8ba7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123525 Oct 28 18:10:44.513350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3213/6558] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:10:45.281721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:45.282352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:45.297755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.298138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.299276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.299902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:45.300577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:45.301008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:45.660515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:45.670961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b41f4cee-83f3-4620-955f-94dbc09abb44 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1277 microversion: 2.1 time: 0.393247 Oct 28 18:10:45.671596 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3346/6559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:45 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1277 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:46.698154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:46.699786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:46.707822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.708449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.709148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.712736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:46.713346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:46.713888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:46.899600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:46.908296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-657f9b1c-acc5-463f-a602-d221d2c83f8e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1277 microversion: 2.1 time: 0.216302 Oct 28 18:10:46.909195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3214/6560] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:46 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:10:47.944550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:47.946165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:47.964182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.968040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.968489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:47.969609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:47.970628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:47.972426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:48.175090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:48.186033 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b1c2447f-67b7-41ad-8b80-a456fa1f7716 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.250911 Oct 28 18:10:48.200176 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3347/6561] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:47 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:49.213203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:49.213965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:49.221675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.222316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.222939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.223761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:49.224370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:49.230068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:49.418818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:49.429561 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5d8b05cd-5e92-4e72-a743-bd3008701594 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.220592 Oct 28 18:10:49.430685 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3215/6562] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:49 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:50.453177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:50.453725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:50.458795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:50.459864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:50.465958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:50.466456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:50.466903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:50.467646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:50.468108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:50.468541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:50.630021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:50.639689 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bb8379f-dd4d-4b38-b0d8-1f782476f5fc tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.190984 Oct 28 18:10:50.640270 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3348/6563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:50 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:51.668021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:51.668737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:51.673515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:51.679913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.680494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.680952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.681660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:51.682304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:51.683062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:51.849433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:51.859584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f926576-926a-497e-add2-1c81c596c5ab tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.198092 Oct 28 18:10:51.860884 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3216/6564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:51 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:52.885995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:52.886614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:52.894818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.895314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.895781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:52.896488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:52.896946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:52.897376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:53.064126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:53.074191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50b3ed4b-46a3-4f3a-bd2a-545045a35b1c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.192363 Oct 28 18:10:53.074937 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3349/6565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:52 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:54.098856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:54.100363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:54.110283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.110867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.111327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.112500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:54.112980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:54.113419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:54.262328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:54.272154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a115e8e-b113-40e5-8854-0280e9a91fa0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.178807 Oct 28 18:10:54.272993 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3217/6566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:54 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:55.297682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:55.298305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:55.305985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.306492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.307106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.307870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:55.308336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:55.308834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:55.331556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:55.459804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:55.468719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d7514cc-66ea-4bff-932a-4217cbee1f9d tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.175169 Oct 28 18:10:55.475433 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3350/6567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:55 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:56.494702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:56.495298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:56.498447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=39 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:56.516232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:56.516674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:56.517133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:56.518107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:56.518778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:56.519422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:56.522691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:56.724556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:56.732577 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8a4eea6-cee5-4231-b16c-9c50f896d3ca tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.241750 Oct 28 18:10:56.733477 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3218/6568] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:56 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:57.757902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:57.759560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:57.767174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:57.767924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:57.768374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:57.769088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:57.769547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:57.770169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:57.947678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:57.955973 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fcbefcc5-7abb-4a97-8330-005f518f3dec tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.201942 Oct 28 18:10:57.971550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3351/6569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:57 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:58.981622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:10:58.983643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:10:58.989831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.990423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.991081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:58.992015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:58.992486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:58.993101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.154551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:10:59.166059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6565f244-09b4-4601-ac02-d62c10a7cf6c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.188843 Oct 28 18:10:59.166352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3219/6570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:10:58 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:10:59.701169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bee57-d371-450f-872c-60969f10a2e6", "name": "network-vif-plugged", "status": "completed", "tag": "cee6c742-306f-4650-8ca7-65ac3795233c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:10:59.716597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:10:59.718705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:10:59.719445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:10:59.720220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:10:59.734378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] Creating event network-vif-plugged:cee6c742-306f-4650-8ca7-65ac3795233c for instance 180bee57-d371-450f-872c-60969f10a2e6 on n-h2-860864-13 Oct 28 18:10:59.741532 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ae69f2db-181e-4679-bbff-e0c08001d006 req-4597bff5-fe8f-481e-826f-67a32809b641 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046090 Oct 28 18:10:59.742370 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3352/6571] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:00.195240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:00.196058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:00.207215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.208155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.208797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.209744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:00.210381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:00.210986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:00.374283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:00.383955 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6b912c1-2c1e-45f1-9375-f137f03551c6 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1265 microversion: 2.1 time: 0.195395 Oct 28 18:11:00.384758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3220/6572] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:00 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:01.410203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:01.411663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:01.419495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.420238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.420878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.421841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.422735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.423189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.647961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:01.657141 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb95437d-719a-469e-8ef5-1d87189eda63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1453 microversion: 2.1 time: 0.252430 Oct 28 18:11:01.658471 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3353/6573] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:01 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:01.680911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:01.682323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:01.689751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.690525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.691149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.692207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:01.692823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:01.693406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:01.876861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:01.885493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb40105b-aab4-41c1-9573-7db03a907e07 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1453 microversion: 2.1 time: 0.208750 Oct 28 18:11:01.886829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3221/6574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:01 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:11:04.376483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180bee57-d371-450f-872c-60969f10a2e6", "tag": "cee6c742-306f-4650-8ca7-65ac3795233c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:04.387827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:04.388334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:04.388862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:04.401184 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] Creating event network-changed:cee6c742-306f-4650-8ca7-65ac3795233c for instance 180bee57-d371-450f-872c-60969f10a2e6 on n-h2-860864-13 Oct 28 18:11:04.407321 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e15b5ae8-410e-47b1-b088-434bcf7fcbe1 req-e8797ca4-61d7-4f02-8059-37dceb383ba6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034188 Oct 28 18:11:04.408261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3354/6575] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:31.452574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=7 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:31.453435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=23 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:31.625155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba1303eb-89b3-4a6b-8090-06a1fa163066 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: .version_select at 0x7f751f82baf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1753045535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTmCQsA6y1PgHj8CG590P2WEOdAOmcrqWesuQmz8csJy4qMtfW3rpmS06nQ1QjWeAFIt3hM8fB/znJ1qdndOzCOMk6TTP6HcDCR4sIbZe7qmbmbELEuFbsw4REGIaaXuw=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:31.644441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ba1303eb-89b3-4a6b-8090-06a1fa163066 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:31.650621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ba1303eb-89b3-4a6b-8090-06a1fa163066 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:31.684453 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba1303eb-89b3-4a6b-8090-06a1fa163066 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.235237 Oct 28 18:11:31.684453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3222/6576] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:11:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:37.948989 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1079827272", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f234808d-9ea8-4b54-8a54-d66078ebd0dc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1753045535", "security_groups": [{"name": "tempest-secgroup-smoke-85642426"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:37.964792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:37.965537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=18 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:38.134495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] validate_networks() for [('f234808d-9ea8-4b54-8a54-d66078ebd0dc', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:11:38.751315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:11:38.751854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:11:38.752333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:11:38.752751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:11:38.753169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:11:38.770417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.770919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.771409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.772148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:38.772614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:38.773047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:38.803415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:11:38.813304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:11:38.829425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:11:38.832617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:11:38.915278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eb3b5010-f0c4-4e64-ba39-8fb69f309ae6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.970865 Oct 28 18:11:38.924137 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3355/6577] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:11:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:11:38.937730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0f495549-a0d4-4c1a-82f2-6c8f075544d8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:38.942769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0f495549-a0d4-4c1a-82f2-6c8f075544d8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:39.053870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0f495549-a0d4-4c1a-82f2-6c8f075544d8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:39.066135 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0f495549-a0d4-4c1a-82f2-6c8f075544d8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1267 microversion: 2.1 time: 0.140622 Oct 28 18:11:39.066682 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3223/6578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:38 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:40.091669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:40.092460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:40.103464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.104275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.104976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.105921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:40.106586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:40.107224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:40.185571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:40.200531 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e13403ce-10d8-48a2-a99b-dad091df7acb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1319 microversion: 2.1 time: 0.114255 Oct 28 18:11:40.219062 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3356/6579] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:40 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1319 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:41.229057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:41.230399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:41.250681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.251539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.252349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.253287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:41.253933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:41.254553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:41.560436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:41.571147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-824a90c1-7ea4-450e-92bf-cca8f712f285 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.346803 Oct 28 18:11:41.572224 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3224/6580] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:41 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:42.010974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:42.022055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:42.022794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:42.023571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:42.036179 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] Creating event network-changed:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h1-860864-13 Oct 28 18:11:42.041877 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e26862ff-3ac4-4945-a78d-43bbec5ae9c0 req-01146a3b-b382-4764-970a-d41f93eb1276 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034544 Oct 28 18:11:42.043162 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3357/6581] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:42.602276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:42.602924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:42.621435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:42.622648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:42.622648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:42.623858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:42.624199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:42.624691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:42.890626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:42.900925 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-953c8f1c-bee4-4188-ae05-9180cd97f533 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.303436 Oct 28 18:11:42.901867 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3225/6582] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:42 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:43.929538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:43.930220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:43.937443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.937927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.938541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:43.939276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:43.939867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:43.940544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:44.085084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:44.094013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ecee006-22af-40a1-834b-faf2c7a524e3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.171222 Oct 28 18:11:44.094623 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3358/6583] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:43 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:45.119942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:45.120579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:45.128018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.128553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.129104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.129823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:45.130339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:45.130773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:45.274590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:45.283594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85fe67bd-87d8-4056-938d-0ee84884b473 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.167646 Oct 28 18:11:45.284180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3226/6584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:45 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:46.306167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:46.306938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:46.313937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.314448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.315025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.315766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:46.316228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:46.316661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:46.506947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:46.515270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f739aa4-6fa1-4605-9c4e-423cd1aae44d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.213019 Oct 28 18:11:46.516180 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3359/6585] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:46 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:47.542310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:47.542991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:47.550944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.551464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.551913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.552619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:47.553075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:47.553505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:47.697922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:47.706880 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54f0b07e-5956-4f6f-8c2d-01b3e1be59ff tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.168494 Oct 28 18:11:47.707649 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3227/6586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:47 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:48.730260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:48.730885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:48.738699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.739537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.740166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.741101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:48.741568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:48.742008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:48.794469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:48.822632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:49.200421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:49.209093 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60bc4113-0683-4497-914c-8639b56c0546 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.482733 Oct 28 18:11:49.209790 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3360/6587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:48 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:50.236257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:50.237713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:50.241866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:11:50.246453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.247221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.247697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.248412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.251603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.256857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.504787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:50.513513 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1d7aeb6-4e92-4d1e-861a-0247fc206280 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.282616 Oct 28 18:11:50.520401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3228/6588] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:50 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:50.543487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "name": "network-vif-plugged", "status": "completed", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:50.558712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:50.559314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:50.559938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:50.578209 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] Creating event network-vif-plugged:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h1-860864-13 Oct 28 18:11:50.584189 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f830cf68-93e8-4166-b7a4-ffc9c9ed26e3 req-b3d16022-d9cd-4be5-899d-acbeb6cc3892 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044149 Oct 28 18:11:50.585208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3361/6589] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:11:51.546729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:51.547338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:51.556691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.557190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.557636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.558360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:51.558825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:51.559265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:51.744683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:51.758885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b747212-a912-4038-bf51-4f85e6dc2ddb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1391 microversion: 2.1 time: 0.217738 Oct 28 18:11:51.763406 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3229/6590] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:51 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1391 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:52.784868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:52.786821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:52.797569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.798113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.798557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:52.805782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:52.806293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:52.806739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.099938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:53.118520 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9b4a5e3-57b2-4120-a670-5041df1b64d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1562 microversion: 2.1 time: 0.338507 Oct 28 18:11:53.118792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3362/6591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:52 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1562 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:53.142322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:53.144187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:53.151751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.152554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.153225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.153969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:53.154885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:53.154885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:53.437719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:53.446853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8afdf4a-ac82-4183-98e8-7f97f2f1cba8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1562 microversion: 2.1 time: 0.308450 Oct 28 18:11:53.448074 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3230/6592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:53 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1562 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:11:55.409767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:11:55.411620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:11:55.412258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:11:55.420851 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.421356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.421865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.422328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.422791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:11:55.423211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.423385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:11:55.423797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.424683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:11:55.439317 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] Creating event network-changed:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h1-860864-13 Oct 28 18:11:55.446171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-05b8a871-e7c6-4c1a-91a3-78d3ee759194 req-c0288582-bbba-45f5-8d9f-e469dc6f3ee1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042757 Oct 28 18:11:55.447866 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3231/6593] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:11:55.779586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:11:55.792037 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72f1fa83-1cea-4512-97b0-4aea5e386f34 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1562 microversion: 2.1 time: 0.390603 Oct 28 18:11:55.792037 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3363/6594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:11:55 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1562 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:12:27.140051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:27.142550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:27.145914 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:12:27.146091 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action (ip 10.222.0.48) !!! Oct 28 18:12:27.148221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:27.149177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=44 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:27.159410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.159972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.160428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.161192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:27.161664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:27.162107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:27.224946 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5fe6f66d-72f1-46b6-903d-aea9fc4ef982 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action" status: 200 len: 24563 microversion: 2.1 time: 0.088689 Oct 28 18:12:27.225851 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3232/6595] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:27 2022] POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action => generated 24563 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:12:44.180928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2009952195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1486031842", "security_groups": [{"name": "tempest-secgroup-smoke-667960096"}], "block_device_mapping_v2": [{"uuid": "02c0d086-9cf6-4029-af77-0adb5d39c0ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2c01e57-9e4c-488e-b87a-ef86398e9e92"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:44.192622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:44.193505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=42 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:44.298860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] validate_networks() for [('b2c01e57-9e4c-488e-b87a-ef86398e9e92', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:12:54.209696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:57.416746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:57.418269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:57.421217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:57.422087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:12:57.429993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.430499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.430952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.431709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.432180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.432622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.680028 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5539648-fab4-4088-8070-a76e977d4449 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1834 microversion: 2.1 time: 0.267682 Oct 28 18:12:57.681289 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3233/6596] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:57 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1834 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:57.703928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:57.704557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:57.711060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.711608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.712060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.712760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.713224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.713750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.853187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:57.861018 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e4104f0-f7d0-4d71-97ac-c3c97d993af6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1681 microversion: 2.1 time: 0.160969 Oct 28 18:12:57.861590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3234/6597] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:57 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:57.959494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:57.961645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:57.968111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.968599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.969044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:57.969735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:57.970193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:57.970623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.024672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-130e41bb-adf5-4c67-a4cc-91731af26b10 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action" status: 200 len: 32631 microversion: 2.1 time: 0.068986 Oct 28 18:12:58.031846 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3235/6598] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:57 2022] POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action => generated 32631 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:12:58.172185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:12:58.172871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:58.180435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.180927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.181371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.182066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.182527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.182959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.336585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5c481c019984c8f955c67a85677d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74340844464633990b36c6ac91751a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:58.337282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] flavor_id is None. Assuming migration. {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 18:12:58.337795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:12:58.583391 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b7fedfd2-2042-4141-b804-2e8cc11da06a tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action" status: 202 len: 0 microversion: 2.1 time: 0.415275 Oct 28 18:12:58.584345 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3236/6599] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:12:58 2022] POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:12:58.592178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:58.592526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:58.599576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.600079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.600528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.601546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:58.602008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:58.602446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:58.800704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:58.809762 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab59279b-ade4-464b-83ba-01154779aacb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1690 microversion: 2.1 time: 0.221581 Oct 28 18:12:58.810335 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3237/6600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:58 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:12:59.833528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:12:59.834213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:12:59.840814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:59.841307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:59.841757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:59.842447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:12:59.842909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:12:59.843342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:12:59.975705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:12:59.983868 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8b3d29c-0406-48f3-8e1c-5b92ca99bb0e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1690 microversion: 2.1 time: 0.154218 Oct 28 18:12:59.984451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3238/6601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:12:59 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:01.008262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:01.008995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:01.016318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:01.016837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:01.017297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:01.018048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:01.018520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:01.018993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:01.156955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:01.165122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6826b788-4557-4ef4-be7c-e45a09256a06 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.161567 Oct 28 18:13:01.165698 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3239/6602] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:01 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:02.188853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:02.189539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:02.197305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:02.197809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:02.198261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:02.198977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:02.199466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:02.199908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:02.342758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:02.351829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03db9dd1-4adc-40ba-a5a2-a0a5e0dde1ce tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.166742 Oct 28 18:13:02.352404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3240/6603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:02 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:03.376187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:03.376810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:03.383891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.384390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.384841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.385564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:03.386031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:03.386474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:03.522913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:03.530942 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-365b0741-2965-412c-a42b-fd7658670d69 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.158606 Oct 28 18:13:03.531542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3241/6604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:03 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:04.555330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:04.556008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:04.562845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:04.563338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:04.563852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:04.564585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:04.565081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:04.565523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:04.703205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:04.711893 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88b92d9b-4f22-4239-a5ac-9edad374c579 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.160697 Oct 28 18:13:04.712478 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3242/6605] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:04 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:05.735521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:05.736217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:05.745313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:05.745803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:05.746244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:05.746980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:05.747597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:05.748073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:05.916411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:05.925259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-641dbf96-065d-4140-892f-71fb068e5cbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.193975 Oct 28 18:13:05.925868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3243/6606] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:05 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:06.952930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:06.953617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:06.961080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.961573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.962015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:06.962714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:06.963177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:06.963648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:07.100671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:07.109073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2ce34fa-7e62-4ecc-aea1-e46093b88db5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.160129 Oct 28 18:13:07.109660 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3244/6607] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:06 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:08.133692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:08.134369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:08.140841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.141326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.141769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.142468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:08.142928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:08.143382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:08.279100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:08.286952 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4f61abb-6d72-480f-93f4-14f278745816 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.157318 Oct 28 18:13:08.287552 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3245/6608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:08 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:09.310414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:09.311129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:09.318449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.318949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.319426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.320142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:09.320645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:09.321083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:09.461998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:09.470218 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d0fed73-7cb3-4ff2-b77b-ca97155b88b1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.163864 Oct 28 18:13:09.470900 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3246/6609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:09 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:10.494956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:10.495667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:10.502721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.503220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.503701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.504426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:10.504965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:10.505419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:10.644798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:10.653665 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb335cc9-cce8-40a8-829c-709d8d9ad342 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.162782 Oct 28 18:13:10.654241 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3247/6610] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:10 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:11.676735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:11.677403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:11.685058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.685556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.685996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.686697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:11.687164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:11.687619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:11.691789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:11.831619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:11.840479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20e0c265-23dd-4df5-8432-802a8b5ac6f6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1695 microversion: 2.1 time: 0.167845 Oct 28 18:13:11.841066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3248/6611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:11 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:12.864995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:12.865620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:12.872559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.873061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.873703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:12.874649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:12.875435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:12.876235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.016981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:13.025818 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-541f039f-be10-48d4-b335-eb0d1dfc73d0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1694 microversion: 2.1 time: 0.165444 Oct 28 18:13:13.026389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3249/6612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:12 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:13.324973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "name": "network-vif-unplugged", "status": "completed", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:13.338247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:13.338776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:13.339223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:13.352754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Creating event network-vif-unplugged:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h2-860864-13 Oct 28 18:13:13.371838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:13:13.386063 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-08d086a0-0d0e-43c5-b88e-85be18cffca4 req-c596e78a-0731-4bc1-9b8c-be9bb8c51e9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066866 Oct 28 18:13:13.387093 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3250/6613] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:14.051380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:14.053454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:14.062000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.063010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.063962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.065078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:14.065742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:14.066264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:14.207421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:14.216659 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb13c205-144c-44a4-9267-05a25095256c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1694 microversion: 2.1 time: 0.170402 Oct 28 18:13:14.217246 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3251/6614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:14 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:15.241109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:15.241801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:15.248724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.249209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.249652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.250350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.250809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.251246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.456808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:15.465815 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6c61e446-5881-4aac-902c-4e5eee0255d2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1692 microversion: 2.1 time: 0.229127 Oct 28 18:13:15.466408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3252/6615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:15 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:15.470921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:15.482229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:15.482727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:15.483177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:15.495511 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Creating event network-changed:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h2-860864-13 Oct 28 18:13:15.501071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:13:15.512373 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7578d93c-7ca1-4455-ae3e-640552fb279d req-edbb9d60-43b2-41dc-9b06-e531d3656cfd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044776 Oct 28 18:13:15.512987 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3253/6616] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:16.492841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:16.493551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:16.499784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.500280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.500730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.501426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:16.501888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:16.502325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:16.642628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:16.651119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-491505c5-68c5-438b-bd7c-c47f79e5bd11 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1692 microversion: 2.1 time: 0.163673 Oct 28 18:13:16.663537 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3254/6617] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:16 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:17.674057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.674799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:17.682929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.683450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.683895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.684587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.685073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.685504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.820197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:17.828033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fa870a7-fe2e-4d19-80db-a2215bec709a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1689 microversion: 2.1 time: 0.157869 Oct 28 18:13:17.828621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3255/6618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:17.852447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:17.852987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:17.858783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.859270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.859745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.860434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.860891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.861321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.918436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5bd3c05-e8a3-4c30-bf2b-7864ca42ef12 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action" status: 204 len: 0 microversion: 2.1 time: 0.070232 Oct 28 18:13:17.919009 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3256/6619] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:13:17 2022] POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:13:17.927517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:17.928520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:17.935215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.936001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.936656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:17.937502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:17.938883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:17.938883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:18.203216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:18.220200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28e6223b-57f4-4fc5-aa01-0e48827f7e58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1689 microversion: 2.1 time: 0.296623 Oct 28 18:13:18.220716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3257/6620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:17 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1689 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:19.245850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:19.246603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:19.253614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.254123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.254579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:19.255898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:19.256374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:19.256889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:19.414948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:19.423770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31af0a71-912d-4416-ba3c-89fedad4a54d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1689 microversion: 2.1 time: 0.182418 Oct 28 18:13:19.424737 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3258/6621] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:19 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:20.262380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "name": "network-vif-plugged", "status": "completed", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:20.276247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.276691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.277143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.289185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] Creating event network-vif-plugged:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h2-860864-13 Oct 28 18:13:20.294613 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b9cb408a-01fc-4acf-a83f-2841512e970e req-69862ced-0c37-4830-a4bf-a7d1b3332abb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037259 Oct 28 18:13:20.295525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3259/6622] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:13:20.449035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:20.449789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:20.456411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.456928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.457386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.458114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:20.458620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:20.459073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:20.598000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:20.606514 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34082dde-1395-4888-b4dd-7ecf74ecf7e2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1681 microversion: 2.1 time: 0.162207 Oct 28 18:13:20.607095 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3260/6623] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:20 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:49.699276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180bee57-d371-450f-872c-60969f10a2e6", "tag": "cee6c742-306f-4650-8ca7-65ac3795233c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:49.704918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=58 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:49.705604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:13:49.711049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.711706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.712718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.725500 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] Creating event network-changed:cee6c742-306f-4650-8ca7-65ac3795233c for instance 180bee57-d371-450f-872c-60969f10a2e6 on n-h2-860864-13 Oct 28 18:13:49.731787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d211a95c-6001-4022-95bd-e3025dae78ba req-7c3c3784-d8a3-4bae-8d86-b477a970321f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038547 Oct 28 18:13:49.732708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3261/6624] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:13:49.740713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.741397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:49.747854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.748361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.748813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.749514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.749974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.750408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.780697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:13:49.886358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7bc222d-4aae-489e-8fc2-8b758810bf92 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 204 len: 0 microversion: 2.1 time: 0.149704 Oct 28 18:13:49.887831 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3262/6625] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:49 2022] DELETE /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:13:49.897729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:49.898733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:49.907107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.908061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.908774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:49.909928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:49.911634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:49.912303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.076414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:50.084313 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3603602e-ac46-4fac-bf9c-4cb71c69989e tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1578 microversion: 2.1 time: 0.191708 Oct 28 18:13:50.085427 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3263/6626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:49 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:50.842436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:50.847267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:50.857066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.857579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.858120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.859197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:50.860045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:50.860762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:50.926378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9186edc-40f6-407f-beca-8f23000ecab0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action" status: 200 len: 24571 microversion: 2.1 time: 0.087834 Oct 28 18:13:50.927339 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3264/6627] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:13:50 2022] POST /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:13:51.109708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:51.110733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:51.119074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.120455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.120911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.121626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:51.122089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:51.122523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:51.281152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:51.289117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13165fbf-799e-4016-b861-99db1d35d652 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1578 microversion: 2.1 time: 0.183637 Oct 28 18:13:51.289701 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3265/6628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:51 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:52.037125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180bee57-d371-450f-872c-60969f10a2e6", "name": "network-vif-deleted", "tag": "cee6c742-306f-4650-8ca7-65ac3795233c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:13:52.051105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.051958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.052604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.067917 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] Creating event network-vif-deleted:cee6c742-306f-4650-8ca7-65ac3795233c for instance 180bee57-d371-450f-872c-60969f10a2e6 on n-h2-860864-13 Oct 28 18:13:52.074648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ede95221-28cc-4269-9cce-21ae9711a9fd req-a0e48ba1-8445-4cd7-aa71-9a6547eb276f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Oct 28 18:13:52.075642 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3266/6629] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:13:52.318593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:52.319971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:52.327918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.328635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.329420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.330574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:52.331298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:52.331899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:52.413279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:52.423073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6372c6cf-73cf-489c-96d7-0eb599874db0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1225 microversion: 2.1 time: 0.112373 Oct 28 18:13:52.424262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3267/6630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:52 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:13:53.445268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:53.445919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:53.453610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.454105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.454553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.455259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:53.455752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:53.456187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:53.523865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:53.532003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7afd981e-8f4c-472d-b0c6-c7dbcd4e41c8 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1225 microversion: 2.1 time: 0.090707 Oct 28 18:13:53.532581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3268/6631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:53 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:54.556389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:54.557889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:54.565361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.566123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.566575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.567298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:54.567789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:54.568226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:54.635766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:54.643775 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee246b35-162c-41b6-bbc0-ba33e2d60c5f tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1225 microversion: 2.1 time: 0.091730 Oct 28 18:13:54.644356 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3269/6632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:54 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:55.666829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:55.667951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:55.674870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.675377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.675842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.676550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:55.677012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:55.677451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:55.739949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be4d513f7414f3aa402ec76e41c7cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f1bce62a3904c079de041a3a5f7588d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:13:55.748793 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e522217-4fbd-43fc-bc7b-5fbac1a50002 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 200 len: 1225 microversion: 2.1 time: 0.086489 Oct 28 18:13:55.749370 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3270/6633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:55 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:13:56.772800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:56.773586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: 180bee57-d371-450f-872c-60969f10a2e6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:56.780493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.781134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.781690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.782534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:56.783108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:56.783682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:56.797856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 HTTP/1.1 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '180bee57-d371-450f-872c-60969f10a2e6'} Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:56.799728 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance 180bee57-d371-450f-872c-60969f10a2e6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ab88c20-66d7-4ec1-9895-f0c1dde66f63 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6" status: 404 len: 111 microversion: 2.1 time: 0.033791 Oct 28 18:13:56.805361 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3271/6634] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:56 2022] GET /compute/v2.1/servers/180bee57-d371-450f-872c-60969f10a2e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:13:57.272197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:57.272712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:57.278833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.279330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.279811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.280569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.281040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.281488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.295922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f HTTP/1.1 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a1336a16-61d0-4aa0-8307-408f0f4b062f'} Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:57.297485 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c5f9574-febf-4532-81de-cf2a66aca425 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 404 len: 111 microversion: 2.1 time: 0.030924 Oct 28 18:13:57.303608 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3272/6635] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:13:57 2022] DELETE /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:13:57.307935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:13:57.308552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] [instance: a1336a16-61d0-4aa0-8307-408f0f4b062f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:13:57.314540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.315036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.315516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.316229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:13:57.316743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:13:57.317134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:13:57.330718 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] HTTP exception thrown: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Request method failure captured: Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f HTTP/1.1 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBjSi1UP2TLG7_O4NXKOo6xO3mAzV3AHs2OVxkB2pO4A9r9y5BiPLM6y8EmNvh6Nwoc4Bk5T61rI8grbPhLfVrLM2GXvAiKo0u5QMs6rStSoCUKlj25372vy3r-pK1FbDSjFDakdomQEYIAsW6xwl6Ob4C0_sBwelJyRmh2Ey_FxMkY Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f1bce62a3904c079de041a3a5f7588d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f1bce62a3904c079de041a3a5f7588d"}]}] Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 4f1bce62a3904c079de041a3a5f7588d Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411467115 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 9be4d513f7414f3aa402ec76e41c7cd0 Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBootPattern-1411467115-project Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a1336a16-61d0-4aa0-8307-408f0f4b062f'} Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:13:57.332290 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 404 to user: Instance a1336a16-61d0-4aa0-8307-408f0f4b062f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:13:57.337442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a9344e5-f2c1-4f5d-b001-7740038ec8d0 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f" status: 404 len: 111 microversion: 2.1 time: 0.030024 Oct 28 18:13:57.342476 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3273/6636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:13:57 2022] GET /compute/v2.1/servers/a1336a16-61d0-4aa0-8307-408f0f4b062f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:14:00.774458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f8b70ab-1f81-42ff-bc0b-af01119c4814 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Calling method '.version_select at 0x7f751f4c5790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:00.796819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f8b70ab-1f81-42ff-bc0b-af01119c4814 tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1486031842" status: 202 len: 0 microversion: 2.1 time: 0.026078 Oct 28 18:14:00.798641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3274/6637] 10.222.0.48 () {58 vars in 1263 bytes} [Fri Oct 28 18:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1486031842 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:14:01.497569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e0ac788-f2e3-489e-9611-5bbe06ad1fba tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Action: 'create', calling method: .version_select at 0x7f751f814550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2030325200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/Fd40GdaI7qSyeF20eshudYX2Lr91BCQXh0Em/fLOnSQwO7t09uAsFV8fT29UP6zvxwclv6Ie8jSr8n2FYcTq8EedJXUNCL9L+XJ+qFnYjx7PFeFSMvnEpf9Ph8b/yNQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:01.516444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1e0ac788-f2e3-489e-9611-5bbe06ad1fba tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Getting quotas for project d8100770c87b4835ad6c1a026bc54e4e. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:01.522199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1e0ac788-f2e3-489e-9611-5bbe06ad1fba tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Getting quotas for user 7aa92e546d9c4a27b1e9e04e87a571e9 and project d8100770c87b4835ad6c1a026bc54e4e. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:01.547845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e0ac788-f2e3-489e-9611-5bbe06ad1fba tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054768 Oct 28 18:14:01.548766 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3275/6638] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:14:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:02.765851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2036795438", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "44cbdf81-bfda-489e-94b3-bba8feb268b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2030325200", "security_groups": [{"name": "tempest-secgroup-smoke-1469655720"}], "networks": [{"uuid": "5b8b0add-c02a-4e3b-b288-95bb8b785ae5"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:02.898717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] validate_networks() for [('5b8b0add-c02a-4e3b-b288-95bb8b785ae5', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:03.640265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:03.640697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:03.641174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:03.641587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:03.642009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:03.651174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.651693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.652145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.652877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:03.653337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:03.653771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:03.670878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Getting quotas for project d8100770c87b4835ad6c1a026bc54e4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:03.676181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Getting quotas for user 7aa92e546d9c4a27b1e9e04e87a571e9 and project d8100770c87b4835ad6c1a026bc54e4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:03.741798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:03.744508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44cbdf81-bfda-489e-94b3-bba8feb268b4',volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:03.882121 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5ca7ee4-9bbf-46fe-adc1-80c30f6e174a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.121114 Oct 28 18:14:03.889581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3276/6639] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:03.894757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c17ae4ea-d4be-4ff7-8c0b-5c035ec9a198 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:03.895413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c17ae4ea-d4be-4ff7-8c0b-5c035ec9a198 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:04.153649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c17ae4ea-d4be-4ff7-8c0b-5c035ec9a198 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:04.160544 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c17ae4ea-d4be-4ff7-8c0b-5c035ec9a198 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1099 microversion: 2.1 time: 0.269850 Oct 28 18:14:04.161117 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3277/6640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:03 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1099 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:05.184019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7317ec35-906a-405b-bdb3-041873ba854b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:05.184680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7317ec35-906a-405b-bdb3-041873ba854b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:05.252219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7317ec35-906a-405b-bdb3-041873ba854b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:05.259207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7317ec35-906a-405b-bdb3-041873ba854b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1099 microversion: 2.1 time: 0.079291 Oct 28 18:14:05.260477 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3278/6641] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:05 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1099 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:06.283109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2196d8f-b682-4266-bef3-b2c2f81a2e29 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:06.284563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2196d8f-b682-4266-bef3-b2c2f81a2e29 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:06.344453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2196d8f-b682-4266-bef3-b2c2f81a2e29 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:06.351734 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2196d8f-b682-4266-bef3-b2c2f81a2e29 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1099 microversion: 2.1 time: 0.072788 Oct 28 18:14:06.352616 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3279/6642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:06 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1099 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:07.133169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.133798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:07.141879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.142391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.142847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.143593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:07.144064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:07.144507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:07.317093 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a81f4fba-fc0f-41ba-9a3e-d2e0d2ba9ef2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1834 microversion: 2.1 time: 0.187563 Oct 28 18:14:07.318264 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3280/6643] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:07 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1834 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:07.379169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69f6ed28-a3a5-40f3-b6bb-27b1973b6d72 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:07.380395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69f6ed28-a3a5-40f3-b6bb-27b1973b6d72 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:07.442658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69f6ed28-a3a5-40f3-b6bb-27b1973b6d72 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:07.453142 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69f6ed28-a3a5-40f3-b6bb-27b1973b6d72 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1099 microversion: 2.1 time: 0.078153 Oct 28 18:14:07.453949 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3281/6644] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:07 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1099 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:08.483939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.486514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:08.502363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.502881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.503334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.504102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.504572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.505012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.581081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:08.589285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-85377017-c558-4460-a717-fa864cbea27b tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1149 microversion: 2.1 time: 0.114953 Oct 28 18:14:08.590245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3282/6645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:08 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:08.880464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:08.881399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:08.899051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.899598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.900770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.901628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:08.902171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:08.902809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:08.957035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:14:09.042699 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed12fb0b-4e7d-44ba-b2d7-3719cff973bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 204 len: 0 microversion: 2.1 time: 0.165872 Oct 28 18:14:09.043535 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3283/6646] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:14:08 2022] DELETE /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:14:09.050174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:09.060165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.060656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.061095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.073948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] Creating event network-changed:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h2-860864-13 Oct 28 18:14:09.078941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f6035b79-edf1-46db-b9e5-4a9cb489a675 req-739e84c4-f8e0-4117-aa1b-98dd12dbd3d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Oct 28 18:14:09.080197 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3284/6647] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:09.085364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:09.086212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:09.092772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.093486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.093904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.094614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.095073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.095533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.099795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:09.297409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:09.308046 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-811a8a4b-cc8d-40d0-92aa-57c56b3645cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1687 microversion: 2.1 time: 0.225961 Oct 28 18:14:09.309020 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3285/6648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:09 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1687 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:09.616337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:09.617933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:09.629138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:09.633500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.635129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.635877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.636825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:09.637795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:09.638634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:09.771869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:09.784044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22d0ac46-2ccf-400a-8d0d-2a0c9ce9a168 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1215 microversion: 2.1 time: 0.174612 Oct 28 18:14:09.784658 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3286/6649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:09 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:10.334162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:10.351810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:10.376001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.376883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.378119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.380428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.381603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.382277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.630289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:10.647718 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-43606db8-ba80-4586-af9d-db0d572ad544 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1687 microversion: 2.1 time: 0.315276 Oct 28 18:14:10.649354 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3287/6650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:10 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1687 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:10.815878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:10.817200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:10.833499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.834481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.837255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:10.839966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:10.842572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:10.843538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.104155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.115871 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-218c26fa-a16a-45aa-b33d-3964812e497a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1283 microversion: 2.1 time: 0.309446 Oct 28 18:14:11.136619 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3288/6651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:10 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1283 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:11.340164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c68efff-9899-4df7-ac3c-043d9b839c0b", "name": "network-vif-deleted", "tag": "6ac4ec2e-4706-4b35-be7e-d87e9213fe29"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:11.351611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.352335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.352957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.381526 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] Creating event network-vif-deleted:6ac4ec2e-4706-4b35-be7e-d87e9213fe29 for instance 7c68efff-9899-4df7-ac3c-043d9b839c0b on n-h2-860864-13 Oct 28 18:14:11.386871 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5d47de72-83d3-4d3d-9ced-a824573b410a req-5e025dd6-86d5-49a2-95b4-f194ce832b6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066579 Oct 28 18:14:11.387952 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3289/6652] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:11.576000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:11.594964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.595678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.596229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.610358 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] Creating event network-changed:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:14:11.622312 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-560a4330-c615-48d9-a4d3-47c0afd2de0d req-9e90cfe7-364d-4df4-bb6a-d97e92ad1f20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055321 Oct 28 18:14:11.623468 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3290/6653] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:11.675885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:11.677536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:11.693954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.694760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.695471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.696422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.697143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.697821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.771840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:11.772634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:11.773294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:11.774626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lazy-loading 'fault' on Instance uuid 7c68efff-9899-4df7-ac3c-043d9b839c0b {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:14:11.866199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:11.878234 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2887d416-6fd3-4e0a-9150-2dc250e2580b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 200 len: 1357 microversion: 2.1 time: 0.207043 Oct 28 18:14:11.893027 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3291/6654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:11 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:12.142162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.142776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:12.151572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.152082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.152533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.153261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.153781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.154224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.378099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:12.388354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-43400776-cc3b-42c1-9f67-0bf5416a8321 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1283 microversion: 2.1 time: 0.250204 Oct 28 18:14:12.400816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3292/6655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:12 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:12.905764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:12.906391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 7c68efff-9899-4df7-ac3c-043d9b839c0b] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:12.913604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.914094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.914545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.915272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:12.916265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:12.916704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:12.932342 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] HTTP exception thrown: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Request method failure captured: Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b HTTP/1.1 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBtSO3o7q0lqgB9BCdfQKSnCT_IMK0JDkBbQVhDpJfxmJ5uoPv78qgB4xZn9HurAEPhTP3CcxuuE0qSmKkediJpNM2r8He53e4H59vvU6b1GAu8l4XMzsG8RaN7g-9wwi9f9Of1QAwoGm48jK6xFBrW5XVMxA-D2rYpMk69tlwGMKi4 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ced1592851f6494096a84e9d69a4c93a"}]}] Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d4eb59da561249858854cce09ce51860 Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7c68efff-9899-4df7-ac3c-043d9b839c0b'} Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.934032 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Returning 404 to user: Instance 7c68efff-9899-4df7-ac3c-043d9b839c0b could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:14:12.937839 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-026463c6-7740-44bf-b4c7-613c2c48ac38 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b" status: 404 len: 111 microversion: 2.1 time: 0.033735 Oct 28 18:14:12.939663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3293/6656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:12 2022] GET /compute/v2.1/servers/7c68efff-9899-4df7-ac3c-043d9b839c0b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:14:13.413171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:13.413926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:13.420673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.421174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.421625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.422341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:13.422877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:13.423322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:13.660835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:13.988984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:13.997556 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-407a82c0-160c-4fc6-8fbd-37f65f73390a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1283 microversion: 2.1 time: 0.588264 Oct 28 18:14:13.999184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3294/6657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:13 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1283 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:15.024173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:15.024861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:15.033104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.034098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.034715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.035794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:15.036272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:15.036721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:15.246918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:15.257195 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4f609f9-291b-455c-9925-0fe377c147a4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.238842 Oct 28 18:14:15.268524 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3295/6658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:15 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:16.285045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:16.285672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:16.293693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.294196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.294672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.295419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:16.295899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:16.296329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:16.436976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:16.445725 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1e6a7b1-1bd3-4c8d-a5ab-e9737275c090 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.166937 Oct 28 18:14:16.446551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3296/6659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:16 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:16.667442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eee83f86-ab44-4100-ae7e-865374e49649 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '.version_select at 0x7f751f638b80>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:16.690488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eee83f86-ab44-4100-ae7e-865374e49649 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1753045535" status: 202 len: 0 microversion: 2.1 time: 0.026831 Oct 28 18:14:16.691039 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3297/6660] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 18:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1753045535 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:14:16.721442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d8088541-0e3b-45e9-a55a-ae97997634bb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: .version_select at 0x7f75245815e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1939063148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5DkJXDnTvsR8X+6pKHlrh3JeiwRMebByD89zGM+rY6z94Ugt0ITOZncNLNk4WIPf4s/JcF6RX3PKPkdgRuFZVnyjW75QElm3525UlFFzCUngPWcMADaEJF9aI49vkHXA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:16.738023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d8088541-0e3b-45e9-a55a-ae97997634bb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:16.744111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d8088541-0e3b-45e9-a55a-ae97997634bb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:16.768778 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d8088541-0e3b-45e9-a55a-ae97997634bb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051181 Oct 28 18:14:16.770099 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3298/6661] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:14:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:17.470874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:17.471484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:17.477453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.478071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.478555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.479261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:17.479750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:17.480187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:17.620963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:17.628754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f2a1b1ba-0947-4a8c-a149-f785af9cb4ee tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.163201 Oct 28 18:14:17.629332 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3299/6662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:17 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:18.652598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:18.653213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:18.660361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.660962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.661450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.662177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:18.662680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:18.663269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:18.871297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:18.879522 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0b299970-2e9e-4c66-aade-826521b2b4c2 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.230871 Oct 28 18:14:18.880176 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3300/6663] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:18 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:19.902949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:19.903632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:19.910662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.911165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.911642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:19.912359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:19.912825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:19.913434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:20.132818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:20.141148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f503a87-a418-4e41-8d8f-e704a5db5ddb tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.242798 Oct 28 18:14:20.141886 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3301/6664] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:19 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:21.167431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:21.169049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:21.178086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.178903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.179696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.180749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:21.181623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:21.182352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:21.461458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:21.471557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7aa88048-e370-4e8f-ac70-f900e4640723 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.309188 Oct 28 18:14:21.472716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3302/6665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:21 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:22.496877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:22.497504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:22.504201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.504695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.505142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.506009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:22.506595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:22.507042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:22.709949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:22.720867 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b2a59a2-6929-4b2f-b6cb-c99c6813996d tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.228760 Oct 28 18:14:22.721796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3303/6666] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:22 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:22.937105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-238246611", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "a05dbb8b-f2e2-42a7-b4b0-3e19ebb2ee56"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1939063148", "security_groups": [{"name": "tempest-secgroup-smoke-522144490"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:23.086909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] validate_networks() for [('a05dbb8b-f2e2-42a7-b4b0-3e19ebb2ee56', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:14:23.529663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:14:23.530210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:14:23.530585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:14:23.531013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:14:23.531478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:14:23.550215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.551070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.551885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.553037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.553515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.553962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.577721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:14:23.586950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:14:23.602548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:14:23.606118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:14:23.665778 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1be0270-6d5b-4350-89bb-c1e465a6b440 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734395 Oct 28 18:14:23.666703 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3304/6667] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:14:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:14:23.678382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f862f7b-8a2f-4561-abfb-93aae68fd512 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:23.679005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f862f7b-8a2f-4561-abfb-93aae68fd512 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:23.746542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f862f7b-8a2f-4561-abfb-93aae68fd512 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:23.755935 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f862f7b-8a2f-4561-abfb-93aae68fd512 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1266 microversion: 2.1 time: 0.081200 Oct 28 18:14:23.757218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3305/6668] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:23 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:23.767084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:23.768340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:23.779645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.780340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.781125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.782228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:23.782916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:23.783571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:23.974293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:23.984158 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c52c3b0-6e74-4655-8f63-5f8bee62b434 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.225275 Oct 28 18:14:24.000621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3306/6669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:23 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:24.198037 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:14:24.198602 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:14:24.200303 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:14:24.200391 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:14:24.202221 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:14:24.202350 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:14:24.781810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:24.782502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:24.799411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:24.801368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:24.801895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.802665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:24.803140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:24.803928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:24.808742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:24.891298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:24.901461 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-297b2705-45dc-4e2a-b46a-a1265c81afaf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1318 microversion: 2.1 time: 0.123645 Oct 28 18:14:24.902420 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3307/6670] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:24 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:25.010641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:25.011622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:25.018631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.019132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.019608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.020376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.021151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.021481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.249754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:25.263239 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f90f56f2-1cd1-4505-b04e-67d8b1d6b63a tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.253351 Oct 28 18:14:25.265418 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3308/6671] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:25 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:25.926495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:25.927206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:25.934505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.935294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.936003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:25.936906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:25.937715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:25.938159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.006546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.014802 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba189802-0a8c-4212-ad58-4823d3b4cf2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1324 microversion: 2.1 time: 0.092497 Oct 28 18:14:26.015408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3309/6672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:25 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1324 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:26.289243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:26.289874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:26.300065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.300606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.301074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.301832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.302301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.303055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.454142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:26.462397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5abbf2a-5823-407b-8332-5c7292823fa4 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.177167 Oct 28 18:14:26.463030 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3310/6673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:26 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:26.709606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "name": "network-vif-plugged", "status": "completed", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:26.723568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:26.724186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:26.724722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:26.738624 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] Creating event network-vif-plugged:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:14:26.745077 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-33947519-2a2e-421d-9f75-d4b168baa979 req-b2dbb602-8bf1-431d-8e2d-92dbcf02f462 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039825 Oct 28 18:14:26.745808 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3311/6674] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:27.039199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:27.039947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:27.046649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.047288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.047820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.048538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.049003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.049446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.204167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:27.213993 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0ee43ad-96e4-42f9-8ab2-fe3a05ef3d74 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.178850 Oct 28 18:14:27.214473 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3312/6675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:27 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:27.219772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:27.229907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.230397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.231101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.242128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] Creating event network-changed:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:14:27.247087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ea20522b-aed6-47cf-b356-0e94ebde2a4b req-4a8e61b7-4038-4921-9203-14632b1b4535 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031392 Oct 28 18:14:27.247726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3313/6676] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:27.486133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:27.486838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:27.493121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.493553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.494504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.495241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:27.495805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:27.496240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:27.635735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:27.643739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a28b067-9451-487b-ade6-e37fc51f6045 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1271 microversion: 2.1 time: 0.161880 Oct 28 18:14:27.644320 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3314/6677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:27 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:28.238194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.238919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:28.245944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.246450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.246901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.247659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.248138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.248578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.383668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.391405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b2d19a6c-664a-44d3-94b5-03ce55e22373 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.157823 Oct 28 18:14:28.391979 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3315/6678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:28.666066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.666969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:28.673057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.673549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.673990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.674682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.675136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.675599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.809776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.817524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bfb81c33-73ee-4165-9024-356b8dd9f2a3 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1460 microversion: 2.1 time: 0.155385 Oct 28 18:14:28.818096 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3316/6679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1460 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:28.839335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:28.839968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:28.845614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.846101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.846545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.847237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:28.847732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:28.848163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:28.982405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:28.990338 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5aedb2e-7d54-46cb-99ee-8dbbc8c63204 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1460 microversion: 2.1 time: 0.154428 Oct 28 18:14:28.990921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3317/6680] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:28 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:29.414002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:29.414658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:29.422019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.422522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.422996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.423732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:29.424204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:29.424643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:29.628278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:29.638002 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-06f2a034-9f54-483a-a1d5-a5c363816a77 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.227915 Oct 28 18:14:29.643529 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3318/6681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:29 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:30.661868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:30.662653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:30.670172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.670672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.671118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:30.671863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:30.672328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:30.672804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.075459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:31.083389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51da0ba6-9f3f-453c-bb95-1bde61a7099f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.425400 Oct 28 18:14:31.083989 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3319/6682] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:30 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:31.192161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:31.203826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:31.216347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:31.216847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:31.217292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:31.240916 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] Creating event network-changed:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:14:31.247291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c25eb4f3-fbf0-4849-87d9-848e50fea731 req-de5ed4f2-15aa-4aff-abe4-82dfc3fd3b80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058264 Oct 28 18:14:31.247700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3320/6683] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:14:32.112920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:32.114274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:32.122051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.122698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.123141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.123944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.124399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.124835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.473818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:32.498004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a54bf838-bc39-44c1-a99d-67c1f09635a0 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.395352 Oct 28 18:14:32.499391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3321/6684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:32 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:32.600876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-plugged", "status": "completed", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:32.613593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:32.614312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:32.615022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:32.627511 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] Creating event network-vif-plugged:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:14:32.634016 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c1f481d7-520f-4cec-8c6d-1ede1fcc20a8 req-eb4696a4-d4d7-4ef3-bc8b-418991355a5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037055 Oct 28 18:14:32.635637 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3322/6685] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:33.264112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}, {"name": "network-changed", "server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:33.273745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.274228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.274665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.286778 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Creating event network-changed:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:14:33.287289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] Creating event network-changed:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:14:33.293033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c3e14557-eab8-4bd4-a49a-bf797ada12fd req-60d7d413-2327-415d-96ab-d62d9b7b46ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035068 Oct 28 18:14:33.293635 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3323/6686] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:14:33.526190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:33.527146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:33.534149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.534648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.535257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.536355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:33.536981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:33.537700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:33.565036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:33.750926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=30 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:33.756425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:33.765217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-030c2a0a-cdfa-48cd-b792-636085ac520b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1391 microversion: 2.1 time: 0.244990 Oct 28 18:14:33.765731 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3324/6687] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:33 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:34.788363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:34.788969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:34.796703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.797195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.797636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.798327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.798783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.799212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.933212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:34.941003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a709539-75bd-43ca-9679-c11426813394 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1564 microversion: 2.1 time: 0.156537 Oct 28 18:14:34.941578 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3325/6688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:34 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:34.964349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:34.964901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:34.970930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.971467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.971922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:34.972628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:34.973096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:34.973537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:35.105097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:35.113033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f7401987-9637-4525-acb8-8ce4043fc1dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1564 microversion: 2.1 time: 0.152855 Oct 28 18:14:35.113645 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3326/6689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:34 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:14:37.055091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:14:37.055748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:14:37.063535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.064048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.064504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.065260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.065737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.066222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.070573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:14:37.295858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:14:37.307563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5872cfb-8244-4de9-94c5-9b78945a9920 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1564 microversion: 2.1 time: 0.255690 Oct 28 18:14:37.319757 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3327/6690] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:14:37 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:14:37.319757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:14:37.326365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:14:37.326982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:14:37.327496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:14:37.342466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] Creating event network-changed:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:14:37.347577 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-09b505de-0283-4b19-a1db-3f630a528e55 req-7c3efa84-c337-457d-ac58-4b61ff0dd2f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038222 Oct 28 18:14:37.348350 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3328/6691] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:04.659648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:04.660752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:04.665062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.665686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:04.674175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.674667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.675110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.675835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.676299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.676730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.703200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:15:04.785482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-da3d034c-369b-41a0-972c-529941dabdb1 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "DELETE /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 204 len: 0 microversion: 2.1 time: 0.127915 Oct 28 18:15:04.785977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3329/6692] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:15:04 2022] DELETE /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:15:04.791228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:04.801469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.801964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.802403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.813772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] Creating event network-changed:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:15:04.818655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5165d808-4b83-44ef-85b3-4afd77af02ad req-c8cfed83-8ff5-4527-a414-0957a15f6a0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031321 Oct 28 18:15:04.819208 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3330/6693] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:04.825127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:04.825838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:04.831975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.832470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.832919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.833625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:04.834087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:04.834523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:04.967505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:04.975603 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f24dc9f7-350b-4090-a3bf-c9707a25759c tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1585 microversion: 2.1 time: 0.155181 Oct 28 18:15:04.976487 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3331/6694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:04 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1585 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:06.001352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:06.001990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:06.009187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.009675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.010115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.010812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.011938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.012527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.210207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:06.218095 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3741e46e-132b-4e5b-ad31-5a03e620998f tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1585 microversion: 2.1 time: 0.220757 Oct 28 18:15:06.218663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3332/6695] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:05 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1585 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:06.861366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05322d9c-6990-4679-9ec6-d8b40ea5c734", "name": "network-vif-deleted", "tag": "cf240377-c5fe-48e2-980b-d45464eef873"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:06.871828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:06.872322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:06.872762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:06.884247 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] Creating event network-vif-deleted:cf240377-c5fe-48e2-980b-d45464eef873 for instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 on n-h1-860864-13 Oct 28 18:15:06.890067 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fda8c8e9-922d-4191-a769-d7265beb1d88 req-33fcd431-1360-487d-bfff-87816949744d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Oct 28 18:15:06.890659 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3333/6696] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:15:07.244072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:07.246079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:07.253046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.254056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.254521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.255415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:07.255892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:07.256337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:07.322656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:07.330813 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-624b6e9b-e36f-4bcd-b292-2535baff5574 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1230 microversion: 2.1 time: 0.092265 Oct 28 18:15:07.331421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3334/6697] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:07 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:08.354260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:08.355785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:08.363007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.363640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.364152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.364938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:08.365494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:08.366018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:08.431939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:08.441054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8cd4ddff-9206-416f-b6f3-db1ce51b2015 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1230 microversion: 2.1 time: 0.090766 Oct 28 18:15:08.441753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3335/6698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:08 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:09.465581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:09.466227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:09.473137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.473637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.474089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.474833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:09.475304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:09.475776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:09.537999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:09.546634 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce0eddfd-88cb-4c5f-8edd-6bfdf0f92fbc tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1230 microversion: 2.1 time: 0.085741 Oct 28 18:15:09.547236 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3336/6699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:09 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:10.570364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:10.570986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:10.579072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.579662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.580105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.580841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.581348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.581799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.649869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa92e546d9c4a27b1e9e04e87a571e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8100770c87b4835ad6c1a026bc54e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:10.658930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a12a2603-cd09-40dd-a55a-2a6ec25e1d36 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 200 len: 1230 microversion: 2.1 time: 0.092499 Oct 28 18:15:10.659522 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3337/6700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:10 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:10.668869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:10.671230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:10.677784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.678282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.678732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.679514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:10.679981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:10.680419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:10.730653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76c46f7d-96b6-4af1-82b1-e5f7583288d5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action" status: 200 len: 24568 microversion: 2.1 time: 0.065368 Oct 28 18:15:10.731314 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3338/6701] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:10 2022] POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action => generated 24568 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:15:11.683065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:11.683765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] [instance: 05322d9c-6990-4679-9ec6-d8b40ea5c734] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:11.691190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.691715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.692162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.692869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:11.693333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:11.693770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:11.708366 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] HTTP exception thrown: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Request method failure captured: Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 HTTP/1.1 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBtxWta5KAlWIqKVqqiLkjNkLazGWnh4WCtXUfMEDTX0kiVLikaFSuT0qdK1YGya53fo57S7-cLiLSOXncEIanod_5XYBlqk9EVRhpi8XudfP7iVcBEZfFBLs9tWNIwAF35o_0R3frao1lPJUzKVwFWliD-AHUX2PhmMtM2CxKX937k Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: d8100770c87b4835ad6c1a026bc54e4e Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestVolumeBackupRestore-1800007491 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d8100770c87b4835ad6c1a026bc54e4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d8100770c87b4835ad6c1a026bc54e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d8100770c87b4835ad6c1a026bc54e4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d8100770c87b4835ad6c1a026bc54e4e"}]}] Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestVolumeBackupRestore-1800007491 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: d8100770c87b4835ad6c1a026bc54e4e Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1800007491 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestVolumeBackupRestore-1800007491-project Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7aa92e546d9c4a27b1e9e04e87a571e9 Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestVolumeBackupRestore-1800007491-project Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '05322d9c-6990-4679-9ec6-d8b40ea5c734'} Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:15:11.710003 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Returning 404 to user: Instance 05322d9c-6990-4679-9ec6-d8b40ea5c734 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d5ccaf7-3a7c-49a9-a70c-891a86d12923 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734" status: 404 len: 111 microversion: 2.1 time: 0.032823 Oct 28 18:15:11.714796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3339/6702] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:11 2022] GET /compute/v2.1/servers/05322d9c-6990-4679-9ec6-d8b40ea5c734 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:15:11.871614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7fd6bcbf-7982-4ac2-b58d-25f433a0a4e0 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] Calling method '.version_select at 0x7f751f814550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:11.904225 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7fd6bcbf-7982-4ac2-b58d-25f433a0a4e0 tempest-TestVolumeBackupRestore-1800007491 tempest-TestVolumeBackupRestore-1800007491-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2030325200" status: 202 len: 0 microversion: 2.1 time: 0.038161 Oct 28 18:15:11.908141 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3340/6703] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 18:15:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2030325200 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:15:40.924975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:40.925628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:40.928320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:40.928984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:40.937397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.937893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.938344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:40.939053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:40.939557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:40.939997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.076499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53d840c4-7ee2-40b2-a048-64cd81079933 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1836 microversion: 2.1 time: 0.155509 Oct 28 18:15:41.077071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3341/6704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:40 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1836 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:41.098504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.099119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:41.104868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.105383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.106090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.106629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.107095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.107588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.237770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.245591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed25b3e7-9054-46f4-96c0-90330bd7cfab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1683 microversion: 2.1 time: 0.150654 Oct 28 18:15:41.246853 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3342/6705] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:41.344346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:41.346559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:41.352637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.353135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.353593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.354299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.354772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.355214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.408326 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9ddfcf2-7049-4a1e-a958-4111363f4563 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action" status: 200 len: 32634 microversion: 2.1 time: 0.067950 Oct 28 18:15:41.408996 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3343/6706] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:41 2022] POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:15:41.564009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:41.564605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:41.571702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.572197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.572645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.573346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.573816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.574291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.604991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd5c481c019984c8f955c67a85677d23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74340844464633990b36c6ac91751a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.606116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] flavor_id is None. Assuming migration. {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 18:15:41.606578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:15:41.720804 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49f2b9a2-a122-450f-8505-aacc3f93b3e0 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action" status: 202 len: 0 microversion: 2.1 time: 0.161023 Oct 28 18:15:41.724856 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3344/6707] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:15:41 2022] POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:15:41.730162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:41.731485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:41.738057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.738700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.739155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.740204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:41.740380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:41.740798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:41.883943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:41.892451 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-122f31c6-74d9-4a0d-b703-e6b165542619 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1692 microversion: 2.1 time: 0.166019 Oct 28 18:15:41.893364 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3345/6708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:41 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:42.917466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:42.918647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:42.926775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.927273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.927746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:42.928455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:42.928915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:42.929351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:43.068368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:43.077222 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9827eadc-2503-42b6-b745-089f3fa2444a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1692 microversion: 2.1 time: 0.164127 Oct 28 18:15:43.077798 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3346/6709] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:42 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:44.101093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:44.101738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:44.108635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.109134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.109845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.110548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:44.111014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:44.111486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:44.569144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:44.577073 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4efa285-0011-43d8-8342-b1fcd019a8de tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.479961 Oct 28 18:15:44.577645 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3347/6710] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:44 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:45.600601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:45.601634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:45.609074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.609821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.610265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.610983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:45.611469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:45.611905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:45.741828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:45.750101 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f78038d-420d-4e17-aa5c-3cab4485f48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.153480 Oct 28 18:15:45.750680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3348/6711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:45 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:46.774040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:46.774670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:46.781532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:46.782025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:46.782473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:46.783172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:46.783670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:46.784109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:46.922623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:46.930295 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6d205da-854a-4d9d-aa56-1b1def860379 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.160237 Oct 28 18:15:46.930859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3349/6712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:46 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:47.953886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:47.954524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:47.961819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.962314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.962760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:47.963484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:47.963948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:47.964383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:48.097186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:48.104959 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03ebd60b-4728-4461-bfbe-f7792a9d4b72 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.155055 Oct 28 18:15:48.105589 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3350/6713] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:47 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:49.130911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:49.131540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:49.138882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.139390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.139856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.140557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:49.141014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:49.141447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:49.275079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:49.283587 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c85d7271-5674-41d5-85f4-efc790e0870c tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.156630 Oct 28 18:15:49.284159 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3351/6714] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:49 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:50.307132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:50.307812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:50.315165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.315708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.316161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.316874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:50.317338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:50.317780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:50.451592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:50.459346 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-201ee64c-4f9e-418f-8dda-bcf91ad5ea73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.156192 Oct 28 18:15:50.459950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3352/6715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:50 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:51.482752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:51.483361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:51.490518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.491005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.491478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.492172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:51.492629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:51.493061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:51.623292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:51.630931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63f2a89e-c1a0-4cfb-8e05-6439e9a80660 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.152067 Oct 28 18:15:51.631519 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3353/6716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:51 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:52.655484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:52.656104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:52.662858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.663399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.663846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.664539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:52.664999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:52.665436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:52.801562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:52.809409 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4fadbfba-59f5-4926-ac20-865d5d7646d1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.158484 Oct 28 18:15:52.809958 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3354/6717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:52 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:53.833182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:53.833799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:53.841131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.841617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.842065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.842764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:53.843226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:53.843688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:53.976898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:53.985729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-892b32a6-c87b-4970-8c3e-7f73856213c3 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.156446 Oct 28 18:15:53.986310 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3355/6718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:53 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:55.009376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:55.010007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:55.017649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.018086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.018532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.019227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:55.019719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:55.020158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:55.024258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:15:55.158091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:55.165784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bea408c5-5b02-488e-b7cc-4d6300135158 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1697 microversion: 2.1 time: 0.160498 Oct 28 18:15:55.166365 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3356/6719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:55 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:56.188807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:56.190093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:56.196710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.197204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.197646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.198351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.198808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.199276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.339094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:56.348102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-82341a39-32c6-4afc-9927-0494b98c2195 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1696 microversion: 2.1 time: 0.163195 Oct 28 18:15:56.348723 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3357/6720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:56 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:56.505169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-unplugged", "status": "completed", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:56.515067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:56.515585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:56.516031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:56.528803 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Creating event network-vif-unplugged:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h1-860864-13 Oct 28 18:15:56.534364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:15:56.546583 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a037193f-b039-4834-bd10-6b4a2ce9e39c req-dbd1194a-3ee1-4f2f-ab65-3769a2ed08ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168860 Oct 28 18:15:56.547196 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3358/6721] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:57.375603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:57.376540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:57.383042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.383592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.384044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.384755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:57.385227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:57.385699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:57.529919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:57.537655 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-90cb7ee4-6a0e-4596-99a1-65d078ee9b4e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1696 microversion: 2.1 time: 0.167600 Oct 28 18:15:57.538223 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3359/6722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:57 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:15:58.562363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:58.562980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:58.569888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.570382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.570827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.571576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.572037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.572468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.706350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:58.714188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d2b84c9-304e-4f3b-85c4-481d2deec3b6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1694 microversion: 2.1 time: 0.156458 Oct 28 18:15:58.714758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3360/6723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:58 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:15:58.719738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:15:58.728502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:58.728984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:58.729420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:58.742125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Creating event network-changed:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h1-860864-13 Oct 28 18:15:58.748463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:15:58.758887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2a02e591-948b-49f9-b8de-19730b0f09a9 req-5c53cd2c-f691-488e-9b5a-d3b6b2893047 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 Oct 28 18:15:58.759503 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3361/6724] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:15:59.739770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:15:59.740468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:15:59.747687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.748179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.748621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.749312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:15:59.749767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:15:59.750199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:15:59.890220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:15:59.898143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a4ee9089-3828-4177-a252-41fd9c853a17 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1694 microversion: 2.1 time: 0.163752 Oct 28 18:15:59.898722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3362/6725] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:15:59 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:00.922336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:00.922951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:00.929739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.930236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.930683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:00.931416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:00.931883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:00.932323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.074482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:01.082852 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b94aff37-d6cd-47d7-8e3c-1e0e03795023 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1691 microversion: 2.1 time: 0.165111 Oct 28 18:16:01.083460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3363/6726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:00 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:01.107124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:01.107712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:01.113827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.114324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.114776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.115764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.115976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.116412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.226960 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-091aec3b-d67c-48e9-aa76-e68d6b78f24b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action" status: 202 len: 0 microversion: 2.1 time: 0.124049 Oct 28 18:16:01.227834 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3364/6727] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:16:01 2022] POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:16:01.236271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:01.236979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:01.243260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.243797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.244254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.245023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:01.245426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:01.245870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:01.387104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:01.395017 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6acc5df-e566-456b-81ed-8eb1996be3a6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.163031 Oct 28 18:16:01.395673 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3365/6728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:01 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:02.418106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:02.418880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:02.425756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.426256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.426705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.427432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:02.427899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:02.428334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:02.564781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:02.572493 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed2d5cd5-4a82-4c64-8d59-617370f5ed94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.158357 Oct 28 18:16:02.573072 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3366/6729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:02 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:03.256389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-plugged", "status": "completed", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:03.266877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.267392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.267837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.279879 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Creating event network-vif-plugged:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h1-860864-13 Oct 28 18:16:03.285212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:16:03.295647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-71c4319c-d7bf-44b0-8daa-6ef1b1951409 req-67060ddd-2ce7-406d-aed9-838aecd3f4ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140352 Oct 28 18:16:03.296245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3367/6730] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:03.597862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:03.598504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:03.604744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.605243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.605757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.606586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:03.607055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:03.607530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:03.756562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:03.765006 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca1c0501-8269-432a-971b-5b5dd8c3a328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.172317 Oct 28 18:16:03.765683 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3368/6731] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:03 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:04.345470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-unplugged", "status": "completed", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:04.356689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.357380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.357826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.372270 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Creating event network-vif-unplugged:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:16:04.377754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:16:04.389285 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6f6bb665-a3da-41d6-858a-ae6ad68f4687 req-8071b100-47b6-4a2d-af7c-69a3b1944678 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047677 Oct 28 18:16:04.389913 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3369/6732] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:04.790384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:04.791249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:04.798361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.798860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.799308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.800035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:04.800493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:04.800923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:04.940213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:04.948204 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e6f1096-4ef4-4dfe-98a5-f7f0c90d9281 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.163203 Oct 28 18:16:04.948978 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3370/6733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:04 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:05.971763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:05.972518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:05.979222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.979757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.980211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:05.981192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:05.982120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:05.982569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.117214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:06.125947 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ff7e58f-3c68-42b5-8cca-ca3c4a1b40ea tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.158171 Oct 28 18:16:06.126530 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3371/6734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:05 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:06.420769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:06.430092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:06.430575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:06.431011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:06.442489 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Creating event network-changed:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:16:06.444898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:06.448826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:16:06.459998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-247b7a77-323a-45e4-a201-119248fa4de1 req-3d778d20-30e1-4970-8fd1-675e0d748b6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043468 Oct 28 18:16:06.460586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3372/6735] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:16:07.151598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:07.152231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:07.159483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:07.159976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:07.160419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:07.161117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:07.161577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:07.162013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:07.294967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:07.302866 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81f860dc-8735-4c35-be1c-77f3176c0f44 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1690 microversion: 2.1 time: 0.156648 Oct 28 18:16:07.303469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3373/6736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:07 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:08.326147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:08.327509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:08.334349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.334845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.335296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.336034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:08.336500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:08.336942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:08.471486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:08.479139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cfc7d167-4089-4444-9795-f7ba7c1b64d9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1683 microversion: 2.1 time: 0.156992 Oct 28 18:16:08.479750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3374/6737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:08 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:11.019276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-plugged", "status": "completed", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:11.027048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=75 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:11.035956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:11.036461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:11.036893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:11.048407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] Creating event network-vif-plugged:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:16:11.054044 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-846cbe5e-f722-4d98-ae4a-1712070ba04a req-111a95f5-ffa8-4db2-ad2a-c9e7df7b6b66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038186 Oct 28 18:16:11.054674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3375/6738] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:40.710975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:40.711679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=15 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:40.814502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:40.817015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:40.823384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.823891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.824346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.825056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:40.825526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:40.825969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:40.885163 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4eac3316-3e60-44ab-8216-ec2ea91c0755 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action" status: 200 len: 63007 microversion: 2.1 time: 0.179367 Oct 28 18:16:40.885797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3376/6739] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:16:40 2022] POST /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab/action => generated 63007 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:16:57.303986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:57.304753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:16:57.416893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:57.417626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:57.424875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.425375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.425857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.426565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:57.427063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:57.427561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:57.558999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea8585d8-d13f-4345-92c2-b62192f683c2 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1836 microversion: 2.1 time: 0.260372 Oct 28 18:16:57.559540 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3377/6740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:57 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1836 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:16:58.414009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.414621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:58.421433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.421925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.422371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.423222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.424203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.425217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.452757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:16:58.533162 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fe63c583-7874-4ebc-a843-aefc6c0f97cf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 204 len: 0 microversion: 2.1 time: 0.122523 Oct 28 18:16:58.534458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3378/6741] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:16:58 2022] DELETE /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:16:58.604107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:16:58.614532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.614956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.615417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.626986 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] Creating event network-changed:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:16:58.632197 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-93d2ed24-883f-4bf7-a490-afc3e127625c req-6bb0d65c-4652-4d44-b4e3-c0b29410cf39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096286 Oct 28 18:16:58.632919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3379/6742] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:16:58.637956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:58.638650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:58.646219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.646713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.647151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.647875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:58.648334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:58.648769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:58.791196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:58.799783 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4831abd3-6216-4fd0-83bf-d4013eac39fc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1689 microversion: 2.1 time: 0.165441 Oct 28 18:16:58.800520 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3380/6743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:58 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:16:59.823925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:16:59.824550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:16:59.831884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:59.832386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:59.832835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:59.833545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:16:59.834012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:16:59.834449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:16:59.969623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:16:59.978617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-454e144e-8819-4250-955c-114c2e976206 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1689 microversion: 2.1 time: 0.158535 Oct 28 18:16:59.979213 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3381/6744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:16:59 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:00.826376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9c1472-4036-4c87-afa4-28b7092c84ab", "name": "network-vif-deleted", "tag": "257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:00.837715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:00.838358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:00.838625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:00.851243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] Creating event network-vif-deleted:257ba38e-1ca8-4e92-a8fc-e01eb4a5d1e8 for instance 4e9c1472-4036-4c87-afa4-28b7092c84ab on n-h2-860864-13 Oct 28 18:17:00.856419 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ce99191e-7842-4c28-b14f-a889ba5b0b44 req-e0eb72ea-7fa8-4ded-a308-c494efc701ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 Oct 28 18:17:00.857145 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3382/6745] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:01.004434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:01.005166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:01.011465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.011958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.012404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.013154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.013615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.014048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.050723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:01.051144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:01.051614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:01.052069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lazy-loading 'fault' on Instance uuid 4e9c1472-4036-4c87-afa4-28b7092c84ab {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:17:01.096195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:01.104244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3144f6c5-8d55-4da6-bdc9-3ed116ae0f41 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 200 len: 1356 microversion: 2.1 time: 0.104193 Oct 28 18:17:01.104830 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3383/6746] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:00 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:02.128629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:02.129308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 4e9c1472-4036-4c87-afa4-28b7092c84ab] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:02.136112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:02.136605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:02.137054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:02.137753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:02.138215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:02.138650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:02.152571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] HTTP exception thrown: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Request method failure captured: Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab HTTP/1.1 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBtSO3o7q0lqgB9BCdfQKSnCT_IMK0JDkBbQVhDpJfxmJ5uoPv78qgB4xZn9HurAEPhTP3CcxuuE0qSmKkediJpNM2r8He53e4H59vvU6b1GAu8l4XMzsG8RaN7g-9wwi9f9Of1QAwoGm48jK6xFBrW5XVMxA-D2rYpMk69tlwGMKi4 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ced1592851f6494096a84e9d69a4c93a"}]}] Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d4eb59da561249858854cce09ce51860 Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '4e9c1472-4036-4c87-afa4-28b7092c84ab'} Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.154214 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Returning 404 to user: Instance 4e9c1472-4036-4c87-afa4-28b7092c84ab could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-972762c8-edff-4f25-abc0-e5e7a7f32328 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab" status: 404 len: 111 microversion: 2.1 time: 0.031021 Oct 28 18:17:02.158862 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3384/6747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:02 2022] GET /compute/v2.1/servers/4e9c1472-4036-4c87-afa4-28b7092c84ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:17:05.215075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2bd83615-57e2-4bf8-af27-2ce26c3127c7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '.version_select at 0x7f75047c8700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:05.248552 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2bd83615-57e2-4bf8-af27-2ce26c3127c7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1939063148" status: 202 len: 0 microversion: 2.1 time: 0.037266 Oct 28 18:17:05.249176 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3385/6748] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 18:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1939063148 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:17:05.283915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f919bb12-2efa-474f-ab7b-141c3d4372ab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: .version_select at 0x7f75047c63a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-240330052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu/h0ZeouVIKXTucXTKtsYqdFvtQJBxQ/nTScSWmEeKgFvBqOrMdE9q5i4rn1C/Mg7RA6B9+SIiOGFovQ2QRIHq3lvI2Nxq3qTxNhKZOQJ9yuk+Q8OwiGMTz2vVcG5Jrg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:05.301000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f919bb12-2efa-474f-ab7b-141c3d4372ab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:05.306263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f919bb12-2efa-474f-ab7b-141c3d4372ab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:05.330598 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f919bb12-2efa-474f-ab7b-141c3d4372ab tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050182 Oct 28 18:17:05.330812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3386/6749] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:17:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:17:11.219361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1008767770", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "28fc1f0c-7189-4e38-858d-36d3e49bd311"}], "key_name": "tempest-TestNetworkAdvancedServerOps-240330052", "security_groups": [{"name": "tempest-secgroup-smoke-580796166"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:11.340649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] validate_networks() for [('28fc1f0c-7189-4e38-858d-36d3e49bd311', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:17:11.878948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:17:11.879826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:17:11.880740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:17:11.881371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:17:11.881806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:17:11.895203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.896345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.897193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.898096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:11.898784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:11.899779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:11.923290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:17:11.930302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:17:11.950659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:17:11.953913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:17:12.020498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3df587ac-c909-4282-8edb-198ce5fe6632 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.804936 Oct 28 18:17:12.021734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3387/6750] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:17:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:17:12.041158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2d95435d-3a67-4924-a3b8-d39f32edb4c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:12.042111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2d95435d-3a67-4924-a3b8-d39f32edb4c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:12.133908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2d95435d-3a67-4924-a3b8-d39f32edb4c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:12.145851 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2d95435d-3a67-4924-a3b8-d39f32edb4c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1266 microversion: 2.1 time: 0.116536 Oct 28 18:17:12.146707 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3388/6751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:12 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:13.174362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:13.175054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:13.182251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.182757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.183223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.183986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:13.184516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:13.185069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:13.265607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:13.283555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c79c8c49-3e52-4264-ae8d-4a45f76a5c53 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1318 microversion: 2.1 time: 0.112993 Oct 28 18:17:13.289899 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3389/6752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:13 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:14.310500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:14.311123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:14.319409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.320578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.321079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.321982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.322456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.322906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.462922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:14.471318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e44c58c3-c8f0-4036-ba77-22d3235767c6 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.164130 Oct 28 18:17:14.471906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3390/6753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:14 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:14.813095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752d7464-203d-45ff-9938-632881747195", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:14.831529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:14.832791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:14.833442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:14.856318 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] Creating event network-changed:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h1-860864-13 Oct 28 18:17:14.863123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7443b34a-6c58-45d3-b7ce-01d87f8fbf63 req-d1afda18-5082-4b3b-be4e-b81c52a6784d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053787 Oct 28 18:17:14.864312 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3391/6754] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:15.495812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:15.496521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:15.503397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.503886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.504340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.505039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:15.505505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:15.505963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:15.645987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:15.653674 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-600c8813-543c-49c3-b3ea-bba8c085a291 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.163051 Oct 28 18:17:15.654250 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3392/6755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:15 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:16.677395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:16.678067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:16.684930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:16.685432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:16.685886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:16.686600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:16.687073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:16.687556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:16.822681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:16.831199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c8cd607-c951-4ef7-8108-1a1e38398322 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.158529 Oct 28 18:17:16.831856 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3393/6756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:16 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:17.855106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:17.855721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:17.863232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.863789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.864239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.864943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:17.865408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:17.865849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:17.998459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:18.006707 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10dd3fd1-c4e0-4c3a-b56d-552cdd89a756 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.155616 Oct 28 18:17:18.007292 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3394/6757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:17 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:19.029515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:19.030133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:19.037607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.038104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.038553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.039256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:19.039754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:19.040195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:19.174988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:19.182688 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-133efa77-0732-4e4f-bc48-0671641f8074 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.157239 Oct 28 18:17:19.183265 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3395/6758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:19 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:20.206340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:20.206990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:20.213688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.214180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.214629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.215326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:20.215807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:20.216242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:20.347442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:20.355088 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-02252781-0e3c-4255-a253-0f26dd8c9eb5 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.153064 Oct 28 18:17:20.355705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3396/6759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:20 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:21.379135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:21.379994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:21.387152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:21.387703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:21.388176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:21.388883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:21.389341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:21.389779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:21.530812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:21.534953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:21.540111 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6bbd0d8c-c91d-4959-b543-75218e6661dc tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.165724 Oct 28 18:17:21.540686 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3397/6760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:21 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:21.545573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752d7464-203d-45ff-9938-632881747195", "name": "network-vif-plugged", "status": "completed", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:21.555931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:21.556419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:21.556866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:21.567908 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] Creating event network-vif-plugged:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h1-860864-13 Oct 28 18:17:21.573233 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2628647f-33aa-4768-ac18-50e6c4829e06 req-1f14d5a3-3811-477d-ae45-442b139a9420 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 Oct 28 18:17:21.573842 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3398/6761] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:22.561618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:22.562444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:22.568144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:22.568855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:22.575958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:22.576452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:22.576901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:22.577599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:22.578063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:22.578515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:22.716937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:22.724635 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1130839-dcad-4467-a370-4838c14bfd56 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1391 microversion: 2.1 time: 0.163985 Oct 28 18:17:22.725217 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3399/6762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:22 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:17:23.748337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:23.748982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:23.756133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.756627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.757080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.757780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.758245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.758684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.900205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:23.907996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-152f0080-a741-454e-8fb7-8405812c5c48 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1563 microversion: 2.1 time: 0.163532 Oct 28 18:17:23.909137 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3400/6763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:23 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:23.930285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:23.930894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:23.936651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.937146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.937593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:23.938294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:23.938755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:23.939192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:24.070487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:24.078267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9a16631-cef7-42e4-8b12-10bce6f2b873 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1563 microversion: 2.1 time: 0.151608 Oct 28 18:17:24.078883 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3401/6764] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:23 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:25.655361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:17:25.656143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:25.664177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.664688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.665374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.666141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.666657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.667102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.813476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:17:25.822403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3257bb6c-0c02-459b-89ad-b67f30e17ff4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1563 microversion: 2.1 time: 0.171190 Oct 28 18:17:25.823160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3402/6765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:17:25 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:17:25.827553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752d7464-203d-45ff-9938-632881747195", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:25.837591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:25.838078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:25.838513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:25.851154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] Creating event network-changed:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h1-860864-13 Oct 28 18:17:25.856911 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ba2bbb4b-6f00-4ce4-b662-cfda03edaf41 req-3efb78a6-2e24-4e0b-8f0a-9222c001837b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032286 Oct 28 18:17:25.857696 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3403/6766] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:17:44.215460 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:17:44.216070 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:17:44.221889 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:17:44.222022 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:17:44.227915 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:17:44.228027 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:17:59.425595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:59.426520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=28 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:17:59.430835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:17:59.433454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:17:59.441190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.441982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.442426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.443124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:17:59.443616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:17:59.444056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:17:59.501146 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55130401-3cdf-4882-a2a9-b508b48b5850 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action" status: 200 len: 24570 microversion: 2.1 time: 0.078279 Oct 28 18:17:59.501786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3404/6767] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:17:59 2022] POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:18:29.938533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:29.939238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:29.942015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:29.943254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:29.949520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:29.950014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:29.950464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:29.951171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:29.951661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:29.952097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.232157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:30.240816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2cbadeed-5cd9-4d5f-a2ca-543acdd7cb73 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1681 microversion: 2.1 time: 0.305811 Oct 28 18:18:30.241385 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3405/6768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:29 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:30.335837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:30.338003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:30.344908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.345402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.345847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.346545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.347010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.347481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.404351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ddf74c4f-1dd4-4658-9799-3a5fdf488650 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action" status: 200 len: 32645 microversion: 2.1 time: 0.072404 Oct 28 18:18:30.405218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3406/6769] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:18:30 2022] POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action => generated 32645 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:18:30.624210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:30.624837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:30.632271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.632773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.633219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.633914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.634380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.634813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.768796 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-35204ef3-e005-4408-9942-cee592ab1375 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1834 microversion: 2.1 time: 0.148676 Oct 28 18:18:30.769380 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3407/6770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:30 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1834 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:30.799059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:30.801514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:30.807613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.808115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.808568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.809276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:30.809746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:30.810191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:30.834349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lazy-loading 'flavor' on Instance uuid 752d7464-203d-45ff-9938-632881747195 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:18:30.846594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 752d7464-203d-45ff-9938-632881747195] Going to try to live migrate instance to another host {{(pid=120568) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 18:18:32.288547 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4705af7e-2553-47a8-8bd8-0714e5c6b3d7 tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action" status: 202 len: 0 microversion: 2.1 time: 1.493124 Oct 28 18:18:32.293351 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3408/6771] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:18:30 2022] POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:18:32.298290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:32.299089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:32.307685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:32.308431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:32.309050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:32.310074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:32.310620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:32.311095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:32.460213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:32.469191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e129df4-7591-4a60-8a1a-f53bc54432f8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.174547 Oct 28 18:18:32.469765 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3409/6772] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:32 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:33.372609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752d7464-203d-45ff-9938-632881747195", "name": "network-vif-unplugged", "status": "completed", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:33.383924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.384433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.384861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.395168 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] Creating event network-vif-unplugged:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h1-860864-13 Oct 28 18:18:33.400247 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-25704610-720f-4b70-aea5-c5e69b491c43 req-9d3a6863-7d83-45cb-9934-88f3cf74c947 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031307 Oct 28 18:18:33.400854 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3410/6773] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:18:33.495500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:33.496242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:33.503499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.504010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.504455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.505262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:33.505920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:33.506539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:33.640039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:33.648463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dde1fdbb-934f-4123-8524-01940aa3f3bd tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.157358 Oct 28 18:18:33.649080 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3411/6774] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:33 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:34.671570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:34.672190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:34.679552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:34.680051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:34.680502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:34.681204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:34.681663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:34.682096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:34.819982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:34.827664 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54b5b870-7394-457d-88c5-cfacbf86ff40 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.160116 Oct 28 18:18:34.828243 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3412/6775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:34 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:35.416907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752d7464-203d-45ff-9938-632881747195", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:35.426108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.426585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.427584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.438841 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] Creating event network-changed:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h1-860864-13 Oct 28 18:18:35.444442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5858bcd6-8ed0-4895-9f76-f456d34d70e6 req-5d6a5382-de95-45a1-9eae-be7a8b1ec940 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031175 Oct 28 18:18:35.445064 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3413/6776] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:18:35.854075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:35.854780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:35.861209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.861758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.862166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.862877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:35.863339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:35.863801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:35.999753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:36.008188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-75dc932d-3336-44ba-989f-a27b97ddc466 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.160668 Oct 28 18:18:36.008760 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3414/6777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:35 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:37.033156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:37.033765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:37.041129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:37.041636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:37.042089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:37.042795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:37.043265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:37.043745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:37.174598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:37.183156 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9c8a10db-ba17-4967-af90-a39979d51fdf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.154111 Oct 28 18:18:37.183774 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3415/6778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:37 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:38.206104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:38.206757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:38.214047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.214545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.214996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.215738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:38.216204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:38.216643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:38.352379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:38.360406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6fe33e7e-3670-463f-9aae-9db9b0dcf4f9 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.158206 Oct 28 18:18:38.361591 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3416/6779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:38 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:39.384613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:39.385237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:39.392168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:39.392665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:39.393118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:39.393823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:39.394293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:39.394733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:39.528375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:39.536037 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2737c69-ee33-4241-aa14-36c0849e3d98 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.155678 Oct 28 18:18:39.536621 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3417/6780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:39 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:40.560247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:40.560867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:40.568229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.568796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.569242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.569941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:40.570402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:40.570839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:40.704967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:40.713367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e727f0e-b7a1-4308-bcb8-eca4f0ff2464 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.157091 Oct 28 18:18:40.713952 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3418/6781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:40 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:41.737100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:41.737749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:41.746605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.747101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.747584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.748297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:41.748756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:41.749190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:41.890208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:41.898080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d25b4aa-bc46-4cfe-9be1-2db9d02fa744 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.165141 Oct 28 18:18:41.898661 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3419/6782] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:41 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:42.921974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:42.922748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:42.930120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:42.930601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:42.931051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:42.931788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:42.932253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:42.932717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:43.076503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:43.084649 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6cf83b60-e926-4edf-b508-2de7361199ef tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1691 microversion: 2.1 time: 0.166477 Oct 28 18:18:43.085928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3420/6783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:42 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:44.109512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:44.110122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:44.117160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.117656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.118109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.118818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.119289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.119755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.137897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:44.253539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:44.261452 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b8eeb3d3-8069-4375-8d38-b02affe2a3b8 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1681 microversion: 2.1 time: 0.155877 Oct 28 18:18:44.262034 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3421/6784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:44 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:44.283922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:44.284540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:44.291071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.291608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.292062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.292772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.293239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.293678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.432075 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-404cd679-2853-4760-9293-70a9c1f764cb tempest-TestNetworkAdvancedServerOps-45312547 tempest-TestNetworkAdvancedServerOps-45312547-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1834 microversion: 2.1 time: 0.151623 Oct 28 18:18:44.432669 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3422/6785] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:44 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1834 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:44.456383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:44.457000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:44.463764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.464264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.464716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.465423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.465897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.466335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.599161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:44.607014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad83a3f6-70a5-486b-97ec-7e738db39bbb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1681 microversion: 2.1 time: 0.154429 Oct 28 18:18:44.607628 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3423/6786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:44 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:44.701152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:44.703385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:44.709502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.710727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.711116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.711843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:44.712308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:44.712742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:44.764710 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51123abb-5d4c-49b1-8741-e7c1d86802bf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action" status: 200 len: 38524 microversion: 2.1 time: 0.067372 Oct 28 18:18:44.765386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3424/6787] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:18:44 2022] POST /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195/action => generated 38524 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:18:45.984299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:45.984886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:45.993444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:45.993940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:45.994390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:45.995087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:45.995580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:45.996014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:46.023313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:18:46.102930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae843609-e6f0-4851-83f4-0add2b208de7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 204 len: 0 microversion: 2.1 time: 0.122800 Oct 28 18:18:46.103737 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3425/6788] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:18:45 2022] DELETE /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:18:46.112019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752d7464-203d-45ff-9938-632881747195", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:46.122233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:46.122877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:46.123310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:46.137583 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] Creating event network-changed:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h2-860864-13 Oct 28 18:18:46.142572 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7afcd8f3-061d-4983-9485-9cfea5ca2693 req-83d2b0ed-0bdf-4349-a3a1-fc75ef8ba85f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037356 Oct 28 18:18:46.143178 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3426/6789] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:46.148474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:46.149187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:46.155300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:46.155838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:46.156291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:46.157010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:46.157476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:46.157916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:46.298600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:46.307515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60697ec7-e867-45f7-8fc3-6e00cbd58078 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1687 microversion: 2.1 time: 0.163100 Oct 28 18:18:46.308298 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3427/6790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:46 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:47.333613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:47.334378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:47.342664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:47.346097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:47.346750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:47.347842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:47.348483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:47.349155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:47.386306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:47.386788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:47.387244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:47.387725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lazy-loading 'fault' on Instance uuid 752d7464-203d-45ff-9938-632881747195 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:18:47.432713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:47.440787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e933ab6-3f0b-4ef0-ada2-59cb8f056ece tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 200 len: 1356 microversion: 2.1 time: 0.111149 Oct 28 18:18:47.441367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3428/6791] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:47 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:18:48.159591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752d7464-203d-45ff-9938-632881747195", "name": "network-vif-deleted", "tag": "c51bc5cf-52c8-41d2-8f9b-acdfd28d741c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:48.170207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:48.170697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:48.171148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:48.182032 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] Creating event network-vif-deleted:c51bc5cf-52c8-41d2-8f9b-acdfd28d741c for instance 752d7464-203d-45ff-9938-632881747195 on n-h2-860864-13 Oct 28 18:18:48.186964 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-67fa70c5-1d17-43e6-b832-4cfeac9ebd0b req-64144c9d-91a9-48a9-b971-f5f92334c020 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031440 Oct 28 18:18:48.187599 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3429/6792] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:18:48.466823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:48.467550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 752d7464-203d-45ff-9938-632881747195] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:48.473924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:48.474417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:48.474866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:48.475596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:48.476585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:48.477043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:48.490147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] HTTP exception thrown: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Request method failure captured: Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 HTTP/1.1 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBtSO3o7q0lqgB9BCdfQKSnCT_IMK0JDkBbQVhDpJfxmJ5uoPv78qgB4xZn9HurAEPhTP3CcxuuE0qSmKkediJpNM2r8He53e4H59vvU6b1GAu8l4XMzsG8RaN7g-9wwi9f9Of1QAwoGm48jK6xFBrW5XVMxA-D2rYpMk69tlwGMKi4 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ced1592851f6494096a84e9d69a4c93a"}]}] Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d4eb59da561249858854cce09ce51860 Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '752d7464-203d-45ff-9938-632881747195'} Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:18:48.492756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Returning 404 to user: Instance 752d7464-203d-45ff-9938-632881747195 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42b7fee7-672e-4820-8c42-7564d2bbbae4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195" status: 404 len: 111 microversion: 2.1 time: 0.032317 Oct 28 18:18:48.496801 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3430/6793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:48 2022] GET /compute/v2.1/servers/752d7464-203d-45ff-9938-632881747195 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:18:51.870976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8f2f171d-6c1b-447c-89ef-e6c069b3d2df tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '.version_select at 0x7f750479b040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:51.896902 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8f2f171d-6c1b-447c-89ef-e6c069b3d2df tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-240330052" status: 202 len: 0 microversion: 2.1 time: 0.030122 Oct 28 18:18:51.897739 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3431/6794] 10.222.0.48 () {58 vars in 1281 bytes} [Fri Oct 28 18:18:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-240330052 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:18:51.932231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb52ae40-17f7-40c4-9fce-4524397d0de2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: .version_select at 0x7f75047591f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1259345517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhVJo+v3xXMY5XNZBSlLxIN4YKEmig1wEGUVGffKOotajIxUJkp+U4/4wgEmbJ6jCMNAnyqWm3Pw0Sulf9m5b2XEUcaE4Dx4CQFVW06ry1HWDBBPG8Ge8YxmvAsn0FgbA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:51.949605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb52ae40-17f7-40c4-9fce-4524397d0de2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:51.954830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fb52ae40-17f7-40c4-9fce-4524397d0de2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:51.978114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb52ae40-17f7-40c4-9fce-4524397d0de2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050478 Oct 28 18:18:51.978719 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3432/6795] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:18:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:18:57.410239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1082992547", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "93702eb4-6a0a-4858-af15-60c2bfa212c6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1259345517", "security_groups": [{"name": "tempest-secgroup-smoke-1698046687"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:18:57.539475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] validate_networks() for [('93702eb4-6a0a-4858-af15-60c2bfa212c6', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:18:58.034058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:18:58.034733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:18:58.035217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:18:58.035826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:18:58.036439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:18:58.046353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:58.046846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:58.047296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:58.048067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:58.048536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:58.048969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:58.067185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:18:58.072789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Getting quotas for user d4eb59da561249858854cce09ce51860 and project ced1592851f6494096a84e9d69a4c93a. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:18:58.085784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:18:58.088178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:18:58.136922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d0885879-e3f1-49b2-98d3-91f2ee012de4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731342 Oct 28 18:18:58.137764 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3433/6796] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:18:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:18:58.149688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a237748-3942-4096-8946-71400a977b35 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:58.150533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a237748-3942-4096-8946-71400a977b35 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:58.162742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:18:58.214217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a237748-3942-4096-8946-71400a977b35 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:58.221123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a237748-3942-4096-8946-71400a977b35 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1267 microversion: 2.1 time: 0.076251 Oct 28 18:18:58.237210 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3434/6797] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:58 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:18:59.245676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:18:59.246434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:18:59.257068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:59.259970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:59.261431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:59.262320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:18:59.263059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:18:59.263614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:18:59.349811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:18:59.360083 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-af1bee05-9d7b-4293-a455-0c22bf353462 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1337 microversion: 2.1 time: 0.119211 Oct 28 18:18:59.371405 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3435/6798] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:18:59 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1337 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:00.386919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:00.388205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:00.396532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.397428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.398368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.400005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.400942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.401640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.553832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:00.566759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c690a552-2b57-40b7-bd72-9caa23f5aa2f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.185053 Oct 28 18:19:00.567359 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3436/6799] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:00 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:00.697215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:00.708303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:00.708889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:00.709497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:00.984704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] Creating event network-changed:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:19:00.989742 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3ff6a782-a4ad-435e-9e73-1cfede237351 req-4d606942-c868-482c-a380-5a099f7d7a4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297572 Oct 28 18:19:00.990489 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3437/6800] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:01.591774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:01.592492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:01.599639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.600131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.600577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.601371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:01.602024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:01.602462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:01.732503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:01.740152 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f712d04-2c9e-4731-a0b1-2d6668686c58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.152660 Oct 28 18:19:01.740717 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3438/6801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:01 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:02.764824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:02.765444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:02.772297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:02.772786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:02.773795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:02.774490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:02.774948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:02.775446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:02.909755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:02.917824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4125114a-0682-4e9a-bc70-593ee73b76a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.156897 Oct 28 18:19:02.918387 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3439/6802] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:02 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:03.941492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:03.942147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:03.949207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:03.949702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:03.950155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:03.950861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:03.951328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:03.951788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:04.082218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:04.090533 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4a0fa93e-b8db-41a4-995c-dbc49a606ae1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.152954 Oct 28 18:19:04.091097 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3440/6803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:03 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:05.114394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:05.115012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:05.122555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:05.123043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:05.123521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:05.124229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:05.124699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:05.125140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:05.260283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:05.267891 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-091a6f8f-7aab-430c-b325-eac6a8f5a72b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.157539 Oct 28 18:19:05.268459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3441/6804] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:05 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:06.291197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:06.291918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:06.298646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.299149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.299629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.300338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:06.300811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:06.301249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:06.435384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:06.438898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:06.443940 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b1f029d-d7a4-44e3-84db-3dcea27575a1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.157324 Oct 28 18:19:06.444515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3442/6805] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:06 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:07.467581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:07.468180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:07.475972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.476465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.476910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.477615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.478520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.478961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.613130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:07.621819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a302ec5-0532-4f53-af06-dae14c16199f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.158867 Oct 28 18:19:07.622396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3443/6806] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:07 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:07.792871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "name": "network-vif-plugged", "status": "completed", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:07.802489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:07.802981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:07.803462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:07.816468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] Creating event network-vif-plugged:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:19:07.822490 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7110904a-c747-478d-8453-a14856707660 req-f8be3f45-6100-4c5e-abdc-d925fc1893ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Oct 28 18:19:07.823274 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3444/6807] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:19:08.645718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:08.646427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:08.648399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:08.649109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:08.656773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.657267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.657710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.658410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:08.658870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:08.659302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:08.794586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:08.802230 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e3893c30-d628-4e32-bd35-b178bbfa9d7e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1393 microversion: 2.1 time: 0.160757 Oct 28 18:19:08.802792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3445/6808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:08 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:09.826715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:09.827335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:09.834199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:09.834688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:09.835130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:09.835854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:09.836313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:09.836742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:09.968037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:09.975948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea35dff3-10cb-4348-957f-e178d9f2efb1 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1565 microversion: 2.1 time: 0.153137 Oct 28 18:19:09.976522 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3446/6809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:09 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:09.999394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:10.000016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:10.005917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.006420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.006866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.007595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:10.008065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:10.008501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:10.143282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:10.150983 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e731b2ca-f26c-4194-aff1-573131b9e561 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1565 microversion: 2.1 time: 0.155316 Oct 28 18:19:10.151581 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3447/6810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:09 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:19:11.992745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:19:11.994246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:12.001911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:12.002500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:12.003018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:12.003818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:12.004347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:12.004849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:12.145648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:19:12.154249 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed68554f-974e-4ea8-ab36-cc927acdacc4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1565 microversion: 2.1 time: 0.166127 Oct 28 18:19:12.154833 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3448/6811] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:19:11 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:19:12.159566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:12.168737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:12.169223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:12.169659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:12.180859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] Creating event network-changed:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:19:12.185919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4a445e07-805e-4463-918d-00ba3963c9d1 req-9bb353f3-2c26-4c14-83bd-05bbddeb6f8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Oct 28 18:19:12.186705 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3449/6812] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:19:43.482354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=30 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:43.483211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=34 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:19:43.488594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:19:43.490835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:19:43.499073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.499604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.500056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.500758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:19:43.501224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:19:43.501659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:19:43.555540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5389c80-bde9-4351-9391-a216c1e95072 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action" status: 200 len: 24573 microversion: 2.1 time: 0.075462 Oct 28 18:19:43.556172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3450/6813] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:19:43 2022] POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:20:13.982131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:13.984979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:13.987655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:13.988329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:13.995895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.996390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.996837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:13.997538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:13.998004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:13.998441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.079189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:20:14.079673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:20:14.080160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:20:14.080583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:20:14.081007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:20:14.140410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:14.146238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.146736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.147200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.147941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.148412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.148850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.176454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-572ab6e4-7cdc-4597-8921-68352ea1477f tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action" status: 202 len: 1138 microversion: 2.1 time: 0.199384 Oct 28 18:20:14.177108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3451/6814] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:20:13 2022] POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action => generated 1138 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 18:20:14.196852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:14.198086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:14.204280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.204814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.205298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.206038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:14.206501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:14.206937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:14.350266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:14.359428 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86e567a0-2bba-46c8-9074-cea8b82de376 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.166272 Oct 28 18:20:14.363456 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3452/6815] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:14 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:15.384714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:15.386230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:15.392665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:15.393182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:15.393626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:15.394320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:15.394779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:15.395209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:15.526922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:15.534609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-776f9056-359e-4163-8042-669e8f2f39d4 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.153826 Oct 28 18:20:15.535207 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3453/6816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:15 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:16.558311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:16.558956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:16.566379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:16.566958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:16.567459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:16.568137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:16.568599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:16.569033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:16.699629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:16.707307 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b5ba2de-51d0-4c42-b98a-3178d2e53aee tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.153500 Oct 28 18:20:16.707897 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3454/6817] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:16 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:17.731820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:17.732477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:17.739278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.739809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.740259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:17.740961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:17.741427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:17.741864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:17.880126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:17.888017 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-68452141-38dd-4212-b384-43ae31b2df97 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.160495 Oct 28 18:20:17.888593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3455/6818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:17 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:18.911835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:18.912478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:18.919901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:18.920391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:18.920837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:18.921540 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:18.921998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:18.922431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:19.053394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:19.061661 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd3a527d-5844-41eb-b14c-709a44a5ac2e tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.153753 Oct 28 18:20:19.062242 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3456/6819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:18 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:20.085275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:20.085935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:20.093255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.093750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.094205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.094930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:20.095390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:20.095836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:20.230373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:20.238334 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1004ddf8-e524-4dfb-94af-4826b22be23b tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.156956 Oct 28 18:20:20.238923 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3457/6820] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:20 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:21.262435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:21.263085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:21.269973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:21.270470 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:21.270926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:21.271657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:21.272125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:21.272566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:21.406524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:21.414261 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22f4bc99-2fa3-4f36-9a88-3575ee310f04 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.156268 Oct 28 18:20:21.414832 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3458/6821] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:21 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:22.439743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:22.440396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:22.447983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.448493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.448949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.449669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:22.450140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:22.450586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:22.583136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:22.591465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-57498797-bb10-472f-803e-3ee711a0ad58 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.156038 Oct 28 18:20:22.592038 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3459/6822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:22 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:23.616970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:23.617613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:23.624823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.625316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.625760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.626457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:23.626918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:23.627349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:23.757016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:23.765754 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12a60d68-1c14-48c9-8f48-cd3a46d4cee7 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.152828 Oct 28 18:20:23.766330 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3460/6823] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:23 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:24.789321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:24.789974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:24.797739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.798243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.798696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.799425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:24.799987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:24.800439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:24.934154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:24.941927 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-58231099-2a5c-45ba-a6d0-2269d7bcdf67 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1693 microversion: 2.1 time: 0.156543 Oct 28 18:20:24.942512 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3461/6824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:24 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:25.966682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:25.967349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:25.974155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.974656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.975144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:25.975883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:25.976348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:25.976792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:26.112604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:26.120787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7071cb8d-202a-4775-871a-769e577b9daf tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1699 microversion: 2.1 time: 0.158675 Oct 28 18:20:26.121364 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3462/6825] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:25 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:27.144423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:27.145066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:27.151728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.152932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.153391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.153997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:27.154467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:27.154911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:27.285637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:27.293442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f68c72d-3aeb-4e75-a4e5-ad7145df038d tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1699 microversion: 2.1 time: 0.153031 Oct 28 18:20:27.294021 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3463/6826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:27 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:28.317313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:28.317987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:28.326478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.326976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.327448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.328159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:28.328617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:28.329055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:28.471880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:28.479769 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa36953b-b66d-4934-9277-62daa2c0ab94 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1699 microversion: 2.1 time: 0.166916 Oct 28 18:20:28.480398 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3464/6827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:28 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:29.504027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:29.504648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:29.511457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.511948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.512908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.513602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:29.514059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:29.514489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:29.533169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:20:29.650239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:29.658695 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae675232-b69f-41d5-adbc-5a98c738fe28 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1699 microversion: 2.1 time: 0.158512 Oct 28 18:20:29.659269 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3465/6828] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:29 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:30.251814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "name": "network-vif-unplugged", "status": "completed", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:30.263251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.263865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.264420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.280178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] Creating event network-vif-unplugged:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:20:30.286823 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-21fff5f2-42d3-4e1e-84e8-ef3248441c08 req-4b3de84f-4a77-4f9e-8898-86dca7fd6435 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039568 Oct 28 18:20:30.287648 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3466/6829] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:20:30.683537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:20:30.684344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:20:30.690764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.691264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.691740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.692447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:30.692910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:30.693360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:30.822376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:20:30.830887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-14e422ed-16ea-4853-950d-ecd9a16f1b30 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1684 microversion: 2.1 time: 0.152538 Oct 28 18:20:30.831487 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3467/6830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:20:30 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:20:32.302030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "name": "network-vif-plugged", "status": "completed", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:20:32.313024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:20:32.313522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:20:32.313974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:20:32.327895 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] Creating event network-vif-plugged:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:20:32.333151 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ffa808cc-2074-434d-b5e0-9e661feb6156 req-6761a869-48b3-4207-b67f-061b38c85692 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034883 Oct 28 18:20:32.333775 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3468/6831] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:21:04.224832 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:21:04.225434 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:21:04.229540 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:21:04.229676 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:21:04.237621 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:21:04.237774 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:21:05.086150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:05.086950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:05.092291 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:05.094474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:05.101469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:05.101971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:05.102426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:05.103139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:05.103655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:05.104103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:05.155922 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f68dc80a-f074-4396-8516-f8fe98ceafcb tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action" status: 200 len: 24575 microversion: 2.1 time: 0.071686 Oct 28 18:21:05.156557 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3469/6832] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:21:05 2022] POST /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4/action => generated 24575 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:21:36.431219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:36.431862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:36.436494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:36.436799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:36.438266 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:21:36.438419 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 (ip 10.222.0.48) !!! Oct 28 18:21:36.445774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.446280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.446732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.447526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.447995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.448433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.476737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:21:36.555965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04968407-713c-425e-8afa-5e64c24fcaf2 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 204 len: 0 microversion: 2.1 time: 0.128815 Oct 28 18:21:36.559736 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3470/6833] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:21:36 2022] DELETE /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:21:36.624368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:36.634639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.635126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.635601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.646011 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] Creating event network-changed:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:21:36.651008 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-41750a20-972b-4918-9249-b4a27ade409a req-643f79df-ad6d-45ff-a6ef-0564639fa67c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093115 Oct 28 18:21:36.651647 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3471/6834] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:36.657302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:36.657984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:36.664084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.664582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.665030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.665738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:36.666204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:36.666647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:36.806755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:36.815708 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be152f95-9b37-44d8-ad56-0f7423147010 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1690 microversion: 2.1 time: 0.162898 Oct 28 18:21:36.816283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3472/6835] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:36 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:37.839702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:37.840371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:37.847446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.847953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.848402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.849115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:37.849578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:37.850016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:37.981408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:37.990087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-560b7d23-be7d-463e-8f51-438612231a46 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1690 microversion: 2.1 time: 0.154320 Oct 28 18:21:37.990673 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3473/6836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:37 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:38.922444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92fcf712-2933-4d1b-bd6d-f8b5cda58ac4", "name": "network-vif-deleted", "tag": "48fce680-37e5-4dd6-a9be-3340fe13539b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:38.933251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:38.933747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:38.934191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:38.946043 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] Creating event network-vif-deleted:48fce680-37e5-4dd6-a9be-3340fe13539b for instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 on n-h2-860864-13 Oct 28 18:21:38.951748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-73bb7e98-bc2f-4e45-ac9e-45d0e9e99d9b req-d5198230-c870-4bda-859f-dd6048ee4b7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Oct 28 18:21:38.952898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3474/6837] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:21:39.014578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:39.015581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:39.021799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:39.022299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:39.022749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:39.023489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:39.023952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:39.024387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:39.060798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:39.061295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:39.061750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:39.062209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lazy-loading 'fault' on Instance uuid 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:21:39.106956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eb59da561249858854cce09ce51860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced1592851f6494096a84e9d69a4c93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:39.114981 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-36cbd271-f921-44f9-8ff9-92eac61e0400 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 200 len: 1357 microversion: 2.1 time: 0.105554 Oct 28 18:21:39.115604 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3475/6838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:39 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:40.140617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:40.141249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] [instance: 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:40.148111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:40.148607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:40.149056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:40.149756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:40.150225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:40.150661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:40.164027 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] HTTP exception thrown: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Request method failure captured: Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 HTTP/1.1 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXBtSO3o7q0lqgB9BCdfQKSnCT_IMK0JDkBbQVhDpJfxmJ5uoPv78qgB4xZn9HurAEPhTP3CcxuuE0qSmKkediJpNM2r8He53e4H59vvU6b1GAu8l4XMzsG8RaN7g-9wwi9f9Of1QAwoGm48jK6xFBrW5XVMxA-D2rYpMk69tlwGMKi4 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ced1592851f6494096a84e9d69a4c93a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ced1592851f6494096a84e9d69a4c93a"}]}] Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ced1592851f6494096a84e9d69a4c93a Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2081407243 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: d4eb59da561249858854cce09ce51860 Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2081407243-project Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '92fcf712-2933-4d1b-bd6d-f8b5cda58ac4'} Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:21:40.165687 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Returning 404 to user: Instance 92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d6490bb-a50c-4cc6-81c5-9da71519a48a tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4" status: 404 len: 111 microversion: 2.1 time: 0.031079 Oct 28 18:21:40.169482 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3476/6839] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:40 2022] GET /compute/v2.1/servers/92fcf712-2933-4d1b-bd6d-f8b5cda58ac4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:21:44.031559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de1a960e-598b-4650-b939-0be309eec096 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] Calling method '.version_select at 0x7f751f47c550>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:44.057205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de1a960e-598b-4650-b939-0be309eec096 tempest-TestNetworkAdvancedServerOps-2081407243 tempest-TestNetworkAdvancedServerOps-2081407243-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1259345517" status: 202 len: 0 microversion: 2.1 time: 0.029572 Oct 28 18:21:44.058075 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3477/6840] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 18:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1259345517 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:21:51.829440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:21:51.834203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e34fa2b9-b9ae-490f-bf34-1d30a6f6daa3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: .version_select at 0x7f751fae4dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-246458281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGXcm/p0YRumtwiC6/Pg/7CSFJhfkgn/BcR2EWYZXxZqcE9Md7zhmWVFK3lVLnRHz198AlProW0mF0Lm1Vu4BM0jnKI4pDT5oumSaxc0RF/QiGZZTChTFnGYYAe4foANg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:51.861358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e34fa2b9-b9ae-490f-bf34-1d30a6f6daa3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:51.867647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e34fa2b9-b9ae-490f-bf34-1d30a6f6daa3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:51.917052 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e34fa2b9-b9ae-490f-bf34-1d30a6f6daa3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.089425 Oct 28 18:21:51.919112 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3478/6841] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:21:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:21:52.975249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1855163831", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "53a0087f-24b4-4446-a24b-4365df7181d9"}], "key_name": "tempest-TestNetworkBasicOps-246458281", "security_groups": [{"name": "tempest-secgroup-smoke-2018770716"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:53.101395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] validate_networks() for [('53a0087f-24b4-4446-a24b-4365df7181d9', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:21:53.570964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:21:53.571616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:21:53.572184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:21:53.572670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:21:53.573156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:21:53.584405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:53.584988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:53.585695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:53.586488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:53.587013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:53.587544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:53.605771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:21:53.612464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:21:53.627733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:21:53.630070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:21:53.682834 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42b856fe-1ba5-4010-9b79-384eb86d5e5d tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712472 Oct 28 18:21:53.683923 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3479/6842] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:21:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:21:53.695336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-717e55e5-8a0e-469e-a61b-f1d5ba771aae tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:53.696107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-717e55e5-8a0e-469e-a61b-f1d5ba771aae tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:53.756791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-717e55e5-8a0e-469e-a61b-f1d5ba771aae tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:53.766861 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-717e55e5-8a0e-469e-a61b-f1d5ba771aae tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1248 microversion: 2.1 time: 0.075449 Oct 28 18:21:53.767559 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3480/6843] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:53 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:54.789679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:54.790356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:54.798047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:54.798566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:54.799018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:54.799771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:54.800243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:54.801324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:54.866409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:54.875179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4493339c-6c51-449c-a4db-ec2598bd7e61 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1318 microversion: 2.1 time: 0.089483 Oct 28 18:21:54.875822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3481/6844] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:54 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:55.898476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:55.899084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:55.906734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:55.907231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:55.907766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:55.908415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:55.908877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:55.909686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:56.057046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:56.065487 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cce3fc9c-39a9-4833-b590-9f08b7800ccb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.171205 Oct 28 18:21:56.066156 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3482/6845] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:55 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:56.184398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1d8b68-3a80-4da9-8893-68eff7cb98e2", "tag": "270d8952-0193-4dc7-8f10-d40db4507a4e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:21:56.197329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:56.198236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:56.198690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:56.212047 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] Creating event network-changed:270d8952-0193-4dc7-8f10-d40db4507a4e for instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 on n-h1-860864-13 Oct 28 18:21:56.218013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b077c2ed-2bbb-4602-bd6e-572efc68aea6 req-7e1af942-ad3a-4557-9b8d-5d48af60760d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037621 Oct 28 18:21:56.218988 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3483/6846] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:21:57.091196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:57.092914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:57.099116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:57.099643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:57.100091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:57.100798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:57.101257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:57.101695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:57.233829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:57.241730 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cb415bd9-9dd7-446c-b1d3-5e04576280bf tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.155746 Oct 28 18:21:57.242311 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3484/6847] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:57 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:21:58.266120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:58.266797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:58.273597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:58.274089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:58.274537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:58.275232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:58.275724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:58.276159 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:58.420910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:58.428828 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-36e82629-df30-425a-8ee6-a309578690ec tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.166767 Oct 28 18:21:58.429425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3485/6848] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:58 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:21:59.452702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:21:59.453320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:21:59.460282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:59.460779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:59.461226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:59.461944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:21:59.462409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:21:59.462850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:21:59.599876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:21:59.608575 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-27a92a2d-7ebf-4247-b7d6-644c1f7a614b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.159782 Oct 28 18:21:59.609172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3486/6849] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:21:59 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:00.631785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:00.632406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:00.639807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.640312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.640767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.641494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:00.641964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:00.642413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:00.775319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:00.783389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6f70a8a9-5b67-429e-a416-7ad47b8eccb8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.155567 Oct 28 18:22:00.784058 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3487/6850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:00 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:01.806381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:01.807024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:01.814571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.815083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.815581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:01.816301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:01.816778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:01.817221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:01.951912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:01.959683 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-494bfd39-8710-4108-a606-f6c2e3d7e56f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.157249 Oct 28 18:22:01.960265 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3488/6851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:01 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:03.004315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1d8b68-3a80-4da9-8893-68eff7cb98e2", "name": "network-vif-plugged", "status": "completed", "tag": "270d8952-0193-4dc7-8f10-d40db4507a4e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:03.013817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:03.014302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:03.014743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.027028 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] Creating event network-vif-plugged:270d8952-0193-4dc7-8f10-d40db4507a4e for instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 on n-h1-860864-13 Oct 28 18:22:03.032348 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-923b53be-c22e-4001-bc9f-9b23aaa018e3 req-fce57bbd-e2ca-4b7a-b2b1-1923a03c5ceb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165899 Oct 28 18:22:03.032987 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3489/6852] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:22:03.038283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:03.039050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:03.045390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:03.045892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:03.046466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.047092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:03.047613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:03.048055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:03.190230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:03.198143 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f7984c6-c17e-4893-8307-2223b137cb37 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.164005 Oct 28 18:22:03.198732 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3490/6853] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:03 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:22:04.222210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:04.222827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:04.224923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:04.225702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:04.233360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.234539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.235016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.235689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:04.236247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:04.236693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:04.378109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:04.385829 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1cb5d6a-5cc0-41e0-b740-434530be04f9 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1374 microversion: 2.1 time: 0.167621 Oct 28 18:22:04.386407 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3491/6854] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:04 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:05.409342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:05.409986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:05.416934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.417426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.417872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.418575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.419039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.419502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.552534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:05.560436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0b683fa-b44b-4b21-a6ed-9c66f438dc6f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1546 microversion: 2.1 time: 0.155668 Oct 28 18:22:05.561012 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3492/6855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:05 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:05.582911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:22:05.583569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:05.589383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.589886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.590341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.591055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:05.591561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:05.592009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:05.726134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:22:05.733816 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f28d3074-2910-4f7f-b929-4eb2dfaf21b4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1546 microversion: 2.1 time: 0.154744 Oct 28 18:22:05.734400 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3493/6856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:22:05 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:22:07.563078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1d8b68-3a80-4da9-8893-68eff7cb98e2", "tag": "270d8952-0193-4dc7-8f10-d40db4507a4e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:07.570473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:07.575182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:07.576033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:07.576696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:07.594291 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] Creating event network-changed:270d8952-0193-4dc7-8f10-d40db4507a4e for instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 on n-h1-860864-13 Oct 28 18:22:07.600138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-be8f68d4-8795-4583-b949-d6857ef8f4a7 req-bf825796-f0d6-494b-960d-7a216e95c646 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041220 Oct 28 18:22:07.601248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3494/6857] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:22:39.896382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=74 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:22:39.901599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:22:39.903902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:22:39.911531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.912035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.912491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.913197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:22:39.913665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:22:39.914107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:22:39.964515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3430093d-62d8-455f-9f75-fbf9a1db15da tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2/action" status: 200 len: 24570 microversion: 2.1 time: 0.070138 Oct 28 18:22:39.965180 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3495/6858] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:22:39 2022] POST /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:23:15.270571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-534abf01-7cf9-4cd9-a24e-a49ec85f919a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: .version_select at 0x7f751f5c1670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1413665989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHqeFmG6wpT6bb3m2K5ozO2oJsGeI0N/83hY1HQHysBQSrpc3c6vvAwWy4G8RPHfNV+PLmPa+czWxj9f1z4rszYvJqv7J0Or7SNyykZjbk8iT51zUcZIh5I8BSQdnao8Q=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:15.276555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:15.277383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:15.290999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-534abf01-7cf9-4cd9-a24e-a49ec85f919a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:23:15.297246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-534abf01-7cf9-4cd9-a24e-a49ec85f919a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:23:15.324563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-534abf01-7cf9-4cd9-a24e-a49ec85f919a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.058515 Oct 28 18:23:15.325301 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3496/6859] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:23:15 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:23:16.362012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1885170255", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "8081d95a-aeb9-414a-8847-726d5b55735c"}], "key_name": "tempest-TestNetworkBasicOps-1413665989", "security_groups": [{"name": "tempest-secgroup-smoke-1839285378"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:16.475615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] validate_networks() for [('8081d95a-aeb9-414a-8847-726d5b55735c', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:23:16.917250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:23:16.918477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:23:16.918773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:23:16.919359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:23:16.919844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:23:16.930488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.930976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.931467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.932193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:16.932657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:16.933094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:16.953309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:23:16.958769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:23:16.974459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:23:16.976942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:23:17.038965 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a6e7d71-dbca-44f8-8a51-edfcf2eaf3bd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681845 Oct 28 18:23:17.040035 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3497/6860] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:23:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:23:17.052600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22a42463-f173-4ace-a78b-d5c8a550f976 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:17.053307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22a42463-f173-4ace-a78b-d5c8a550f976 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:17.124120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22a42463-f173-4ace-a78b-d5c8a550f976 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:17.133337 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22a42463-f173-4ace-a78b-d5c8a550f976 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1249 microversion: 2.1 time: 0.086023 Oct 28 18:23:17.147784 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3498/6861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:17 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:18.158894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:18.159549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:18.168517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.169096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.169681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.170372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:18.170851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:18.171319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:18.237592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:18.245644 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8382ff3d-f773-4a41-81d8-9dcbdb530d0e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1301 microversion: 2.1 time: 0.091468 Oct 28 18:23:18.246251 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3499/6862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:18 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:19.270296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:19.270955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:19.277512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:19.278016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:19.278467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:19.279179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:19.279674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:19.280118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:19.423091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:19.431603 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88c58459-3035-40f7-a81b-51cd92918c3e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.165202 Oct 28 18:23:19.432210 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3500/6863] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:19 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:19.671173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8623115-d9ec-4e38-bda9-2c263a2112ca", "tag": "96baafd6-77ae-406d-910a-cd651f19764b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:19.691304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:19.692341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:19.692816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:19.706015 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] Creating event network-changed:96baafd6-77ae-406d-910a-cd651f19764b for instance d8623115-d9ec-4e38-bda9-2c263a2112ca on n-h2-860864-13 Oct 28 18:23:19.710954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a1e6ad4d-4388-44a2-ba4a-31c0a6cc4dc7 req-feed0762-99df-4f0a-a1d3-02e32f9db0be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044286 Oct 28 18:23:19.711600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3501/6864] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:23:20.456671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:20.457395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:20.463645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.464144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.464627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.465327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:20.465801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:20.466236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:20.600297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:20.608192 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e2e1700a-cc24-4dda-978c-69dd45aeb88c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.157022 Oct 28 18:23:20.608771 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3502/6865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:20 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:21.632253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:21.632892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:21.639727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:21.640226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:21.640682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:21.641384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:21.641850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:21.642286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:21.774155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:21.781940 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4da7f507-5993-498d-85ac-280c5a1ce619 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.153711 Oct 28 18:23:21.782513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3503/6866] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:21 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:22.805985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:22.806618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:22.813476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:22.813994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:22.814801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:22.815572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:22.816055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:22.816507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:22.952620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:22.960954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-111b7bba-bfcc-40ff-a83e-6fd26abb85dc tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.158892 Oct 28 18:23:22.961479 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3504/6867] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:22 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:23.983818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:23.984494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:23.991899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.992399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.992845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:23.993549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:23.994017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:23.994457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:24.131265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:24.139132 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e563341e-c68c-43c7-8d6b-a40763282a6e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.159304 Oct 28 18:23:24.139729 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3505/6868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:23 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:25.162100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:25.162707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:25.169551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.170054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.170512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.171257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:25.171757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:25.172204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:25.308055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:25.315843 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a831c7a1-ad67-4275-9674-7c219c1beb0a tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.158319 Oct 28 18:23:25.316429 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3506/6869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:25 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:26.338949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:26.339667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:26.346466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.346970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.347444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.348154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:26.348624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:26.349067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:26.485455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:26.493366 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed51cece-09ab-4e2c-9ae1-57e728a5fcc4 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.158744 Oct 28 18:23:26.493954 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3507/6870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:26 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:27.170926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8623115-d9ec-4e38-bda9-2c263a2112ca", "name": "network-vif-plugged", "status": "completed", "tag": "96baafd6-77ae-406d-910a-cd651f19764b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:23:27.176833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:27.177614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:23:27.183617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.184134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.184667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.197077 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] Creating event network-vif-plugged:96baafd6-77ae-406d-910a-cd651f19764b for instance d8623115-d9ec-4e38-bda9-2c263a2112ca on n-h2-860864-13 Oct 28 18:23:27.202148 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-af1ffb5b-8ec2-470c-999e-6b58b47733ed req-4538455b-a0fa-44c8-b063-f292c69f4a42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Oct 28 18:23:27.202981 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3508/6871] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:23:27.518401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:27.519114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:27.525463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.525956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.526400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.527095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:27.527590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:27.528029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:27.663545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:27.671441 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bc4dbfc2-08ee-4022-944e-037f69d1a5cd tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1375 microversion: 2.1 time: 0.158282 Oct 28 18:23:27.672030 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3509/6872] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:27 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:23:28.694385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:28.695045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:28.702139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.702651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.703305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.704061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.704543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.705485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.846576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:28.854375 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-acb7a1bf-d0bb-4c04-ab35-e8bce1d27f0c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1547 microversion: 2.1 time: 0.164046 Oct 28 18:23:28.854960 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3510/6873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:28 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:23:28.876248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:23:28.877398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:23:28.883122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.883660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.884124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:28.884830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:23:28.885302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:23:28.885748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:23:29.018552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:23:29.026475 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e76594a2-ea2f-480e-9ddb-94def821561e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1547 microversion: 2.1 time: 0.153859 Oct 28 18:23:29.027061 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3511/6874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:23:28 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:05.537916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:05.538524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:05.541496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:05.542438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=72 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:05.549911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.550527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.551079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.551937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.552479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.553090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.582421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:24:05.675974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-edcd19a3-cca1-46cc-abb1-4e327ddee7f5 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 204 len: 0 microversion: 2.1 time: 0.143016 Oct 28 18:24:05.676708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3512/6875] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:24:05 2022] DELETE /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:24:05.685731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:05.686616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:05.694505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.695092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.695654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.697063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:05.697606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:05.698135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:05.915131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:05.925362 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1d89955-d023-43d3-b2dd-78ac9d507536 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1553 microversion: 2.1 time: 0.243898 Oct 28 18:24:05.925958 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3513/6876] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:05 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:06.949270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:06.949970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:06.956952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:06.957450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:06.957904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:06.958613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:06.959082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:06.959554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.096026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:07.103883 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dbda8f7e-f689-443c-9a53-f80749117180 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 200 len: 1553 microversion: 2.1 time: 0.158591 Oct 28 18:24:07.108357 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3514/6877] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:06 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:07.525830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8623115-d9ec-4e38-bda9-2c263a2112ca", "name": "network-vif-deleted", "tag": "96baafd6-77ae-406d-910a-cd651f19764b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:07.536984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:07.537481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:07.537930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:07.551515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] Creating event network-vif-deleted:96baafd6-77ae-406d-910a-cd651f19764b for instance d8623115-d9ec-4e38-bda9-2c263a2112ca on n-h2-860864-13 Oct 28 18:24:07.556342 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-68e327af-7a5f-4839-a05a-e9a735267426 req-3174922b-e99e-478c-85a8-380e352fe609 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 Oct 28 18:24:07.556961 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3515/6878] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:08.129338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:08.130090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: d8623115-d9ec-4e38-bda9-2c263a2112ca] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:08.136529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.137090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.137732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.138469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:08.138944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:08.139412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:08.154118 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] HTTP exception thrown: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Request method failure captured: Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca HTTP/1.1 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXB253UU0rX3l2ULMOci9uqi4YlZld_6emgZ7LBLz54vyoUJfvhrxKoeM3fXQuhLOefuLKm3BvMffpKJ8atOk2l9dGgvxJfRfdU5ryvxwTdO_GtfD2jh6o_l0NG05KZhn8RFaRK0G0dixatyQlkBNfJpTczn9SVakxKjwlZwCAy-J6aA Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ddf12a55393648368e69c035714c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ddf12a55393648368e69c035714c8f51"}]}] Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 68fa674ccd5346d9ab297cb4e6846fba Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'd8623115-d9ec-4e38-bda9-2c263a2112ca'} Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:08.155991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Returning 404 to user: Instance d8623115-d9ec-4e38-bda9-2c263a2112ca could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0dc6f1d7-96e7-4ba7-83e8-efd4fc0cdd53 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca" status: 404 len: 111 microversion: 2.1 time: 0.033877 Oct 28 18:24:08.161284 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3516/6879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:08 2022] GET /compute/v2.1/servers/d8623115-d9ec-4e38-bda9-2c263a2112ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:24:08.331093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0853f202-f911-4d43-8b96-6ed0a3ce04f2 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '.version_select at 0x7f751f409790>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:08.354921 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0853f202-f911-4d43-8b96-6ed0a3ce04f2 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1413665989" status: 202 len: 0 microversion: 2.1 time: 0.028515 Oct 28 18:24:08.355899 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3517/6880] 10.222.0.48 () {58 vars in 1257 bytes} [Fri Oct 28 18:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1413665989 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:24:10.078206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:10.078816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:10.086595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.087096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.087589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.088300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.088770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.089211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.114475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:24:10.195244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9e018c64-d1ff-477e-a80d-a8170301bb93 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 204 len: 0 microversion: 2.1 time: 0.121747 Oct 28 18:24:10.198914 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3518/6881] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:24:10 2022] DELETE /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:24:10.268056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1d8b68-3a80-4da9-8893-68eff7cb98e2", "tag": "270d8952-0193-4dc7-8f10-d40db4507a4e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:10.277601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.278175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.278691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.290748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] Creating event network-changed:270d8952-0193-4dc7-8f10-d40db4507a4e for instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 on n-h1-860864-13 Oct 28 18:24:10.295822 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-232e2e36-7947-4b09-bf8f-1aa8574943e1 req-e5d95917-52f8-4017-b4d0-542c4adf29ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095253 Oct 28 18:24:10.296504 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3519/6882] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:10.302350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:10.303066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:10.309158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.309657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.310108 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.310819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:10.311287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:10.311754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:10.453973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:10.462747 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-646ecf11-1969-47ad-957b-6f9b15ef7263 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1671 microversion: 2.1 time: 0.165126 Oct 28 18:24:10.463716 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3520/6883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:10 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:24:11.486450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:11.487193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:11.494625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.495262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.495832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.496645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:11.497207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:11.498016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:11.636414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:11.644872 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1619beb-8e27-451e-8d0f-b5641d235f25 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1671 microversion: 2.1 time: 0.162365 Oct 28 18:24:11.645447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3521/6884] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:11 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:12.255613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1d8b68-3a80-4da9-8893-68eff7cb98e2", "name": "network-vif-deleted", "tag": "270d8952-0193-4dc7-8f10-d40db4507a4e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:12.265861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.266358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.266813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.281274 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] Creating event network-vif-deleted:270d8952-0193-4dc7-8f10-d40db4507a4e for instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 on n-h1-860864-13 Oct 28 18:24:12.286517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5ca14478-b813-41fe-a1ac-2ce8b8c04db7 req-9572daaf-a995-4f33-9a63-2835558639bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035659 Oct 28 18:24:12.287113 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3522/6885] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:12.669269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:12.669986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:12.677411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.677917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.678373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.679082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.679584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.680027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.713228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:12.713720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:12.714199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:12.714654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lazy-loading 'fault' on Instance uuid af1d8b68-3a80-4da9-8893-68eff7cb98e2 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:24:12.760016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:12.768363 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3acc6f1-c916-4574-bcd4-fa61fed95817 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 200 len: 1338 microversion: 2.1 time: 0.102796 Oct 28 18:24:12.769319 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3523/6886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:12 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:13.793485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:13.794411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: af1d8b68-3a80-4da9-8893-68eff7cb98e2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:13.800917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:13.801410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:13.801856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:13.802558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:13.803021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:13.803486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:13.817755 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] HTTP exception thrown: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Request method failure captured: Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 HTTP/1.1 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXB253UU0rX3l2ULMOci9uqi4YlZld_6emgZ7LBLz54vyoUJfvhrxKoeM3fXQuhLOefuLKm3BvMffpKJ8atOk2l9dGgvxJfRfdU5ryvxwTdO_GtfD2jh6o_l0NG05KZhn8RFaRK0G0dixatyQlkBNfJpTczn9SVakxKjwlZwCAy-J6aA Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ddf12a55393648368e69c035714c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ddf12a55393648368e69c035714c8f51"}]}] Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 68fa674ccd5346d9ab297cb4e6846fba Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'af1d8b68-3a80-4da9-8893-68eff7cb98e2'} Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:24:13.819410 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Returning 404 to user: Instance af1d8b68-3a80-4da9-8893-68eff7cb98e2 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a95f202b-e481-4a6b-8d98-476279b3493e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2" status: 404 len: 111 microversion: 2.1 time: 0.031729 Oct 28 18:24:13.823645 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3524/6887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:13 2022] GET /compute/v2.1/servers/af1d8b68-3a80-4da9-8893-68eff7cb98e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:24:13.982115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f3f8dea-67be-499d-8cd6-0fcad9ffda9f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '.version_select at 0x7f751fa508b0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:14.007902 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f3f8dea-67be-499d-8cd6-0fcad9ffda9f tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-246458281" status: 202 len: 0 microversion: 2.1 time: 0.029489 Oct 28 18:24:14.008704 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3525/6888] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 18:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-246458281 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:24:22.532555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-154f0b8f-72a5-442a-9298-915d87eb8d6b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: .version_select at 0x7f751f409e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-561220235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz4CLhVMVW2KZ3v1thkJu3NzODmjsAOs1d3jWXy1aXZdFtZzFGqiGWpriO9920lMTqrFzvIu4NPHn31reBPjhLTxt3ML4HD02nfQwJEuk9/TZKJJcltwByFgEf0kZ2WpA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:22.551770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-154f0b8f-72a5-442a-9298-915d87eb8d6b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:22.557257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-154f0b8f-72a5-442a-9298-915d87eb8d6b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:22.581790 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-154f0b8f-72a5-442a-9298-915d87eb8d6b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053216 Oct 28 18:24:22.582550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3526/6889] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:24:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:23.587464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-173461082", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "c1bbd6b3-2fa8-499e-9a14-c0858d5f6c5a"}], "key_name": "tempest-TestNetworkBasicOps-561220235", "security_groups": [{"name": "tempest-secgroup-smoke-604013879"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:23.695658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] validate_networks() for [('c1bbd6b3-2fa8-499e-9a14-c0858d5f6c5a', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:24:23.808378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:24.174538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:24:24.175608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:24:24.176090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:24:24.176507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:24:24.176925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:24:24.186061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:24.186550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:24.186994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:24.187796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:24.188698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:24.188698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:24.208163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:24:24.213993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Getting quotas for user 68fa674ccd5346d9ab297cb4e6846fba and project ddf12a55393648368e69c035714c8f51. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:24:24.227778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:24:24.230128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:24:24.238011 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:24:24.238513 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:24:24.240041 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:24:24.240284 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:24:24.245899 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:24:24.246199 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:24:24.289006 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a675dc97-037c-47a3-9765-7647551f422e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706340 Oct 28 18:24:24.290054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3527/6890] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:24:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:24:24.301885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8cf1506c-20b0-491e-a8b2-e99011bad777 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:24.302515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8cf1506c-20b0-491e-a8b2-e99011bad777 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:24.357474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cf1506c-20b0-491e-a8b2-e99011bad777 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:24.366377 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8cf1506c-20b0-491e-a8b2-e99011bad777 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1247 microversion: 2.1 time: 0.069160 Oct 28 18:24:24.367067 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3528/6891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:24 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:25.389875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b26d94e-481b-4400-91b2-d6e5ca33756b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:25.390521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b26d94e-481b-4400-91b2-d6e5ca33756b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:25.445356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b26d94e-481b-4400-91b2-d6e5ca33756b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:25.452501 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b26d94e-481b-4400-91b2-d6e5ca33756b tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1247 microversion: 2.1 time: 0.066486 Oct 28 18:24:25.461977 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3529/6892] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:25 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:26.475804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-51674959-035a-48b4-81e9-3e844ec26182 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:26.476426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-51674959-035a-48b4-81e9-3e844ec26182 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:26.534859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-51674959-035a-48b4-81e9-3e844ec26182 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:26.542010 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-51674959-035a-48b4-81e9-3e844ec26182 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1247 microversion: 2.1 time: 0.070169 Oct 28 18:24:26.542762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3530/6893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:26 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1247 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:27.566204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8e2a7fd-a373-4368-9375-73e07b33a850 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:27.566814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8e2a7fd-a373-4368-9375-73e07b33a850 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:27.622243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e8e2a7fd-a373-4368-9375-73e07b33a850 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:27.631425 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8e2a7fd-a373-4368-9375-73e07b33a850 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1247 microversion: 2.1 time: 0.069740 Oct 28 18:24:27.632153 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3531/6894] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:27 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:28.654169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:28.654796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:28.662415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:28.662912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:28.663378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:28.664090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:28.664555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:28.664999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:28.727097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:28.734822 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1681e6b-042e-40b8-965a-46b78e45f3cb tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1251 microversion: 2.1 time: 0.084671 Oct 28 18:24:28.735421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3532/6895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:28 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1251 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:29.758279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:29.759039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:29.765830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:29.766326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:29.766772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:29.767581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:29.768769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:29.769205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:29.839429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:29.848565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2e8c3b3f-7c47-4687-8bf8-fa76fb0c6a47 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1305 microversion: 2.1 time: 0.094115 Oct 28 18:24:29.849179 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3533/6896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:29 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:30.873879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:30.874631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:30.882523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:30.883109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:30.883592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:30.884314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:30.884780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:30.885221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:31.021290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:31.028976 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea84c9e0-d3fb-48e3-ae4d-a8e7cfdc3894 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.159379 Oct 28 18:24:31.029556 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3534/6897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:30 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:31.131715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b5ee66-231f-439f-a5c2-ea7ac4be0759", "tag": "2967539c-a507-47f2-b41b-87abcc5df870"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:31.137974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:31.143203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:31.143818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:31.144982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:31.158912 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] Creating event network-changed:2967539c-a507-47f2-b41b-87abcc5df870 for instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 on n-h2-860864-13 Oct 28 18:24:31.164131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9d1b45dc-40a7-48a6-b7c1-93cd651d9d53 req-a13df830-d2ec-4554-922a-74e2c8d62249 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036865 Oct 28 18:24:31.164937 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3535/6898] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:24:32.054594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:32.055337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:32.062741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:32.063247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:32.063728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:32.064438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:32.064916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:32.065360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:32.198505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:32.206925 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f50e5920-e76d-4b8f-b743-79fddde0f201 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.158075 Oct 28 18:24:32.207524 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3536/6899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:32 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:33.230101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:33.230746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:33.238640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:33.239144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:33.239620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:33.240325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:33.240796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:33.241238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:33.377513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:33.385373 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-621688db-c73f-4809-a895-923693d6d4db tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.159287 Oct 28 18:24:33.385947 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3537/6900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:33 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:34.407685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:34.408311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:34.410445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:34.416762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:34.417261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:34.417710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:34.418417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:34.418881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:34.419326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:34.550060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:34.558031 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c3dc0514-83cf-47a5-bf6a-45dced287ed8 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.154303 Oct 28 18:24:34.558638 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3538/6901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:34 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:35.583096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:35.583751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:35.591514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:35.592021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:35.592473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:35.593187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:35.593656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:35.594097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:35.726272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:35.734077 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c09bb595-e4bc-4d9f-8550-30712aade0a1 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.156626 Oct 28 18:24:35.734670 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3539/6902] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:35 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:36.757949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:36.758566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:36.765458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:36.765961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:36.766416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:36.767125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:36.767627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:36.768202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:37.160224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:37.167999 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23630248-9724-4cd4-a0d1-01081dd2bc6c tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.414000 Oct 28 18:24:37.168586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3540/6903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:36 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:37.383907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b5ee66-231f-439f-a5c2-ea7ac4be0759", "name": "network-vif-plugged", "status": "completed", "tag": "2967539c-a507-47f2-b41b-87abcc5df870"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:37.394055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:37.394552 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:37.395597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:37.407005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] Creating event network-vif-plugged:2967539c-a507-47f2-b41b-87abcc5df870 for instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 on n-h2-860864-13 Oct 28 18:24:37.412706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-4c6aae76-a125-45a0-ada4-94428efbea39 req-6a570646-6f06-464f-84cd-a36fa0eb0e8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032674 Oct 28 18:24:37.413303 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3541/6904] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:24:38.188372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=18 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:24:38.193627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:38.194377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:38.200887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:38.201385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:38.201839 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:38.202536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:38.203002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:38.203467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:38.335546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:38.343255 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bca973cd-efa6-4bbc-a205-7a64ffbb2559 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1372 microversion: 2.1 time: 0.155901 Oct 28 18:24:38.343865 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3542/6905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:38 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:39.366874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:39.367514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:39.374583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.375075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.375558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.376260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.376720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.377686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.512142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:39.521014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2ab41ffa-a8dd-41f4-9fcb-8c80e0d7c4de tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1544 microversion: 2.1 time: 0.158156 Oct 28 18:24:39.521593 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3543/6906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:39 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1544 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:39.543864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:24:39.544474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:24:39.551286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.551814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.552261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.552957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:39.553419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:39.553854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:39.684420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:24:39.692308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5bd8ab59-dc3e-44f6-8ceb-1d5e24d9b0b3 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1544 microversion: 2.1 time: 0.152054 Oct 28 18:24:39.692887 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3544/6907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:24:39 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:24:41.426946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b5ee66-231f-439f-a5c2-ea7ac4be0759", "tag": "2967539c-a507-47f2-b41b-87abcc5df870"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:24:41.438777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:24:41.439269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:24:41.439805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:24:41.452776 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] Creating event network-changed:2967539c-a507-47f2-b41b-87abcc5df870 for instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 on n-h2-860864-13 Oct 28 18:24:41.459438 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5e71ca93-a0a9-4703-96e1-2c89a067fdfd req-8bce173d-8fae-49f2-a88a-daec734d1b7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036933 Oct 28 18:24:41.460373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3545/6908] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:25:13.762184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:13.764541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:13.766764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=20 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:13.767449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=74 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:13.774750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:13.775244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:13.775712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:13.776417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:13.776880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:13.777319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:13.829275 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-216c7a87-57f9-4636-9f54-4a0de34d9853 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759/action" status: 200 len: 24565 microversion: 2.1 time: 0.071552 Oct 28 18:25:13.829939 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3546/6909] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:25:13 2022] POST /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:25:44.131954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:44.134268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:44.136939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:44.137757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:25:44.144100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:44.144873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:44.145333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:44.146052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:44.146524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:44.146966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:44.198490 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28cf33a6-1ef6-412d-934f-7e334dbe95a0 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "POST /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759/action" status: 200 len: 32637 microversion: 2.1 time: 0.071421 Oct 28 18:25:44.199149 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3547/6910] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:25:44 2022] POST /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759/action => generated 32637 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 18:25:45.218644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:45.219228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:45.227181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:45.227726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:45.228183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:45.228927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:45.229398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:45.229840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:45.261203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:25:45.344731 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0500e825-911a-480f-9e4a-39c6862a0409 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 204 len: 0 microversion: 2.1 time: 0.129746 Oct 28 18:25:45.345195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3548/6911] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:25:45 2022] DELETE /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:25:45.350461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74b5ee66-231f-439f-a5c2-ea7ac4be0759", "tag": "2967539c-a507-47f2-b41b-87abcc5df870"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:45.360520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:45.361008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:45.361451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:45.374368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] Creating event network-changed:2967539c-a507-47f2-b41b-87abcc5df870 for instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 on n-h2-860864-13 Oct 28 18:25:45.380248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1f96d8a0-27bc-45f5-a57c-b5c255c93fe6 req-08761115-d4b8-4a5c-bf9a-18bb9ba47490 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Oct 28 18:25:45.380859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3549/6912] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:25:45.386021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:45.386725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:45.392867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:45.393364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:45.393816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:45.395124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:45.395790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:45.396236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:45.555960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:45.564030 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ccfb3532-ccf7-4d78-8282-920df4e13a1e tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1669 microversion: 2.1 time: 0.182014 Oct 28 18:25:45.564612 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3550/6913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:45 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:25:46.590266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:46.590898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:46.598149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.598657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.599139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.599901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:46.600376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:46.600819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:46.736045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:46.745205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c4d22d6a-cf8c-4e04-89a6-08ba1d21d734 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1669 microversion: 2.1 time: 0.158884 Oct 28 18:25:46.745779 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3551/6914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:46 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:47.454618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74b5ee66-231f-439f-a5c2-ea7ac4be0759", "name": "network-vif-deleted", "tag": "2967539c-a507-47f2-b41b-87abcc5df870"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:25:47.465648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.466143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.466583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.477973 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] Creating event network-vif-deleted:2967539c-a507-47f2-b41b-87abcc5df870 for instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 on n-h2-860864-13 Oct 28 18:25:47.482938 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a9ca9131-a92c-4fea-9975-72cec5b41040 req-a4ac5b2e-0169-46c3-819c-59b9a5464d32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Oct 28 18:25:47.483562 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3552/6915] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:25:47.770545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:47.771361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:47.777960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.778462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.778911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.779655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.780121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.780558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.820746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:47.821365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:47.821679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:47.822138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lazy-loading 'fault' on Instance uuid 74b5ee66-231f-439f-a5c2-ea7ac4be0759 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:25:47.875993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fa674ccd5346d9ab297cb4e6846fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf12a55393648368e69c035714c8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:25:47.885065 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-75be0130-6461-49db-b7ea-95180dc1b578 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 200 len: 1337 microversion: 2.1 time: 0.119697 Oct 28 18:25:47.886258 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3553/6916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:47 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 1337 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:25:48.910374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:48.911558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] [instance: 74b5ee66-231f-439f-a5c2-ea7ac4be0759] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:25:48.918621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:48.919126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:48.919628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:48.920346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:25:48.920815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:25:48.921256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:25:48.934919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] HTTP exception thrown: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Request method failure captured: Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 HTTP/1.1 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXB253UU0rX3l2ULMOci9uqi4YlZld_6emgZ7LBLz54vyoUJfvhrxKoeM3fXQuhLOefuLKm3BvMffpKJ8atOk2l9dGgvxJfRfdU5ryvxwTdO_GtfD2jh6o_l0NG05KZhn8RFaRK0G0dixatyQlkBNfJpTczn9SVakxKjwlZwCAy-J6aA Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ddf12a55393648368e69c035714c8f51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ddf12a55393648368e69c035714c8f51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ddf12a55393648368e69c035714c8f51"}]}] Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: ddf12a55393648368e69c035714c8f51 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkBasicOps-2000907568 Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 68fa674ccd5346d9ab297cb4e6846fba Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkBasicOps-2000907568-project Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '74b5ee66-231f-439f-a5c2-ea7ac4be0759'} Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:25:48.936621 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Returning 404 to user: Instance 74b5ee66-231f-439f-a5c2-ea7ac4be0759 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2be89941-b736-47ca-ac8b-25c596110947 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759" status: 404 len: 111 microversion: 2.1 time: 0.032203 Oct 28 18:25:48.941627 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3554/6917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:25:48 2022] GET /compute/v2.1/servers/74b5ee66-231f-439f-a5c2-ea7ac4be0759 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:25:49.400209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b7e4dd6f-2a59-433a-b61f-58d92a833c00 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] Calling method '.version_select at 0x7f751fa50310>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:25:49.423336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b7e4dd6f-2a59-433a-b61f-58d92a833c00 tempest-TestNetworkBasicOps-2000907568 tempest-TestNetworkBasicOps-2000907568-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-561220235" status: 202 len: 0 microversion: 2.1 time: 0.026647 Oct 28 18:25:49.424457 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3555/6918] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 18:25:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-561220235 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:26:06.968773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:06.969678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:07.241689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-575fc1e2-7e00-4a0a-a749-795bc9f60c06 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Action: 'create', calling method: .version_select at 0x7f751f70e4c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-685239866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVp5JbP8RKEp/lGOSoTO2aMTKZYn3SJ4+aSEpKbW1qYmh2GN8WtgnxEPdzGHpxa8qWP39cb8WvNeZ08mvYG3rySHrxdxgdeN+3Q8kIxiTwPidSzSbD2k+YQaXuitNddzg=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:07.264906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-575fc1e2-7e00-4a0a-a749-795bc9f60c06 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:26:07.271473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-575fc1e2-7e00-4a0a-a749-795bc9f60c06 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for user a96df18e6fd64227b0db1734ed7319ed and project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:26:07.299498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-575fc1e2-7e00-4a0a-a749-795bc9f60c06 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.335937 Oct 28 18:26:07.300699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3556/6919] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:26:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:08.262068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1235899946", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-685239866", "security_groups": [{"name": "tempest-secgroup-smoke-1230616499"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "199cd270-69da-4788-b806-4d0ed319d13f"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:08.617363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] validate_networks() for [('199cd270-69da-4788-b806-4d0ed319d13f', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:26:09.026380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:26:09.031695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for user a96df18e6fd64227b0db1734ed7319ed and project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: dict_keys(['metadata_items']) {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:26:09.044774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:26:09.045213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:26:09.045706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:26:09.046149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:26:09.046558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:26:09.055256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:09.055789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:09.056250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:09.056997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:09.057472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:09.057916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:09.075181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:26:09.080420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Getting quotas for user a96df18e6fd64227b0db1734ed7319ed and project 049bcd6bcf1b4a1d8aa1e555fe28aa35. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:26:09.093076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:26:09.096502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:26:09.147213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ec1b9bd4-aa49-48e1-8aec-2a7b3cdb4214 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.889881 Oct 28 18:26:09.148358 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3557/6920] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:26:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:26:09.159272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-832eef0d-b4d6-4bf4-aa6b-dc11b0f649f7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:09.160471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-832eef0d-b4d6-4bf4-aa6b-dc11b0f649f7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:09.230105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-832eef0d-b4d6-4bf4-aa6b-dc11b0f649f7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:09.239774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-832eef0d-b4d6-4bf4-aa6b-dc11b0f649f7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1302 microversion: 2.1 time: 0.083877 Oct 28 18:26:09.240362 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3558/6921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:09 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:10.265006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d44ec4c-08ea-4363-b45e-6906847adce2 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:10.265631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d44ec4c-08ea-4363-b45e-6906847adce2 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:10.327928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d44ec4c-08ea-4363-b45e-6906847adce2 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:10.335250 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d44ec4c-08ea-4363-b45e-6906847adce2 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1302 microversion: 2.1 time: 0.074159 Oct 28 18:26:10.336225 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3559/6922] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:10 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1302 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:11.358665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e5c46c08-1c99-4e73-adb7-ef4cbec99cf4 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:11.359296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e5c46c08-1c99-4e73-adb7-ef4cbec99cf4 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:11.423702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e5c46c08-1c99-4e73-adb7-ef4cbec99cf4 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:11.432091 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e5c46c08-1c99-4e73-adb7-ef4cbec99cf4 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1302 microversion: 2.1 time: 0.077222 Oct 28 18:26:11.433090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3560/6923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:11 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1302 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:12.456923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:12.458243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:12.465571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:12.466075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:12.466526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.467250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:12.467966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:12.468377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:12.538852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:12.546704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81ae0e47-bd69-43b5-a2c6-5075593ecd5e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1306 microversion: 2.1 time: 0.093806 Oct 28 18:26:12.547282 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3561/6924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:12 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:13.571027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:13.571776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:13.578685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:13.579189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:13.579685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:13.580398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:13.580870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:13.581322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:13.653939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:13.663764 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb32cd08-4402-450d-98e5-6fffe64d576e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1360 microversion: 2.1 time: 0.097232 Oct 28 18:26:13.664428 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3562/6925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:13 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1360 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:14.725036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3b594a-2a88-4ea9-9ddb-8489d264a8cc", "tag": "aa3c6220-bff6-4688-9109-40bfa125808e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:14.734458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:14.734945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:14.735420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:14.746789 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] Creating event network-changed:aa3c6220-bff6-4688-9109-40bfa125808e for instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc on n-h1-860864-13 Oct 28 18:26:14.752194 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a82e5411-5b1c-4e9e-aca7-fe184b33c6fa req-c89b9abd-6ad8-41da-9ca2-fb2e02ceb904 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083904 Oct 28 18:26:14.752807 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3563/6926] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:26:14.759142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:14.759895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:14.766077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:14.766583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:14.767037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:14.767780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:14.768253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:14.768696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:14.905497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:14.914574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-719298d1-ef84-4d28-b935-646335e55578 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.160377 Oct 28 18:26:14.915163 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3564/6927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:14 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:26:15.937280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:15.937915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:15.944934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:15.945423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:15.945871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:15.946571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:15.947036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:15.947505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:16.083270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:16.091248 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3d7d7f35-0f03-4205-8764-1aca129d1789 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.157889 Oct 28 18:26:16.092496 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3565/6928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:15 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:17.116354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:17.116962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:17.124877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:17.125376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:17.125828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:17.126532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:17.126996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:17.127460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:17.267696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:17.279954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fdacbe1-b619-4f6d-8354-7d43071a9dce tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.168128 Oct 28 18:26:17.281066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3566/6929] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:17 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:18.304303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:18.305163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:18.312163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:18.312658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:18.313106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:18.313817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:18.314363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:18.315044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:18.453161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:18.461617 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-13bb13af-78d6-4fec-b443-d72ef4d7412d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.161386 Oct 28 18:26:18.462203 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3567/6930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:18 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:19.485027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:19.485682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:19.487672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:19.494279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:19.494782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:19.495238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:19.495989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:19.496459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:19.496927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:19.631816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:19.639763 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba375f69-1925-43f8-83d6-4b790be2a421 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.158641 Oct 28 18:26:19.640338 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3568/6931] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:19 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:20.402790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3b594a-2a88-4ea9-9ddb-8489d264a8cc", "name": "network-vif-plugged", "status": "completed", "tag": "aa3c6220-bff6-4688-9109-40bfa125808e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:20.412408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:20.412892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:20.413332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:20.424171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] Creating event network-vif-plugged:aa3c6220-bff6-4688-9109-40bfa125808e for instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc on n-h1-860864-13 Oct 28 18:26:20.429355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f6ddbe61-8b76-4487-a98a-dad74e79bd86 req-697d7cce-edb1-4328-85d8-7072afa65c65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088534 Oct 28 18:26:20.429934 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3569/6932] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:26:20.662796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:20.663479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:20.670601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:20.671097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:20.671581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:20.672283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:20.672747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:20.673187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:20.805955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:20.813562 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c499b50-4b6d-45ba-a484-e4d11f94e2ab tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.155266 Oct 28 18:26:20.814130 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3570/6933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:20 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:21.837717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:21.838371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:21.840367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=20 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:26:21.847036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:21.847565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:21.849157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:21.849893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:21.850553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:21.850995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:21.987660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:21.995651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-414629ca-b8ce-4145-b86c-acc5a552dd59 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1428 microversion: 2.1 time: 0.161808 Oct 28 18:26:21.996257 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3571/6934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:21 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1428 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:23.019277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:23.020945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:23.027797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.028233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.028685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.029390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.029863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.030303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.171292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:23.179715 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8b9d401f-d756-4879-947d-03acc45a0ee7 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1608 microversion: 2.1 time: 0.164337 Oct 28 18:26:23.180304 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3572/6935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:23 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1608 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:23.202183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:23.202800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:23.209017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.209513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.209961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.210667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.211135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.211608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.342298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:23.350216 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1bd5057a-f47f-4d42-9330-7fc7f04f2fc6 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1608 microversion: 2.1 time: 0.151641 Oct 28 18:26:23.350797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3573/6936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:23 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1608 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:23.372451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:26:23.373073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:26:23.379906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.380400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.380852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.381555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:23.382017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:23.382451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:23.517206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:26:23.525068 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9764fea-535c-4991-bc3d-5efe7ae6d752 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1608 microversion: 2.1 time: 0.156432 Oct 28 18:26:23.525649 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3574/6937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:26:23 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:26:25.500314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3b594a-2a88-4ea9-9ddb-8489d264a8cc", "tag": "aa3c6220-bff6-4688-9109-40bfa125808e"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:26:25.512548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:26:25.513043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:26:25.513488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:26:25.525899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] Creating event network-changed:aa3c6220-bff6-4688-9109-40bfa125808e for instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc on n-h1-860864-13 Oct 28 18:26:25.531094 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1fece570-4116-4b7a-852d-3c15db8b8548 req-8b8209cd-225e-4a43-827b-6df44dbc2496 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034884 Oct 28 18:26:25.532077 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3575/6938] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:27:32.253614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:32.254530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=80 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:27:32.260945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:27:32.261547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:27:32.269894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:32.270382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:32.270836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:32.271576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:27:32.272050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:27:32.272521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:27:32.299435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f49ed11f-64df-4f40-8d32-d32f8d09f450 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.049620 Oct 28 18:27:32.300016 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3576/6939] 10.222.0.48 () {58 vars in 1293 bytes} [Fri Oct 28 18:27:32 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc/os-server-password => generated 116 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:27:44.252497 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:27:44.253080 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:27:44.254330 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:27:44.254457 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:27:44.255948 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:27:44.256071 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:27:44.614147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG neutronclient.v2_0.client [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=120567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 18:27:44.614981 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.439315 Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Traceback (most recent call last): Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-8153d2ed-6b45-41f5-9f92-dc89a00eed0e'] Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Traceback (most recent call last): Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return req.get_response(self.application) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack self.force_reraise() Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack raise self.value Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return request.get_response(self.application) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 28 18:27:44.661931 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return resp(environ, start_response) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self._create_instance( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2548, in _ports_needed_per_instance Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack nets = self._get_available_networks( Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 454, in _get_available_networks Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack nets = neutron.list_networks(**search_opts).get('networks', []) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.665805 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] http://10.222.0.48/compute/v2.1/servers returned with HTTP 401 Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:27:44 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.48) Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: CRITICAL nova [None req-bd0b43b0-093c-4c6d-a79d-de30cafb261c tempest-TestVolumeBootPattern-1411467115 tempest-TestVolumeBootPattern-1411467115-project] Unhandled error: OSError: write error Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova OSError: write error Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova Oct 28 18:27:44.669924 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3364/6940] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:12:44 2022] POST /compute/v2.1/servers => generated 0 bytes in 900490 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 28 18:31:35.727267 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:31:35.728306 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:31:35.728788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:35.729573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:35.730704 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:31:35.730883 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.732000 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:31:35.732156 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.733040 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:31:35.733165 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.793949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:35.794452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:35.803905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:35.804399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:35.804847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:35.805544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:35.806006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:35.806441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:35.832796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:31:35.915238 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8b4db49-c241-4fa2-ab74-68dbdd0a189e tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 204 len: 0 microversion: 2.1 time: 0.189851 Oct 28 18:31:35.915868 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3577/6941] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:31:35 2022] DELETE /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:31:35.921759 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:31:35.922588 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:31:35.923927 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 18:31:35.924068 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.926015 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 18:31:35.926138 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.928624 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 18:31:35.928736 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc (ip 10.222.0.48) !!! Oct 28 18:31:35.938612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:35.939232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:35.951131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:35.951651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:35.952084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:35.952781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:35.953342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:35.953771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:36.097915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:36.106668 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5aff5f55-d44a-4cca-9c5a-db79b370309c tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1733 microversion: 2.1 time: 0.186270 Oct 28 18:31:36.107243 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3365/6942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:35 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:37.130929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:37.131685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:37.144899 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39564. Oct 28 18:31:37.146748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:37.147249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:37.147724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:37.148444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:37.148913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:37.149351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:37.150196 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39566. Oct 28 18:31:37.270405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96df18e6fd64227b0db1734ed7319ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049bcd6bcf1b4a1d8aa1e555fe28aa35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:37.281152 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-26666094-21de-4ebf-b4f0-a32b301bc948 tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 200 len: 1665 microversion: 2.1 time: 0.154608 Oct 28 18:31:37.285783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3578/6943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:37 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:37.310667 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39578. Oct 28 18:31:37.318908 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39580. Oct 28 18:31:37.363050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3b594a-2a88-4ea9-9ddb-8489d264a8cc", "name": "network-vif-deleted", "tag": "aa3c6220-bff6-4688-9109-40bfa125808e"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:37.384924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:37.385698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:37.387198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:37.400781 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] Creating event network-vif-deleted:aa3c6220-bff6-4688-9109-40bfa125808e for instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc on n-h1-860864-13 Oct 28 18:31:37.409924 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-74ea7a6b-de2f-42f0-8863-559c2f16055a req-235a5d8a-f336-4140-b634-2972b63538b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114727 Oct 28 18:31:37.412022 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3366/6944] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:31:38.305808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:38.306521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:38.317464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.317958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.318403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.319125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.319597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.320099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.334128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] HTTP exception thrown: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Request method failure captured: Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc HTTP/1.1 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXB65Aw3v1-4sO3lGdLfzwEFhIPSDVhPOTOnvDtTFCdyWr2-jRRa3Z7OchsUl5xInP0RhVQ88AArVj0DkgNgxr8K3PbMeCH2ENRFsFQq5qN8ztQJRNm--HbD3ylXCYX5dIGy5krc_bKfkasy4-cNjNcBgiDWbommSXso8a0rcafWTBKo Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}] Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a96df18e6fd64227b0db1734ed7319ed Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ba3b594a-2a88-4ea9-9ddb-8489d264a8cc'} Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.335808 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Returning 404 to user: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:31:38.339991 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a856117f-cfc2-4b64-827b-e14e4dbf1acd tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 404 len: 111 microversion: 2.1 time: 0.035582 Oct 28 18:31:38.341095 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3579/6945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:38 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:31:38.795928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:38.796456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:38.804875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.805399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.805838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.806537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.806995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.807446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.821681 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] HTTP exception thrown: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Request method failure captured: Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc HTTP/1.1 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXB65Aw3v1-4sO3lGdLfzwEFhIPSDVhPOTOnvDtTFCdyWr2-jRRa3Z7OchsUl5xInP0RhVQ88AArVj0DkgNgxr8K3PbMeCH2ENRFsFQq5qN8ztQJRNm--HbD3ylXCYX5dIGy5krc_bKfkasy4-cNjNcBgiDWbommSXso8a0rcafWTBKo Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}] Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: a96df18e6fd64227b0db1734ed7319ed Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'ba3b594a-2a88-4ea9-9ddb-8489d264a8cc'} Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:31:38.823326 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Returning 404 to user: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fb42e501-6df8-44ba-8006-351b65cb88ef tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 404 len: 111 microversion: 2.1 time: 0.034907 Oct 28 18:31:38.827439 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3367/6946] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:31:38 2022] DELETE /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:31:38.833677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:38.834297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] [instance: ba3b594a-2a88-4ea9-9ddb-8489d264a8cc] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:38.840337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.840829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.841278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.841984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:38.842447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:38.842884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:38.860293 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] HTTP exception thrown: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Request method failure captured: Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc HTTP/1.1 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXB65Aw3v1-4sO3lGdLfzwEFhIPSDVhPOTOnvDtTFCdyWr2-jRRa3Z7OchsUl5xInP0RhVQ88AArVj0DkgNgxr8K3PbMeCH2ENRFsFQq5qN8ztQJRNm--HbD3ylXCYX5dIGy5krc_bKfkasy4-cNjNcBgiDWbommSXso8a0rcafWTBKo Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/049bcd6bcf1b4a1d8aa1e555fe28aa35"}]}] Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 049bcd6bcf1b4a1d8aa1e555fe28aa35 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestServerBasicOps-1583628565 Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: a96df18e6fd64227b0db1734ed7319ed Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestServerBasicOps-1583628565-project Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'ba3b594a-2a88-4ea9-9ddb-8489d264a8cc'} Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:31:38.861840 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Returning 404 to user: Instance ba3b594a-2a88-4ea9-9ddb-8489d264a8cc could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-31ba3198-fbf7-4700-89f3-a5c8af21f62b tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc" status: 404 len: 111 microversion: 2.1 time: 0.033511 Oct 28 18:31:38.866179 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3580/6947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:38 2022] GET /compute/v2.1/servers/ba3b594a-2a88-4ea9-9ddb-8489d264a8cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:31:39.029237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-44488a67-199f-40b7-bf5a-fa10bc5eba0d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] Calling method '.version_select at 0x7f7524223040>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:39.059504 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-44488a67-199f-40b7-bf5a-fa10bc5eba0d tempest-TestServerBasicOps-1583628565 tempest-TestServerBasicOps-1583628565-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-685239866" status: 202 len: 0 microversion: 2.1 time: 0.034951 Oct 28 18:31:39.060234 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3368/6948] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Oct 28 18:31:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-685239866 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:31:57.591798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:57.592547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:57.716884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1322003234", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:31:57.771166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] validate_networks() for None {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:31:58.043482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:31:58.043945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:31:58.044431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:31:58.044957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:31:58.045389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:31:58.056730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:58.057222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:58.058168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:58.058935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:58.059422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:58.059867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:58.079453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Getting quotas for project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:31:58.084631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Getting quotas for user 6d6b5bcbabc24e619fafbc42529bae35 and project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:31:58.097230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:31:58.099561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:31:58.145160 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-919958cd-c026-4b9f-9da0-56541d618dd2 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559301 Oct 28 18:31:58.145813 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3581/6949] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:31:58.156892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=10 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:58.157649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:31:58.162160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c08668a3-1a60-4b80-ab2d-c6449f11d175 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:58.162891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c08668a3-1a60-4b80-ab2d-c6449f11d175 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:58.221926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c08668a3-1a60-4b80-ab2d-c6449f11d175 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:58.231967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c08668a3-1a60-4b80-ab2d-c6449f11d175 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1222 microversion: 2.1 time: 0.076970 Oct 28 18:31:58.232544 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3369/6950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:58 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:31:59.256343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:31:59.256985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:31:59.264914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:59.265592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:59.266286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:59.267259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:31:59.268020 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:31:59.268651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:31:59.340229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:31:59.348503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc400969-7d65-429b-b22b-619edd8abf65 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1282 microversion: 2.1 time: 0.097283 Oct 28 18:31:59.363391 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3582/6951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:31:59 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:00.374451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:00.375311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:00.382636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:00.383252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:00.383912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:00.384632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:00.385123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:00.385578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:00.809923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:00.817694 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf2d6562-06bb-49eb-8b6a-b5c47c28e83c tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.447976 Oct 28 18:32:00.818276 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3370/6952] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:00 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:01.010464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1c406d-3f2d-481b-9f03-56aeb72ebf65", "tag": "3abff14f-610c-4550-8937-21b4dd59aeba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:01.021101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:01.022092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:01.022712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:01.035060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] Creating event network-changed:3abff14f-610c-4550-8937-21b4dd59aeba for instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 on n-h2-860864-13 Oct 28 18:32:01.040609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-97136509-2cc8-4c90-8a58-35e28a47afce req-a51e13ee-36b3-4728-9ed4-cc9e3b152b2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033902 Oct 28 18:32:01.041312 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3583/6953] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:01.841173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:01.841794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:01.848656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:01.849145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:01.849579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:01.850273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:01.850757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:01.851186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:01.980639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:01.988240 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3828b87-c752-49fb-84d6-75bccff9c559 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.151122 Oct 28 18:32:01.988816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3371/6954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:01 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:03.013144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:03.013898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:03.020886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:03.021384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:03.021829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:03.022547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:03.022993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:03.023454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:03.161249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:03.169412 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-28eadb6f-2af5-4d18-8eb6-3ea09832b128 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.161687 Oct 28 18:32:03.169985 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3584/6955] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:03 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:04.192570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:04.193178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:04.201040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:04.201521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:04.201951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:04.202635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:04.203086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:04.203546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:04.339843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:04.347525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9bde7b85-1245-4076-9a92-233f3aafe03a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.158819 Oct 28 18:32:04.348102 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3372/6956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:04 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:05.370709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:05.371334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:05.378535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:05.379032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:05.379523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:05.380227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:05.380720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:05.381136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:05.517792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:05.525735 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-adc4792d-c354-4705-87a2-c974a9633ee5 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.159516 Oct 28 18:32:05.526360 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3585/6957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:05 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:06.548429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:06.549035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:06.555821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:06.556307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:06.556742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:06.557663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:06.558122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:06.558553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:06.688357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:06.695999 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d6111aa-b546-4226-bd19-93f1ebae6bee tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.151431 Oct 28 18:32:06.696570 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3373/6958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:06 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:07.615054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1c406d-3f2d-481b-9f03-56aeb72ebf65", "name": "network-vif-plugged", "status": "completed", "tag": "3abff14f-610c-4550-8937-21b4dd59aeba"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:07.624679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:07.625232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:07.625910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:07.637498 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] Creating event network-vif-plugged:3abff14f-610c-4550-8937-21b4dd59aeba for instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 on n-h2-860864-13 Oct 28 18:32:07.642480 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-eb51534b-5258-4ac2-a423-ff5664e7781d req-4b1253f1-8fcc-40d7-ba0e-5974b9ce178f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087776 Oct 28 18:32:07.643071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3586/6959] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:07.719293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:07.720337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:07.726724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:07.727217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:07.727683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:07.728389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:07.728854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:07.729940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:07.862763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:07.870733 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9735f2ab-9c8f-4e7b-b3fd-95e4446d1cea tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.155868 Oct 28 18:32:07.871305 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3374/6960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:07 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:08.891334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:08.892223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:08.897801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:08.898518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:08.906396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:08.906899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:08.907354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:08.908090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:08.908560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:08.909004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:09.045734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:09.053800 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f792614-d4d8-4e1f-8ff2-f77c77379d31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1322 microversion: 2.1 time: 0.163393 Oct 28 18:32:09.054503 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3587/6961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:08 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:10.077845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.078449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:10.080407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:10.086325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.086803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.087240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.088029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.089473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.089916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.222209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:10.230371 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-856e0069-d9db-4aec-b5f4-095badbc3d2a tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1472 microversion: 2.1 time: 0.156911 Oct 28 18:32:10.230952 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3375/6962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:10 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:10.304196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-24b3f7eb-ac6f-4fd9-8ef9-6fa7770d3842 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '.version_select at 0x7f75246a5700>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.371205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-24b3f7eb-ac6f-4fd9-8ef9-6fa7770d3842 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/6ea7aa870c0047aba1f88706096093fb" status: 200 len: 371 microversion: 2.1 time: 0.119869 Oct 28 18:32:10.371829 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3588/6963] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 18:32:10 2022] GET /compute/v2.1/os-quota-sets/6ea7aa870c0047aba1f88706096093fb => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:10.384002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e98960c5-cb4f-45e1-ac5c-43a93c5e76e0 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-890706695", "id": 2129447477, "os-flavor-access:is_public": "True"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:10.403174 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e98960c5-cb4f-45e1-ac5c-43a93c5e76e0 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022860 Oct 28 18:32:10.404100 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3376/6964] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:10 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:10.416383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2129447477"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:10.418790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:10.425626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.426141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.426576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.427647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.428129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.428569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.599216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e3aa9ecf63494530975d9658b1d5c7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea7aa870c0047aba1f88706096093fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:10.606282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-890706695 {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:32:10.613539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.614116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.614562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.615295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.615782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.616293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.639543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Getting quotas for project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:10.644574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Getting quotas for user 6d6b5bcbabc24e619fafbc42529bae35 and project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:10.657005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.compute.api [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] ram quota exceeded for 6ea7aa870c0047aba1f88706096093fb, tried to resize instance. Oct 28 18:32:10.657555 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Request method failure captured: Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action HTTP/1.1 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 39 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCAdlaEGgXUjaWXxedz6IwWFAuwCAbXDgFRZXU0YJEJkCVjC7bh6MlEdtSR3npjeFTOZm5lfvTPCMwN-BuuHqKIL-PuvxSkvomFVs1STeFXUHhWYagA66l4cSnYab0e5pUEQvfY-KReDWR_j80XRZsS6OGxhVoAKH-R2q2qlYO92qbk Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 6ea7aa870c0047aba1f88706096093fb Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Role: admin,member,reader Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: admin,member,reader Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6ea7aa870c0047aba1f88706096093fb"}]}] Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 6ea7aa870c0047aba1f88706096093fb Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-76823601-project-admin Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: e3aa9ecf63494530975d9658b1d5c7c0 Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-76823601-project-admin Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: {"resize": {"flavorRef": "2129447477"}} Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3b1c406d-3f2d-481b-9f03-56aeb72ebf65', 'body': {'resize': {'flavorRef': '2129447477'}}} Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:10.659704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b1e881c-d5ef-4d7f-949b-3c5ae23ce6d8 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action" status: 403 len: 118 microversion: 2.1 time: 0.248657 Oct 28 18:32:10.664162 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3589/6965] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:32:10 2022] POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action => generated 118 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:32:10.670895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b651a7c-5bb8-496f-ab32-a2f805fe0ece tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.688120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b651a7c-5bb8-496f-ab32-a2f805fe0ece tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2129447477" status: 202 len: 0 microversion: 2.1 time: 0.021043 Oct 28 18:32:10.688672 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3377/6966] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 18:32:10 2022] DELETE /compute/v2.1/flavors/2129447477 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:32:10.696635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d21bb74-40bc-465f-9873-84260b67d826 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.718213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d21bb74-40bc-465f-9873-84260b67d826 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025240 Oct 28 18:32:10.718786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3590/6967] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 18:32:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:10.739004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64b79865-ddd5-4abe-8cea-ca5bb10147ce tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '.version_select at 0x7f75242289d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:10.814191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64b79865-ddd5-4abe-8cea-ca5bb10147ce tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/6ea7aa870c0047aba1f88706096093fb" status: 200 len: 371 microversion: 2.1 time: 0.078928 Oct 28 18:32:10.814761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3378/6968] 10.222.0.48 () {58 vars in 1242 bytes} [Fri Oct 28 18:32:10 2022] GET /compute/v2.1/os-quota-sets/6ea7aa870c0047aba1f88706096093fb => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:10.827135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9ae0891-2e72-4b09-ad39-e32fba02ca22 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1493335775", "id": 1473183333, "os-flavor-access:is_public": "True"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:10.844764 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9ae0891-2e72-4b09-ad39-e32fba02ca22 tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021909 Oct 28 18:32:10.845270 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3591/6969] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:10 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:10.858276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1473183333"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:10.860686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:10.867035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.867561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.868004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:10.868696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:10.869153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:10.869602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.032763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e3aa9ecf63494530975d9658b1d5c7c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ea7aa870c0047aba1f88706096093fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:11.039317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1493335775 {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:32:11.046493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.046973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.047424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.048509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.048979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.049385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.080081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Getting quotas for project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:11.085663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Getting quotas for user 6d6b5bcbabc24e619fafbc42529bae35 and project cb84ee356a8d40bea45d485dfd76cfcb. Resources: {'cores', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:11.098062 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.compute.api [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] cores quota exceeded for 6ea7aa870c0047aba1f88706096093fb, tried to resize instance. Oct 28 18:32:11.098528 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Request method failure captured: Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action HTTP/1.1 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 39 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCAdlaEGgXUjaWXxedz6IwWFAuwCAbXDgFRZXU0YJEJkCVjC7bh6MlEdtSR3npjeFTOZm5lfvTPCMwN-BuuHqKIL-PuvxSkvomFVs1STeFXUHhWYagA66l4cSnYab0e5pUEQvfY-KReDWR_j80XRZsS6OGxhVoAKH-R2q2qlYO92qbk Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 6ea7aa870c0047aba1f88706096093fb Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Role: admin,member,reader Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: admin,member,reader Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6ea7aa870c0047aba1f88706096093fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6ea7aa870c0047aba1f88706096093fb"}]}] Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 6ea7aa870c0047aba1f88706096093fb Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-76823601 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersAdminNegativeTestJSON-76823601-project-admin Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: e3aa9ecf63494530975d9658b1d5c7c0 Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-76823601-project-admin Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: {"resize": {"flavorRef": "1473183333"}} Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '3b1c406d-3f2d-481b-9f03-56aeb72ebf65', 'body': {'resize': {'flavorRef': '1473183333'}}} Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:11.100493 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e40763e-1bf3-492f-a6c7-9fc1543bd50f tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action" status: 403 len: 113 microversion: 2.1 time: 0.248257 Oct 28 18:32:11.104972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3379/6970] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:32:10 2022] POST /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65/action => generated 113 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:32:11.111286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d13b651-1405-4545-952b-7e21c2326cfc tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.129797 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d13b651-1405-4545-952b-7e21c2326cfc tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1473183333" status: 202 len: 0 microversion: 2.1 time: 0.022228 Oct 28 18:32:11.130367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3592/6971] 10.222.0.48 () {58 vars in 1161 bytes} [Fri Oct 28 18:32:11 2022] DELETE /compute/v2.1/flavors/1473183333 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:32:11.138167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30f222b7-0cad-4b5b-aff9-f9af5a94213a tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.158190 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30f222b7-0cad-4b5b-aff9-f9af5a94213a tempest-ServersAdminNegativeTestJSON-76823601 tempest-ServersAdminNegativeTestJSON-76823601-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023714 Oct 28 18:32:11.158759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3380/6972] 10.222.0.48 () {58 vars in 1146 bytes} [Fri Oct 28 18:32:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:11.179806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.180428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:11.187294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.187854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.188306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.189007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.189471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.189910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.215500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:32:11.293380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efd172ca-814c-4f7f-9236-9132278833a8 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 204 len: 0 microversion: 2.1 time: 0.115392 Oct 28 18:32:11.294253 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3593/6973] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:32:11 2022] DELETE /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:32:11.302159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:11.302765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:11.309913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.310397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.310837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.311555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:11.312034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:11.312458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:11.447542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:11.455221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22d9ff6d-9950-44f2-8c2a-0777d728f24b tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1478 microversion: 2.1 time: 0.156922 Oct 28 18:32:11.455818 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3381/6974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:11 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:12.478713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:12.479960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:12.487710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:12.488215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:12.488668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:12.489379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:12.489846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:12.490288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:12.622161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d6b5bcbabc24e619fafbc42529bae35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb84ee356a8d40bea45d485dfd76cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:12.630970 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81b03000-ae81-47e2-a792-38cf76e9de31 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 200 len: 1478 microversion: 2.1 time: 0.156606 Oct 28 18:32:12.631572 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3594/6975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:12 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:13.141133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1c406d-3f2d-481b-9f03-56aeb72ebf65", "name": "network-vif-deleted", "tag": "3abff14f-610c-4550-8937-21b4dd59aeba"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:13.153409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:13.153891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:13.154320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.166264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] Creating event network-vif-deleted:3abff14f-610c-4550-8937-21b4dd59aeba for instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 on n-h2-860864-13 Oct 28 18:32:13.172654 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e2516932-48d4-4ac3-a3ea-473333572068 req-f29449c3-8af8-422f-bfc3-00bddfcfcc2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Oct 28 18:32:13.173461 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3382/6976] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:13.654292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:13.654826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] [instance: 3b1c406d-3f2d-481b-9f03-56aeb72ebf65] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:13.661723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:13.662228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:13.662705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.663439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:13.663903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:13.664340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:13.677706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] HTTP exception thrown: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Request method failure captured: Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 HTTP/1.1 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCAc4tm5LXg-oBnrAXOusYNHwrj2zx-b7anq_kzlRVZ5R8uWptGgHTTep0hYe24iIAVbrWmRm53hB5dIi6sFeSQ2yxM8vyOYNZKmTbeWYQCJdwrllZMrXSng8l8Kk3dmRIrRAsoCndUG1ebXrxjN0TzRRBk5OoJxjIXMHUpdVIOZJqk Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: cb84ee356a8d40bea45d485dfd76cfcb Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1975663538 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb84ee356a8d40bea45d485dfd76cfcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cb84ee356a8d40bea45d485dfd76cfcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cb84ee356a8d40bea45d485dfd76cfcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cb84ee356a8d40bea45d485dfd76cfcb"}]}] Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1975663538 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: cb84ee356a8d40bea45d485dfd76cfcb Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1975663538 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersAdminNegativeTestJSON-1975663538-project Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 6d6b5bcbabc24e619fafbc42529bae35 Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1975663538-project Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '3b1c406d-3f2d-481b-9f03-56aeb72ebf65'} Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:13.679351 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] Returning 404 to user: Instance 3b1c406d-3f2d-481b-9f03-56aeb72ebf65 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef6772a9-9833-405d-820a-69de546e9842 tempest-ServersAdminNegativeTestJSON-1975663538 tempest-ServersAdminNegativeTestJSON-1975663538-project] 10.222.0.48 "GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65" status: 404 len: 111 microversion: 2.1 time: 0.030639 Oct 28 18:32:13.684424 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3595/6977] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:13 2022] GET /compute/v2.1/servers/3b1c406d-3f2d-481b-9f03-56aeb72ebf65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:32:19.784830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1875460498", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "dd190980-82f0-4c18-a713-fb48dc4bc925"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:19.839401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] validate_networks() for [('dd190980-82f0-4c18-a713-fb48dc4bc925', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:32:20.263257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:32:20.263703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:32:20.264179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:32:20.264584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:32:20.264992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:32:20.274249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:20.274734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:20.275165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.276648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:20.277670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:20.278095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:20.296711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Getting quotas for project 9314275b19e54b2596b377cc7bb7fa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:32:20.302236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Getting quotas for user 1c19a158039a4f3595b344d30f59cb58 and project 9314275b19e54b2596b377cc7bb7fa8c. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:32:20.316071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:32:20.318485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:32:20.369068 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f0f0a77-59e0-4ccb-b6f7-55b6cd05ce8c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709482 Oct 28 18:32:20.370634 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3383/6978] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:32:20.382056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6334563a-e9ee-4a1f-8736-8ce8a70b6de6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:20.384499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6334563a-e9ee-4a1f-8736-8ce8a70b6de6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:20.390866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:20.458104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6334563a-e9ee-4a1f-8736-8ce8a70b6de6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:20.467089 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6334563a-e9ee-4a1f-8736-8ce8a70b6de6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1215 microversion: 2.1 time: 0.089132 Oct 28 18:32:20.468898 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3596/6979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:20 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:21.493828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:21.494540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:21.506157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:21.506835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:21.507284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:21.508259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:21.508921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:21.509584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:21.620342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:21.629242 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c2583db9-81bb-4a9c-be98-6b7bfb3e3cdd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1275 microversion: 2.1 time: 0.141663 Oct 28 18:32:21.630115 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3384/6980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:21 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:22.653879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:22.654501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:22.660543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:22.673818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:22.674322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:22.675239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:22.675995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:22.676689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:22.677195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:22.845446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:22.855600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3dee835e-5cef-4eb8-9cb5-a6940e9906b0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.205963 Oct 28 18:32:22.856371 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3597/6981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:22 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:22.995020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:23.010939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:23.011622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:23.012455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:23.027456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] Creating event network-changed:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h2-860864-13 Oct 28 18:32:23.033735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7e0e5b90-d901-4836-8ddc-faf2d6a9b6b1 req-1055a3eb-3e34-48ba-b9d8-04e004144a82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045547 Oct 28 18:32:23.035209 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3385/6982] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:23.879625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:23.880242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:23.887860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:23.888353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:23.888799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:23.889498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:23.889959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:23.890391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:24.019583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:24.027885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9fd71154-04a9-4b53-8858-3c74431e3aa9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.152448 Oct 28 18:32:24.028458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3598/6983] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:23 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:25.050847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:25.051762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:25.059385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:25.059890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:25.060306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:25.061003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:25.061449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:25.061872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:25.196425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:25.204080 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86385da4-f59b-47f2-a87f-e7b6639fd1c2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.157695 Oct 28 18:32:25.204650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3386/6984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:25 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:26.227467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:26.228091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:26.235034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:26.235608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:26.236387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:26.237105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:26.237572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:26.238010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:26.373513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:26.382980 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e1d281c4-2eb8-456f-99c2-5c1bf5fd2064 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.159403 Oct 28 18:32:26.383891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3599/6985] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:26 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:27.408166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:27.408773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:27.416761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:27.417332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:27.417886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:27.418607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:27.419095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:27.419565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:27.555535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:27.563246 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5edf7d16-f07b-47ba-8e4f-4a93194659eb tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.159265 Oct 28 18:32:27.563900 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3387/6986] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:27 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:28.586154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:28.586771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:28.590061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:28.596129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:28.596633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:28.597109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:28.597819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:28.598285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:28.598728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:28.603400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:28.738049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:28.746517 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79884ff4-eeeb-4844-ba96-3ade5bc7a1aa tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.164248 Oct 28 18:32:28.747106 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3600/6987] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:28 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:29.639977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "name": "network-vif-plugged", "status": "completed", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:29.646259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:29.653496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:29.654061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:29.654560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:29.659672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=80 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:29.669361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] Creating event network-vif-plugged:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h2-860864-13 Oct 28 18:32:29.674477 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5219ca1f-b92c-4bc3-9e62-1a1cd5707bda req-f52e1f35-f2c8-4b69-a33d-2615c53c6415 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038193 Oct 28 18:32:29.675128 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3388/6988] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:32:29.770619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:29.771232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:29.779065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:29.779608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:29.780065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:29.780785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:29.781253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:29.781692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:29.912448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:29.920801 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a46ce860-1509-46f2-ba95-9d397bfbd642 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.154104 Oct 28 18:32:29.921379 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3601/6989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:29 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:30.941395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=5 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:30.942174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=8 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:30.948659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:30.949367 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:30.957015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:30.957494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:30.957929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:30.958612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:30.959063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:30.959515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:31.095918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:31.104114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f9c3f0e9-2edb-4016-a950-9845465353a5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1315 microversion: 2.1 time: 0.163095 Oct 28 18:32:31.104791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3389/6990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:30 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:32.128421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:32.129041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:32.130928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:32.138057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.138555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.139006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.139755 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.140219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.140657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.268957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:32.276804 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b67ace7-2e0c-4665-9e13-4281812ddcd0 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1503 microversion: 2.1 time: 0.152610 Oct 28 18:32:32.277389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3602/6991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:32 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:32.299600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:32:32.301893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:32.309329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.309821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.310262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.310956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.311443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.311875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.387749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:32.393137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:32:32.399579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:32:32.400008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:32:32.400675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:32:32.401245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:32:32.401678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:32:32.513081 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-eabf2bb0-f5f2-406e-ad8a-4bba494eeacf tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "POST /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9/action" status: 202 len: 0 microversion: 2.1 time: 0.217975 Oct 28 18:32:32.514414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3390/6992] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:32:32 2022] POST /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:32:32.522132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:32.523029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:32.538093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.538669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.539125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.539875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:32.540355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:32.540958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:32.688464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:32.696576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22eb42b1-42ea-44e2-88b2-5c52d7c04430 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1512 microversion: 2.1 time: 0.178592 Oct 28 18:32:32.697162 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3603/6993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:32 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:33.721774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:33.722391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:33.730635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:33.731126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:33.731599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:33.732297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:33.732758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:33.733186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:33.870506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:33.879615 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9e5cccc0-6a70-4398-a96e-f8823ae5af05 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1512 microversion: 2.1 time: 0.161678 Oct 28 18:32:33.880302 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3391/6994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:33 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:34.905024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:34.905569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:34.912365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:34.912858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:34.913301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:34.913998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:34.914457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:34.914888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:35.046519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:35.054524 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bbc7cda3-40fa-4556-a2e8-c3a6ae684bf7 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.154726 Oct 28 18:32:35.055092 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3604/6995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:34 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:36.078299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:36.078906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:36.085799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.086285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.086729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.087453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:36.088502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:36.088972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:36.220197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:36.227875 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5410339-4d18-4784-ab85-3d8088726c78 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.153498 Oct 28 18:32:36.229079 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3392/6996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:36 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:37.251592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:37.252478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:37.258531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:37.259026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:37.259502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:37.260307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:37.260773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:37.261212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:37.390496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:37.398213 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cf31ecd3-4d67-4606-ad30-9e354902c528 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.150829 Oct 28 18:32:37.398786 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3605/6997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:37 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:38.422221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:38.422863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:38.429207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.429688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.430124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.430812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:38.431267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:38.432276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:38.566618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:38.574529 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac676ba4-88b9-4de1-9e77-e951c2365556 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.156185 Oct 28 18:32:38.575116 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3393/6998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:38 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:39.598269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:39.598807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:39.605924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.606417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.606862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.607590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:39.608053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:39.608489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:39.739949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:39.748296 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0380705-51ae-4fe4-8921-c414da2cb1a4 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.154096 Oct 28 18:32:39.748911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3606/6999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:39 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:40.776345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:40.777484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:40.785652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:40.786137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:40.786571 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:40.787267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:40.787742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:40.788162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:40.923929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:40.932398 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a4a638fe-fff5-4a00-8454-d96376113f4b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.162800 Oct 28 18:32:40.932987 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3394/7000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:40 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:41.956228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:41.956752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:41.964264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:41.964751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:41.965206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:41.965919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:41.966383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:41.966821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:42.100480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:42.108516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f25021b3-9eca-40f6-a80c-b58c720a1ca2 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.156433 Oct 28 18:32:42.109101 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3607/7001] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:41 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:43.133834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:43.135836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:43.143512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:43.144068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:43.144638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.145445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:43.146001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:43.146524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:43.290586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:43.299972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37540b50-6ee5-473c-88a1-bc58b9949a22 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.171316 Oct 28 18:32:43.300683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3395/7002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:43 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:44.325424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:44.326090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:44.333151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:44.333646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:44.334097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:44.334805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:44.335269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:44.335742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:44.469231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:44.476941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-621e3af3-1286-41eb-a14f-4b3625df99f5 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.155592 Oct 28 18:32:44.477514 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3608/7003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:44 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:45.501251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:45.502109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:45.508887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:45.509867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:45.510395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.511279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:45.511757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:45.512181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:45.691266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:45.699760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-473b88a0-a053-4100-98f7-803dbef5c832 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.203094 Oct 28 18:32:45.700332 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3396/7004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:45 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:46.722433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:46.722968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:46.729951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.730450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.730902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:46.731633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:46.732100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:46.732534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:46.866113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:46.874147 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e36bab1b-4dcf-4fb9-94b8-f0df588f763b tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.155792 Oct 28 18:32:46.874808 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3609/7005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:46 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:47.897949 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:47.898588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:47.906079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.906570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.907004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:47.907736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:47.908191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:47.908616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:48.035116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:48.043430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e76a187d-df01-4355-9220-68a78a55a6ba tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.149423 Oct 28 18:32:48.044004 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3397/7006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:47 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:49.066085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:49.066707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:49.074080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:49.074569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:49.075089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:49.075885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:49.076346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:49.076782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:49.212415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:49.220672 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b62bac89-f480-4102-9999-b3d5cfd35f9d tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.158484 Oct 28 18:32:49.221256 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3610/7007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:49 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:50.244451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:50.245145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:50.252222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:50.252703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:50.253138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:50.253819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:50.254270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:50.254699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:50.383640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:50.391885 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c9cad1ad-ddb0-41c8-b68a-c4977b998602 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.151796 Oct 28 18:32:50.392455 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3398/7008] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:50 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:51.414599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:51.415222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:51.422182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:51.422707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:51.423538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:51.424237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:51.424703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:51.425137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:51.554191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:51.562628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cbfc8716-87c8-40e3-87dc-b157029266cd tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.151990 Oct 28 18:32:51.563206 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3611/7009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:51 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:52.584795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:52.585401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:52.592407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:52.592887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:52.593323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:52.594010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:52.594464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:52.594889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:52.727251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:52.735862 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-be03be3a-3879-455b-8461-ecfb28699025 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.154943 Oct 28 18:32:52.736441 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3399/7010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:52 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:53.760300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:53.761012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:53.767970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:53.768473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:53.768928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:53.769634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:53.770103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:53.770547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:53.905561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:53.913371 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d88a1f11-9122-466f-9990-4d06e7ebc6a1 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.157582 Oct 28 18:32:53.913888 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3612/7011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:53 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:54.936579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:54.937172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:54.944065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:54.944575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:54.945007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:54.945689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:54.946132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:54.946551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:55.079073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:55.086968 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ef3473af-57c5-41b6-9ce9-73f768fb2285 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.154257 Oct 28 18:32:55.087547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3400/7012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:54 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:32:56.110592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:56.111241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:56.118294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:56.118789 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:56.119266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:56.119999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:56.120467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:56.120906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:56.254314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:56.262570 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a039d7b-c5ce-48d3-aa93-b8fa324dfd1e tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.156010 Oct 28 18:32:56.263224 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3613/7013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:56 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:57.286107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:57.286723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:57.294115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:57.294603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:57.295041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:57.295763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:57.296220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:57.296646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:57.434107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:57.441912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03fe2a13-c65b-406b-8cbe-797487eeb594 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.159759 Oct 28 18:32:57.442501 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3401/7014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:57 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:58.465008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:58.465631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:58.472537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:58.473036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:58.473487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:58.474188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:58.474664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:58.475102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:58.604524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:58.612496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69fe452f-308b-47d2-8312-322b04f9b9f3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.151308 Oct 28 18:32:58.613019 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3614/7015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:58 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:32:59.636724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:32:59.637259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:32:59.644055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:59.644536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:59.644969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:59.645654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:32:59.646106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:32:59.646529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:32:59.777003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:32:59.779189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:32:59.786104 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18d8f8e7-d879-451c-8f3c-407412ec7788 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.153373 Oct 28 18:32:59.786689 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3402/7016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:32:59 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:00.810572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:00.811194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:00.813940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=30 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:00.819474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:00.819968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:00.820409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:00.821103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:00.821566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:00.822619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:00.825492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=90 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:00.958060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:00.966052 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4c6be64f-eda5-415e-a14d-397080eb0987 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1517 microversion: 2.1 time: 0.159933 Oct 28 18:33:00.966622 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3615/7017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:00 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:01.989561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:01.990230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:01.993677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=34 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:02.000610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:02.001112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:02.001553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:02.002510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:02.002973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:02.003430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:02.085147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "name": "network-vif-unplugged", "status": "completed", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:02.097107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:02.097601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:02.098066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:02.115956 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Creating event network-vif-unplugged:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h1-860864-13 Oct 28 18:33:02.122867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] Instance f23efe2c-5863-4397-9256-5935c45c74e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:33:02.134606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3e11481a-c83f-4963-b5ac-9ef327923b22 req-c4cd9d29-712b-477f-850e-f6ad42de7297 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053167 Oct 28 18:33:02.135678 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3616/7018] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:02.145323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:02.153858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-455ed415-15fc-48c7-bb60-de4428d611de tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1516 microversion: 2.1 time: 0.168240 Oct 28 18:33:02.154732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3403/7019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:01 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:03.179638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:03.180259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:03.187161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:03.187722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:03.188225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:03.188936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:03.189402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:03.189842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:03.322625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:03.330443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9d21a72a-e778-41b0-b9c4-cb5ecdef331a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1514 microversion: 2.1 time: 0.156049 Oct 28 18:33:03.331013 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3617/7020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:03 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:04.166118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:04.176408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:04.176905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:04.177332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:04.189096 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Creating event network-changed:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h1-860864-13 Oct 28 18:33:04.194398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] Instance f23efe2c-5863-4397-9256-5935c45c74e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:33:04.206776 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0e135be7-70d1-4606-b4d9-aceb3c1dc1c8 req-3d31eb96-7763-4b60-b546-77089811354b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044386 Oct 28 18:33:04.207359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3404/7021] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:04.354102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:04.354822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:04.362182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:04.362694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:04.363143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:04.363886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:04.364353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:04.364787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:04.497640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:04.505701 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-475f7b43-c1be-42ca-963a-08d19ab20339 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1514 microversion: 2.1 time: 0.155721 Oct 28 18:33:04.506283 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3618/7022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:04 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:05.530680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:05.531297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:05.538523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:05.539015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:05.539489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:05.540207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:05.540692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:05.541120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:05.699796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:05.708602 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fdbe83c1-932f-4181-aec0-9d1e1c4b50c3 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1514 microversion: 2.1 time: 0.182362 Oct 28 18:33:05.709322 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3405/7023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:05 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:06.732484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:06.733107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:06.740043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.740544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.741000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.741703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.742169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.742637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.883982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:06.892378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30eeccdb-ead7-450c-afdb-87782ab964a6 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1511 microversion: 2.1 time: 0.163770 Oct 28 18:33:06.892972 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3619/7024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:06 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:06.917381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:06.917917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:06.924919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.925408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.925852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.926548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:06.927006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:06.927463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:06.953522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:33:07.003307 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.compute.api [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Found an unconfirmed migration during delete, id: 16, status: finished Oct 28 18:33:08.321831 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8550fff8-c296-49a9-ae40-3266c90f3902 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 204 len: 0 microversion: 2.1 time: 1.408664 Oct 28 18:33:08.322947 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3406/7025] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:33:06 2022] DELETE /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 0 bytes in 1410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:33:08.331336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:08.331982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:08.339287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:08.339812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:08.340262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:08.340975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:08.341444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:08.341877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:08.426095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "name": "network-vif-plugged", "status": "completed", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:08.437354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:08.437928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:08.438389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:08.453378 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] Creating event network-vif-plugged:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h1-860864-13 Oct 28 18:33:08.458316 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b4bdeb9f-21d5-4459-8587-48f569e78c6a req-a95aa526-e8bb-42de-9fe1-79a6dca66b5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 Oct 28 18:33:08.459172 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3407/7026] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:08.485405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:08.495056 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-84c97688-883c-4484-b652-658a71b83739 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1503 microversion: 2.1 time: 0.167606 Oct 28 18:33:08.496205 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3620/7027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:08 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:09.520280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:09.521150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:09.527978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.528468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.528907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.529651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:09.530056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:09.530482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:09.664853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c19a158039a4f3595b344d30f59cb58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9314275b19e54b2596b377cc7bb7fa8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:09.674340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72c1ad49-8743-48e7-8431-d3735f78a036 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 200 len: 1503 microversion: 2.1 time: 0.159094 Oct 28 18:33:09.674940 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3408/7028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:09 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:10.163559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23efe2c-5863-4397-9256-5935c45c74e9", "name": "network-vif-deleted", "tag": "41653e8a-c38c-47ad-a209-24b4d136c599"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:10.179823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.180314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.180949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.203138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] Creating event network-vif-deleted:41653e8a-c38c-47ad-a209-24b4d136c599 for instance f23efe2c-5863-4397-9256-5935c45c74e9 on n-h1-860864-13 Oct 28 18:33:10.208536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2727ed0c-da92-443b-9dd1-bbcdb7b6d3ff req-21137c2e-1612-49cc-bfbb-9eafae7080a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048710 Oct 28 18:33:10.209144 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3621/7029] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:10.698233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:10.698780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:10.705605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.706089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.706529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.707222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.707716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.708144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.722737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] HTTP exception thrown: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Request method failure captured: Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 HTTP/1.1 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCAzCdh0vcxf0t5WbDCpmrXqkM1ETDcbX6UCRllc9Prt1fWgTAMW0190STOfCZMf6GRCRKOR0rbMVSTpvdB4Ha7IlJ2_5dMUd2D2yFKqLkmxK7Pw7-oxrdAPhUglLhOrv2Qs49QP_bAOoDJ8baTLRL4FkNpxA52p1z7w2sJni4w037A Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9314275b19e54b2596b377cc7bb7fa8c"}]}] Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 1c19a158039a4f3595b344d30f59cb58 Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f23efe2c-5863-4397-9256-5935c45c74e9'} Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.724401 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Returning 404 to user: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-686ae857-1123-4c43-8ce5-4bb34d45f17a tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 404 len: 111 microversion: 2.1 time: 0.032107 Oct 28 18:33:10.729183 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3409/7030] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:10 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:33:10.742310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:10.742912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:10.749166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.749665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.750121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.750829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.751309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.751780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.766220 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] HTTP exception thrown: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Request method failure captured: Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 HTTP/1.1 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCAzCdh0vcxf0t5WbDCpmrXqkM1ETDcbX6UCRllc9Prt1fWgTAMW0190STOfCZMf6GRCRKOR0rbMVSTpvdB4Ha7IlJ2_5dMUd2D2yFKqLkmxK7Pw7-oxrdAPhUglLhOrv2Qs49QP_bAOoDJ8baTLRL4FkNpxA52p1z7w2sJni4w037A Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9314275b19e54b2596b377cc7bb7fa8c"}]}] Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 1c19a158039a4f3595b344d30f59cb58 Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'f23efe2c-5863-4397-9256-5935c45c74e9'} Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:33:10.767886 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Returning 404 to user: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f75f8a9a-e557-408b-b8c0-218e77d224f9 tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 404 len: 111 microversion: 2.1 time: 0.031468 Oct 28 18:33:10.772125 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3622/7031] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:33:10 2022] DELETE /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:33:10.778791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:10.779421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] [instance: f23efe2c-5863-4397-9256-5935c45c74e9] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:10.785305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.785784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.786221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.786909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:10.787386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:10.787849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:10.801025 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] HTTP exception thrown: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Request method failure captured: Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 HTTP/1.1 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCAzCdh0vcxf0t5WbDCpmrXqkM1ETDcbX6UCRllc9Prt1fWgTAMW0190STOfCZMf6GRCRKOR0rbMVSTpvdB4Ha7IlJ2_5dMUd2D2yFKqLkmxK7Pw7-oxrdAPhUglLhOrv2Qs49QP_bAOoDJ8baTLRL4FkNpxA52p1z7w2sJni4w037A Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9314275b19e54b2596b377cc7bb7fa8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9314275b19e54b2596b377cc7bb7fa8c"}]}] Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9314275b19e54b2596b377cc7bb7fa8c Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-DeleteServersTestJSON-260561672 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 1c19a158039a4f3595b344d30f59cb58 Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-DeleteServersTestJSON-260561672-project Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'f23efe2c-5863-4397-9256-5935c45c74e9'} Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:33:10.802508 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] Returning 404 to user: Instance f23efe2c-5863-4397-9256-5935c45c74e9 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9174e4a7-46ce-4567-aed0-a52d21c2b58c tempest-DeleteServersTestJSON-260561672 tempest-DeleteServersTestJSON-260561672-project] 10.222.0.48 "GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9" status: 404 len: 111 microversion: 2.1 time: 0.029689 Oct 28 18:33:10.807046 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3410/7032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:10 2022] GET /compute/v2.1/servers/f23efe2c-5863-4397-9256-5935c45c74e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:33:19.813859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-852496648", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "c760f8f2-2510-4ce8-b566-2a5c00a99951"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:19.873347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] validate_networks() for [('c760f8f2-2510-4ce8-b566-2a5c00a99951', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:33:20.251352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:33:20.252276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:33:20.252760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:33:20.253182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:33:20.253602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:33:20.264153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:20.264639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:20.265080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:20.265814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:20.266274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:20.266705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:20.284854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for project 87b9266a72594c338ea8786db265169f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:33:20.290788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for user b2d2efde111141ccbbed812473cceb78 and project 87b9266a72594c338ea8786db265169f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:33:20.303798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:33:20.306718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:33:20.353770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5e92ebaf-1674-447f-a218-6ff751a727a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681864 Oct 28 18:33:20.354436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3623/7033] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:33:20.365731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65f50924-67aa-460c-91ef-11ff0931c6a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:20.366328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65f50924-67aa-460c-91ef-11ff0931c6a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:20.427878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65f50924-67aa-460c-91ef-11ff0931c6a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:20.437501 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65f50924-67aa-460c-91ef-11ff0931c6a3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1217 microversion: 2.1 time: 0.075500 Oct 28 18:33:20.438066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3411/7034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:20 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:21.465087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:21.466451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:21.478169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:21.478758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:21.480083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:21.480893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:21.481451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:21.482751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:21.571062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:21.580920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74673e28-562b-413b-96fe-0659b7904742 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1287 microversion: 2.1 time: 0.123781 Oct 28 18:33:21.582053 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3624/7035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:21 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:22.606128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:22.607271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:22.609301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:22.616678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:22.617101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:22.617535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:22.618595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:22.619057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:22.619704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:22.767842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:22.778304 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-777da9c7-ae46-4dec-8c52-71a336aca575 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.176023 Oct 28 18:33:22.778887 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3412/7036] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:22 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:22.827708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:22.845494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:22.846335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:22.847018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:22.869869 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] Creating event network-changed:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h1-860864-13 Oct 28 18:33:22.875599 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d6366964-c301-4214-9dc4-b4f81aa957bc req-d0e9c390-96cb-41e4-87f9-ccd6010c7251 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053863 Oct 28 18:33:22.876218 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3625/7037] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:33:23.801731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:23.802343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:23.809796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:23.810279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:23.810716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:23.811432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:23.811891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:23.812317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:23.945864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:23.954124 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5c4bc675-bb76-4028-a275-0efeb9e7ac7f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.156310 Oct 28 18:33:23.954699 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3413/7038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:23 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:24.978531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:24.979241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:24.985462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:24.985962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:24.986410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:24.987109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:24.987612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:24.988052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:25.116891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:25.124876 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-be9f87c0-7a3f-4bb4-a03d-55f55eaafb71 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.151642 Oct 28 18:33:25.125490 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3626/7039] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:24 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:26.149040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:26.150520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:26.157104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:26.157596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:26.158036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:26.158724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:26.159173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:26.159626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:26.294127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:26.301781 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-070d6420-eba9-4db8-b972-1d0b5f185fee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.156624 Oct 28 18:33:26.302345 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3414/7040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:26 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:27.325909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:27.326526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:27.333353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:27.333858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:27.334307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:27.335010 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:27.335518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:27.335957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:27.468828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:27.476676 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0037f8d-2d8f-4f83-a10c-fe2c636eaf0c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.154687 Oct 28 18:33:27.478098 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3627/7041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:27 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:28.487467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "name": "network-vif-plugged", "status": "completed", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:28.500992 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:28.501712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:28.510121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:28.510963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:28.511469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:28.511674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:28.511959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:28.512281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:28.512723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:28.512860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:28.513222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:28.528040 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] Creating event network-vif-plugged:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h1-860864-13 Oct 28 18:33:28.534020 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4b682f6e-c3c7-4822-a95f-e8811918aee7 req-1b938b75-0619-408f-9475-b21fe0b57c35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050623 Oct 28 18:33:28.534899 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3415/7042] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:33:28.656371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:28.664695 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c81bf0b-bae0-4c80-8c92-ae12d4bb4d67 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.167468 Oct 28 18:33:28.666052 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3628/7043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:28 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:29.691392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:29.692114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:29.698885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:29.699390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:29.699831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:29.700516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:29.700969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:29.701392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:29.836441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:29.844657 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6fa0e026-fb28-48c2-9334-8ee30cddb5b2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1317 microversion: 2.1 time: 0.158279 Oct 28 18:33:29.845277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3416/7044] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:29 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:30.868960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:30.869576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:30.872447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:30.873214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:30.873830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:30.880629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:30.881127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:30.881603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:30.882311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:30.882776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:30.883217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:30.888195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=66 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:31.013006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.020964 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b7f6d80-21d4-4d11-98fe-179fbb7dac54 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1507 microversion: 2.1 time: 0.155914 Oct 28 18:33:31.021550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3629/7045] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:30 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:31.043821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:31.044470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.046435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:31.052952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.053429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.053861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.054790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.054992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.055814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.189244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.197921 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c22d310d-e5ee-4208-9b94-49db7f58e8d8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1507 microversion: 2.1 time: 0.158032 Oct 28 18:33:31.198499 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3417/7046] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:31 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:31.220488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:31.222815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.228927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.229422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.229875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.230585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.231053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.231534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.300151 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-505a71f7-2beb-45ad-a4db-0bc79972d198 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "PUT /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1079 microversion: 2.1 time: 0.083580 Oct 28 18:33:31.304008 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3630/7047] 10.222.0.48 () {60 vars in 1256 bytes} [Fri Oct 28 18:33:31 2022] PUT /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:31.319607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:31.320224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.327325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.327846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.328285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.328980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.329436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.329866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.457621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.465527 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a961ab7-1513-4586-bed0-8c09e000c8e5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1505 microversion: 2.1 time: 0.149874 Oct 28 18:33:31.466109 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3418/7048] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:31 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:31.487285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:31.487982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.494576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.495061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.495559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.496265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.496757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.497184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.630665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.639308 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99fd5547-8d45-4ffc-a179-f91efd58d714 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1505 microversion: 2.1 time: 0.155913 Oct 28 18:33:31.639912 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3631/7049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:31 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:31.661295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:33:31.663637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.670976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.671495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.671935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.672633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.673084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.673507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.702308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.707724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:33:31.714229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:33:31.714653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:33:31.715155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:33:31.715590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:33:31.715999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:33:31.779182 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-991f581b-d497-4251-b75a-96c846811df5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c/action" status: 202 len: 0 microversion: 2.1 time: 0.121706 Oct 28 18:33:31.782835 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3419/7050] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:33:31 2022] POST /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:33:31.787903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:31.788530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:31.795188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.795725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.796175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.796930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:31.797399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:31.797847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:31.933267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:31.941379 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdddf1f9-c0ad-4672-96ea-df62c8de122c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1516 microversion: 2.1 time: 0.157381 Oct 28 18:33:31.955404 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3632/7051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:31 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:32.965593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:32.966141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:32.968920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:32.975230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:32.975754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:32.976292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:32.977054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:32.977528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:32.978122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:33.124057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:33.132346 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0311ea6a-de85-4802-aa5e-1ddd66b89d3c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1516 microversion: 2.1 time: 0.170926 Oct 28 18:33:33.132925 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3420/7052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:32 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:34.155885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:34.156508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:34.163347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:34.163871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:34.164318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:34.165677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:34.166302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:34.166751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:34.297177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:34.304942 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-32dfb700-1ac4-4e78-8c36-e4e7e50f279b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.153030 Oct 28 18:33:34.305559 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3633/7053] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:34 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:35.328381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:35.329003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:35.336018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:35.336509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:35.337126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:35.337833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:35.338292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:35.338722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:35.472211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:35.480497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e4d1cf41-1790-403c-8bf0-046bae9e50c0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.156021 Oct 28 18:33:35.481068 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3421/7054] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:35 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:33:36.504432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:36.505057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:36.512601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:36.513092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:36.513535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:36.514231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:36.514689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:36.515130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:36.647889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:36.656080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-683fb163-9f73-48d2-92ee-fc576777c888 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.155821 Oct 28 18:33:36.656643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3634/7055] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:36 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:37.680097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:37.680939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:37.687426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:37.687909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:37.688339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:37.689024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:37.689473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:37.689893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:37.816794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:37.824990 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0df300fd-fc4a-4156-8c6e-cce291450618 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.149039 Oct 28 18:33:37.825566 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3422/7056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:37 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:38.848648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:38.849278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:38.856542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:38.857039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:38.857518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:38.858285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:38.858804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:38.859241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:38.991573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:38.999837 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-491756af-ee55-4c2c-8a93-53a495922f66 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.155215 Oct 28 18:33:39.000412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3635/7057] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:38 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:40.023528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:40.024141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:40.031648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:40.032132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:40.032576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:40.033285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:40.033743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:40.034169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:40.161347 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:40.169199 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb549167-4155-48b1-aaed-506145687d16 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.149631 Oct 28 18:33:40.169774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3423/7058] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:40 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:41.192411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:41.193026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:41.200872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.201365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.201806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:41.202502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:41.202961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:41.203418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:41.335011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:41.342857 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b68d6a00-c660-4345-bc81-721091006fab tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.154389 Oct 28 18:33:41.343449 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3636/7059] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:41 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:42.369444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:42.370065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:42.378052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:42.378540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:42.378974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:42.379701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:42.380155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:42.380580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:42.512852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:42.520627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6e1083cc-8d96-414d-b88d-c1802320084e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.155694 Oct 28 18:33:42.521192 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3424/7060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:42 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:43.545156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:43.545787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:43.552973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.553417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.553871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:43.554591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:43.555064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:43.555539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:43.691764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:43.699576 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b21bbfc0-168b-4123-a558-d7b35007d57e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.158309 Oct 28 18:33:43.700181 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3637/7061] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:43 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:44.722100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:44.722642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:44.730130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:44.730606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:44.731041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:44.731749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:44.732196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:44.732611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:44.866660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:44.875552 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22f342e3-c8f2-4563-a00b-04c96f7b25d2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.157324 Oct 28 18:33:44.876217 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3425/7062] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:44 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:45.900452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:45.901080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:45.908067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:45.908572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:45.909030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:45.909734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:45.910201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:45.910643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:46.039634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:46.048171 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfeb46cd-f386-4422-9f5b-098fb650820d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.152134 Oct 28 18:33:46.048746 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3638/7063] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:45 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:47.072586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:47.073196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:47.081399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.082232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.083025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.084328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:47.085169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:47.085977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:47.221099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:47.228912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-feb9fea4-cf33-4cd6-ba7e-020dfcbcc4b1 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.160933 Oct 28 18:33:47.229484 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3426/7064] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:47 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:48.252765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:48.253416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:48.260903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.261403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.261851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.262549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:48.263012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:48.263479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:48.392191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:48.400516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a5b28853-8113-4fd3-ac19-a58ca3a54679 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.151404 Oct 28 18:33:48.401083 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3639/7065] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:48 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:49.424389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:49.425020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:49.431995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:49.432473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:49.432910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:49.433596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:49.434049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:49.434473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:49.563592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:49.566962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:33:49.572637 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-75d8a3cb-76b0-4868-a0a7-3f134e4cb27b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.152172 Oct 28 18:33:49.573215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3427/7066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:49 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:50.597516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:50.598286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:50.606601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:50.607133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:50.607694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:50.608467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:50.609032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:50.609508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:50.747052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:50.755014 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c55cb550-8091-4269-999f-87c2c2a317f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.162333 Oct 28 18:33:50.755615 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3640/7067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:50 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:51.779533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:51.780148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:51.787668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.788148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.788579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.789268 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:51.789720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:51.790770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:51.923197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:51.931074 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-26e140a1-7eaa-4883-b199-b387bd6a6ca6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.156760 Oct 28 18:33:51.931695 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3428/7068] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:51 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:52.954281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:52.954840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:52.961732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.962275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.962873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:52.963612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:52.964073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:52.964506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:53.096160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:53.104716 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1b5df3d5-7b97-48a6-b0f5-cbaecc8bb940 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.154464 Oct 28 18:33:53.105281 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3641/7069] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:52 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:54.128164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:54.128779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:54.136341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.136825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.137257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.137943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:54.138393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:54.138816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:54.267663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:54.275578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6b2a8b9e-d69e-4a7b-a4e6-56d563933f6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.151503 Oct 28 18:33:54.276213 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3429/7070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:54 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:55.298073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:55.298697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:55.306171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:55.306691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:55.307103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:55.307844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:55.308310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:55.308750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:55.442813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:55.451343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8988ae0b-5afb-493f-80bb-e76dc2efa6ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.157210 Oct 28 18:33:55.451957 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3642/7071] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:55 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:56.474188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:56.474778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:56.482179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.482659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.483094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.483818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:56.484316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:56.484761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:56.612780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:56.620727 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8d603a48-0507-49a9-beca-7f5a9fe1625f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.150398 Oct 28 18:33:56.621301 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3430/7072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:56 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:57.644735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:57.645352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:57.653268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:57.653765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:57.654213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:57.654916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:57.655403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:57.655845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:57.791508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:57.799217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-75e614f6-8d6d-488d-b3cd-0285968e0117 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.158490 Oct 28 18:33:57.799832 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3643/7073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:57 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:58.822655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:58.823290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:33:58.830121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.830623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.831052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.831766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:33:58.832216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:33:58.832635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:33:58.963958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:33:58.971659 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7b3a161a-e805-4f26-afcd-0ffccccbb2de tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.152987 Oct 28 18:33:58.972232 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3431/7074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:58 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:33:59.995899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:33:59.996525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:00.003658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.004157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.004609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.005313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.005777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.006215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.137622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:00.145283 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b85bcbb-9fae-4d6a-b11b-c6ae9bc51b83 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1521 microversion: 2.1 time: 0.153902 Oct 28 18:34:00.145857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3644/7075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:33:59 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:00.762467 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "name": "network-vif-unplugged", "status": "completed", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:00.772998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:00.773676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:00.774097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:00.786684 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Creating event network-vif-unplugged:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h2-860864-13 Oct 28 18:34:00.792098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:34:00.803435 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-79a5b4be-75aa-484e-be04-c165cfe24740 req-17a31af6-0264-44cd-9280-3cea19eda27f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045238 Oct 28 18:34:00.804228 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3432/7076] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:01.170491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:01.171232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:01.173211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=32 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:01.178760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.179259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.179743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.181044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:01.181563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:01.182114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:01.185019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:01.320077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:01.328196 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c1d53f2-6cb8-4c3e-b92b-125b9602d3a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1520 microversion: 2.1 time: 0.163084 Oct 28 18:34:01.328791 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3645/7077] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:01 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:02.352740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:02.353445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:02.360717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.361198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.361624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.362312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.362759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.363176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.494821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:02.502690 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a216bb81-c4df-40ff-a4d2-7db12f5ae291 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1518 microversion: 2.1 time: 0.154262 Oct 28 18:34:02.503264 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3433/7078] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:02 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:02.823271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:02.833471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:02.833976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:02.834410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:02.846571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Creating event network-changed:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h2-860864-13 Oct 28 18:34:02.851862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:34:02.863266 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1f4a41bc-7c0f-49e5-ba1d-dceb40a57cf6 req-45f116d2-0e5d-4bd1-a82f-4777611a61d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043827 Oct 28 18:34:02.863906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3646/7079] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:03.527020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:03.527676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:03.530371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=28 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:03.535922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.536407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.536846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.537561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:03.538018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:03.538440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:03.671924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:03.679619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc272bd5-710c-4a1d-91ea-e38f0b651c78 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1518 microversion: 2.1 time: 0.157220 Oct 28 18:34:03.680202 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3434/7080] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:03 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:04.705329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:04.706053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:04.712893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.713394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.713847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.714568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.715036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.715517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.849069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:04.857153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b16507d1-d10c-49af-8fb2-37bb8b54423b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1515 microversion: 2.1 time: 0.157249 Oct 28 18:34:04.857726 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3647/7081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:04 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:04.879634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:04.880197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:04.887713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.888195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.888626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.889311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.889759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.890180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.947589 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-58a2ef33-a446-4f2c-948d-50196f46f9c2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c/action" status: 204 len: 0 microversion: 2.1 time: 0.071853 Oct 28 18:34:04.948405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3435/7082] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:04 2022] POST /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:04.956816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:04.957377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:04.964083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.964591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.965102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:04.965836 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:04.966398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:04.966846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:05.099809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:05.107905 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-828c7f6a-d364-4cbd-bf78-ef29c97f4ef4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1515 microversion: 2.1 time: 0.155228 Oct 28 18:34:05.108491 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3648/7083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:04 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:06.132634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:06.134059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:06.141071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:06.141566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:06.142007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:06.142710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:06.143167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:06.143615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:06.284040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:06.293219 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-de6b9e69-9c8f-41b2-adea-c2b614bc8643 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1515 microversion: 2.1 time: 0.164788 Oct 28 18:34:06.293928 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3436/7084] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:06 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:07.317227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:07.317880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:07.324504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.325003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.325455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.326165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.326629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.327068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.456718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:07.465461 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f5965981-ed6d-4d3e-9067-aff2d5e77514 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1507 microversion: 2.1 time: 0.152232 Oct 28 18:34:07.466038 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3649/7085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:07 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:07.488762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:07.489375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:07.495351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.495858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.496297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.496991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:07.497448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:07.497877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:07.629841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:07.638296 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b55b068-7cc6-46e7-88c6-0878ef1313a0 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1507 microversion: 2.1 time: 0.153664 Oct 28 18:34:07.638874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3437/7086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:07 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:07.665486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f0a91a32-7d07-49b4-a860-f29759aba706 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'create', calling method: .version_select at 0x7f7524b07dc0>, body: {"keypair": {"name": "tempest-keypair-1843440608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhJ6X86YH7JHs/B88/hKjUWkzwQpp7G7UK64Ztbzt+MSDnzxk1pKA/4YFtQbPcFHkxMqz+fcC2/OKPdTmCZNYlvLRNOvKKQQxoWaPINYuirX36wMe8cCTrzzMo+Yd8/WQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:07.681838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f0a91a32-7d07-49b4-a860-f29759aba706 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for project 87b9266a72594c338ea8786db265169f. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:34:07.686955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-f0a91a32-7d07-49b4-a860-f29759aba706 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for user b2d2efde111141ccbbed812473cceb78 and project 87b9266a72594c338ea8786db265169f. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:34:07.715790 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f0a91a32-7d07-49b4-a860-f29759aba706 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054409 Oct 28 18:34:07.716400 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3650/7087] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:34:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:08.020739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "name": "network-vif-plugged", "status": "completed", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:08.032368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:08.033193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:08.033774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:08.046322 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] Creating event network-vif-plugged:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h2-860864-13 Oct 28 18:34:08.051527 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-08db0742-2fa5-4cf2-ae0e-abbabfaef167 req-23c65f22-62fa-41fe-9e4a-494c4aa4713c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Oct 28 18:34:08.052331 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3438/7088] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:08.934307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:08.934966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:08.941964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:08.942463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:08.942914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:08.943654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:08.944126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:08.944570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.078874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:09.087190 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6084044-668e-4e0e-8ce8-a990240240b8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 200 len: 1507 microversion: 2.1 time: 0.157468 Oct 28 18:34:09.087955 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3651/7089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:08 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:09.111833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:09.112418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:09.118535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.119022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.119486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.120177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.120634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.121059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.146351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:34:09.225984 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6267d6ae-8367-4f85-936a-3ccb661f6daf tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 204 len: 0 microversion: 2.1 time: 0.119053 Oct 28 18:34:09.226645 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3439/7090] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:09 2022] DELETE /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:09.282249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1862083866", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "c760f8f2-2510-4ce8-b566-2a5c00a99951"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:09.339140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] validate_networks() for [('c760f8f2-2510-4ce8-b566-2a5c00a99951', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:34:09.708085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:34:09.708524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:34:09.709016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:34:09.709440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:34:09.709869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:34:09.718855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.719357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.719838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.720587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:09.721058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:09.721502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:09.738386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for project 87b9266a72594c338ea8786db265169f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:34:09.744208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Getting quotas for user b2d2efde111141ccbbed812473cceb78 and project 87b9266a72594c338ea8786db265169f. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:34:09.756768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:34:09.759681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:34:09.803943 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86161194-fbe9-4a99-9a7b-5776af488b85 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525416 Oct 28 18:34:09.804525 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3652/7091] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:34:09.816767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72c338fc-3a32-41b4-abbc-d5d6c3f935e3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:09.817469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72c338fc-3a32-41b4-abbc-d5d6c3f935e3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:09.873361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72c338fc-3a32-41b4-abbc-d5d6c3f935e3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:09.880719 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72c338fc-3a32-41b4-abbc-d5d6c3f935e3 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1218 microversion: 2.1 time: 0.068258 Oct 28 18:34:09.881322 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3440/7092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:09 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:10.906595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:10.907944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:10.914783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.915707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.916252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:10.917080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:10.917613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:10.918281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:10.992486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:11.001128 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3f17d59-051c-4901-81d6-be56e0ccaf46 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1270 microversion: 2.1 time: 0.099735 Oct 28 18:34:11.002270 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3653/7093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:10 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:34:11.544295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c2ebe-aa3c-473b-8d47-617e9c65480c", "name": "network-vif-deleted", "tag": "0811628a-25c4-4b63-90dd-15b9fd159f6c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:11.561777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:11.562845 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:11.563551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:11.578560 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] Creating event network-vif-deleted:0811628a-25c4-4b63-90dd-15b9fd159f6c for instance a26c2ebe-aa3c-473b-8d47-617e9c65480c on n-h2-860864-13 Oct 28 18:34:11.584133 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9236d47d-ac61-45d9-b4dc-f3739fd4c40b req-377cffbd-1d26-4e6b-91ce-9246439679a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044767 Oct 28 18:34:11.585312 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3441/7094] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:12.026413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:12.027740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:12.034431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.034858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.035305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:12.036054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:12.036516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:12.036945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:12.194535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:12.204408 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23da863e-efc1-4f54-9718-a15b47bb450b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.183065 Oct 28 18:34:12.204995 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3654/7095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:12 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:13.230665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:13.231359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:13.237904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.238387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.238819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.239542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.239998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.240423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.377962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:13.385819 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ee207c48-6413-49f6-89ec-452619bf320f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.161062 Oct 28 18:34:13.386391 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3442/7096] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:13 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:13.599956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:13.611271 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:13.611791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:13.612229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:13.623311 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] Creating event network-changed:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h2-860864-13 Oct 28 18:34:13.628866 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a4f528d7-48ee-4e10-a7a1-5df47dfb3b92 req-c4bf58df-454b-4186-a787-2d529eb50554 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032659 Oct 28 18:34:13.629440 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3655/7097] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:14.408977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:14.409578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:14.416964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.417437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.417869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.418561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:14.419000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:14.419442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:14.552142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:14.560754 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e75bf638-ed45-49bc-884e-631096b2f936 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.155733 Oct 28 18:34:14.561320 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3443/7098] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:14 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:15.584329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:15.584961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:15.592096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.592587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.593030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.593727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:15.594188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:15.594627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:15.724626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:15.732839 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-396b4f8f-e446-4278-8bde-331c5e66e928 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.152930 Oct 28 18:34:15.733407 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3656/7099] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:15 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:16.756128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:16.756777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:16.764369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.764853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.765292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.765985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:16.766439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:16.766868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:16.782234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:16.898483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:16.906787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2baa749b-0d51-40ea-8219-edcf00550e7c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.154850 Oct 28 18:34:16.907362 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3444/7100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:16 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:17.929642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:17.930259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:17.937239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:17.937730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:17.938179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:17.938879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:17.939341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:17.939875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.076510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "name": "network-vif-plugged", "status": "completed", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:18.080085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:18.090704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e0462bf-16b3-406b-83af-f0b0c2fbe96b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.164836 Oct 28 18:34:18.095408 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3657/7101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:17 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:18.095572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:18.095572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:18.095572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:18.107826 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] Creating event network-vif-plugged:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h2-860864-13 Oct 28 18:34:18.113215 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5bde6fe8-ab1d-4e69-b82f-023b51326bed req-940c2017-4840-4909-a2ce-c3c778880180 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041288 Oct 28 18:34:18.113959 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3445/7102] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:19.114628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:19.115251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:19.122754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.123252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.123748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.124453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:19.124916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:19.125354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:19.260828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:19.268868 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99cb6c0a-2cbb-4bcc-8a31-54bcf27323a9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1318 microversion: 2.1 time: 0.158213 Oct 28 18:34:19.269447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3658/7103] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:19 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:20.290272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:20.294582 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.295283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:20.301782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.302269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.302707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.303416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.303875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.304299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.439019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:20.447018 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-23f49ff4-4862-4169-80c4-9acb75e6ca1b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1508 microversion: 2.1 time: 0.158565 Oct 28 18:34:20.447557 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3446/7104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:20.469658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.470326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:20.472333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:20.473137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:20.480512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.481012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.481463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.482171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.482638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.483078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.616420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:20.624930 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-20f644f6-f9a9-4e95-bced-54808d60d69b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1508 microversion: 2.1 time: 0.159155 Oct 28 18:34:20.625520 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3659/7105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:20.647251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:20.649644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:20.655760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.656251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.656720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.657419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.657872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.658326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.688855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:20.694392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:34:20.701049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:34:20.701409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:34:20.701885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:34:20.702294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:34:20.702706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:34:20.765078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-164d854a-44db-4e8d-b986-8cc4cb0c28ea tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2/action" status: 202 len: 0 microversion: 2.1 time: 0.121696 Oct 28 18:34:20.765894 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3447/7106] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:20 2022] POST /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:34:20.774133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:20.775397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:20.781633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.782133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.782603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.783311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:20.783793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:20.784228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:20.920005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:20.928310 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12019072-9f26-4776-9e06-a3a188de837f tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1515 microversion: 2.1 time: 0.158090 Oct 28 18:34:20.928904 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3660/7107] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:20 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:21.952030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:21.952578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:21.959491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.959983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.960419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:21.961315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:21.961854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:21.962588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:22.096646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:22.105463 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5d9481ae-b026-4f1d-ad46-13c22c1d5fbe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1515 microversion: 2.1 time: 0.158607 Oct 28 18:34:22.106050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3448/7108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:21 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:23.129162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:23.129782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:23.138025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.138532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.138983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.139734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:23.140203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:23.140643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:23.272575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:23.281037 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dfa46d19-3cb5-4d22-8d31-5f7a79246a94 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.155934 Oct 28 18:34:23.281616 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3661/7109] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:23 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:24.305201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:24.305878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:24.312830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.313316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.313747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.314438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:24.314888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:24.315310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:24.445207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:24.453471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13748eaa-b0b7-481a-bec6-91f809629d7b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.152119 Oct 28 18:34:24.454050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3449/7110] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:24 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:25.478077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:25.478709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:25.485526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.486026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.486474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.487174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:25.487661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:25.488100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:25.621305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:25.629348 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40a9fa9d-8300-4f2f-91e3-7bc137269e3d tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.156024 Oct 28 18:34:25.629926 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3662/7111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:25 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:26.653016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:26.653548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:26.660390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.660875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.661305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.661994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:26.662444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:26.662865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:26.797730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:26.805547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d3b4a93-ca9c-4a2b-a345-495df5a1300e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.156548 Oct 28 18:34:26.806326 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3450/7112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:26 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:27.828669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:27.829287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:27.836260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.836812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.837220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.837919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:27.838380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:27.838814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:27.966169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:27.973865 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6516f23-d758-4d27-8cd6-ebc2a6e5f33e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.149091 Oct 28 18:34:27.974438 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3663/7113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:27 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:28.998504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:28.999111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:29.006189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.006647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.007075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.007784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:29.008232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:29.009764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:29.146945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:29.154683 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1c54706-8daa-4c32-9d68-a068f72ff1a4 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.160076 Oct 28 18:34:29.155252 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3451/7114] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:28 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:30.178930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:30.179602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:30.187402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.187906 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.188347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.189059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:30.189512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:30.189946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:30.208615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:30.329273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:30.337753 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e55767ea-22ce-4c3d-a08c-a8668c94a1a8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.163939 Oct 28 18:34:30.338342 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3664/7115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:30 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:31.361836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:31.362466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:31.370155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:31.370650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:31.371298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:31.372113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:31.372605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:31.373053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:31.505697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:31.514037 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca9ee9ff-23a1-4c55-aa2b-98f3e7b296ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.156780 Oct 28 18:34:31.514609 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3452/7116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:31 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:32.538275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:32.538932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:32.542507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:32.550295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.550977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.551680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.552383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:32.552859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:32.553303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:32.691413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:32.699178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-009fa9f6-d0b1-4600-aeae-746b6d8dc522 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.164887 Oct 28 18:34:32.699792 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3665/7117] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:32 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:33.722741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:33.723297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:33.725961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:33.732015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.732533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.732996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:33.733689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:33.734139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:33.734560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:33.863747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:33.873516 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e0654a3-2067-48bb-9bd4-9c5d74f135ee tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.154895 Oct 28 18:34:33.874089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3453/7118] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:33 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:34.897236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:34.897873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:34.904897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.905395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.905848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:34.906557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:34.907027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:34.907493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:35.039726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:35.048166 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-76badc4e-bd95-4b6b-97f5-44c76de89eae tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.154976 Oct 28 18:34:35.048753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3666/7119] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:34 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:36.070441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:36.071048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:36.078493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:36.078973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:36.079441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:36.080130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:36.080583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:36.081005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:36.213665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:36.221375 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cd812b5-8c28-4d91-97e9-69086f6e1c90 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.154891 Oct 28 18:34:36.221961 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3454/7120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:36 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:37.245742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:37.246396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:37.252703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.253199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.253644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.254345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:37.254808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:37.255246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:37.393401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:37.401441 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-632a749f-0a76-42f0-a832-a92e5e1ce755 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.160466 Oct 28 18:34:37.402018 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3667/7121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:37 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:38.424716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:38.425357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:38.432118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.432596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.433027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.433704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:38.434149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:38.434567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:38.566744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:38.575852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b86624f7-d189-4d98-a02b-f6171df2a22a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.155207 Oct 28 18:34:38.576434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3455/7122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:38 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:39.600017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:39.600572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:39.607463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.607964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.608412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.609118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:39.609584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:39.610024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:39.738691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:39.746989 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60cfe018-a641-4d11-bf52-ce6988523403 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.150992 Oct 28 18:34:39.747600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3668/7123] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:39 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:40.770693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:40.771305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:40.779046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.779570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.780011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.780699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:40.781152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:40.781573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:40.914523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:40.922189 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bab86682-86d9-4ef1-b98f-f35c0b1f5921 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.155486 Oct 28 18:34:40.922761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3456/7124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:40 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:41.945874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:41.946545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:41.953421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.953899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.954343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:41.955047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:41.955545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:41.955981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:42.087086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:42.095668 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0310760-9110-4c00-8383-263ae2f81d9b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.153849 Oct 28 18:34:42.096246 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3669/7125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:41 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:43.120125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:43.120745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:43.127995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.128432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.128870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.129563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:43.130057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:43.130445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:43.262555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:43.270223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db00bc08-13fb-477a-9eb2-5e2759c6fcd2 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.154661 Oct 28 18:34:43.270785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3457/7126] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:43 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:44.294484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:44.295128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:44.302130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.302623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.303074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.303809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:44.304278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:44.304716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:44.433187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:44.441065 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc4c8f30-c50d-4d6c-bdab-298f3f7d71c8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.151079 Oct 28 18:34:44.441643 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3670/7127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:44 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:45.465611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:45.466257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:45.473121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.473638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.474038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.474733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:45.475185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:45.475637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:45.612718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:45.621912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95c3cb7c-ba8c-4bbb-aa02-e745a0b3de6a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.161052 Oct 28 18:34:45.622484 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3458/7128] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:45 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:46.645915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:46.646532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:46.654251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.654743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.655194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.655920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:46.656389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:46.656826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:46.784988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:46.792963 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83886e3c-c59a-4916-9ac9-63f5a6629257 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.151002 Oct 28 18:34:46.793536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3671/7129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:46 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:47.816145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:47.816751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:47.824258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.824738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.825170 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.825850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:47.826297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:47.826715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:47.829270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:47.958067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:47.966931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1eaf3303-c8aa-4525-b44c-fce3434dce7a tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.154672 Oct 28 18:34:47.967528 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3459/7130] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:47 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:48.990521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:48.991145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:48.998694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:48.999187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:48.999669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.000381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.000842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.001280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.139625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:49.147389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c35f936a-3b6e-4692-b8ac-75bc279b813e tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1520 microversion: 2.1 time: 0.160801 Oct 28 18:34:49.147974 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3672/7131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:48 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:49.768646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:49.781610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:49.782097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:49.782529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:49.795360 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Creating event network-vif-unplugged:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h1-860864-13 Oct 28 18:34:49.801054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:34:49.814024 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-144f4021-fa9e-478f-b3c7-de2f13582dd5 req-12c43a39-5375-4690-8b35-529af52d6b02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049568 Oct 28 18:34:49.814647 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3460/7132] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:50.174011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:50.174641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:50.182188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.182685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.183142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.183883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:50.184368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:50.184794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:50.317128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:50.325328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01a53383-ffba-4bcf-a1f3-8545150f0b6c tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1519 microversion: 2.1 time: 0.155055 Oct 28 18:34:50.325721 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3673/7133] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:50 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:51.349554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:51.350298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:51.357638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:51.358129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:51.358572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.359279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:51.359769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:51.360200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.500921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:51.508864 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2dea1dc6-147c-4453-aa77-b8da95e9886b tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1517 microversion: 2.1 time: 0.163665 Oct 28 18:34:51.509561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3461/7134] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:51 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:51.843774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:51.854486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:51.854967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:51.855431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:51.866647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Creating event network-changed:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h1-860864-13 Oct 28 18:34:51.872770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:34:51.883464 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8105b28e-72dc-4acb-8a62-6d532005a7d9 req-df58821a-97f4-4ba5-b7e3-77c9b3d0afb4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043339 Oct 28 18:34:51.884043 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3674/7135] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:52.532420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:52.533029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:52.539730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.540209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.541598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.542278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:52.542727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:52.543146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:52.674171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:52.682487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5643b035-63bf-45be-a3e3-33cc8a72b048 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1517 microversion: 2.1 time: 0.153979 Oct 28 18:34:52.683066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3462/7136] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:52 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:53.709001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:53.709731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:53.716438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.716932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.717368 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.718069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.718526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.718963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.848442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:53.856824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86f7a4d4-152d-47c9-ba7f-a86c28cb75ed tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1514 microversion: 2.1 time: 0.153091 Oct 28 18:34:53.857405 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3675/7137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:53 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:53.881705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:53.882319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:53.890515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.891010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.891482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.892183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.892633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.893057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.950926 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9ce5ab97-cf36-40ce-90f4-e681a82ffebe tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "POST /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2/action" status: 204 len: 0 microversion: 2.1 time: 0.074196 Oct 28 18:34:53.951605 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3463/7138] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:34:53 2022] POST /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:53.959895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:53.960520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:53.966424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.966917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.967382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:53.968122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:53.968627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:53.969094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:54.412337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:54.420855 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd985a62-4f30-45e6-af5e-efe1eb4ceaf5 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1514 microversion: 2.1 time: 0.464891 Oct 28 18:34:54.421524 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3676/7139] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:53 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1514 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.444883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.445584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:55.453430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.453927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.454417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.455119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.455604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.456027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.597589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:55.606818 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37a7dbfb-e691-4530-9a4a-a6947190a8f8 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1506 microversion: 2.1 time: 0.165996 Oct 28 18:34:55.607650 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3464/7140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:55 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.629514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.630136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:55.637447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.637942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.638505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.639226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.639729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.640168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.774170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:55.782594 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7538023-4fca-4d0f-bbee-a8c575a82213 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1506 microversion: 2.1 time: 0.157254 Oct 28 18:34:55.783176 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3677/7141] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:55 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.804991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.805601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:55.811579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.812060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.812495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.813175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.813635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.814042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.941446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:55.949498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-10788d0a-e08e-4c96-8deb-320d3aba1191 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1506 microversion: 2.1 time: 0.148341 Oct 28 18:34:55.950069 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3465/7142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:55 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:55.972019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:55.972524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:55.979395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.979894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.980340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:55.981042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:55.981499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:55.981933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.006840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:34:56.080793 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a621c6b4-a07e-4126-8a52-26ddafc95460 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 204 len: 0 microversion: 2.1 time: 0.112439 Oct 28 18:34:56.081493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3678/7143] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:55 2022] DELETE /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:34:56.099618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.100104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:56.106489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.106960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.107409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.108115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.108558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.108972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.133903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:34:56.178622 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.compute.api [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Instance is already in deleting state, ignoring this request Oct 28 18:34:56.179459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1563ccba-9b51-4ace-bc00-82b52a5dd6b6 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 204 len: 0 microversion: 2.1 time: 0.083697 Oct 28 18:34:56.180015 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3466/7144] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:34:56 2022] DELETE /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 18:34:56.188984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:56.189698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:56.195629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.196123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.197191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.197896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.198360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.198798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.333779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:56.336182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:34:56.344429 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3c0dcee1-4297-479d-bc60-11ba7a1df671 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1512 microversion: 2.1 time: 0.159821 Oct 28 18:34:56.345104 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3679/7145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:56 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:56.814083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "name": "network-vif-plugged", "status": "completed", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:56.826649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:56.827408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:56.827925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:56.841609 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] Creating event network-vif-plugged:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h1-860864-13 Oct 28 18:34:56.847061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-4a9f93ed-9a53-4270-af88-8ce18bb32296 req-2b199da2-e481-44f1-95cf-f38b15db1bf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036631 Oct 28 18:34:56.847840 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3467/7146] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:57.367775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:57.368944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:57.377134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.377896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.378347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.379051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.379555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.379996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.519241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d2efde111141ccbbed812473cceb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b9266a72594c338ea8786db265169f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:34:57.527426 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-94ea9831-157e-403a-a44c-9f01eac2ee76 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 200 len: 1512 microversion: 2.1 time: 0.163615 Oct 28 18:34:57.528108 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3680/7147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:57 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:34:57.918948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd01e7c-aba3-4c94-bdb4-7f42515636b2", "name": "network-vif-deleted", "tag": "4f0a07d5-35c5-44e1-a4ca-f809ac62b318"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:34:57.935866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:57.936361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:57.936795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:57.952981 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] Creating event network-vif-deleted:4f0a07d5-35c5-44e1-a4ca-f809ac62b318 for instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 on n-h1-860864-13 Oct 28 18:34:57.961168 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e222eb47-273f-4809-b5a0-766ba7eb98c7 req-fd0cb7a6-9f6f-4a70-becf-f44e7f9207fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046549 Oct 28 18:34:57.962412 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3468/7148] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:34:58.550551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.551199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: 7fd01e7c-aba3-4c94-bdb4-7f42515636b2] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:34:58.558479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.558960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.559433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.560157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:34:58.560609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:34:58.561049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:34:58.574827 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] HTTP exception thrown: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Request method failure captured: Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 HTTP/1.1 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCBvr2nc41u3BXwQbAJ94A72L_ro43XySp1TJP2Jw64UxbMhccMJghmBlva4U6IqvAvmIOCl5HvUex4SVDqLnGwd8LvSP19kMVW0-tPCK3gdca174Dr0Rk0yC6yGfF_Nm4V-7vv6ClRvQj41747bZeeXGXO2pys_IVdkKYkkhwCCaag Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87b9266a72594c338ea8786db265169f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87b9266a72594c338ea8786db265169f"}]}] Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b2d2efde111141ccbbed812473cceb78 Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7fd01e7c-aba3-4c94-bdb4-7f42515636b2'} Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:34:58.576501 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Returning 404 to user: Instance 7fd01e7c-aba3-4c94-bdb4-7f42515636b2 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d1c2d0d-d385-4ce8-84be-6beda38f97c9 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2" status: 404 len: 111 microversion: 2.1 time: 0.031376 Oct 28 18:34:58.580756 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3681/7149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:34:58 2022] GET /compute/v2.1/servers/7fd01e7c-aba3-4c94-bdb4-7f42515636b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:34:58.587919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e261986-050d-4774-973c-edde9d10f5aa tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '.version_select at 0x7f7524b92dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:34:58.592363 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e261986-050d-4774-973c-edde9d10f5aa tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [3570a816-847d-4252-a441-9b50868e4528] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:34:59.600052 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e261986-050d-4774-973c-edde9d10f5aa tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [3570a816-847d-4252-a441-9b50868e4528] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 40406. Oct 28 18:34:59.623314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e261986-050d-4774-973c-edde9d10f5aa tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843440608" status: 202 len: 0 microversion: 2.1 time: 1.040230 Oct 28 18:34:59.623973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3469/7150] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 18:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843440608 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:35:00.232581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:00.233206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:00.241419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.241922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.242378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.243085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.243606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.244040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.257604 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] HTTP exception thrown: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Request method failure captured: Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c HTTP/1.1 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCBvr2nc41u3BXwQbAJ94A72L_ro43XySp1TJP2Jw64UxbMhccMJghmBlva4U6IqvAvmIOCl5HvUex4SVDqLnGwd8LvSP19kMVW0-tPCK3gdca174Dr0Rk0yC6yGfF_Nm4V-7vv6ClRvQj41747bZeeXGXO2pys_IVdkKYkkhwCCaag Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87b9266a72594c338ea8786db265169f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87b9266a72594c338ea8786db265169f"}]}] Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: b2d2efde111141ccbbed812473cceb78 Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'a26c2ebe-aa3c-473b-8d47-617e9c65480c'} Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:00.259230 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Returning 404 to user: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ef74b7a2-bda9-4c46-a936-1b65c41e9392 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 404 len: 111 microversion: 2.1 time: 0.032778 Oct 28 18:35:00.264084 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3682/7151] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:35:00 2022] DELETE /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:00.270176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:00.270932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] [instance: a26c2ebe-aa3c-473b-8d47-617e9c65480c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:00.277658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.278136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.278566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.279276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:00.279771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:00.280189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:00.293933 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] HTTP exception thrown: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Request method failure captured: Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c HTTP/1.1 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCBvr2nc41u3BXwQbAJ94A72L_ro43XySp1TJP2Jw64UxbMhccMJghmBlva4U6IqvAvmIOCl5HvUex4SVDqLnGwd8LvSP19kMVW0-tPCK3gdca174Dr0Rk0yC6yGfF_Nm4V-7vv6ClRvQj41747bZeeXGXO2pys_IVdkKYkkhwCCaag Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/87b9266a72594c338ea8786db265169f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_87b9266a72594c338ea8786db265169f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/87b9266a72594c338ea8786db265169f"}]}] Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 87b9266a72594c338ea8786db265169f Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-553077281 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: b2d2efde111141ccbbed812473cceb78 Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerDiskConfigTestJSON-553077281-project Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a26c2ebe-aa3c-473b-8d47-617e9c65480c'} Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:35:00.295551 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] Returning 404 to user: Instance a26c2ebe-aa3c-473b-8d47-617e9c65480c could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93363705-6112-4061-be72-4c7a34bf3f68 tempest-ServerDiskConfigTestJSON-553077281 tempest-ServerDiskConfigTestJSON-553077281-project] 10.222.0.48 "GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c" status: 404 len: 111 microversion: 2.1 time: 0.031619 Oct 28 18:35:00.300078 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3470/7152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:00 2022] GET /compute/v2.1/servers/a26c2ebe-aa3c-473b-8d47-617e9c65480c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:35:08.586491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-347e7835-1723-40d3-9afd-42e4bf1af65d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: .version_select at 0x7f7524286040>, body: {"keypair": {"name": "tempest-keypair-1549449167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfxj6sx490CCsU8LRwMV3hoKYEGlnH3088pwg1Tq6IgEEEHLzKU/R7bgSbEpKbK2woGe39Vj3vG9ue02futOK91nlq+A1ScNywP+kuAfQE4UYKI9Hwn36SjYoe1bUOMAQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:08.592544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:08.605471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-347e7835-1723-40d3-9afd-42e4bf1af65d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:35:08.610602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-347e7835-1723-40d3-9afd-42e4bf1af65d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:35:08.642703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-347e7835-1723-40d3-9afd-42e4bf1af65d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174556 Oct 28 18:35:08.643496 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3683/7153] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:35:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:10.035848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1200668576", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05b323d7-ea32-4e38-9e71-a76a9f8bf385"}], "security_groups": [{"name": "tempest-securitygroup--429948890"}], "key_name": "tempest-keypair-1549449167", "user_data": "}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:10.045265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:10.145659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] validate_networks() for [('05b323d7-ea32-4e38-9e71-a76a9f8bf385', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:35:10.284463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:10.526385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:35:10.526815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:35:10.527335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:35:10.527768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:35:10.528186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:35:10.536981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:10.537463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:10.537904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:10.538638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:10.539094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:10.539555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:10.557377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:35:10.562885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:35:10.576585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:35:10.578955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:35:10.625452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18032f76-21db-48c8-9fca-679b091ccb70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.594009 Oct 28 18:35:10.626414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3471/7154] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:35:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:35:10.636075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=11 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:10.641543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fcd470dc-cdf0-40e1-b443-03d42204dd99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:10.642182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fcd470dc-cdf0-40e1-b443-03d42204dd99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:10.703166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fcd470dc-cdf0-40e1-b443-03d42204dd99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:10.709600 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fcd470dc-cdf0-40e1-b443-03d42204dd99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1239 microversion: 2.1 time: 0.075701 Oct 28 18:35:10.710631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3684/7155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:10 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:11.735995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:11.737136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:11.748308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.749456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.750176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.751344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:11.752021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:11.752954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:11.826338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:11.835077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa96d025-c430-4a8c-a0aa-fa629476ac4c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1309 microversion: 2.1 time: 0.105153 Oct 28 18:35:11.838417 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3472/7156] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:11 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:12.878026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:12.879265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:12.886613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.887117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.887600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:12.888326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:12.888798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:12.889240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:13.025975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:13.034021 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-813c0258-0555-4428-8ab3-efec35313b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.160198 Oct 28 18:35:13.034700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3685/7157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:12 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:13.426162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:13.437342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:13.438116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:13.438548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:13.450100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] Creating event network-changed:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h1-860864-13 Oct 28 18:35:13.454894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-afbb7b28-ee1b-460c-864e-6d636dd73ad3 req-ffd67a7a-2e9e-4c1d-a3f7-41797bbabf9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033830 Oct 28 18:35:13.455719 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3473/7158] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:14.058111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:14.058730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:14.065683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:14.066170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:14.066618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:14.067315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:14.067882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:14.068313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:14.199560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:14.207427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b11b1943-131b-47dd-8287-6a808ddcb2f2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.153772 Oct 28 18:35:14.208007 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3686/7159] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:14 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:15.232748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:15.233435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:15.239644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:15.240124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:15.240559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:15.241256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:15.241692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:15.242113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:15.370207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:15.378272 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-39920848-5f4d-4800-865d-b36eb27efb1f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.151894 Oct 28 18:35:15.378838 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3474/7160] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:15 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:16.401627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:16.402253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:16.409231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.409724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.410170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.410875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:16.411341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:16.411802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:16.546313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:16.553995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ea311dea-f507-49c1-a27e-73752506bb5d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.157114 Oct 28 18:35:16.554595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3687/7161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:16 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:17.577776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:17.578414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:17.585346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:17.585832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:17.586273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:17.587189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:17.587674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:17.588104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:17.725749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:17.734070 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-73d48ecf-c9f9-4a4a-a40a-89975c04a3b9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.160184 Oct 28 18:35:17.734645 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3475/7162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:17 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:18.757522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:18.758268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:18.766280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.766879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.767339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.768079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.768548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.768994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.907013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "name": "network-vif-plugged", "status": "completed", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:18.920583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:18.925808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:18.926236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:18.926678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:18.937351 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-42b0870a-9d7e-4e95-927a-f83ed97ab704 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.183686 Oct 28 18:35:18.937901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3688/7163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:18 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:18.939114 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] Creating event network-vif-plugged:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h1-860864-13 Oct 28 18:35:18.944480 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3203bcd7-b6a6-4628-a953-22350f3bd8fe req-413c61d7-ee5a-42f9-94b9-b28772a69cbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043311 Oct 28 18:35:18.945065 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3476/7164] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:19.961146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:19.962289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:19.969178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:19.969680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:19.970133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:19.970841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:19.971313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:19.971830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:20.103388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:20.111123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ff40d1e2-825e-4916-b7d9-866fa7c208db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1364 microversion: 2.1 time: 0.153936 Oct 28 18:35:20.111733 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3689/7165] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:19 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:21.133366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:21.134381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:21.138789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:21.139691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:21.146682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.147164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.147622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.148311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.148763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.150014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.285695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:35:21.294142 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1b9a175-1dd4-4a34-a80e-dbc4f4681744 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1551 microversion: 2.1 time: 0.162633 Oct 28 18:35:21.294661 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3477/7166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:35:21 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:35:21.316588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:35:21.317082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:35:21.318969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:35:21.325678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.326546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.327068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.327916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:21.328571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:21.329016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:21.408899 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72d2b724-6abc-4a10-90b9-2c98ef4e6d1d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096217 Oct 28 18:35:21.409507 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3690/7167] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:35:21 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:35:22.442478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:35:22.451948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:35:22.452427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:35:22.452853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:35:22.464020 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] Creating event network-changed:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h1-860864-13 Oct 28 18:35:22.468973 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7a70271f-eeb1-4368-9240-8142b1bb1db7 req-93655691-9970-4756-b620-c30308f89293 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084715 Oct 28 18:35:22.469635 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3478/7168] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:26.747800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:26.748622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=34 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:26.753367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:26.754100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:26.762710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:26.763233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:26.763702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:26.764408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:26.764869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:26.765304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:26.899314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:26.907060 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf87a50b-34ff-4808-8619-5269a0e833c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.162148 Oct 28 18:36:26.907671 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3691/7169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:26 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:26.928365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:26.929117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=32 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:26.933784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:26.934482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:26.942039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:26.942522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:26.942956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:26.943667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:26.944123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:26.944548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.076834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:27.084483 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b738167f-4742-43a0-9c4b-3102e641686c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.158811 Oct 28 18:36:27.085050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3479/7170] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:26 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:27.107103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:27.107751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:27.113655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.114143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.114584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.115276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.115766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.116197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.245324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:27.253328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1fb11e8a-02c7-43a2-9bb7-08f4eda4f39b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.150078 Oct 28 18:36:27.253899 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3692/7171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:27 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:27.276879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:27.279119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:27.285044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.285520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.285953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.286642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.287092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.287555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.316359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:27.322383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:36:27.329049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:36:27.329463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:36:27.329926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:36:27.330328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:36:27.330733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:36:27.394699 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b0aa8f99-6e04-4027-a2ff-60726c83bf25 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/action" status: 202 len: 0 microversion: 2.1 time: 0.122793 Oct 28 18:36:27.395358 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3480/7172] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:36:27 2022] POST /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:36:27.404007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:27.404738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:27.410682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.411181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.411669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.412376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:27.412842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:27.413280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:27.548681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:27.557782 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-267fd5ea-ddd4-477e-b6e7-fa7fcdaf5c44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1678 microversion: 2.1 time: 0.157687 Oct 28 18:36:27.558365 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3693/7173] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:27 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:28.585291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:28.587095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:28.597666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:28.598407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:28.598848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:28.599577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:28.600036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:28.600734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:28.733686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:28.741772 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae2cdf24-2c80-4bf8-a928-1a224a5355b3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1678 microversion: 2.1 time: 0.164013 Oct 28 18:36:28.742850 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3481/7174] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:28 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:29.766776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:29.767421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:29.774344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:29.774847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:29.775304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:29.776073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:29.776543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:29.776985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:29.913547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:29.921869 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5e9b05b-0d90-47fe-b1b2-8e6160a4d2c6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.159105 Oct 28 18:36:29.922453 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3694/7175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:29 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:30.946634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:30.947240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:30.954049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:30.954527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:30.954959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:30.955664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:30.956111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:30.956528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:31.085651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:31.093359 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-03c20300-0c36-489d-9694-57314d747960 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.151209 Oct 28 18:36:31.093932 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3482/7176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:30 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:32.118550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:32.119153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:32.126133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:32.126623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:32.127103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:32.128089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:32.128561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:32.128987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:32.269326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:32.277252 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f70ec919-e369-4b13-a5c3-e6dfaf9866d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.163843 Oct 28 18:36:32.277845 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3695/7177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:32 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:33.300179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:33.300776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:33.308150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:33.308628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:33.309059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:33.309738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:33.310184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:33.310631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:33.446120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:33.453748 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f34618a6-e8a0-4b48-ad19-53f1b4be92c8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.157602 Oct 28 18:36:33.454315 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3483/7178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:33 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:34.477739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:34.478354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:34.485629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:34.486124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:34.486570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:34.487275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:34.487759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:34.488197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:34.617943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:34.625717 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ffc0ba91-2ab1-45e5-9ba1-ecbb73795153 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.152521 Oct 28 18:36:34.626281 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3696/7179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:34 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:35.650238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:35.650766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:35.657479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:35.657954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:35.658380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:35.659057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:35.659533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:35.659952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:35.794750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:35.802569 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a4e78e18-f9b8-47be-b708-15b1912bc473 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.156891 Oct 28 18:36:35.803143 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3484/7180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:35 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:36.826547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:36.827166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:36.834116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:36.834615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:36.835068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:36.836609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:36.836994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:36.837437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:37.090526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:37.098333 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a8ea84de-c214-40cf-8f41-a2806722d32f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.275802 Oct 28 18:36:37.098911 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3697/7181] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:36 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:38.122541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:38.123108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:38.129887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:38.130374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:38.130818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:38.131558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:38.132021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:38.132456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:38.263707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:38.271456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72dfa194-87c3-4abf-b44a-2fccf1d8c399 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.152836 Oct 28 18:36:38.272017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3485/7182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:38 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:39.295461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:39.296082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:39.302614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:39.303053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:39.303535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:39.304905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:39.305351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:39.305760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:39.438519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:39.447059 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d2f39cf-e10b-415c-9d5a-408e5c9e67bf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.155556 Oct 28 18:36:39.447670 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3698/7183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:39 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:40.470450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:40.471059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:40.478362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:40.478847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:40.479278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:40.479985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:40.480433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:40.480849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:40.610599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:40.618837 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-063ea124-df10-42dc-86b9-bd5fd4931cfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1683 microversion: 2.1 time: 0.152258 Oct 28 18:36:40.619354 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3486/7184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:40 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:36:41.530539 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:36:41.531050 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:36:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 28 18:36:41.632642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "name": "network-vif-unplugged", "status": "completed", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:41.645537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:41.646804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:41.655535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:41.656108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:41.656610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:41.657400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:41.657921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:41.658403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:41.667730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:41.668235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:41.668688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:41.680953 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Creating event network-vif-unplugged:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h2-860864-13 Oct 28 18:36:41.689608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:36:41.702931 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b97fa5a1-30aa-41c1-ac49-336bc15a325f req-d905d52d-617b-4554-9e72-22c9b1854018 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177470 Oct 28 18:36:41.704238 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3699/7185] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:41.813022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:41.821763 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cfd98f5a-70ef-4fa4-97e8-5c0de16bddd7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1682 microversion: 2.1 time: 0.181004 Oct 28 18:36:41.822563 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3487/7186] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:41 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:42.846500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:42.847251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:42.855533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:42.856045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:42.856503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:42.857229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:42.857701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:42.858149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:42.992983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:43.000847 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9200a9eb-16db-4e43-ad93-a9e9a1a51085 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1680 microversion: 2.1 time: 0.158791 Oct 28 18:36:43.001423 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3700/7187] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:42 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:43.734717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:43.744812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:43.745291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:43.745715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:43.757335 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Creating event network-changed:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h2-860864-13 Oct 28 18:36:43.762668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:36:43.774742 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ae10cac3-76fc-4f01-8de9-05601654ef40 req-dd2205e2-cc94-4017-b7ed-6ee86026412e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043194 Oct 28 18:36:43.775677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3488/7188] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:44.025318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:44.025937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:44.032685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:44.033174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:44.033624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:44.034336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:44.034797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:44.035229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:44.189572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:44.198219 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a132496-d5e2-439e-9203-99d04e0fb0a7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1680 microversion: 2.1 time: 0.177442 Oct 28 18:36:44.198816 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3701/7189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:44 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:45.223706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:45.224340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:45.231392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:45.232005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:45.232519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:45.233304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:45.233832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:45.234335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:45.390984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:45.399836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0aa818e3-7997-4804-a702-e2a062e4d0cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1680 microversion: 2.1 time: 0.181360 Oct 28 18:36:45.415552 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3489/7190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:45 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:36:46.424642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:46.425263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:46.432858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.433350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.433793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.434499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.435120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.435596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.568984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:46.576994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c867b77d-2e29-4aa1-9781-582425487db0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1677 microversion: 2.1 time: 0.156277 Oct 28 18:36:46.577586 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3702/7191] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:46 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:46.600081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:46.600633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:46.608355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.608838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.609277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.609971 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.610424 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.610852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.672691 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7f87853-6298-4cab-816e-8aa588c1d944 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/action" status: 204 len: 0 microversion: 2.1 time: 0.076494 Oct 28 18:36:46.673349 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3490/7192] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:36:46 2022] POST /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:36:46.681632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:46.682344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:46.688402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.688924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.689308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.690021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.690483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.690920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.842831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:46.863029 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad14bca2-75a2-4b7e-b75e-fd70a03ef79d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1677 microversion: 2.1 time: 0.185345 Oct 28 18:36:46.864701 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3703/7193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:46 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:46.890909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "name": "network-vif-plugged", "status": "completed", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:46.901817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:46.902373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:46.903158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:46.916131 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Creating event network-vif-plugged:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h2-860864-13 Oct 28 18:36:46.921731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:36:46.934035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-00d54767-3bb0-4bf3-b081-4eaa30ca2cc8 req-b2f95ad7-8c83-41e5-83fe-be1e67b19bcc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046879 Oct 28 18:36:46.934916 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3491/7194] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:47.889437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:47.890005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:47.898358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:47.898881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:47.899343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:47.900087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:47.900561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:47.901004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:48.044613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:48.053698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4840397e-419e-4ce6-b1a1-331a7ac1b139 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1677 microversion: 2.1 time: 0.168838 Oct 28 18:36:48.054493 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3704/7195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:47 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:36:49.079238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:49.079970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:49.086305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.086794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.087237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.087976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.088437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.088869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.221311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:49.229665 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3f792864-bac0-462c-93d4-c55ccbac0963 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.155719 Oct 28 18:36:49.230243 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3492/7196] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:49 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:49.253210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:49.253832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:49.260774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.261275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.261729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.262441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.262913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.263357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.389985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:49.397704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4624199-6a5f-45b3-b1b8-dde876d813ed tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.148703 Oct 28 18:36:49.398473 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3705/7197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:49 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:49.420691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:49.421293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:49.427166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.427677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.428107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.428787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.429251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.430782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.558220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:49.560560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:49.567850 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f23613f-7d26-429f-8168-dceae9a5f16b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1669 microversion: 2.1 time: 0.150961 Oct 28 18:36:49.568501 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3493/7198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:49 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:49.590702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:49.591148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:49.597187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.597687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.598139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.598847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.599316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.599784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.624802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:36:49.658384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:49.702116 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9afd450f-0626-4c6b-93a1-ffad66078167 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 204 len: 0 microversion: 2.1 time: 0.115079 Oct 28 18:36:49.702746 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3706/7199] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:36:49 2022] DELETE /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:36:49.712234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:49.712879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:49.720020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.720504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.720938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.721628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:49.722081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:49.722505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:49.854285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:49.861972 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7e09233-9be6-4ae4-86a5-4db78b612ba3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1675 microversion: 2.1 time: 0.154490 Oct 28 18:36:49.862539 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3494/7200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:49 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:50.888028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:50.888848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:50.895534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:50.896030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:50.896476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:50.897180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:50.897637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:50.898094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:51.030054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:51.038232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8c3d2f60-ae66-41d9-9079-23f48e13e460 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1675 microversion: 2.1 time: 0.154529 Oct 28 18:36:51.039451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3707/7201] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:50 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:51.654243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8f11d-98a9-44b5-bf58-c7537a54634d", "name": "network-vif-deleted", "tag": "0795927c-27ed-46cc-bcc4-03576acf4755"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:51.669318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:51.669930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:51.670772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:51.688526 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] Creating event network-vif-deleted:0795927c-27ed-46cc-bcc4-03576acf4755 for instance 15b8f11d-98a9-44b5-bf58-c7537a54634d on n-h2-860864-13 Oct 28 18:36:51.694282 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3837157a-2051-4e20-a53b-a03fb64f703c req-073d0664-471f-4d94-86e2-d462e5ab7b1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046856 Oct 28 18:36:51.695273 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3495/7202] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:52.064348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:52.067071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:52.077690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:52.078303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:52.078831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:52.079658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:52.080200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:52.080715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:52.118856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:52.119747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:52.120638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:52.121753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lazy-loading 'fault' on Instance uuid 15b8f11d-98a9-44b5-bf58-c7537a54634d {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:36:52.173465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:52.181578 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-eded2a12-4908-4a22-b146-7f546f98c852 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 200 len: 1329 microversion: 2.1 time: 0.121163 Oct 28 18:36:52.182165 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3708/7203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:52 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:53.206006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:53.206706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:53.214644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.215125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.215609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.216325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.216773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.217194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.230394 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d HTTP/1.1 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '15b8f11d-98a9-44b5-bf58-c7537a54634d'} Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:53.232054 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb004af4-0c9b-4f79-865f-ad0a8677689a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 404 len: 111 microversion: 2.1 time: 0.031802 Oct 28 18:36:53.236471 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3496/7204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:53 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:36:53.246602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:53.247280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:53.254356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.254852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.255306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.256049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.256515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.256949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.274332 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d HTTP/1.1 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '15b8f11d-98a9-44b5-bf58-c7537a54634d'} Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:36:53.276005 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ceaf56f8-527a-45b7-97e5-51881036e302 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 404 len: 111 microversion: 2.1 time: 0.034866 Oct 28 18:36:53.280772 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3709/7205] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:53 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:36:53.325138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-446234335", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "05b323d7-ea32-4e38-9e71-a76a9f8bf385"}], "security_groups": [{"name": "tempest-securitygroup--429948890"}], "key_name": "tempest-keypair-1549449167", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:53.427330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] validate_networks() for [('05b323d7-ea32-4e38-9e71-a76a9f8bf385', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:36:53.793831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:36:53.794247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:36:53.794713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:36:53.795113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:36:53.795547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:36:53.804459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.804943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.805369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.806094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:53.806546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:53.806966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:53.823760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:36:53.828900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:36:53.841616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:36:53.843897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:36:53.893264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f0d4a18-0bc2-45df-bb88-812136b778b2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.571886 Oct 28 18:36:53.893920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3497/7206] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:36:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:36:53.906017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c52f8c66-2b95-4c44-95b0-03b5ada4f211 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:53.906732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c52f8c66-2b95-4c44-95b0-03b5ada4f211 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:53.961349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c52f8c66-2b95-4c44-95b0-03b5ada4f211 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:53.968745 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c52f8c66-2b95-4c44-95b0-03b5ada4f211 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1238 microversion: 2.1 time: 0.066780 Oct 28 18:36:53.969334 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3710/7207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:53 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:54.992527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:54.993135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:55.000238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:55.000774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:55.001263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:55.002026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:55.002731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:55.003310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:55.064936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:55.073492 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ef7dac2-8231-4034-8720-f5627af8eebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1296 microversion: 2.1 time: 0.086043 Oct 28 18:36:55.074060 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3498/7208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:54 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:56.097525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:56.098170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:56.106585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.107081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.107577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.108287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.108750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.109189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.251379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:56.260129 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e0aabde7-c104-4b58-8e24-cb64d500387a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.166464 Oct 28 18:36:56.260680 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3711/7209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:56 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:56.286770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:36:56.299329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:56.299889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:56.300315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:56.312844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] Creating event network-changed:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h2-860864-13 Oct 28 18:36:56.317511 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-7de40b16-c8d3-4ad8-9dd1-76883d5394d9 req-9fa65b7d-5afa-48b7-9fca-b26ff1935305 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Oct 28 18:36:56.318444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3499/7210] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:36:57.283595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:57.284221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:57.287103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:57.292794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:57.293301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:57.293754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:57.294465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:57.294935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:57.295397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:57.711578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:57.719407 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0155f028-93d7-4eb7-aabf-dead62a318f6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.439780 Oct 28 18:36:57.720049 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3712/7211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:57 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:58.745553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:58.746244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:58.748203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:36:58.753678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:58.754159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:58.754588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:58.755277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:58.755755 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:58.756175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:58.902899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:36:58.911061 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1acc2f71-d3e5-499c-87de-5d6f767ece4b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.171692 Oct 28 18:36:58.912007 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3500/7212] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:58 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:36:59.935750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:36:59.936316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:36:59.943181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.943702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.944157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:36:59.945068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:36:59.945561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:36:59.945996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:00.078570 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:00.086756 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8409b699-086c-4f64-a354-e0ff3e2271d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.155052 Oct 28 18:37:00.087332 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3713/7213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:36:59 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:00.950100 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "name": "network-vif-plugged", "status": "completed", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:00.962004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:00.962484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:00.962913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:00.973963 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] Creating event network-vif-plugged:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h2-860864-13 Oct 28 18:37:00.978920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b49cae04-8f65-40eb-900e-9b9d1ed8a5ce req-2efbf43f-bd4d-4d5d-afee-ee2906216bd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 Oct 28 18:37:00.979530 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3501/7214] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:01.110126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:01.110779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:37:01.118915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.119880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.120084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.120661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:01.121149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:01.121593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:01.254120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:01.262004 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b7a7bba-e990-4a7e-8dc4-12fae9c1002d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.155807 Oct 28 18:37:01.262580 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3714/7215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:01 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:02.287282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:02.288007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:37:02.294359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:02.294842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:02.295282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:02.296000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:02.296453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:02.296878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:02.433412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:02.441066 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2bdb28d3-612c-434c-9d54-e4d0467b6e02 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1363 microversion: 2.1 time: 0.158928 Oct 28 18:37:02.441736 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3502/7216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:02 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:37:03.466861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:03.467535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:37:03.474381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:03.474878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:03.475340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:03.476708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:03.477262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:03.477703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:03.605081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:37:03.613038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4e2177a-4603-4910-90ba-11b3810ddd9b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1550 microversion: 2.1 time: 0.150145 Oct 28 18:37:03.613928 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3715/7217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:37:03 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:37:03.637076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:37:03.637601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:37:03.644275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:03.644754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:03.645185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:03.645868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:03.646316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:03.646733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:03.724144 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a1df96cf-d299-4285-b94c-4cd6f8bf081c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091042 Oct 28 18:37:03.724749 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3503/7218] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:37:03 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:37:04.653048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:37:04.657886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:37:04.665252 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:37:04.665745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:37:04.666192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:37:04.677267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] Creating event network-changed:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h2-860864-13 Oct 28 18:37:04.682993 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-40b6d013-b879-4b5a-aae9-5597ba7cbb00 req-137c92af-9515-48f0-a91b-56645ab1ab3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033482 Oct 28 18:37:04.683699 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3716/7219] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:08.163984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.164776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.166835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=7 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.167578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=39 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.172990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:08.180668 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:08.181180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:08.181604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:08.203549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Going to try to stop instance {{(pid=120567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 18:38:08.249244 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-32463b1c-a9c0-40a0-b9d9-b8f16ef1e08d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action" status: 202 len: 0 microversion: 2.1 time: 0.086653 Oct 28 18:38:08.249872 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3504/7220] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:08 2022] POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:38:08.258132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.259045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:08.264154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:08.264996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:08.272671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:08.273322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:08.273850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:08.274660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:08.275206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:08.275815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:08.421899 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:08.429856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c984540-c020-4c7e-90c1-654672b172e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.174798 Oct 28 18:38:08.430446 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3717/7221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:08 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:09.453048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:09.453740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:09.461271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:09.461760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:09.462197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:09.462887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:09.463336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:09.463777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:09.645632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:09.653324 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f7232bd2-e24f-4468-9ede-448fe84eb85d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.204536 Oct 28 18:38:09.653895 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3505/7222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:09 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:10.676951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:10.677523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:10.685000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:10.685498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:10.685950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:10.686662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:10.687130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:10.687597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:10.815472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:10.823774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ff072d59-1283-422f-9209-a506c24b85cf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.150855 Oct 28 18:38:10.824378 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3718/7223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:10 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:11.848947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:11.849588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:11.856901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:11.857379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:11.857806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:11.858491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:11.858937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:11.859357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:11.991335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:11.999073 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2642e2b0-11e3-4058-a602-db1b883c1e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.154037 Oct 28 18:38:11.999674 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3506/7224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:11 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:13.022991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:13.023680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:13.030561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:13.031070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:13.031556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:13.032269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:13.032741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:13.033187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:13.162888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:13.170860 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5eaea89d-3646-4cae-ad49-24e4925f42a2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.151895 Oct 28 18:38:13.171477 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3719/7225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:13 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:14.195111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:14.195818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:14.202659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:14.203144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:14.203607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:14.204299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:14.204752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:14.205186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:14.341728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:14.349579 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-28c3c2f5-b056-4c47-ae1e-87c7eb3b6b87 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.159200 Oct 28 18:38:14.350192 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3507/7226] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:14 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:15.372840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:15.373467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:15.380678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:15.381371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:15.381805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:15.382516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:15.382986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:15.383462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:15.514739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:15.523336 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-958f1f14-d21b-4ef1-af1b-51a1cf9a5781 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.154383 Oct 28 18:38:15.523945 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3720/7227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:15 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:16.546903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:16.547444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:16.555650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:16.556173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:16.556695 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:16.557491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:16.557996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:16.558521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:16.693225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:16.701145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-895a6e8f-0da2-4cba-9dc3-d5bc163087e8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.158173 Oct 28 18:38:16.701715 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3508/7228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:16 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:17.725673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:17.726298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:17.733343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:17.733844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:17.734300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:17.735012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:17.735517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:17.735967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:17.864312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:17.872670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1da2499-7697-4213-b825-f0b032640366 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.151576 Oct 28 18:38:17.873248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3721/7229] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:17 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:18.896335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:18.896947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:18.904243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:18.904758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:18.905194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:18.905886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:18.906340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:18.906762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.035236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:19.043478 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cc1a357f-b2e1-4082-8562-779c434ce624 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1655 microversion: 2.1 time: 0.151038 Oct 28 18:38:19.044058 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3509/7230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:18 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:19.066841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:19.069875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:19.076838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.077329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.077780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.078483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.078943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.079395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.106858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:19.112338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Old instance type m1.heat2, new instance type m1.heat {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:38:19.119267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:19.119721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:19.120199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:19.120617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:19.121032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:19.184481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15077333-beb0-4e47-a141-ba52e693bf0d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action" status: 202 len: 0 microversion: 2.1 time: 0.121535 Oct 28 18:38:19.185094 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3722/7231] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:19 2022] POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:38:19.194194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:19.194945 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:19.200877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.201362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.201805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.202491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:19.202946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:19.203394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:19.341655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:19.350269 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cafab411-04b5-4c94-a804-853332cc3c74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.160169 Oct 28 18:38:19.352645 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3510/7232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:19 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:20.378109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:20.378724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:20.389627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:20.390114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:20.390557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:20.391250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:20.391743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:20.392177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:20.525829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:20.534054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b9cf86a-e0f9-4b36-be4b-8069ce41ea38 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1678 microversion: 2.1 time: 0.160947 Oct 28 18:38:20.534639 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3723/7233] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:20 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:21.557507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:21.558120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:21.565077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:21.565553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:21.565997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:21.566693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:21.567154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:21.567611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:21.704085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:21.712328 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b3248b8-f3c9-473d-bbaa-2d1158f3335f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1683 microversion: 2.1 time: 0.158722 Oct 28 18:38:21.713162 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3511/7234] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:21 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:22.735874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:22.736523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:22.739565 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:38:22.739715 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:38:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 (ip 10.222.0.48) !!! Oct 28 18:38:22.746235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.746729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.747176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.747907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:22.748374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:22.748829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:22.880400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:22.888207 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23e99261-6bf3-4e92-83ee-27c32e78cfdd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1683 microversion: 2.1 time: 0.156282 Oct 28 18:38:22.888785 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3724/7235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:22 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:23.875829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "name": "network-vif-unplugged", "status": "completed", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:23.888921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.889670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.890108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.904520 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Creating event network-vif-unplugged:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h1-860864-13 Oct 28 18:38:23.910231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] Instance e447f906-08f0-4c95-98e3-6e5c796d0842 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:38:23.913281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:23.914006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:23.922078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-311351f6-ce3f-43c4-abfb-ceac1b664e56 req-adcb2ab7-d9b9-4d26-86f6-03a7ae4bfaa6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050498 Oct 28 18:38:23.922933 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3512/7236] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:23.924081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.924774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.925473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:23.926297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:23.927000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:23.927557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:24.065952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:24.074136 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c47de8fd-bcc9-49c3-a342-600ce2682aa3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1682 microversion: 2.1 time: 0.165792 Oct 28 18:38:24.074753 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3725/7237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:23 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:25.098734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:25.100065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:25.106999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.107511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.107946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.108630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.109082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.109503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.238838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:25.247339 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-888d65dd-999f-4739-a986-e267e22e17d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1680 microversion: 2.1 time: 0.152909 Oct 28 18:38:25.247926 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3513/7238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:25 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:25.962653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:25.972857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:25.973356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:25.973806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:25.985519 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Creating event network-changed:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h1-860864-13 Oct 28 18:38:25.990981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] Instance e447f906-08f0-4c95-98e3-6e5c796d0842 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:38:26.001557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b7d9c292-db61-4f85-aba2-43cbcf9118b1 req-867ebf3c-2da6-46d2-80b5-554f1b2f4d8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043269 Oct 28 18:38:26.002145 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3726/7239] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:26.272590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:26.273829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:26.280846 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:26.281323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:26.281749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:26.282447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:26.282886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:26.283302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:26.423895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:26.432426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-304607c0-f50f-4cbd-9ed2-b2248e9dd511 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1680 microversion: 2.1 time: 0.164482 Oct 28 18:38:26.433018 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3514/7240] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:26 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:27.458436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:27.459927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:27.466209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.466713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.467157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.467922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.468382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.468823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.624095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:27.632945 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-79f7114c-10f4-40f9-85c1-93ea8b3e6bf2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1676 microversion: 2.1 time: 0.179626 Oct 28 18:38:27.633549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3727/7241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:27 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:27.655633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:27.656195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:27.663660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.664158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.664905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.665383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.665760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.666193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.731731 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af047ece-7482-4ae9-92f1-ebdee0f9d56a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action" status: 204 len: 0 microversion: 2.1 time: 0.079760 Oct 28 18:38:27.732396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3515/7242] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:27 2022] POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:38:27.741149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:27.741869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:27.748345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.748892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.749371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.750106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:27.750794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:27.751264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:27.902361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:27.914080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d9801ad-c6b7-4a79-8247-9266a958967f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1676 microversion: 2.1 time: 0.176619 Oct 28 18:38:27.915913 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3728/7243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:27 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:28.939823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:28.940427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:28.948271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:28.948767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:28.949208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:28.949908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:28.950380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:28.950790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.093980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:29.102890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-748b0195-ba93-4b76-9671-dbb45fe417d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1676 microversion: 2.1 time: 0.168408 Oct 28 18:38:29.103594 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3516/7244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:28 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:29.872700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "name": "network-vif-plugged", "status": "completed", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:29.883394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:29.883885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:29.884367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:29.896041 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] Creating event network-vif-plugged:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h1-860864-13 Oct 28 18:38:29.901055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-26096405-74aa-47ce-b2ac-397cf6ce9001 req-92af9e7c-a583-4bc7-b3b2-31c082b103cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088671 Oct 28 18:38:29.901644 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3729/7245] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:30.129941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.130652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:30.137588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.138070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.138503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.139190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.139678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.140105 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.267938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:30.276452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6dc668fa-9b9b-4d0f-9932-40fe38ccc741 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1655 microversion: 2.1 time: 0.150695 Oct 28 18:38:30.277024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3517/7246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:30.300162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.300867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:30.307040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.307581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.308033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.308738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.309201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.309640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.451175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:30.459853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-15c75102-2403-4dfd-a264-a1a88f3fa762 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1655 microversion: 2.1 time: 0.163895 Oct 28 18:38:30.460439 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3730/7247] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:30.482394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:30.488346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.488830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.489265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.511848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Going to try to start instance {{(pid=120567) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 18:38:30.516205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:30.552870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3161e645-3a63-4ce0-9991-d7a49ddfa5a0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action" status: 202 len: 0 microversion: 2.1 time: 0.074095 Oct 28 18:38:30.553486 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3518/7248] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:38:30 2022] POST /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:38:30.561928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:30.562559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:30.569300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.569800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.570255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.570977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:30.571481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:30.571924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:30.703842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:30.712025 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9a7211c9-72d1-4c71-b3f1-9b79a12cc48a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1664 microversion: 2.1 time: 0.154000 Oct 28 18:38:30.712625 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3731/7249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:30 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:31.739442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:31.740684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:31.747142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.747669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.748112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.748804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.749261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.749703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.878920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:31.887255 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-674eef8c-ffaf-49cd-bacc-0b0ed8801734 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1668 microversion: 2.1 time: 0.154726 Oct 28 18:38:31.888123 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3519/7250] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:31 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:31.909961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:31.910500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:31.917929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.918422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.918866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.919597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:31.920057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:31.920490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:31.947499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:38:31.961583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:32.025123 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b17996f-d73c-4f25-9638-5160a541d631 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 204 len: 0 microversion: 2.1 time: 0.118187 Oct 28 18:38:32.026092 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3732/7251] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:38:31 2022] DELETE /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:38:32.034425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:32.035123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:32.041794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.042283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.042717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.043456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:32.043913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:32.044337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:32.179139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:32.186925 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa270cbc-0abf-4344-872f-4171a4ca1777 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1674 microversion: 2.1 time: 0.156397 Oct 28 18:38:32.187561 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3520/7252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:32 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:33.211227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:33.211959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:33.218615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.219113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.219602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:33.220300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:33.220756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:33.221189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:33.350702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:33.358584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2bc098bc-bf83-4e51-8871-a074f2c11bb9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 200 len: 1674 microversion: 2.1 time: 0.152156 Oct 28 18:38:33.359389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3733/7253] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:33 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:34.179733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e447f906-08f0-4c95-98e3-6e5c796d0842", "name": "network-vif-deleted", "tag": "dc105454-d4d2-4f1c-be83-32410c9cad70"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:34.190850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.190850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.191323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.204418 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] Creating event network-vif-deleted:dc105454-d4d2-4f1c-be83-32410c9cad70 for instance e447f906-08f0-4c95-98e3-6e5c796d0842 on n-h1-860864-13 Oct 28 18:38:34.210720 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-10b33889-5634-43aa-a981-0a0ffbf5cd10 req-49caf026-688a-46b0-aa36-6756343c65d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034660 Oct 28 18:38:34.211327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3521/7254] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:34.384757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:34.385372 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:34.395037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.395979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.397681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.399292 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.400251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.401081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.416545 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 HTTP/1.1 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e447f906-08f0-4c95-98e3-6e5c796d0842'} Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:34.418245 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6687b36-e185-4ea1-b398-0117e89e1ebd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 404 len: 111 microversion: 2.1 time: 0.040061 Oct 28 18:38:34.423633 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3734/7255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:34 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:38:34.438655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:34.439485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:34.446326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.446880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.447406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.448161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:34.448679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:34.449167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:34.462746 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 HTTP/1.1 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e447f906-08f0-4c95-98e3-6e5c796d0842'} Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:38:34.464524 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa2d65d2-7af0-4285-84d3-a34d79c2f584 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 404 len: 111 microversion: 2.1 time: 0.031609 Oct 28 18:38:34.469860 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3522/7256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:34 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:38:34.514827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-563232859", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "05b323d7-ea32-4e38-9e71-a76a9f8bf385"}], "security_groups": [{"name": "tempest-securitygroup--429948890"}], "key_name": "tempest-keypair-1549449167", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:34.620709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] validate_networks() for [('05b323d7-ea32-4e38-9e71-a76a9f8bf385', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:38:35.059255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:38:35.059714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:38:35.060200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:38:35.060654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:38:35.061081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:38:35.071091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.071624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.072078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.072822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:35.073286 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:35.073721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:35.091451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:38:35.096816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:38:35.109613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:38:35.111955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:38:35.160174 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e344d25-d30f-495f-b92c-fdbf98f4f5cb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.649119 Oct 28 18:38:35.161437 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3735/7257] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:38:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:38:35.172751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77d0e68a-1b12-43a5-b7c3-a7761afebc92 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:35.173362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-77d0e68a-1b12-43a5-b7c3-a7761afebc92 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:35.250844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77d0e68a-1b12-43a5-b7c3-a7761afebc92 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:35.259598 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77d0e68a-1b12-43a5-b7c3-a7761afebc92 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1238 microversion: 2.1 time: 0.090781 Oct 28 18:38:35.260185 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3523/7258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:35 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:36.284946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:36.286619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:36.296312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.296905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.297748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.298670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:36.299427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:36.300095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:36.376875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:36.386039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab1aade5-6e96-49f5-84be-a54d87a9a69e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1308 microversion: 2.1 time: 0.107763 Oct 28 18:38:36.386628 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3736/7259] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:36 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:37.410776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:37.411406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:37.419821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:37.420313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:37.420753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:37.421456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:37.422101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:37.422826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:37.564826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:37.573628 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2eb0b073-3c46-4b2d-a7e7-d062240173ee tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.167689 Oct 28 18:38:37.574197 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3524/7260] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:37 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:38.001339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:38.012544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.013031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.013468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.025528 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] Creating event network-changed:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:38:38.030391 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-53923f14-64d8-46be-9faf-0eabd50baed4 req-26cf84b9-a666-44c6-875c-7ffa34d1e0ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033463 Oct 28 18:38:38.030990 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3737/7261] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:38:38.598196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:38.599130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:38.602575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=45 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:38.608325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.608931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.609369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.610055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:38.610553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:38.610924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:38.747639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:38.755567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c2c5292-9389-47b4-a914-f79a0306198f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.161281 Oct 28 18:38:38.756140 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3525/7262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:38 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:39.779604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:39.780317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:39.782266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:39.788006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.788504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.788954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.789654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:39.790121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:39.790560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:39.924302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:39.932873 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-57cd43f4-d77e-4496-bc0d-46df46b54570 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.158404 Oct 28 18:38:39.933446 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3738/7263] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:39 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:40.956599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:40.957114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:40.964642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:40.965122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:40.965563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:40.966246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:40.966698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:40.967118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:41.096869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:41.105206 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-928cecec-1215-4be1-93c7-70bc0f358bf7 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.152570 Oct 28 18:38:41.105772 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3526/7264] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:40 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:42.129751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:42.131100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:42.138068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.138565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.139012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.139771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:42.140235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:42.140671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:42.277459 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:42.285289 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3005529f-373e-48de-bdd5-786a2e30e6fd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.159707 Oct 28 18:38:42.285856 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3739/7265] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:42 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:38:43.309160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:43.309768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:43.316585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.317067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.317499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:43.319227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.319729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.320156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:43.454437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:43.463184 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ba0aa22f-c782-474a-8799-c2ee8f94b770 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.157919 Oct 28 18:38:43.463784 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3527/7266] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:43 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:43.506009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-plugged", "status": "completed", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:43.516485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:43.516982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:43.517440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:43.529481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] Creating event network-vif-plugged:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:38:43.534403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-d8abda62-6f3f-46fa-88f7-b57e3b8e8e79 req-7fce821c-a055-4a1e-ac17-e6d6aa22902d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032947 Oct 28 18:38:43.535010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3740/7267] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:44.487440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:44.488046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:44.494792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:44.495269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:44.495746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:44.496453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:44.496900 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:44.497320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:44.636324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:44.644236 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9c36b78d-cd57-4f60-ae95-9462523bd4aa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1363 microversion: 2.1 time: 0.160684 Oct 28 18:38:44.644830 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3528/7268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:44 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:45.667910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:45.668703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:45.672975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.673675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:45.681924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.682415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.682861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.683582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.684046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.684480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.814320 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:38:45.822734 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0c07f47f-c36c-48d9-b4b6-95da2f114054 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1550 microversion: 2.1 time: 0.156604 Oct 28 18:38:45.823321 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3741/7269] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:38:45 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:38:45.847165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:38:45.847702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:38:45.849516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:38:45.855639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.856120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.856559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.857251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:45.857707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:45.858133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:45.935126 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4092de8c-8a3b-4173-9de9-a4e37d959799 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092877 Oct 28 18:38:45.935789 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3529/7270] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:38:45 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:38:47.129669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:38:47.140675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:38:47.141163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:38:47.141608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:38:47.152638 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] Creating event network-changed:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:38:47.157706 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-faa4f18d-5fb0-41e1-a892-01b13802708f req-ef45b4bb-b3c9-4ffb-90c4-c4a2fa916e29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Oct 28 18:38:47.158307 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3742/7271] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:39:59.157074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=9 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:59.157998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:39:59.162636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:39:59.164875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:39:59.173223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:59.173710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:59.174148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:59.174841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:39:59.175295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:39:59.175751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:39:59.204632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:39:59.210052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:39:59.217308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:39:59.217725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:39:59.218194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:39:59.218626 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:39:59.219035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:39:59.281040 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [08c461a0-c9e6-460f-bf71-b2fea782cbcd] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:40:00.287733 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [08c461a0-c9e6-460f-bf71-b2fea782cbcd] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 40940. Oct 28 18:40:00.291546 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96216ba3-39e4-4add-b70f-d41640a2c2b1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/action" status: 202 len: 0 microversion: 2.1 time: 1.136373 Oct 28 18:40:00.294972 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3530/7272] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:39:59 2022] POST /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/action => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:40:00.299143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:00.299922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:00.304822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:00.305427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:00.314239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.314754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.315203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.315947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:00.316426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:00.316872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:00.460619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:00.469651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01ed882b-0ed8-40b5-8e1d-2fb62c897dbf tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1677 microversion: 2.1 time: 0.173120 Oct 28 18:40:00.470431 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3743/7273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:00 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:01.493754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:01.495416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:01.502621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:01.503358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:01.503820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:01.504512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:01.504964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:01.505383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:01.640236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:01.648000 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-62321e20-465e-4ff9-b027-43ef0e0f0d10 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1677 microversion: 2.1 time: 0.159025 Oct 28 18:40:01.648656 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3531/7274] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:01 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:02.673202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:02.673812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:02.680654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.681151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.682220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.682918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:02.683405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:02.683848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:02.822953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:02.830681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c0237bef-3c96-4f31-8adc-d36d1fcfe2fc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.161477 Oct 28 18:40:02.831249 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3744/7275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:02 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:03.855078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:03.855708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:03.862431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:03.862911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:03.863414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:03.864050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:03.864499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:03.864951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:03.992780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:04.000431 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30e57dea-58f5-4cf4-a894-3da75f7d6df8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.149913 Oct 28 18:40:04.000997 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3532/7276] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:03 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:05.024285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:05.024900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:05.031779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:05.032269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:05.032712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:05.033405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:05.033866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:05.034298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:05.170069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:05.177859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c413a794-e5d7-4c28-994b-cde940955bea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.157517 Oct 28 18:40:05.178447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3745/7277] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:05 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:06.202398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:06.203041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:06.209791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.210267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.210699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.211404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:06.211855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:06.212269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:06.343265 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:06.351096 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5dd84d1f-529d-4764-a451-550b61ea9990 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.153751 Oct 28 18:40:06.351683 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3533/7278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:06 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:07.375347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:07.376026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:07.382305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.382805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.383259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:07.383987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:07.384455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:07.385457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:07.518903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:07.526948 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e33583c7-2bff-4670-978d-e286dc10c01c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.155868 Oct 28 18:40:07.527553 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3746/7279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:07 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:08.549466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:08.550075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:08.556227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:08.556719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:08.557152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:08.557838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:08.558293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:08.558890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:08.732569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:08.740512 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0785bd1c-14fa-4c9d-8672-806b53957e6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.195000 Oct 28 18:40:08.741356 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3534/7280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:08 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:09.764964 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:09.765609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:09.772447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:09.772939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:09.773382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:09.774077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:09.774539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:09.774973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:09.908011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:09.915688 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-827f0322-4923-4422-9ee2-1b13f114db5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.154753 Oct 28 18:40:09.916263 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3747/7281] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:09 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:10.940098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:10.940657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:10.947733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:10.948216 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:10.948672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:10.949651 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:10.950106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:10.950529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:11.082662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:11.090491 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e47ab5b-9e4f-4a94-b193-f0c2694f934c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.154311 Oct 28 18:40:11.091061 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3535/7282] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:10 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:12.114160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:12.114822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:12.122390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:12.122900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:12.123352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:12.124091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:12.124561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:12.125005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:12.256329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:12.264339 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f4dd108a-170b-44fc-af64-156a204201dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.154121 Oct 28 18:40:12.264924 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3748/7283] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:12 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:13.287390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:13.287994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:13.290239 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:40:13.290387 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:40:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 (ip 10.222.0.48) !!! Oct 28 18:40:13.297594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.298066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.298492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.299174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:13.299649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:13.300065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:13.435009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:13.442735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a920174e-cdfa-4113-9ace-d5dc6ced4502 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.159224 Oct 28 18:40:13.443316 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3536/7284] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:13 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:14.467214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:14.467862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:14.474776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.475272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.475752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.476456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:14.476922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:14.477360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:14.606655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:14.614585 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fa6e2658-8325-4994-acbb-ec1f82321187 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.151810 Oct 28 18:40:14.615100 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3749/7285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:14 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:15.637736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:15.638378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:15.645392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:15.645887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:15.646327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:15.647026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:15.647510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:15.647944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:15.782690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:15.790715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff406fc9-5d1d-41a1-a527-9c6a71359fab tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.157023 Oct 28 18:40:15.791277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3537/7286] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:15 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:16.814847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:16.815485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:16.822268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:16.822797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:16.823260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:16.824478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:16.824942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:16.825374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:16.955888 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:16.963628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df256046-4c90-4266-bbc5-d485efce2b1c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.152691 Oct 28 18:40:16.964366 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3750/7287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:16 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:17.986929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:17.987570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:17.994361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:17.994844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:17.995278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:17.996663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:17.997163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:17.997589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:18.126359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:18.134366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c343516-1cc6-4a8c-be39-86b3b9624e3c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1682 microversion: 2.1 time: 0.151381 Oct 28 18:40:18.134936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3538/7288] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:17 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:19.158156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:19.158783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:19.165796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:19.166298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:19.166750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:19.167478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:19.168472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:19.168936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:19.309599 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:19.317551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd322072-7a34-4875-98d1-ddaa7d658c2c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1681 microversion: 2.1 time: 0.163292 Oct 28 18:40:19.318389 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3751/7289] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:19 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:19.472160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-unplugged", "status": "completed", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:19.483940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:19.484427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:19.484862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:19.497487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Creating event network-vif-unplugged:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h1-860864-13 Oct 28 18:40:19.503143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] Instance 7950a635-b164-4f17-a691-b90eea4d63b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:40:19.515071 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-310bf4ac-75c2-4224-abcc-123dd1054674 req-c66b606b-c879-44ec-8372-047c4c431520 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046608 Oct 28 18:40:19.515734 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3539/7290] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:20.342310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:20.342930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:20.349716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:20.350212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:20.350662 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:20.351391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:20.351858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:20.352298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:20.488133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:20.497738 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ab08937c-e75d-490b-8ed4-ae2bf6031b06 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1681 microversion: 2.1 time: 0.160032 Oct 28 18:40:20.498421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3752/7291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:20 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:21.524617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:21.525318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:21.532687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:21.533180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:21.533628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:21.534348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:21.534838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:21.535266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:21.550472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:21.560394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:21.560881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:21.561324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:21.573205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Creating event network-changed:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h1-860864-13 Oct 28 18:40:21.579260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] Instance 7950a635-b164-4f17-a691-b90eea4d63b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:40:21.590749 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-824ec2a0-2696-4d1e-a6b9-ad8b6a01635a req-24e08804-fe9c-483d-82a0-a5c780426727 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043380 Oct 28 18:40:21.591487 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3753/7292] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:21.674155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:21.681926 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-974a3aae-925d-43d0-aeff-05ee145e707a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1679 microversion: 2.1 time: 0.162608 Oct 28 18:40:21.682496 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3540/7293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:21 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:22.707976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:22.708608 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:22.714933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:22.715390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:22.715847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:22.716553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:22.717051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:22.717496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:22.854028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:22.862377 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f3b29c42-82cd-4cd6-9110-e0003c3e54dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1679 microversion: 2.1 time: 0.159858 Oct 28 18:40:22.862958 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3754/7294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:22 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:23.887793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:23.888342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:23.896269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:23.896760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:23.897199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:23.897904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:23.898362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:23.898791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.037425 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:24.045300 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca79a049-da6d-48b2-8496-b7dc4f20d99f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1676 microversion: 2.1 time: 0.162243 Oct 28 18:40:24.045892 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3541/7295] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:23 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:24.068747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:24.069283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:24.076259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.076747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.077192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.077887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.078351 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.078783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.116101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.116585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.117027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.117781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.118244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.118678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.139011 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:40:24.144105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:40:24.248771 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cad7e338-9543-426b-81dd-5950b3330d96 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/action" status: 202 len: 0 microversion: 2.1 time: 0.183727 Oct 28 18:40:24.249413 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3755/7296] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:40:24 2022] POST /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:40:24.257995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:24.258762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:24.265879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.266581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.267070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.268021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:24.268702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:24.269196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:24.420044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:24.429246 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7bf9e3e8-7403-4379-914c-781abadc516c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.175150 Oct 28 18:40:24.429973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3542/7297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:24 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:25.454652 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:25.455352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:25.463207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:25.463666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:25.464112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:25.465278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:25.465742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:25.466176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:25.597104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:25.600680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:25.605781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a4e6d8b-7c93-4602-844f-000070d4c8c9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.155495 Oct 28 18:40:25.606355 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3756/7298] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:25 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:26.399155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-plugged", "status": "completed", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:26.410454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:26.410932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:26.411374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:26.426369 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Creating event network-vif-plugged:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h1-860864-13 Oct 28 18:40:26.431764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] Instance 7950a635-b164-4f17-a691-b90eea4d63b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:40:26.443933 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-dfad926d-5c9d-4121-9a0a-b39f36d69bee req-5b4f9cfe-2e90-4cef-b37a-8a907e8d02f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048342 Oct 28 18:40:26.444702 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3543/7299] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:26.629847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:26.630462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:26.638520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:26.639094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:26.639564 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:26.640262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:26.640722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:26.641152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:26.789893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:26.798766 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c7f378db-f025-4e4d-8db9-36c862a2be30 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.173002 Oct 28 18:40:26.799384 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3757/7300] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:26 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:27.737646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-unplugged", "status": "completed", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:27.749529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:27.750018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:27.750451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:27.763085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Creating event network-vif-unplugged:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:40:27.769138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] Instance 7950a635-b164-4f17-a691-b90eea4d63b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:40:27.780116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6b0f708d-e4fc-4cf8-bceb-8a54332c6c31 req-d80269af-fc54-4007-a3f0-589aee491a31 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048496 Oct 28 18:40:27.780738 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3544/7301] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:27.822113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:27.822734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:27.830528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:27.831030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:27.831508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:27.832228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:27.832698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:27.833139 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:27.965384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:27.974049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f721f38-06c4-455d-af7c-6e03bcec1ff1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.155736 Oct 28 18:40:27.974543 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3758/7302] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:27 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:28.998774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:28.999500 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:29.006965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.007480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.007915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.008594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.009040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.009459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.146852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:29.155085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1c9bce6d-21d4-4b00-aa17-2852950aee21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.161145 Oct 28 18:40:29.155674 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3545/7303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:28 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:29.814833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:29.824970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:29.825457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:29.826464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:29.837845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Creating event network-changed:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:40:29.843144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] Instance 7950a635-b164-4f17-a691-b90eea4d63b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:40:29.853584 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7726c8dc-0137-4b93-82a9-6a2ce2df7bd1 req-688eb4a9-06dd-40e3-8e55-76ac7db57a2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043182 Oct 28 18:40:29.854167 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3759/7304] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:30.180065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:30.180693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:30.183489 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=37 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:30.189396 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:30.189893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:30.190366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:30.191073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:30.191563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:30.191996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:30.194955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:30.328704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:30.336477 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-07e1d9db-a1bb-430e-ae50-865cccb2c07b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.160393 Oct 28 18:40:30.337584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3546/7305] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:30 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:31.362445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:31.363146 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:31.366379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:31.372274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:31.373037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:31.373494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:31.374205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:31.374672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:31.375115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:31.515185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:31.523547 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2aa7f4c1-b75e-4995-a476-3de7ad681563 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1675 microversion: 2.1 time: 0.166622 Oct 28 18:40:31.524140 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3760/7306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:31 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:32.548894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:32.549510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:32.556445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.556937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.557375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.558066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.558522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.558948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.693298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:32.700432 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ab62877-2ad3-4145-bbf8-ef1ffd3495b4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1668 microversion: 2.1 time: 0.156040 Oct 28 18:40:32.701360 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3547/7307] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:32 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:32.723375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:32.724002 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:32.730874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.731352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.732345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.733047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.733514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.733950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.873536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:32.881669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-855dc2fd-716a-4ad7-85fb-033ac928cf03 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1668 microversion: 2.1 time: 0.162264 Oct 28 18:40:32.882257 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3761/7308] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:32 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:32.904316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:32.904850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:32.910699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.911178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.911648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:32.912356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:32.912806 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:32.913230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.044565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:33.052971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d2ee813-7045-4998-8cc6-ef07864d763d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1668 microversion: 2.1 time: 0.153000 Oct 28 18:40:33.053544 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3548/7309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:32 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:33.075114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:33.075770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:33.082034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.082531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.082981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.083708 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.084178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.084618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.110478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:40:33.186514 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e8f98ad8-fe99-4c4f-86d7-43a7cc8da09f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 204 len: 0 microversion: 2.1 time: 0.114799 Oct 28 18:40:33.187288 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3762/7310] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:40:33 2022] DELETE /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:40:33.195243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:33.195898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:33.202311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.202790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.203226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.203944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:33.204394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:33.204815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:33.335628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:33.344029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6456d319-9aca-4fdc-a4ef-7235759de0f0 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1674 microversion: 2.1 time: 0.152629 Oct 28 18:40:33.344597 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3549/7311] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:33 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:34.049374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-plugged", "status": "completed", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:34.061371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.061914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.062516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.073350 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] Creating event network-vif-plugged:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:40:34.078638 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-bb3829c0-b4d0-4407-babd-1315db06e127 req-7b50fbd0-4c20-4675-a053-545fa9841c6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Oct 28 18:40:34.079245 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3763/7312] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:34.367139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:34.367765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:34.375255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.375756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.376189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.376865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:34.377310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:34.377987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:34.512837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:34.521209 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d5a47dd-a0c5-4c0f-a5ba-63ee283ddebb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1674 microversion: 2.1 time: 0.157967 Oct 28 18:40:34.521792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3550/7313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:34 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:35.413035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:35.418413 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7950a635-b164-4f17-a691-b90eea4d63b6", "name": "network-vif-deleted", "tag": "0d6c2a4f-6051-4927-9499-96c061e94f06"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:35.429544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:35.430023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.430463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.444397 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] Creating event network-vif-deleted:0d6c2a4f-6051-4927-9499-96c061e94f06 for instance 7950a635-b164-4f17-a691-b90eea4d63b6 on n-h2-860864-13 Oct 28 18:40:35.449705 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e3dbb8f6-7949-4234-b099-1f8dfba0e9c9 req-3b7ded4e-00b3-48fc-bd01-40fcda10e70d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037440 Oct 28 18:40:35.450335 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3764/7314] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:35.547961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:35.550639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:35.560082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:35.561550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.562326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.563302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:35.564006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.564630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.605016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:35.605630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:35.611671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:35.612637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lazy-loading 'fault' on Instance uuid 7950a635-b164-4f17-a691-b90eea4d63b6 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:40:35.663161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:35.672279 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9d066b1c-041c-46b5-911d-22d6eeba2f49 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 200 len: 1328 microversion: 2.1 time: 0.130737 Oct 28 18:40:35.672855 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3551/7315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:35 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:36.698705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:36.699751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:36.706323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.706823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.707277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.708003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.708471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.708974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.726178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 HTTP/1.1 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7950a635-b164-4f17-a691-b90eea4d63b6'} Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:36.727893 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-298c93c6-a44b-4fe2-b432-0308bf9d98a8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 404 len: 111 microversion: 2.1 time: 0.036123 Oct 28 18:40:36.732184 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3765/7316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:36 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:36.747919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:36.748717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:36.755864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.756349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.756787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.757483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:36.757934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:36.758356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:36.771745 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 HTTP/1.1 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7950a635-b164-4f17-a691-b90eea4d63b6'} Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:40:36.773402 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b869e76-bd3c-4171-8ed9-1b2ab9bb41ef tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 404 len: 111 microversion: 2.1 time: 0.030857 Oct 28 18:40:36.778232 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3552/7317] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:36 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:40:36.828628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1421712971", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "05b323d7-ea32-4e38-9e71-a76a9f8bf385"}], "security_groups": [{"name": "tempest-securitygroup--429948890"}], "key_name": "tempest-keypair-1549449167", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:36.935023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] validate_networks() for [('05b323d7-ea32-4e38-9e71-a76a9f8bf385', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:40:37.303794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:40:37.304236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:40:37.304725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:40:37.305148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:40:37.305573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:40:37.314726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.315163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.315651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.316399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:37.316870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:37.317311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:37.334227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:40:37.339496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:40:37.352458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:40:37.354776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:40:37.402626 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-46a3f2b2-a243-4cf0-97d5-83bb43668e53 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.579592 Oct 28 18:40:37.403299 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3766/7318] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:40:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:40:37.415439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53644601-422f-4417-8f78-8574a5863f6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:37.416056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53644601-422f-4417-8f78-8574a5863f6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:37.472262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53644601-422f-4417-8f78-8574a5863f6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:37.478852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53644601-422f-4417-8f78-8574a5863f6c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1239 microversion: 2.1 time: 0.067522 Oct 28 18:40:37.479448 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3553/7319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:37 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:38.505024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:38.505806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:38.512251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.513031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.514315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.515141 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:38.515880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:38.516443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:38.584000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:38.592835 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-df1b2597-7993-442e-a677-4a19caae894e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1297 microversion: 2.1 time: 0.092242 Oct 28 18:40:38.593818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3767/7320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:38 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:39.617853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:39.618653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:39.627350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:39.628142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:39.629260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:39.629983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:39.630577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:39.631016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:39.773333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:39.782601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dacf844b-5593-4aad-81e1-55ccb50638fe tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.168582 Oct 28 18:40:39.783411 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3554/7321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:39 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:40:39.787930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:39.800472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:39.800967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:39.801495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:39.814243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] Creating event network-changed:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:40:39.819416 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-25ff8474-4a79-45bb-9636-ea5fb75831a2 req-b04696c2-dab0-438c-b07a-89bbbfbf2cc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036498 Oct 28 18:40:39.820071 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3768/7322] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:40.807184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:40.807799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:40.814843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.815336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.815805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.816497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:40.816959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:40.817383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:40.960354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:40.968693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-31a9b2e8-7355-48db-951b-2684af92f1db tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.165438 Oct 28 18:40:40.969272 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3555/7323] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:40 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:41.994429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:41.995129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:42.001903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:42.002393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:42.003092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:42.003830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:42.004298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:42.004731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:42.139230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:42.146977 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0d4d8368-c0fb-4ec3-8205-8660dacafd5c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.157719 Oct 28 18:40:42.147595 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3769/7324] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:41 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:43.172162 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:43.172670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:43.179674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.180158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.180595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.181284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:43.181740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:43.182163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:43.311654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:43.319270 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0deb617d-dbd1-4331-8ac4-039ca7e32f8a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.151989 Oct 28 18:40:43.319865 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3556/7325] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:43 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:44.342263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:44.342889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:44.349858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.350360 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.350811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.351559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:44.352033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:44.352468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:44.489861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:44.497651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f780610-ba35-49b2-9ab9-eba09c9e6601 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.159419 Oct 28 18:40:44.498310 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3770/7326] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:44 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:45.523502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:45.524143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:45.532120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:45.532603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:45.533041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:45.533735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:45.534191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:45.534618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:45.671522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:45.679143 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61040a84-6973-4d6b-a061-a0c12105edfb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.159681 Oct 28 18:40:45.679761 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3557/7327] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:45 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:46.521659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-plugged", "status": "completed", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:46.533610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.534113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.534560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.546781 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] Creating event network-vif-plugged:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:40:46.551678 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-618b52ea-f110-48cb-a362-274699e61cf6 req-c8ab8846-a4a5-4f04-b522-71481929aabf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034309 Oct 28 18:40:46.552279 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3771/7328] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:40:46.702797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:46.703729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:46.710501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.710976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.711434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.712127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:46.712579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:46.712998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:46.844434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:46.852385 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db5d6fc9-6d10-4dc1-813c-0512297c0f6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.154187 Oct 28 18:40:46.853155 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3558/7329] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:46 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:47.874835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:47.875665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:47.881022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:47.881762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:47.888937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.889865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.890315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:47.891018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:47.891515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:47.891960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:48.036003 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:48.043681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6623dcf7-667c-4f33-84e9-b8ad3b62ad99 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1364 microversion: 2.1 time: 0.170416 Oct 28 18:40:48.044262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3772/7330] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:47 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:49.067478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:49.068055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:49.069867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:40:49.076178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.077583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.078027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.078720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.079173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.079624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.208784 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:40:49.216498 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1dddf4cf-d282-451b-b8c7-2e66ab49619f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1551 microversion: 2.1 time: 0.153025 Oct 28 18:40:49.217680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3559/7331] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:40:49 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:40:49.240834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:40:49.241379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:40:49.248274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.248879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.249332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.250044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:49.250515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:49.250962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:49.331705 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c2ae949b-ce08-4d9d-8215-06f4c5161214 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094656 Oct 28 18:40:49.332333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3773/7332] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Oct 28 18:40:49 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:40:50.307643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:40:50.317251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:40:50.317732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:40:50.318165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:40:50.329169 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] Creating event network-changed:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:40:50.334116 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e40a0c13-4647-4db9-9ff8-13a88d02d109 req-88eb78ca-77dd-4c1c-a148-cfc7dc4fd8ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081457 Oct 28 18:40:50.334711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3560/7333] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:41:55.156723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:55.157428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:55.158923 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:41:55.159096 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a (ip 10.222.0.48) !!! Oct 28 18:41:55.164733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:41:55.165349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:41:55.176419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.176923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.177377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.178090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.178554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.178998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.365364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:41:55.373972 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a72f53fa-e183-4528-b83d-0a927e3d87b5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1669 microversion: 2.1 time: 0.219554 Oct 28 18:41:55.374558 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3774/7334] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:41:55 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:41:55.395557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=33 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:55.396305 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=77 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:41:55.402639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91c1acb5-f9b9-4e55-9740-803a715a56da"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:41:55.405627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:41:55.412446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.412874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.413309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.413999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:41:55.414448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:41:55.414871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:41:55.647726 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb1b6e07-9458-4f5b-8efb-184aaca053bd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254483 Oct 28 18:41:55.648508 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3561/7335] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:41:55 2022] POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:07.422079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:07.424353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:07.426343 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:07.427021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:07.432791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.433293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.433749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.434460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.434932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.435407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.464538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:07.470032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120568) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 18:42:07.476986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:42:07.477424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:42:07.477911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:42:07.478337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:42:07.478759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:42:07.541642 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b63a5eeb-edca-470d-9c8e-fcc92b0e48a1 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/action" status: 202 len: 0 microversion: 2.1 time: 0.123984 Oct 28 18:42:07.542497 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3775/7336] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:07 2022] POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:42:07.549207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:07.550385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:07.555837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:07.556581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:07.564030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.564526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.565102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.565982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:07.566473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:07.567052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:07.710114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:07.720228 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b312fe94-28fa-461a-87b6-f4d7b2a8e94a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1724 microversion: 2.1 time: 0.173198 Oct 28 18:42:07.720881 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3562/7337] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:07 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:08.744951 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:08.745575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:08.753357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:08.753861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:08.754311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:08.755028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:08.755590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:08.756036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:08.892695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:08.901145 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a90f1aa-f23a-42e9-8f2e-b8962102ea85 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1724 microversion: 2.1 time: 0.160999 Oct 28 18:42:08.901727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3776/7338] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:08 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:09.924638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:09.925242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:09.932034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.932455 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.932884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:09.933564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:09.934015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:09.934434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:10.065261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:10.073415 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b8b2ff1-1bf1-4e92-95e5-ace1b38e5d8f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.152753 Oct 28 18:42:10.073996 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3563/7339] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:09 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:11.099161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:11.099807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:11.106754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.107251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.107734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.109285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:11.109751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:11.110193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:11.244356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:11.252713 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-abd96213-43e3-45d1-b6c6-a504c228914f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.157457 Oct 28 18:42:11.253550 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3777/7340] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:11 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:12.275404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:12.276012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:12.283156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.283672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.284109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.284804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:12.285253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:12.285700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:12.418317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:12.427335 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7270eb0a-3444-4bdf-b938-79f81d490c34 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.155822 Oct 28 18:42:12.427936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3564/7341] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:12 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:13.451140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:13.452383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:13.459215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.459754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.460200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.460901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:13.461365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:13.461801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:13.589045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:13.597557 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7805f877-adbc-4299-aa33-de33c6e49b70 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.150329 Oct 28 18:42:13.598138 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3778/7342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:13 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:14.622033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:14.622559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:14.630131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.630612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.631043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:14.631760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:14.632208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:14.632628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:14.766222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:14.774438 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4a953ff3-eb74-4cc4-9629-db0bd7d3019b tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.156418 Oct 28 18:42:14.775019 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3565/7343] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:14 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:15.799501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:15.800120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:15.807179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.807790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.808247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.808963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:15.809430 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:15.809870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:15.949274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:15.957947 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74cf8857-abae-423a-a4a9-e60ec6ced53a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.162941 Oct 28 18:42:15.958542 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3779/7344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:15 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:16.980998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:16.981607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:16.988602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:16.989085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:16.989527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:16.990218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:16.990675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:16.991099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:17.118361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:17.127676 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7f034955-a531-46d6-a92b-4d9b85fbbe9a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.150625 Oct 28 18:42:17.128519 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3566/7345] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:16 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:18.154376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:18.155650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:18.161678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.162176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.162629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.163333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:18.163896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:18.164336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:18.299258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:18.307675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-817a6746-ae15-4c02-93be-0779ea7254e4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.158823 Oct 28 18:42:18.308251 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3780/7346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:18 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:19.331628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:19.332228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:19.339060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.339578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.340011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.340694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:19.341161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:19.341564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:19.469516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:19.477635 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f8d7f736-d914-4c51-8a30-0ed30bf9f733 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.149870 Oct 28 18:42:19.478215 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3567/7347] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:19 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:20.502246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:20.503150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:20.510134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.510631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.511080 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.511817 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:20.512285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:20.512725 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:20.644924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:20.653199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e39aad9-0b65-4560-952f-a4977ebfe8ae tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.155626 Oct 28 18:42:20.653773 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3781/7348] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:20 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:21.676693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:21.677250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:21.684239 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.684718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.685148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.686587 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:21.687275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:21.687729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:21.817254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:21.825426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-93bdbefd-70fa-4d6b-a9ec-ef6f6cbb6087 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.152675 Oct 28 18:42:21.825994 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3568/7349] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:21 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:22.849438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:22.850067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:22.856990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.857489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.857938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.858645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:22.859109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:22.859593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:22.991919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:23.000791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3353e490-00ad-4f4e-9b9f-b5da9e50e06c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.155242 Oct 28 18:42:23.001373 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3782/7350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:22 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:24.025034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:24.025640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:24.033511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.034045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.034473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.035154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:24.035625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:24.036045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:24.168082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:24.176359 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-41a6da63-2c0e-406b-a384-25942c69a24c tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.155250 Oct 28 18:42:24.176946 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3569/7351] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:24 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:25.200557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:25.201143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:25.209030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.209524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.209971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.210671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:25.211133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:25.211596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:25.341394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:25.349761 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3a0a2c23-c30d-4dc1-9b03-e5462fafff2e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.153202 Oct 28 18:42:25.350340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3783/7352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:25 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:26.373920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:26.374438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:26.381534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.382014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.382449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.383135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:26.383610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:26.384039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:26.808667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:26.817475 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9cec883-b5f2-44c1-8980-2bc48458f678 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.448022 Oct 28 18:42:26.818144 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3570/7353] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:26 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:27.841762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:27.843184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:27.850227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.850760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.851217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.851976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:27.852449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:27.852926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:27.982879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:27.992157 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8bc7e43d-4869-43a4-b553-89dabed0af74 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1729 microversion: 2.1 time: 0.154475 Oct 28 18:42:27.992752 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3784/7354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:27 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:28.956450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-unplugged", "status": "completed", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:28.967412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:28.968597 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:28.969030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:28.980878 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Creating event network-vif-unplugged:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h2-860864-13 Oct 28 18:42:28.987416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] Instance 29d48831-b7b9-4199-944e-29908d63b05a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:42:28.998188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6f462b10-92a2-4271-ab9a-25ed1035269b req-9abff956-f638-4ffd-baa3-4066960be081 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098183 Oct 28 18:42:28.999590 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3571/7355] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:29.015955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:29.016878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:29.024384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.024963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.025507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.026234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:29.026735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:29.027176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:29.170934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:29.179624 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-574b7867-8d38-441a-b6cc-c8eb71a8ca6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1728 microversion: 2.1 time: 0.167549 Oct 28 18:42:29.180226 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3785/7356] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:29 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:30.205870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:30.206558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:30.213030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.213513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.213947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.214660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:30.215107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:30.215556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:30.346496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:30.355395 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1acb0eef-fcec-4df1-b95a-55aebcb0abc3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.154401 Oct 28 18:42:30.360129 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3572/7357] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:30 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:31.020464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:31.030864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.031354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.031830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.043543 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Creating event network-changed:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h2-860864-13 Oct 28 18:42:31.049746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] Instance 29d48831-b7b9-4199-944e-29908d63b05a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:42:31.061201 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-18791e4d-08be-4674-838f-643aabe2c94b req-12afbc82-ebb8-41a3-b310-b1a192b1f644 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043848 Oct 28 18:42:31.061806 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3786/7358] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:31.378706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:31.379675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:31.387314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.387959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.388487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.389327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:31.390020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:31.390525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:31.536143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:31.545804 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40a748d4-d525-46ab-a5e9-0bf0ef72f886 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.170606 Oct 28 18:42:31.546742 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3573/7359] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:31 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:32.570946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:32.571693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:32.578711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.579214 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.579696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.580411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:32.580883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:32.581323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:32.717346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:32.725767 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7d78d143-568d-4146-ac48-8510097104d3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.159976 Oct 28 18:42:32.726486 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3787/7360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:32 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:33.750650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:33.751205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:33.758611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.759113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.759589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.760303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:33.760762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:33.761190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:33.893997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:33.902594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c759cad-2d27-4dd8-86e3-e02c84e5b1c2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.156419 Oct 28 18:42:33.903408 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3574/7361] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:33 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:34.927412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:34.927960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:34.934835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.936428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.936921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:34.937623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:34.938087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:34.938521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:35.070879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:35.079771 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e698070d-e5a0-4ac4-ba0a-cf4d569f1ff9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.156330 Oct 28 18:42:35.080346 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3788/7362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:34 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:36.103361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:36.103990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:36.111917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.112402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.112865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.113555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:36.114167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:36.114599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:36.246334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:36.255584 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ab76ed4-12fe-4c03-b708-e326765ae0ea tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.156117 Oct 28 18:42:36.256166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3575/7363] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:36 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:37.278387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:37.279038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:37.285370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.285874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.286330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.287045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:37.287542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:37.287987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:37.420261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:37.428730 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7b381aea-4719-4e83-b439-42617a40b6a9 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.154515 Oct 28 18:42:37.429306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3789/7364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:37 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:38.453190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:38.453799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:38.455937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=29 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:38.461301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.461795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.462238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.462929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:38.463401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:38.463861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:38.467213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=83 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:38.598586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:38.608747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c56b3ef0-cca3-4ccf-89ea-1a5090e3d327 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.160139 Oct 28 18:42:38.609358 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3576/7365] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:38 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:39.632383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:39.632914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:39.635865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=35 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:39.641682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.642174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.642618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.643315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:39.643802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:39.644231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:39.646928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:39.778746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:39.788055 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1c729151-7dfb-428a-bf3e-4f0f7921e453 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.159963 Oct 28 18:42:39.788628 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3790/7366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:39 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:40.812888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:40.813497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:40.820575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.821081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.821513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.822197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:40.822645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:40.823066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:40.955647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:40.963765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00e07cc7-3d55-4c29-a8f6-accf37418f1e tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.155188 Oct 28 18:42:40.964340 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3577/7367] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:40 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:41.988962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:41.989686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:41.997319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:41.998936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:41.999066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:41.999811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:42.000278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:42.000747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:42.133534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:42.142154 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dcecae00-561a-4790-b242-d94d44da8d32 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.157064 Oct 28 18:42:42.142742 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3791/7368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:41 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:43.166962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:43.167546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:43.174720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.175206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.175667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.176370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:43.176828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:43.177252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:43.333641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:43.343047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-601a140b-6013-4e31-a27e-e1c2fbdbae12 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1726 microversion: 2.1 time: 0.180744 Oct 28 18:42:43.343654 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3578/7369] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:43 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:44.368209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:44.368834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:44.375716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.376220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.376670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.377386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.378111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.378548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.511942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:44.521003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8a2f8ca-bc60-4356-9835-2068e6865a43 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1723 microversion: 2.1 time: 0.156563 Oct 28 18:42:44.521535 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3792/7370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:44 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:44.544157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:44.544709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:44.551517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.552005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.552435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.553128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.553576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.553999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.592201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.592934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.593366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.594090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.594535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.594952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.615025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:42:44.620180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Getting quotas for user 392c6c5a9d0442df8c38f82f292a0d41 and project 9a238593a54b4d63b0110c01882ac3f3. Resources: {'cores', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:42:44.720985 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cb7bad30-bc34-4830-866a-6c36bc078a61 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/action" status: 202 len: 0 microversion: 2.1 time: 0.180496 Oct 28 18:42:44.721667 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3579/7371] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:42:44 2022] POST /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:42:44.729928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:44.730786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:44.737095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.737606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.738062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.738790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:44.739293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:44.739729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:44.876014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:44.884804 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4ba7607f-0978-4200-ae14-41263095385a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.158810 Oct 28 18:42:44.891458 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3793/7372] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:44 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:45.909171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:45.909909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:45.916892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.917380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.917819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:45.918511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:45.918969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:45.919932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.051284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:46.059748 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c40d2192-84b7-48c0-94b1-15a55ce2070d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.155702 Oct 28 18:42:46.060985 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3580/7373] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:45 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:46.504238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-plugged", "status": "completed", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:46.514788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:46.515358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:46.515840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:46.528064 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Creating event network-vif-plugged:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h2-860864-13 Oct 28 18:42:46.534695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] Instance 29d48831-b7b9-4199-944e-29908d63b05a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:42:46.546028 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-da68b570-9a1b-459c-b9c5-a7f702160eeb req-682f0937-9c73-4bdc-ab1c-0cd41b41cdb9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045785 Oct 28 18:42:46.546805 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3794/7374] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:47.084904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:47.085648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:47.093048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:47.093667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:47.094352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:47.095324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:47.096072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:47.096603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:47.236001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:47.244181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5161644b-7f70-4b15-8299-1e138360aecb tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.163983 Oct 28 18:42:47.244779 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3581/7375] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:47 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:48.269936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:48.273153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:48.281669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.282435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.283054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.284380 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:48.285012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:48.285612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:48.436977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:48.445949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e29803dc-d9a2-4c1f-a9ed-5048ed7f8291 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.180440 Oct 28 18:42:48.446560 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3795/7376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:48 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:42:49.469915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:49.470549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:49.477445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:49.477938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:49.478382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:49.479077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:49.479567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:49.480011 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:49.614699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:49.623709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc34a954-67c7-4580-b9be-98db721241d5 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.157053 Oct 28 18:42:49.624652 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3582/7377] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:49 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:50.061714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-unplugged", "status": "completed", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:50.072941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:50.073412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:50.073849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:50.086169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Creating event network-vif-unplugged:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:42:50.092092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] Instance 29d48831-b7b9-4199-944e-29908d63b05a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:42:50.103185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ebca8ce4-fc17-4ea2-9355-001491c600fd req-c48fdf89-b666-4a3f-8843-0ae913758e8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045945 Oct 28 18:42:50.104002 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3796/7378] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:50.647735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:50.648339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:50.655783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:50.656273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:50.656711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:50.657414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:50.657867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:50.658287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:50.797658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:50.806141 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6f34b175-b524-46fe-8f13-69b2b955f81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.162357 Oct 28 18:42:50.806722 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3583/7379] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:50 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:51.831609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:51.832458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:51.840618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:51.841129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:51.842233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:51.842958 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:51.843467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:51.843915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:51.976771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:51.985670 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb3e07d3-b5b7-4ef3-9aa7-54557994c258 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.158590 Oct 28 18:42:51.986244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3797/7380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:51 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:52.141228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:42:52.151680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:52.152151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:52.152573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:52.164858 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Creating event network-changed:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:42:52.171673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] Instance 29d48831-b7b9-4199-944e-29908d63b05a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 18:42:52.182625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-6a9fe67d-d22b-4a75-9907-1d6d14ece4f0 req-508edb64-7548-4892-af7b-38ae6cd3a639 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045645 Oct 28 18:42:52.183250 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3584/7381] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:42:53.068426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:53.069693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:53.079784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:53.080281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:53.080924 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:53.081646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:53.082110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:53.082547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:53.217053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:53.226359 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-604e6f57-9652-4f34-b473-057a604db6d6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.164095 Oct 28 18:42:53.226982 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3798/7382] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:53 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:54.252535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:54.253978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:54.260649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:54.261144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:54.261583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:54.262284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:54.262738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:54.263163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:54.405554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:54.413884 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dba2c23b-f472-4ce9-80d7-9d432915ce21 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.167266 Oct 28 18:42:54.414458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3585/7383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:54 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:55.438641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:55.439263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:55.446318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:55.446816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:55.447273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:55.448017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:55.448482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:55.448944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:55.585756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:55.594609 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de089789-bee2-409b-a29f-67b7af80edc6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.160379 Oct 28 18:42:55.595229 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3799/7384] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:55 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:56.618780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:56.619323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:56.621301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:42:56.628753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.629228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.629655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.630338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:56.630787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:56.631210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:56.765488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:56.773601 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-012e451b-6f36-4ce6-a9c2-a2e532ab5819 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.158791 Oct 28 18:42:56.774166 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3586/7385] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:56 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:57.798099 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:57.798712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:57.805487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:57.805976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:57.806421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:57.807113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:57.807605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:57.808038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:57.940144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:57.948384 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30a419e5-0821-4f9f-8ae3-75c1a82ad798 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.154617 Oct 28 18:42:57.948958 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3800/7386] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:57 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:42:58.972345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:42:58.973022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:42:58.980075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.980600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.981039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:58.981740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:42:58.982454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:42:58.982625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:42:59.116310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:42:59.125551 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-271643b5-881d-4fb1-b7ad-bbc897bf551d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.157063 Oct 28 18:42:59.126138 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3587/7387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:42:58 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:00.149547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:00.150193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:00.157491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:00.157997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:00.158450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:00.159188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:00.159696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:00.160142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:00.289473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:00.298304 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd77ce5a-ecda-4808-aa68-1505cb52d6dc tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.152726 Oct 28 18:43:00.298891 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3801/7388] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:00 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:01.321814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:01.322428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:01.329541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.330020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.330450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:01.331132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:01.331614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:01.332037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:01.464944 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:01.473724 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bc8d0261-3173-4334-a857-c87de953891d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.155840 Oct 28 18:43:01.474307 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3588/7389] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:01 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:02.497374 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:02.498812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:02.505995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:02.506502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:02.506956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:02.507730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:02.508209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:02.508651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:02.643290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:02.651605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dca9cf7f-5879-4e84-b77a-fd15c7c4acb3 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.158214 Oct 28 18:43:02.652195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3802/7390] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:02 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:03.674423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:03.674967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:03.681824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.682299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.682734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.683434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:03.683888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:03.684315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:03.820116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:03.829063 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d3c4179d-67ff-44c5-91c1-749d88b942f8 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1722 microversion: 2.1 time: 0.158632 Oct 28 18:43:03.829646 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3589/7391] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:03 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:04.852677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:04.853325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:04.860197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:04.860689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:04.861136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:04.861832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:04.862324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:04.862757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:04.999409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:05.007916 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5892b23a-cb60-4740-adc8-0a1906de492f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1715 microversion: 2.1 time: 0.159140 Oct 28 18:43:05.008495 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3803/7392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:04 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:05.031639 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.032377 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:05.039211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.039796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.040301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.041002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.041456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.041887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.044569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:05.176642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:05.185723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e1c6619-9ae6-4cd5-8c54-660cc5200860 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1715 microversion: 2.1 time: 0.157945 Oct 28 18:43:05.186267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3590/7393] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:05.208710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.209333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:05.215397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.215932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.216673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.217396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.217870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.218315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.347889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:05.356175 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-398bb761-5899-40dc-acfd-5cc349dcd7d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1715 microversion: 2.1 time: 0.151288 Oct 28 18:43:05.357596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3804/7394] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:05.381624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.382123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:05.388262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.388765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.389194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.389887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.390337 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.390760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.420341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:43:05.498156 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60cf0cea-2eea-4029-9d9f-16408b4444dd tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 204 len: 0 microversion: 2.1 time: 0.119368 Oct 28 18:43:05.502396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3591/7395] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:05 2022] DELETE /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:05.507758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:05.508415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:05.515128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.515673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.516156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.516882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:05.517357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:05.517827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:05.652312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:05.660560 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-322b2967-5686-41d0-aaeb-07c24cec6611 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1721 microversion: 2.1 time: 0.156760 Oct 28 18:43:05.661161 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3805/7396] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:05 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:06.685533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:06.686181 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:06.693006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:06.693486 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:06.693920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:06.694601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:06.695076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:06.695523 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:06.827595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:06.835796 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-27640ae1-4dbf-4faf-acb7-d792cf9dcf6f tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1721 microversion: 2.1 time: 0.155063 Oct 28 18:43:06.836391 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3592/7397] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:06 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:07.125528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-plugged", "status": "completed", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:07.137133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.137767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.138965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.150657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] Creating event network-vif-plugged:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:43:07.156443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ade7ab5f-d0c3-4fdf-8c78-537d2687f9e2 req-9c217e33-1920-45eb-a1c1-f902a07e4329 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Oct 28 18:43:07.157056 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3806/7398] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:07.860580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:07.861231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:07.868504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.869262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.869709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.871633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:07.872101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:07.873297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:07.945720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:07.954366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9347c69-ff26-4fff-bec5-54e49925ee93 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1654 microversion: 2.1 time: 0.098075 Oct 28 18:43:07.955500 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3593/7399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:07 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:08.139625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d48831-b7b9-4199-944e-29908d63b05a", "name": "network-vif-deleted", "tag": "6251bd59-5f55-4be1-af26-daac6ba3035c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:08.150677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.151275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.151978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.167013 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] Creating event network-vif-deleted:6251bd59-5f55-4be1-af26-daac6ba3035c for instance 29d48831-b7b9-4199-944e-29908d63b05a on n-h1-860864-13 Oct 28 18:43:08.173681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-96044a00-83a3-4c11-8e79-02eeead8118b req-91d0fd33-3c27-4ef7-8dd3-64b180646635 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038103 Oct 28 18:43:08.174513 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3807/7400] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:08.979679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:08.980283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:08.984812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:08.990569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.991289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.991986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:08.992939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:08.993416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:08.994014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:09.071612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:09.081238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0e91ffe8-e3ac-4551-8195-f62010616956 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1370 microversion: 2.1 time: 0.105540 Oct 28 18:43:09.081836 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3594/7401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:08 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:10.105648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:10.106279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:10.109399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=36 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:10.113600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.114097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.114544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.115246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:10.115738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:10.116177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:10.118806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=96 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:10.181560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:10.190445 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1cead896-156a-4ec4-acd4-6431a1d57fd2 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1370 microversion: 2.1 time: 0.090157 Oct 28 18:43:10.191020 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3808/7402] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:10 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:11.214258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:11.214828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:11.222226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.222706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.223136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.223847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:11.224298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:11.224715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:11.331768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:11.340265 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d17e020f-4f15-40b8-a3ba-9c7f3c429096 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1370 microversion: 2.1 time: 0.129867 Oct 28 18:43:11.340851 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3595/7403] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:11 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:12.364113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:12.364814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:12.372962 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.373476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.373920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.374633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.375100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.375572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.406818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:12.407309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:12.407785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:12.408241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lazy-loading 'fault' on Instance uuid 29d48831-b7b9-4199-944e-29908d63b05a {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:43:12.452404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392c6c5a9d0442df8c38f82f292a0d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a238593a54b4d63b0110c01882ac3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:12.460911 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d8b1785-89e2-46ca-88e3-378119da8745 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 200 len: 1375 microversion: 2.1 time: 0.100983 Oct 28 18:43:12.461503 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3809/7404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:12 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 1375 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:13.485223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:13.485827 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:13.492645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.493128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.493555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.494232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.494680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.495099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.508877 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a HTTP/1.1 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '29d48831-b7b9-4199-944e-29908d63b05a'} Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:13.510477 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-baa0acf1-bd2e-4763-b5ef-bbe548255046 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 404 len: 111 microversion: 2.1 time: 0.031171 Oct 28 18:43:13.515048 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3596/7405] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:13 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:13.574062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:13.576927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:13.583816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.584317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.584768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.585475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:13.585945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:13.586404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:13.599864 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-volume_attachments HTTP/1.1 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '29d48831-b7b9-4199-944e-29908d63b05a'} Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:13.601582 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-63bfdd56-aa2d-4bb6-afec-dec696dfe756 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033017 Oct 28 18:43:13.606279 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3810/7406] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:43:13 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:16.930494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:16.930999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:16.939529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.940015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.940590 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.941449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.941899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.942319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.957402 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a HTTP/1.1 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '29d48831-b7b9-4199-944e-29908d63b05a'} Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:16.958984 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-81bf6057-ae00-4cf1-ad1a-647a046e54f4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 404 len: 111 microversion: 2.1 time: 0.034000 Oct 28 18:43:16.966619 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3597/7407] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:16 2022] DELETE /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:16.970676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:16.971487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 29d48831-b7b9-4199-944e-29908d63b05a] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:16.978796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.979300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.979822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.980554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:16.981031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:16.981476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:16.996774 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a HTTP/1.1 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '29d48831-b7b9-4199-944e-29908d63b05a'} Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:16.998356 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 29d48831-b7b9-4199-944e-29908d63b05a could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-afe9fb8a-5e13-40d4-b6ab-a0ec335ae81a tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a" status: 404 len: 111 microversion: 2.1 time: 0.034406 Oct 28 18:43:17.003204 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3811/7408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:16 2022] GET /compute/v2.1/servers/29d48831-b7b9-4199-944e-29908d63b05a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.008686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.009188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.015686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.016197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.016627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.017335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.017793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.018225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.033092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 HTTP/1.1 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7950a635-b164-4f17-a691-b90eea4d63b6'} Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.034652 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6fb7cb1b-891d-47a5-aae1-323f23755a44 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 404 len: 111 microversion: 2.1 time: 0.031310 Oct 28 18:43:17.039185 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3598/7409] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:17 2022] DELETE /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:43:17.048884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.049520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 7950a635-b164-4f17-a691-b90eea4d63b6] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.055726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.056226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.056684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.057398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.057868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.058310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.072405 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 HTTP/1.1 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '7950a635-b164-4f17-a691-b90eea4d63b6'} Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.073967 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 7950a635-b164-4f17-a691-b90eea4d63b6 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.078704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-60dc0967-22df-4740-8ad3-2008262e18d4 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6" status: 404 len: 111 microversion: 2.1 time: 0.031618 Oct 28 18:43:17.079328 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3812/7410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:17 2022] GET /compute/v2.1/servers/7950a635-b164-4f17-a691-b90eea4d63b6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.084134 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.084622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.090773 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.091766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.092242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.092987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.093417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.093836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.108381 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 HTTP/1.1 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'e447f906-08f0-4c95-98e3-6e5c796d0842'} Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.109919 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7eede5b1-7d7f-498c-ae5a-73a630a51ff6 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 404 len: 111 microversion: 2.1 time: 0.031072 Oct 28 18:43:17.117564 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3599/7411] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:17 2022] DELETE /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.120106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.120736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: e447f906-08f0-4c95-98e3-6e5c796d0842] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.126752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.127257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.128006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.128716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.129189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.129633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.143465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 HTTP/1.1 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e447f906-08f0-4c95-98e3-6e5c796d0842'} Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.145022 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance e447f906-08f0-4c95-98e3-6e5c796d0842 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.149720 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d4bd4d1f-a6ec-4c77-b600-e482d236a93d tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842" status: 404 len: 111 microversion: 2.1 time: 0.030315 Oct 28 18:43:17.151511 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3813/7412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:17 2022] GET /compute/v2.1/servers/e447f906-08f0-4c95-98e3-6e5c796d0842 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.156000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.156504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.162496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.162982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.163449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.164149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.164606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.165032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.179558 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d HTTP/1.1 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '15b8f11d-98a9-44b5-bf58-c7537a54634d'} Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.181120 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-066c42b8-2e81-40bc-bbe7-3f1c424d3efa tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 404 len: 111 microversion: 2.1 time: 0.031314 Oct 28 18:43:17.186890 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3600/7413] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:17 2022] DELETE /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.191529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.192150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [instance: 15b8f11d-98a9-44b5-bf58-c7537a54634d] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:17.198303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.198790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.199235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.200084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:17.200618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:17.201055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:17.214633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] HTTP exception thrown: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Request method failure captured: Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d HTTP/1.1 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCDcBOqKxEzJxY4bdAUZQYBnSB9VL59xsTAhB_DGgldv5WEjBGalZzb-ailFjOF4b6GJpgMPdGkDkzxc9885nb8Tjk0ZRO5q2zlae8nEr9pR6UkyvEi1CCQdH1eyHMpCHrUoe8XpVz0xvJwW-2n3Wp5XgfaTuGwmMSoOayX0dr7YIeA Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9a238593a54b4d63b0110c01882ac3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9a238593a54b4d63b0110c01882ac3f3"}]}] Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 9a238593a54b4d63b0110c01882ac3f3 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServerActionsTestJSON-564146427 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 392c6c5a9d0442df8c38f82f292a0d41 Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServerActionsTestJSON-564146427-project Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '15b8f11d-98a9-44b5-bf58-c7537a54634d'} Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:17.216796 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Returning 404 to user: Instance 15b8f11d-98a9-44b5-bf58-c7537a54634d could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7b0985f2-8d94-47a4-9671-2efaebb971be tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d" status: 404 len: 111 microversion: 2.1 time: 0.030836 Oct 28 18:43:17.225305 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3814/7414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:17 2022] GET /compute/v2.1/servers/15b8f11d-98a9-44b5-bf58-c7537a54634d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:17.227514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8b1434f5-076e-41d0-975d-7686a5603379 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] Calling method '.version_select at 0x7f7524db2dc0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:17.232721 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b1434f5-076e-41d0-975d-7686a5603379 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [3570a816-847d-4252-a441-9b50868e4528] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:43:18.240618 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b1434f5-076e-41d0-975d-7686a5603379 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] [3570a816-847d-4252-a441-9b50868e4528] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 41394. Oct 28 18:43:18.264617 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8b1434f5-076e-41d0-975d-7686a5603379 tempest-ServerActionsTestJSON-564146427 tempest-ServerActionsTestJSON-564146427-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549449167" status: 202 len: 0 microversion: 2.1 time: 1.040830 Oct 28 18:43:18.265346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3601/7415] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Oct 28 18:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549449167 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:43:27.579804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=15 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:27.580889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=23 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:27.702129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1453916568", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "3ef2f5e1-e765-40d1-a5f4-febb4f6dcb1c"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:27.768960 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] validate_networks() for [('3ef2f5e1-e765-40d1-a5f4-febb4f6dcb1c', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:43:28.453334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:43:28.453763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:43:28.454243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:43:28.454656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:43:28.455342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:43:28.464356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.464846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.465288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:28.466547 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:28.467033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:28.467493 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:28.488302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Getting quotas for project 260245babd904aa8a8ce20ad74ab0c95. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:43:28.493759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Getting quotas for user f0d54cb8e7b6454e912e7eb7e63c1e08 and project 260245babd904aa8a8ce20ad74ab0c95. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:43:28.507170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:43:28.509483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:43:28.556249 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81eac59c-e50b-4129-8ac4-d42ccb5a02bf tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982775 Oct 28 18:43:28.557287 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3815/7416] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:43:28.565964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:28.567566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:28.571430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f33eb9c9-9b5d-434a-9c8f-ea52846cecf6 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:28.572048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f33eb9c9-9b5d-434a-9c8f-ea52846cecf6 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:28.640927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f33eb9c9-9b5d-434a-9c8f-ea52846cecf6 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:28.648259 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f33eb9c9-9b5d-434a-9c8f-ea52846cecf6 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1217 microversion: 2.1 time: 0.084016 Oct 28 18:43:28.649034 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3602/7417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:28 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:29.674639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:29.675285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:29.685518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.686215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.686859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.687790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:29.688437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:29.696424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:29.809417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:29.822527 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34615a08-7f3c-4a9e-a19f-e46edef78f6c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1287 microversion: 2.1 time: 0.152524 Oct 28 18:43:29.823159 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3816/7418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:29 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:30.845201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:30.845808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:30.853032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.853799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.854463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:30.855395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:30.856049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:30.857382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.002610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:31.010605 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2781b6c1-5496-4bc3-a2e9-524376a2179c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.169262 Oct 28 18:43:31.011190 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3603/7419] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:30 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:31.098672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb2385db-06e6-4d0f-96c9-7b65110a2a6c", "tag": "68dcdb1c-2c30-40bf-b930-7a36c00139e1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:31.112741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:31.113355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:31.113893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:31.127316 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] Creating event network-changed:68dcdb1c-2c30-40bf-b930-7a36c00139e1 for instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c on n-h2-860864-13 Oct 28 18:43:31.132679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ed80d28e-8a9c-437c-a23e-74f93996452e req-8f34a356-08b5-45f6-b3ed-614422fa3b46 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037539 Oct 28 18:43:31.133333 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3817/7420] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:32.034896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:32.035555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:32.042866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.043443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.043998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.044797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:32.045256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:32.045687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:32.179336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:32.187609 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8725096-bff0-46a5-a46a-eeb17318789b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.156541 Oct 28 18:43:32.188231 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3604/7421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:32 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:33.211769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:33.212483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:33.219345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.219883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.220327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.221035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:33.221504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:33.221952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:33.352260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:33.360217 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc4fdf41-ecbe-418c-9508-e16256a0cecc tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.153690 Oct 28 18:43:33.360797 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3818/7422] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:33 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:34.382739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:34.383355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:34.390430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.390915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.391361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.392104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:34.392559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:34.392988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:34.521472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:34.529517 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b44d1d20-b32e-4d42-8d9e-3a9261ba2fee tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.150724 Oct 28 18:43:34.530083 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3605/7423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:34 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:35.553352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:35.553969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:35.562189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.562685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.563134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.563865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:35.564331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:35.564770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:35.698220 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:35.706263 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-98f4d73d-9418-4ffe-8d38-1c071bfb9882 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.156969 Oct 28 18:43:35.706843 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3819/7424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:35 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:36.730119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:36.730723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:36.738778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.739255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.739710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.740389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:36.740834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:36.741252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:36.870079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:36.878121 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8667f17-8187-44d3-bb00-cf8c8bd198bb tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.151659 Oct 28 18:43:36.879021 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3606/7425] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:36 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:37.901499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:37.902118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:37.908544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:37.909042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:37.909492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:37.910223 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:37.910687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:37.911126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:38.045498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:38.053259 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b2d0700e-7137-45a4-9138-34eddae53685 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.155683 Oct 28 18:43:38.053831 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3820/7426] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:37 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:38.645464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:38.666717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2385db-06e6-4d0f-96c9-7b65110a2a6c", "name": "network-vif-plugged", "status": "completed", "tag": "68dcdb1c-2c30-40bf-b930-7a36c00139e1"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:38.676718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:38.677187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:38.677618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:38.689042 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] Creating event network-vif-plugged:68dcdb1c-2c30-40bf-b930-7a36c00139e1 for instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c on n-h2-860864-13 Oct 28 18:43:38.693971 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2cf61ec5-43f0-4704-9181-89872bc0d4d0 req-d0fb9543-16a2-4f03-8723-a2c418fdccd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096177 Oct 28 18:43:38.694549 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3607/7427] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:39.077006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:39.077629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:39.079656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:39.080432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:39.086908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.087424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.087876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.088579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:39.089044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:39.089480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:39.216519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:39.224200 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-83cfa0bf-7157-48ff-a025-487d037571a7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1317 microversion: 2.1 time: 0.151164 Oct 28 18:43:39.224781 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3821/7428] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:39 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:40.249231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:40.249931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:40.256410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.256895 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.257332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.258015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.258464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.258886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.392374 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:40.400120 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-20535803-8a84-497a-97ce-155378bd702e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.156613 Oct 28 18:43:40.400711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3608/7429] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:40 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:40.462653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378242420", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "3ef2f5e1-e765-40d1-a5f4-febb4f6dcb1c"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:40.517542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] validate_networks() for [('3ef2f5e1-e765-40d1-a5f4-febb4f6dcb1c', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:43:40.937569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:43:40.938036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:43:40.938519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:43:40.938937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:43:40.939358 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:43:40.948288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.948785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.949232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.949971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:40.950485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:40.950940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:40.967934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Getting quotas for project 260245babd904aa8a8ce20ad74ab0c95. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:43:40.973128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Getting quotas for user f0d54cb8e7b6454e912e7eb7e63c1e08 and project 260245babd904aa8a8ce20ad74ab0c95. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:43:40.985994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:43:40.988312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:43:41.033728 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5614909c-6f2a-4ef6-b497-03b7a03c22d9 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574861 Oct 28 18:43:41.034397 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3822/7430] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:43:41.046528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e18ef64c-9c2f-4e67-8bc1-57f2aac6c120 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:41.047135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e18ef64c-9c2f-4e67-8bc1-57f2aac6c120 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:41.104099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e18ef64c-9c2f-4e67-8bc1-57f2aac6c120 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:41.112298 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e18ef64c-9c2f-4e67-8bc1-57f2aac6c120 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1216 microversion: 2.1 time: 0.070844 Oct 28 18:43:41.112882 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3609/7431] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:41 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:42.137328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:42.138717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:42.145458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:42.146198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:42.146740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:42.147668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:42.148308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:42.148764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:42.239070 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:42.250746 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-021eba43-dbb4-4e6c-9179-e16aa48acca2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1286 microversion: 2.1 time: 0.118601 Oct 28 18:43:42.251358 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3823/7432] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:42 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:43.274119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:43.275094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:43.284138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:43.284812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:43.285323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:43.286194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:43.286657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:43.287088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:43.424487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:43.432853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-df2a2217-6e06-4a09-93b2-b038a1aea4d3 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.162334 Oct 28 18:43:43.433253 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3610/7433] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:43 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:43.667302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc38c0ef-afae-429c-8874-84d6759a0231", "tag": "b9df9553-4a1b-4eb9-a13b-a10dddc4950a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:43.679218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:43.679766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:43.680217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:43.694267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] Creating event network-changed:b9df9553-4a1b-4eb9-a13b-a10dddc4950a for instance fc38c0ef-afae-429c-8874-84d6759a0231 on n-h1-860864-13 Oct 28 18:43:43.699325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-aa448cf7-56ee-4ac6-ba65-ff691013439a req-0b7effd7-9497-404d-99e2-58cb2a2cf54b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036232 Oct 28 18:43:43.700077 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3824/7434] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:44.456083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:44.456699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:44.463573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:44.464056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:44.464491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:44.465178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:44.465630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:44.466979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:44.598169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:44.605863 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-039f51d1-adbb-49cc-8ff5-e5d6176d070e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.153634 Oct 28 18:43:44.606680 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3611/7435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:44 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:45.630631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:45.631248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:45.637531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:45.638353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:45.638657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:45.639359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:45.639844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:45.640277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:45.772795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:45.781919 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4c5934c-9f10-4320-a3c0-1edce3a8b0aa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.156765 Oct 28 18:43:45.782500 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3825/7436] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:45 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:46.805653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:46.806235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:46.813166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:46.813676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:46.814112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:46.814835 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:46.815289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:46.815738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:46.953837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:46.961571 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edf06448-1be0-4ff7-bbfe-1782851dff51 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.159835 Oct 28 18:43:46.962164 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3612/7437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:46 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:47.985194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:47.985736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:47.992636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:47.993134 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:47.993588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:47.994287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:47.994750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:47.995187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:48.126029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:48.134139 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5745bbef-4ca7-4571-837a-5539db0a893d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.153687 Oct 28 18:43:48.134709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3826/7438] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:47 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:49.157379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:49.157894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:49.164804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:49.165287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:49.165721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:49.166408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:49.166859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:49.167282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:49.305607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:49.313333 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3fae91dc-9349-4345-82a1-cc7a4092e306 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.160091 Oct 28 18:43:49.313915 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3613/7439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:49 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:49.381677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc38c0ef-afae-429c-8874-84d6759a0231", "name": "network-vif-plugged", "status": "completed", "tag": "b9df9553-4a1b-4eb9-a13b-a10dddc4950a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:49.392639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:49.393135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:49.393579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:49.405227 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] Creating event network-vif-plugged:b9df9553-4a1b-4eb9-a13b-a10dddc4950a for instance fc38c0ef-afae-429c-8874-84d6759a0231 on n-h1-860864-13 Oct 28 18:43:49.410330 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b973ebed-07fa-43ae-a13e-34aa80438d65 req-eb77ad82-76f6-4217-8601-cf115cba921e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Oct 28 18:43:49.410857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3827/7440] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:50.336814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:50.337392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:50.344373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:50.344855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:50.345287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:50.345966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:50.346413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:50.346831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:50.478413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:50.487007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e91df660-053f-43fc-b445-8371f55e3054 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1316 microversion: 2.1 time: 0.154171 Oct 28 18:43:50.487610 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3614/7441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:50 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:51.508707 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:51.509499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:51.514199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:51.514914 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:51.522052 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.522569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.523026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.523763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.524232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.524672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.656492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:51.664205 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-206d2c5e-38cb-4a2e-9a5e-92c8ecc72fc7 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1505 microversion: 2.1 time: 0.157336 Oct 28 18:43:51.664780 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3828/7442] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:51 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:51.687547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:51.688077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:51.689961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:51.695965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.696445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.696897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.697609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.698078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.698494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.725074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:43:51.800802 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b394ecb-0df0-4af0-98a7-b1d3518bb39e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 204 len: 0 microversion: 2.1 time: 0.117832 Oct 28 18:43:51.801511 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3615/7443] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:51 2022] DELETE /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:51.811507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:51.812127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:51.818076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.818569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.819009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.819728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:51.820188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:51.820624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:51.954700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:51.962454 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-68ebc8ac-f3a2-49aa-b5ec-80e72edd6ffe tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1511 microversion: 2.1 time: 0.156494 Oct 28 18:43:51.963024 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3829/7444] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:51 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:52.986038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:52.986728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:52.993437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:52.993910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:52.994338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:52.995015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:52.995517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:52.995936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:53.128596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:53.136302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-33b9e61c-071c-470d-ba0e-4d2ab717db18 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 200 len: 1511 microversion: 2.1 time: 0.154599 Oct 28 18:43:53.136868 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3616/7445] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:52 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:53.663085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc38c0ef-afae-429c-8874-84d6759a0231", "name": "network-vif-deleted", "tag": "b9df9553-4a1b-4eb9-a13b-a10dddc4950a"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:53.674677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:53.675625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:53.676389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:53.699159 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] Creating event network-vif-deleted:b9df9553-4a1b-4eb9-a13b-a10dddc4950a for instance fc38c0ef-afae-429c-8874-84d6759a0231 on n-h1-860864-13 Oct 28 18:43:53.704619 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8a630437-18d9-4cfc-91e4-42081585ebf3 req-3564ae6e-a4f3-48d2-8519-b5fe532882a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Oct 28 18:43:53.705516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3830/7446] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:43:54.160165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.160757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.168086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.170670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.171450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.172497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.172959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.173390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.189944 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 HTTP/1.1 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'fc38c0ef-afae-429c-8874-84d6759a0231'} Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.192428 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 404 to user: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e96c73ca-6e4e-425b-adbc-3f6c5b151829 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 404 len: 111 microversion: 2.1 time: 0.037672 Oct 28 18:43:54.197325 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3617/7447] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:54.204091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.204797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.210977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.211522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.211963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.212664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.213130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.213572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.349362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:54.357715 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04ec2683-60bc-4b53-af38-35a93242f0b0 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.158231 Oct 28 18:43:54.358314 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3831/7448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:54.380360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:54.382659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: b12fa14e-1c29-4b4f-8336-939841acb867] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.388922 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/b12fa14e-1c29-4b4f-8336-939841acb867/action HTTP/1.1 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 32 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: {"resize": {"flavorRef": "452"}} Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'b12fa14e-1c29-4b4f-8336-939841acb867', 'body': {'resize': {'flavorRef': '452'}}} Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:54.390429 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 404 to user: Instance b12fa14e-1c29-4b4f-8336-939841acb867 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69665976-e160-4d29-a90e-1060badf4522 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "POST /compute/v2.1/servers/b12fa14e-1c29-4b4f-8336-939841acb867/action" status: 404 len: 111 microversion: 2.1 time: 0.015636 Oct 28 18:43:54.395261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3618/7449] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:54 2022] POST /compute/v2.1/servers/b12fa14e-1c29-4b4f-8336-939841acb867/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:54.400391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.401044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.407705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.408199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.408648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.409349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.409812 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.410248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.538528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:54.546605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0a0e8cc7-8afc-42e2-b3fb-488192fe3c7e tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.150027 Oct 28 18:43:54.547178 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3832/7450] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:54.569798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.570431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.581050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.581560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.581999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.582701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.583161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.583627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.711721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:54.719613 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-378b840a-93ca-4740-95a2-97ed50316bd5 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.153592 Oct 28 18:43:54.720186 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3619/7451] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:43:54.742120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ff5df0a4-2528-4369-ba30-fc7cf51f544f"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:54.744401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.751881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.752373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.753087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.753786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.754250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.754685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.794700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:54.799812 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: request: POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action HTTP/1.1 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 65 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: {"resize": {"flavorRef": "ff5df0a4-2528-4369-ba30-fc7cf51f544f"}} Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: exception: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'bb2385db-06e6-4d0f-96c9-7b65110a2a6c', 'body': {'resize': {'flavorRef': 'ff5df0a4-2528-4369-ba30-fc7cf51f544f'}}} Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:54.801760 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 400 to user: Flavor ff5df0a4-2528-4369-ba30-fc7cf51f544f could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:54.806115 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23224619-48e1-41ba-9754-e88cccbbf203 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action" status: 400 len: 107 microversion: 2.1 time: 0.065069 Oct 28 18:43:54.808323 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3833/7452] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:54 2022] POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action => generated 107 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:43:54.814259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.814871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.820813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.821295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.821730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.822428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.822886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.823314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.954037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:54.961783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e3ec664-85fc-4fcf-b8a3-41ad76586c2c tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.151447 Oct 28 18:43:54.962352 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3620/7453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:54.985835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:54.986455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:54.992410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.992903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.993354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:54.994057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:54.994521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:54.994959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.125059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:55.133324 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7cf90cb5-effe-4204-820a-1bdf1a9ba4fa tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.151989 Oct 28 18:43:55.133916 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3834/7454] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:54 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:55.155495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5350797-2315-46a2-919f-f9bfe3190193 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5350797-2315-46a2-919f-f9bfe3190193 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: request: POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action HTTP/1.1 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 29 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: {"resize": {"flavorRef": ""}} Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'bb2385db-06e6-4d0f-96c9-7b65110a2a6c', 'body': {'resize': {'flavorRef': ''}}} Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise error Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi '' Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.159013 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5350797-2315-46a2-919f-f9bfe3190193 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5350797-2315-46a2-919f-f9bfe3190193 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action" status: 400 len: 113 microversion: 2.1 time: 0.008969 Oct 28 18:43:55.164023 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3621/7455] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:43:55 2022] POST /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 18:43:55.169356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:55.169979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:55.175982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.176483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.176935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.177643 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.178110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.178550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.311290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:55.314864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=100 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:55.320367 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0debc9cb-a279-4939-ad1d-34a14551ec9d tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1507 microversion: 2.1 time: 0.155371 Oct 28 18:43:55.320950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3835/7456] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:55 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:55.347232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:55.347752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:55.354715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.355206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.355697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.357025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.357488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.357922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.362439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:55.373309 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 HTTP/1.1 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'fc38c0ef-afae-429c-8874-84d6759a0231'} Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:55.375090 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 404 to user: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a609f5b2-63a7-4ab5-bb46-4ac35cd42463 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 404 len: 111 microversion: 2.1 time: 0.033929 Oct 28 18:43:55.380161 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3622/7457] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:55 2022] DELETE /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:43:55.385603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:55.386228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: fc38c0ef-afae-429c-8874-84d6759a0231] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:55.392225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.392727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.393183 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.393897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.394365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.394808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.408887 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 HTTP/1.1 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'fc38c0ef-afae-429c-8874-84d6759a0231'} Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:55.410421 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 404 to user: Instance fc38c0ef-afae-429c-8874-84d6759a0231 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3f070e16-6687-4303-ba5a-b0427b09aea1 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231" status: 404 len: 111 microversion: 2.1 time: 0.030389 Oct 28 18:43:55.415536 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3836/7458] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:55 2022] GET /compute/v2.1/servers/fc38c0ef-afae-429c-8874-84d6759a0231 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:43:55.420864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:55.421358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:55.428670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.429150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.429596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.430287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.430741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.431164 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.455878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:43:55.530312 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2439abad-5117-412b-91a9-bf7d0d2ffcf2 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 204 len: 0 microversion: 2.1 time: 0.113630 Oct 28 18:43:55.531171 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3623/7459] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:43:55 2022] DELETE /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:43:55.539541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:55.540164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:55.547063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.547597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.548050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.548760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:55.549231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:55.549670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:55.679476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:55.687254 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ff747fa-c905-418c-aeb4-779ce9da7082 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1513 microversion: 2.1 time: 0.151783 Oct 28 18:43:55.687855 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3837/7460] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:55 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:56.710542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:56.711231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:56.719273 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:56.719788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:56.720219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:56.720908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:56.721353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:56.721772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:56.854277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:56.862592 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6482caf8-e9f5-40f7-9dce-54a2a2b91067 tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1513 microversion: 2.1 time: 0.156264 Oct 28 18:43:56.863171 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3624/7461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:56 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:57.555462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb2385db-06e6-4d0f-96c9-7b65110a2a6c", "name": "network-vif-deleted", "tag": "68dcdb1c-2c30-40bf-b930-7a36c00139e1"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:43:57.572647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.573578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.574082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.589679 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] Creating event network-vif-deleted:68dcdb1c-2c30-40bf-b930-7a36c00139e1 for instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c on n-h2-860864-13 Oct 28 18:43:57.598492 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5a0e2bba-9ee5-4fa3-913c-1ddaf0e365a5 req-29c8120d-6616-4d77-bf2a-c24cbbbb6fd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046457 Oct 28 18:43:57.599722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3838/7462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:43:57.885701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:57.886200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:57.893339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.893809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.894233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.894910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.895354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.895821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.928254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:57.928732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:57.929163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:57.929604 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lazy-loading 'fault' on Instance uuid bb2385db-06e6-4d0f-96c9-7b65110a2a6c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:43:57.973197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d54cb8e7b6454e912e7eb7e63c1e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260245babd904aa8a8ce20ad74ab0c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:43:57.982011 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-445a714b-40ae-4ece-93e3-c398bd7b356b tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 200 len: 1307 microversion: 2.1 time: 0.099777 Oct 28 18:43:57.982762 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3625/7463] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:57 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:43:59.006923 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:43:59.007655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] [instance: bb2385db-06e6-4d0f-96c9-7b65110a2a6c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:43:59.010473 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:43:59.016355 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.016841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.017285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.017978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:43:59.018437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:43:59.018871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:43:59.033897 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] HTTP exception thrown: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Request method failure captured: Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c HTTP/1.1 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCLPP76BvQkGcsg03e0eIFIsod18yZmmhcFw2OoImqdCHBLaOhBcMruyQFXw20P0RURsUvmtBMD0S_i4H0w9z9ykdQvEh-qxs4KUZ_VKhxthmGAwQWybLilAVeuS8H58wmFKQOE5GTXqmpgcu3iYnVDpknO5tgn1la55kTwXvpvLlp8 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_260245babd904aa8a8ce20ad74ab0c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/260245babd904aa8a8ce20ad74ab0c95"}]}] Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 260245babd904aa8a8ce20ad74ab0c95 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1481556228 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: f0d54cb8e7b6454e912e7eb7e63c1e08 Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-ServersNegativeTestJSON-1481556228-project Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'bb2385db-06e6-4d0f-96c9-7b65110a2a6c'} Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:43:59.035556 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] Returning 404 to user: Instance bb2385db-06e6-4d0f-96c9-7b65110a2a6c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fd50bcf-cfcc-41f9-b039-b1fd2c09092f tempest-ServersNegativeTestJSON-1481556228 tempest-ServersNegativeTestJSON-1481556228-project] 10.222.0.48 "GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c" status: 404 len: 111 microversion: 2.1 time: 0.034599 Oct 28 18:43:59.040297 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3839/7464] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:43:59 2022] GET /compute/v2.1/servers/bb2385db-06e6-4d0f-96c9-7b65110a2a6c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:44:29.836641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:29.837392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.022169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da43c141-6831-4958-9438-f3191441ef16 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: .version_select at 0x7f751ed3eb80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1589396023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC53M/Ch4LmjTCQIi2WHvOyrR0JjxWB3kgHEcLpFo9OfgFuUSXuXtOhs9OxPsP33/n0dO0RCe4+Kj5rx/UcXficCH+jQ0pGAGoMRqNECYFxzLcDMStz3VOq8TmO4GUyBQA=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:30.038080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-da43c141-6831-4958-9438-f3191441ef16 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:30.043983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-da43c141-6831-4958-9438-f3191441ef16 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:30.070374 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da43c141-6831-4958-9438-f3191441ef16 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.240159 Oct 28 18:44:30.070986 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3626/7465] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:44:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:30.126255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2030733231", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1589396023", "networks": [{"uuid": "f76e25f0-568a-4e0d-b193-d78d53fe781d"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:30.136412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.138023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:30.196747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] validate_networks() for [('f76e25f0-568a-4e0d-b193-d78d53fe781d', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:44:30.640695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:44:30.641125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:44:30.641606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:44:30.642009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:44:30.642432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:44:30.653124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:30.653769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:30.654226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:30.654973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:30.655463 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:30.655907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:30.674859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:44:30.680772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:44:30.696407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:44:30.698871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:44:30.759845 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b229e228-8e80-4999-812d-3d4bf98e4f4f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638547 Oct 28 18:44:30.761114 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3840/7466] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:44:30.772896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6fd2d90-3712-420c-9cdf-a0c7c8d0af24 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:30.773613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6fd2d90-3712-420c-9cdf-a0c7c8d0af24 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:30.836203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6fd2d90-3712-420c-9cdf-a0c7c8d0af24 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:30.846747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6fd2d90-3712-420c-9cdf-a0c7c8d0af24 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1263 microversion: 2.1 time: 0.078024 Oct 28 18:44:30.848160 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3627/7467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:30 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:31.872000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:31.872807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:31.879760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:31.880488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:31.881090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:31.881945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:31.882594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:31.883758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:31.965704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:31.974805 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-145d32c3-078b-44ca-ac21-b5bbf9b0993a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1315 microversion: 2.1 time: 0.108211 Oct 28 18:44:31.976152 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3841/7468] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:31 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1315 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:33.000196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:33.000821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:33.008713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:33.009206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:33.009638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:33.010371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:33.010825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:33.011423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:33.148061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:33.157034 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36270f50-1dce-4552-9395-a3a189df6d32 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.161449 Oct 28 18:44:33.171458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3628/7469] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:32 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:33.696976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba41c78-9296-4658-8c8f-2582582b10e4", "tag": "debd333d-e9b0-4767-8295-b23e2cd5ef7b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:33.712523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:33.713438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:33.713977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:33.727572 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] Creating event network-changed:debd333d-e9b0-4767-8295-b23e2cd5ef7b for instance aba41c78-9296-4658-8c8f-2582582b10e4 on n-h2-860864-13 Oct 28 18:44:33.733968 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b999394d-11fa-4a52-99cc-f6f4dc70b11a req-a89c4ebf-01aa-477d-8fc1-4ed841e4f31e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040929 Oct 28 18:44:33.734971 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3842/7470] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:34.181718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:34.182326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:34.192748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:34.193233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:34.193671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:34.194371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:34.194818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:34.195236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:34.347288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:34.356040 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7acb2bc1-7759-474e-b231-3bb1dbe65b09 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.177723 Oct 28 18:44:34.357225 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3629/7471] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:34 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:35.381778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:35.382483 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:35.389276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:35.389769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:35.390212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:35.390907 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:35.391390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:35.391820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:35.522083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:35.530186 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-06f1724e-27cb-49f2-9640-52d434086e3f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.153827 Oct 28 18:44:35.530758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3843/7472] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:35 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:36.553800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:36.554410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:36.562314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:36.562798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:36.563230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:36.563951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:36.564404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:36.564822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:36.701964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:36.709550 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b155c06c-8bef-42e4-99ef-eab42647f885 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.159663 Oct 28 18:44:36.710113 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3630/7473] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:36 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:37.733229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:37.733991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:37.741621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:37.742225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:37.742848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:37.743803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:37.744307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:37.744752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:37.873486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:37.881550 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-daeeb778-5660-4122-b8eb-9d0997550dde tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.153025 Oct 28 18:44:37.882123 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3844/7474] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:37 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:38.904985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:38.905598 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:38.912484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:38.912970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:38.913404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:38.914203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:38.914649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:38.915080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:39.042938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:39.050682 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ca1a3c4e-7474-4b2a-b4b8-73787be1c360 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.149974 Oct 28 18:44:39.051261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3631/7475] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:38 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:40.075025 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:40.075670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:40.082595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:40.083086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:40.083563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:40.084265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:40.084724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:40.085153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:40.222012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:40.229568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fd3d1050-5cf7-4154-9ec1-75ff2d1d837a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.159321 Oct 28 18:44:40.230340 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3845/7476] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:40 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:40.888552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba41c78-9296-4658-8c8f-2582582b10e4", "name": "network-vif-plugged", "status": "completed", "tag": "debd333d-e9b0-4767-8295-b23e2cd5ef7b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:40.894344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:40.900209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:40.900687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:40.901122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:40.912747 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] Creating event network-vif-plugged:debd333d-e9b0-4767-8295-b23e2cd5ef7b for instance aba41c78-9296-4658-8c8f-2582582b10e4 on n-h2-860864-13 Oct 28 18:44:40.918588 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9b233f04-ed42-4393-81ac-074019d87efd req-2563bc82-1a2e-4633-8571-b8ba6cde1351 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Oct 28 18:44:40.919225 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3632/7477] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:41.252523 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:41.253423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:41.255397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:41.256182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:41.263006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:41.263551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:41.263996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:41.264691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:41.265148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:41.265580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:41.396189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:41.404574 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-adbc7499-6b54-4a98-bb7e-0b191a99c03a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1363 microversion: 2.1 time: 0.155985 Oct 28 18:44:41.405139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3846/7478] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:41 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:42.429618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:42.430540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:42.437811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.438446 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.438892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:42.439633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.440114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.440669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:42.575950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:42.583987 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-71e5d744-864f-4594-8840-2aa148612c42 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1554 microversion: 2.1 time: 0.159872 Oct 28 18:44:42.584577 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3633/7479] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:42 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:44:42.607882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:42.609212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:42.616816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.617321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.617979 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:42.618709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:42.619176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:42.619639 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:42.766389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:44:42.774361 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bcf899d7-4d64-4a91-ab46-b21d309c317d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1554 microversion: 2.1 time: 0.171245 Oct 28 18:44:42.774889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3847/7480] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:44:42 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:44:44.461673 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fde25a77-1b5e-472d-9a4f-f81ed402f09e"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:44:44.464059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:44.471658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:44.472142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:44.472578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:44.473264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:44.473713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:44.474132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:44.718417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9cc4bc40-d046-45a2-8e45-834293f586f6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260637 Oct 28 18:44:44.719072 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3634/7481] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:44:44 2022] POST /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:55.455128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:55.455679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:55.458500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:55.459164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:55.466122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.466612 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.467057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.467784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.468242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.468672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.551154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'services' on Instance uuid aba41c78-9296-4658-8c8f-2582582b10e4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:44:55.624131 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f1f08239-55fc-4123-a792-b0bd6c42f325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments/fde25a77-1b5e-472d-9a4f-f81ed402f09e" status: 202 len: 0 microversion: 2.1 time: 0.172652 Oct 28 18:44:55.624803 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3848/7482] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:44:55 2022] DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments/fde25a77-1b5e-472d-9a4f-f81ed402f09e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:44:55.633950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:55.637093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:55.640394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:55.641096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:44:55.648197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.648756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.649257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.650009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:55.650515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:55.650925 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:55.686879 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d7c2bf01-df48-4e49-8dcb-94f7bf5375c3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057195 Oct 28 18:44:55.687463 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3635/7483] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:44:55 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:56.700609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:56.703059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:56.709382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.709880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.710332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:56.711039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:56.711533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:56.711974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:56.743468 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8abcd9e-22b5-41ae-95ef-112639f42bd3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Oct 28 18:44:56.744083 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3849/7484] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:44:56 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:44:57.755630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:57.757794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:57.765427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.765913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.766349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.767049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:57.767532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:57.767959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:57.798842 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1cf4c18-9814-4b4f-947a-3e3d858b670c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047492 Oct 28 18:44:57.799428 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3636/7485] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:44:57 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:58.811752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:58.814723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:58.822077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:58.822190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:58.822597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:58.823884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:58.825333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:58.825969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:58.862497 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-671c3979-9723-43a2-8f07-4e0f8660fec6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055047 Oct 28 18:44:58.863076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3850/7486] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:44:58 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:44:59.875518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:44:59.877661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:44:59.884776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.885254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.885737 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.887027 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:44:59.887508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:44:59.887928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:44:59.917387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9009499a-922c-467b-81a8-bc33dc034b9b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Oct 28 18:44:59.917950 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3637/7487] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:44:59 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:00.929615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.931799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:00.939638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.940127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.940571 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.941266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.941728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.942189 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.971476 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4383d949-6e8d-42a4-9700-6860aad0163b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045864 Oct 28 18:45:00.972040 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3851/7488] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:00 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:45:00.983390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:00.983919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:00.990706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.991187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.991649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:00.992342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:00.992790 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:00.993217 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:01.069399 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance aba41c78-9296-4658-8c8f-2582582b10e4 is not attached to volume fde25a77-1b5e-472d-9a4f-f81ed402f09e Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments/fde25a77-1b5e-472d-9a4f-f81ed402f09e HTTP/1.1 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance aba41c78-9296-4658-8c8f-2582582b10e4 is not attached to volume fde25a77-1b5e-472d-9a4f-f81ed402f09e Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': 'aba41c78-9296-4658-8c8f-2582582b10e4', 'id': 'fde25a77-1b5e-472d-9a4f-f81ed402f09e'} Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fde25a77-1b5e-472d-9a4f-f81ed402f09e. Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba41c78-9296-4658-8c8f-2582582b10e4 is not attached to volume fde25a77-1b5e-472d-9a4f-f81ed402f09e Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:01.074361 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba41c78-9296-4658-8c8f-2582582b10e4 is not attached to volume fde25a77-1b5e-472d-9a4f-f81ed402f09e Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance aba41c78-9296-4658-8c8f-2582582b10e4 is not attached to volume fde25a77-1b5e-472d-9a4f-f81ed402f09e {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e30a2ff-36ae-4213-9e26-44812dbc74b3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments/fde25a77-1b5e-472d-9a4f-f81ed402f09e" status: 404 len: 154 microversion: 2.1 time: 0.097013 Oct 28 18:45:01.078916 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3638/7489] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:45:00 2022] DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4/os-volume_attachments/fde25a77-1b5e-472d-9a4f-f81ed402f09e => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:04.419338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:04.419890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:04.426847 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.427342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.427831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.428550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.429022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.429458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.459408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:45:04.548893 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a1ce7ba3-8c23-4e71-aefc-55c4ca80e5df tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 204 len: 0 microversion: 2.1 time: 0.134243 Oct 28 18:45:04.553303 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3852/7490] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:45:04 2022] DELETE /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:45:04.559483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:04.560090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:04.568293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.568775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.569210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.569912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:04.570362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:04.570786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:04.707177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:04.715757 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f88b0c2-3f4f-44c2-a3b3-54c152d33f3c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1560 microversion: 2.1 time: 0.161113 Oct 28 18:45:04.716396 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3639/7491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:04 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:05.740417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:05.741128 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:05.748102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.748594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.749041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.749743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:05.750213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:05.750649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:05.886793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:05.894797 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1a668fc5-19ce-417f-9243-6e3f05913361 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1560 microversion: 2.1 time: 0.158639 Oct 28 18:45:05.895497 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3853/7492] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:05 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:06.638485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba41c78-9296-4658-8c8f-2582582b10e4", "name": "network-vif-deleted", "tag": "debd333d-e9b0-4767-8295-b23e2cd5ef7b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:06.655778 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.656260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.656688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.671626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] Creating event network-vif-deleted:debd333d-e9b0-4767-8295-b23e2cd5ef7b for instance aba41c78-9296-4658-8c8f-2582582b10e4 on n-h2-860864-13 Oct 28 18:45:06.677010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-2be44d36-f13c-4925-8017-b3bede91bbbe req-dd31ac3c-0ae9-4aad-9d35-aa19a7ec65a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042871 Oct 28 18:45:06.677621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3640/7493] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:06.918512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:06.919053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:06.925805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.926298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.926747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.927472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.927935 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.928370 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.958985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:06.959489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:06.959932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:06.960379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'fault' on Instance uuid aba41c78-9296-4658-8c8f-2582582b10e4 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:45:07.002359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:07.010500 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f36f577-2193-4ec6-b1cf-426cac7c260f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 200 len: 1353 microversion: 2.1 time: 0.096545 Oct 28 18:45:07.011201 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3854/7494] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:06 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:08.034515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:08.035210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: aba41c78-9296-4658-8c8f-2582582b10e4] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:08.041427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:08.041893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:08.042415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:08.043140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:08.043618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:08.044047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:08.057107 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 HTTP/1.1 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'aba41c78-9296-4658-8c8f-2582582b10e4'} Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:08.059206 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance aba41c78-9296-4658-8c8f-2582582b10e4 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-199ca1eb-ce4f-4421-aec8-7d97172001ed tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4" status: 404 len: 111 microversion: 2.1 time: 0.031280 Oct 28 18:45:08.064103 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3641/7495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:08 2022] GET /compute/v2.1/servers/aba41c78-9296-4658-8c8f-2582582b10e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:08.069710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-57a2cb04-636c-480e-ab09-b88c5e3345f1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '.version_select at 0x7f75047e4dc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:08.075035 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-57a2cb04-636c-480e-ab09-b88c5e3345f1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [3cf5aaf0-af5c-4502-a810-4e1347ac3a02] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:45:09.082202 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [None req-57a2cb04-636c-480e-ab09-b88c5e3345f1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [3cf5aaf0-af5c-4502-a810-4e1347ac3a02] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42016. Oct 28 18:45:09.101874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-57a2cb04-636c-480e-ab09-b88c5e3345f1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1589396023" status: 202 len: 0 microversion: 2.1 time: 1.036293 Oct 28 18:45:09.102465 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3855/7496] 10.222.0.48 () {58 vars in 1278 bytes} [Fri Oct 28 18:45:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1589396023 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:45:09.118080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6607d73e-0c97-4f45-b378-b453cf2a746c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: .version_select at 0x7f751ee1f4c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1600175162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYFtDNEpvAbb4PrZMb9nXrHaWFjaf6Ffzpa80u7Ju1VvILWLkAL/YO/VEVVy6177gel6jlF0tsP+oodJw2kh99STRtLml5y/J8lvTR7LkWpc17zg5gFVGcOxnYj2ITV8A=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:09.134473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6607d73e-0c97-4f45-b378-b453cf2a746c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:09.140929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-6607d73e-0c97-4f45-b378-b453cf2a746c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:09.165002 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6607d73e-0c97-4f45-b378-b453cf2a746c tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050869 Oct 28 18:45:09.165593 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3642/7497] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:45:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:09.216640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-265574972", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1600175162", "networks": [{"uuid": "f76e25f0-568a-4e0d-b193-d78d53fe781d"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:09.269433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] validate_networks() for [('f76e25f0-568a-4e0d-b193-d78d53fe781d', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:45:09.633490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:45:09.633953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:45:09.634437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:45:09.634855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:45:09.635273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:45:09.644719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:09.645205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:09.645649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:09.646377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:09.646838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:09.647273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:09.664081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:09.669518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:09.681590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:45:09.684685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:45:09.730418 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-25f705da-2618-4ded-b3c1-c1baf6fe9537 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518269 Oct 28 18:45:09.731065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3856/7498] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:45:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 18:45:09.742109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-33bde6c5-a896-4656-9799-2862b41cfe4b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:09.742714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-33bde6c5-a896-4656-9799-2862b41cfe4b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:09.799072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-33bde6c5-a896-4656-9799-2862b41cfe4b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:09.806029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-33bde6c5-a896-4656-9799-2862b41cfe4b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1262 microversion: 2.1 time: 0.067809 Oct 28 18:45:09.806621 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3643/7499] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:09 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:10.831626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:10.832354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:10.839981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:10.840487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:10.840937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:10.841651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:10.842112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:10.842551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:10.910421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:10.919757 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e34af041-2aa4-45ac-b995-70a86e16e246 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1320 microversion: 2.1 time: 0.092899 Oct 28 18:45:10.920886 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3857/7500] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:10 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1320 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:45:11.943831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:11.944452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:11.951537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:11.952026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:11.952462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:11.953160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:11.953615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:11.954037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:12.032301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c97b196-f9b3-42f5-a757-4d411293e6a5", "tag": "b4d45d66-d941-4f3d-9e7a-0880f995abd3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:12.045312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:12.045813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:12.046469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:12.062810 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] Creating event network-changed:b4d45d66-d941-4f3d-9e7a-0880f995abd3 for instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 on n-h2-860864-13 Oct 28 18:45:12.070166 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-909a5dbe-b051-4352-8a74-d2a210b7140a req-9691bc5d-8726-41a5-99b6-38b0cfc5aa1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045377 Oct 28 18:45:12.071863 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3858/7501] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:12.112333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:12.120793 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16b742f2-603a-4d11-85c1-c35cbcc625a1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.180798 Oct 28 18:45:12.121550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3644/7502] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:11 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:13.146033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:13.146651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:13.153681 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.154174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.154620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.155323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:13.155814 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:13.156251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:13.287957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:13.296335 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2f3a0006-3155-48c8-9047-1ac0869e602b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.155594 Oct 28 18:45:13.296933 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3859/7503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:13 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:14.319617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:14.320231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:14.327116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:14.327631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:14.328069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:14.328756 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:14.329206 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:14.329647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:14.458722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:14.466625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd2bda62-2c5a-4935-a450-9d40147cf9af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.151096 Oct 28 18:45:14.467196 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3645/7504] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:14 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:15.490021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:15.490663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:15.498391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:15.498916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:15.499417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:15.500120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:15.500584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:15.501021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:15.631464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:15.639989 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee32c8ab-0574-49c0-ba04-14213ff4ce49 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.153916 Oct 28 18:45:15.640556 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3860/7505] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:15 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:16.663082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:16.663649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:16.670986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:16.671533 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:16.671962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:16.672643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:16.673085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:16.673503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:16.736756 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:45:16.737016 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 (ip 10.222.0.48) !!! Oct 28 18:45:16.806545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:16.814420 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-acb03c56-b14a-4459-a91c-bdc599595ddf tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.155339 Oct 28 18:45:16.814986 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3646/7506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:16 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:17.838120 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:17.839559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:17.846377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:17.846872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:17.847328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:17.848053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:17.848516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:17.848956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:17.978453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:17.986735 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4da2544-8653-4cf5-97bd-45af20197c46 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.152594 Oct 28 18:45:17.987312 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3861/7507] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:17 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:19.009384 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:19.010029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:19.017141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:19.017652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:19.018095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:19.018793 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:19.019255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:19.019711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:19.066023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c97b196-f9b3-42f5-a757-4d411293e6a5", "name": "network-vif-plugged", "status": "completed", "tag": "b4d45d66-d941-4f3d-9e7a-0880f995abd3"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:19.077573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:19.078677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:19.079468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:19.093770 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] Creating event network-vif-plugged:b4d45d66-d941-4f3d-9e7a-0880f995abd3 for instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 on n-h2-860864-13 Oct 28 18:45:19.098784 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0dc84385-81b5-4c48-8059-77c5a7187636 req-b097f367-c610-4f44-b75b-55155ff0e267 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 Oct 28 18:45:19.099950 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3862/7508] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:45:19.174947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:19.184426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72a29165-e35a-49d3-9397-9a691d7f82af tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.179025 Oct 28 18:45:19.185017 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3647/7509] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:19 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:20.205590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:20.206785 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:20.211753 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:20.212456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:20.219618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:20.220107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:20.220553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:20.221242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:20.221701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:20.222133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:20.351615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:20.360436 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-87890732-e21e-41ba-8e77-24e9b7810c21 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1362 microversion: 2.1 time: 0.155749 Oct 28 18:45:20.361393 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3863/7510] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:20 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:21.384713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:21.385821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:21.388150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:21.394207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:21.394683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:21.395112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:21.395825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:21.396271 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:21.396694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:21.527047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:21.534748 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ffd179cd-444d-4867-a697-c4cfbf375022 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1554 microversion: 2.1 time: 0.153852 Oct 28 18:45:21.535270 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3648/7511] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:21 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:21.556619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:21.557781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:21.564684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:21.565173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:21.565617 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:21.566311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:21.566774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:21.567207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:21.700081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:21.703486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:21.708419 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b541757e-7e07-4b9a-9492-55197ae68758 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1554 microversion: 2.1 time: 0.155635 Oct 28 18:45:21.708990 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3864/7512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:21 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:23.212478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "496e6312-1dfb-4a48-9f8a-fbb22a82a42d"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:23.214872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:23.221809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:23.222291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:23.222761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:23.223488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:23.223942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:23.224364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:23.459152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17587b12-70e8-478a-aa84-7b308e9d1bca tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250273 Oct 28 18:45:23.464850 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3649/7513] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:45:23 2022] POST /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:34.167635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:34.168165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:34.171118 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:34.178034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.178573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.179029 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:34.179773 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.180243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.180687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:34.264307 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'services' on Instance uuid 7c97b196-f9b3-42f5-a757-4d411293e6a5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:45:34.335224 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d84bcf88-cea2-4ff1-b88b-96a93d9b9d1f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments/496e6312-1dfb-4a48-9f8a-fbb22a82a42d" status: 202 len: 0 microversion: 2.1 time: 0.172027 Oct 28 18:45:34.335949 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3865/7514] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:45:34 2022] DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments/496e6312-1dfb-4a48-9f8a-fbb22a82a42d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:45:34.342621 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:34.343647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:34.348274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:34.350636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:34.359950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.360444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.360880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:34.362034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:34.362034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:34.362501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:34.395642 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6105e286-d176-420f-b9fc-0a8891d7c182 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054986 Oct 28 18:45:34.396223 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3650/7515] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:34 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:35.410527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:35.413035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:35.420004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:35.420497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:35.420940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:35.421637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:35.422095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:35.422527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:35.456449 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22122901-a08c-45cd-a10b-1dee1f3420c1 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051126 Oct 28 18:45:35.457028 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3866/7516] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:35 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:36.468883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:36.471130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:36.478083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:36.478572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:36.479013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:36.479734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:36.480186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:36.480686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:36.512467 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c96b8df-b7e6-48dc-8f5f-cdafbc9d941f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Oct 28 18:45:36.513223 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3651/7517] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:36 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:37.525124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:37.528153 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:37.534844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:37.535340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:37.535819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:37.536533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:37.536998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:37.537431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:37.567381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5ea008ce-4777-4360-8d96-5d48b492c2d5 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Oct 28 18:45:37.567966 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3867/7518] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:37 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:38.580716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:38.582856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:38.589411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:38.591035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:38.591236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:38.591927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:38.592380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:38.592807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:38.622820 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0b0bbf04-6aa0-4b53-a010-5706dc1d87b8 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Oct 28 18:45:38.623304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3652/7519] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:38 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:39.634512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:39.636777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:39.643618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.644112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.644559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:39.645257 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.645718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.646151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:39.676029 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c33837ed-6079-4030-a79c-fc73707ca9ab tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045570 Oct 28 18:45:39.676574 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3868/7520] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:45:39 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:45:39.688475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:39.688967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:39.694837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.695319 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.695782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:39.696464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:39.696919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:39.697342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:39.775005 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 is not attached to volume 496e6312-1dfb-4a48-9f8a-fbb22a82a42d Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments/496e6312-1dfb-4a48-9f8a-fbb22a82a42d HTTP/1.1 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 is not attached to volume 496e6312-1dfb-4a48-9f8a-fbb22a82a42d Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': '7c97b196-f9b3-42f5-a757-4d411293e6a5', 'id': '496e6312-1dfb-4a48-9f8a-fbb22a82a42d'} Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 496e6312-1dfb-4a48-9f8a-fbb22a82a42d. Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 is not attached to volume 496e6312-1dfb-4a48-9f8a-fbb22a82a42d Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:39.776655 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 is not attached to volume 496e6312-1dfb-4a48-9f8a-fbb22a82a42d Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 is not attached to volume 496e6312-1dfb-4a48-9f8a-fbb22a82a42d {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-56943b43-7e81-426c-8c5b-ed723e3397c6 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments/496e6312-1dfb-4a48-9f8a-fbb22a82a42d" status: 404 len: 154 microversion: 2.1 time: 0.095307 Oct 28 18:45:39.782012 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3653/7521] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:45:39 2022] DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5/os-volume_attachments/496e6312-1dfb-4a48-9f8a-fbb22a82a42d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:43.131488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:43.132048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:43.139275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.139816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.140264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.140977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.141440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.141876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.173865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:45:43.253798 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a79dac4e-e971-4789-98e6-1d0be2f04b6f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 204 len: 0 microversion: 2.1 time: 0.125901 Oct 28 18:45:43.254735 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3869/7522] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:45:43 2022] DELETE /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:45:43.263684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:43.264293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:43.272241 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.272782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.273894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.274594 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:43.275054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:43.275627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:43.413439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:43.422187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e5f6e1e5-d544-410b-98e0-d4e80e7f4037 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1560 microversion: 2.1 time: 0.162799 Oct 28 18:45:43.422759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3654/7523] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:43 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:44.446600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:44.447302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:44.454246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:44.454736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:44.455175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:44.455905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:44.456371 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:44.456804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:44.883654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:44.891856 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-410708cf-b40e-4cf1-9fa8-602db0bc79ff tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1560 microversion: 2.1 time: 0.449642 Oct 28 18:45:44.892428 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3870/7524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:44 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1560 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:45.697608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c97b196-f9b3-42f5-a757-4d411293e6a5", "name": "network-vif-deleted", "tag": "b4d45d66-d941-4f3d-9e7a-0880f995abd3"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:45.711972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.713023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.713855 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:45.729057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] Creating event network-vif-deleted:b4d45d66-d941-4f3d-9e7a-0880f995abd3 for instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 on n-h2-860864-13 Oct 28 18:45:45.736557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-e824d9f8-d242-4f74-9030-8ce1e917e1ec req-d10976f5-2c32-429d-807b-06466eb103c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042743 Oct 28 18:45:45.737405 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3655/7525] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:45.915904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:45.916548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:45.924926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.925441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.925876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:45.926594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.927060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.927533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:45.963142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:45.963658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:45.964102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:45.964555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'fault' on Instance uuid 7c97b196-f9b3-42f5-a757-4d411293e6a5 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:45:46.009386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:46.017739 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-723f41a4-a591-47cb-a92a-00bb9537360e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 200 len: 1352 microversion: 2.1 time: 0.105769 Oct 28 18:45:46.018533 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3871/7526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:45 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:47.045808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:47.046505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 7c97b196-f9b3-42f5-a757-4d411293e6a5] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:47.052703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.053196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.053631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:47.054314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.054767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.055188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:47.071653 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 HTTP/1.1 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '7c97b196-f9b3-42f5-a757-4d411293e6a5'} Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:45:47.073263 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance 7c97b196-f9b3-42f5-a757-4d411293e6a5 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0696f831-ffdf-4d0c-b411-2d8d147d972b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5" status: 404 len: 111 microversion: 2.1 time: 0.034108 Oct 28 18:45:47.078912 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3656/7527] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:47 2022] GET /compute/v2.1/servers/7c97b196-f9b3-42f5-a757-4d411293e6a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:45:47.084268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9be9e41-770b-4fd7-9f39-67acbbf0751d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '.version_select at 0x7f751f0cca60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:47.104031 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9be9e41-770b-4fd7-9f39-67acbbf0751d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1600175162" status: 202 len: 0 microversion: 2.1 time: 0.023669 Oct 28 18:45:47.104612 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3872/7528] 10.222.0.48 () {58 vars in 1278 bytes} [Fri Oct 28 18:45:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1600175162 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:45:47.122456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-091d6e20-98fd-4473-b8bb-b151eb3e1349 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: .version_select at 0x7f751ed1a430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1116003905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsZj/MSRbDC6eAKwar/ZTk5AunPlNWuUj5CHIalaZhIYptGOGe5rqN0GUse03R74aN7buSuHMx4gzc9IYUE6dla2WXK2RND6I8mRsH3bUXuRVA1cM/G/Ithfbg9/74tuA=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:47.139016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-091d6e20-98fd-4473-b8bb-b151eb3e1349 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:47.144560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-091d6e20-98fd-4473-b8bb-b151eb3e1349 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:47.167762 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-091d6e20-98fd-4473-b8bb-b151eb3e1349 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049886 Oct 28 18:45:47.168393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3657/7529] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:45:47 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:45:47.221005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-679328863", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1116003905", "networks": [{"uuid": "f76e25f0-568a-4e0d-b193-d78d53fe781d"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:47.274039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] validate_networks() for [('f76e25f0-568a-4e0d-b193-d78d53fe781d', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:45:47.642818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:45:47.643249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:45:47.643791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:45:47.644205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:45:47.644745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:45:47.654650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.655194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.655679 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:47.656421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:47.656909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:47.657344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:47.677699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:45:47.682953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Getting quotas for user 293445f40265433fa2f70592d7050d8a and project 7d905ecd3a28431c875dc6cf2643bde7. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:45:47.695902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:45:47.698210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:45:47.744921 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18626cc0-78f7-4184-a343-982b005eb5f4 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528836 Oct 28 18:45:47.745758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3873/7530] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:45:47.757421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c34dd949-8cae-4ea3-93b0-864d31031eb7 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:47.758033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c34dd949-8cae-4ea3-93b0-864d31031eb7 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:47.813376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c34dd949-8cae-4ea3-93b0-864d31031eb7 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:47.821326 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c34dd949-8cae-4ea3-93b0-864d31031eb7 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1262 microversion: 2.1 time: 0.068006 Oct 28 18:45:47.821886 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3658/7531] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:47 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:48.848306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:48.849021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:48.855231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:48.856267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:48.856813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:48.857597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:48.858064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:48.858499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:48.924336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:48.931962 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b24398b0-6e3d-4b74-9b73-dff74c8f76a0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1320 microversion: 2.1 time: 0.089440 Oct 28 18:45:48.932539 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3874/7532] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:48 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1320 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:49.957502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:49.958354 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:49.965710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:49.966202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:49.966807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:49.967543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:49.968008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:49.968441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:50.059007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad42fa1-7352-485c-ac81-9cba52a3ac97", "tag": "03405a1c-cc6a-4522-9513-a6aa1eef1a5b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:50.078227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:50.079277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:50.079945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:50.095703 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] Creating event network-changed:03405a1c-cc6a-4522-9513-a6aa1eef1a5b for instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 on n-h2-860864-13 Oct 28 18:45:50.102040 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-869e994e-8695-458e-8d28-d010865b62da req-937a4cf2-0e0a-44b7-8231-151e2513c2e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048141 Oct 28 18:45:50.102795 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3875/7533] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:50.110956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:50.119945 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8dd6a262-1976-4c64-a113-8978e94204bb tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.166307 Oct 28 18:45:50.120785 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3659/7534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:49 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:51.143831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:51.144532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:51.151572 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:51.152067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:51.152544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:51.153297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:51.153748 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:51.154184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:51.283166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:51.290908 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f8a7da33-febf-450f-b4ee-26730d72439b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.151534 Oct 28 18:45:51.291496 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3876/7535] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:51 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:52.315065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:52.315704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:52.322658 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:52.323146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:52.323672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:52.324366 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:52.325445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:52.325875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:52.461422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:52.470264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b51b88ab-2888-46c9-a65b-95bdcf09c46f tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.159047 Oct 28 18:45:52.470879 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3660/7536] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:52 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:53.493646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:53.494261 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:53.501620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:53.502107 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:53.502548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:53.503243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:53.503981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:53.504414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:53.633248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:53.642872 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6cc0cd3-62e9-43c9-ba6e-f37a0f8d5b0a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.153096 Oct 28 18:45:53.643661 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3877/7537] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:53 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:54.665365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:54.665910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:54.673231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:54.673718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:54.674151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:54.674842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:54.675294 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:54.675744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:54.809342 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:54.817852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b8ad52f5-df8f-48aa-8b05-73d7af02325d tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.156497 Oct 28 18:45:54.818419 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3661/7538] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:54 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:55.841274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:55.842738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:55.849588 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:55.850086 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:55.850531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:55.851231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:55.851718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:55.852154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:55.982918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:55.990743 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e09340c8-dffa-496a-b63d-be30cf2fe7ec tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.153573 Oct 28 18:45:55.991313 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3878/7539] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:55 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:57.015007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:57.015713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:57.022553 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:57.023041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:57.023514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:57.024207 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:57.024663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:57.025091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:57.161796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:57.169476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6368e8a1-5489-4eb8-9bda-a1bd5b073722 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.158964 Oct 28 18:45:57.170915 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3662/7540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:57 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:57.223635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad42fa1-7352-485c-ac81-9cba52a3ac97", "name": "network-vif-plugged", "status": "completed", "tag": "03405a1c-cc6a-4522-9513-a6aa1eef1a5b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:45:57.234436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:57.234955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:57.235439 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:57.246558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] Creating event network-vif-plugged:03405a1c-cc6a-4522-9513-a6aa1eef1a5b for instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 on n-h2-860864-13 Oct 28 18:45:57.252105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1e6555de-7750-4e5d-a37e-d3147f8b7373 req-73fca8b5-31a3-46db-ad3e-8f81a143f9f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032387 Oct 28 18:45:57.252712 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3879/7541] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:45:58.194735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:58.195379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:58.197518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:58.204368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:58.204857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:58.205290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:58.205981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:58.206429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:58.206849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:58.344751 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:58.355826 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-88f6f2c8-7445-4c19-a2e1-ff746e334c17 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1362 microversion: 2.1 time: 0.164532 Oct 28 18:45:58.356880 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3663/7542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:58 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:59.377868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:59.378657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:45:59.384747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:59.385456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:59.392560 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.393057 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.393506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:59.394204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.394667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.395103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:59.526338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:59.534269 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7f43cc0e-98f9-45b1-9f22-1aedcac3c423 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1553 microversion: 2.1 time: 0.157475 Oct 28 18:45:59.534863 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3880/7543] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:59 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:45:59.556803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:45:59.557445 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:45:59.564437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.564914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.565345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:59.566030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:45:59.566481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:45:59.566902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:45:59.701451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:45:59.709115 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-65776000-2835-49b7-b44e-88ab312b9172 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1553 microversion: 2.1 time: 0.156119 Oct 28 18:45:59.709711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3664/7544] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:45:59 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:01.199642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8919b66c-779c-42a0-934a-891ccbf06792"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:01.203026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:01.209949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:01.210444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:01.210891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:01.211615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:01.212076 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:01.212506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:01.283150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:01.448736 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99eaa773-8be4-43dc-94bd-18fa4c18b967 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "POST /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252816 Oct 28 18:46:01.449315 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3881/7545] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:46:01 2022] POST /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:12.153630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:12.154111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:12.156272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:12.157115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=70 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:12.163223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.163762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.164227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.164927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.165383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.165813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.246482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'services' on Instance uuid 6ad42fa1-7352-485c-ac81-9cba52a3ac97 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:46:12.320553 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7ee97709-a7c5-4c6f-ae90-92968de3f0f0 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments/8919b66c-779c-42a0-934a-891ccbf06792" status: 202 len: 0 microversion: 2.1 time: 0.170768 Oct 28 18:46:12.321141 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3665/7546] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:46:12 2022] DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments/8919b66c-779c-42a0-934a-891ccbf06792 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:46:12.328400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:12.329808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:12.333848 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:12.336340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:12.344799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.345460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.345917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.346640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:12.347140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:12.347603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:12.381994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e0c5c60-5574-4f4f-9b45-b0a6cd7f684b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056130 Oct 28 18:46:12.382569 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3882/7547] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:12 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:46:13.395875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:13.398215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:13.405331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.406154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.406561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.407250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:13.407744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:13.408161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:13.439709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cf8c5e5e-da2f-4703-99db-86568e539766 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048229 Oct 28 18:46:13.440295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3666/7548] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:13 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:14.451677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:14.455125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:14.462106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:14.462605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:14.463047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:14.463777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:14.464237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:14.464668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:14.495355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-835a4b54-6ad3-48f6-960d-1d8b5f1a94db tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048032 Oct 28 18:46:14.495938 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3883/7549] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:14 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:15.507834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:15.510020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:15.517480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:15.517954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:15.518388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:15.519075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:15.519556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:15.519979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:15.549340 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-299f7b0a-333f-4c0b-bafe-819b869da7ac tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Oct 28 18:46:15.549904 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3667/7550] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:15 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:16.561705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:16.564059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:16.570920 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.571443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.571893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:16.572606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:16.573084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:16.573500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:16.605698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74e2603f-aa58-4c73-864b-9f5595704e79 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047748 Oct 28 18:46:16.606509 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3884/7551] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:16 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:17.618468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:17.620601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:17.627963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:17.628443 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:17.628874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:17.629816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:17.630259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:17.630677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:17.661769 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9701b772-b341-4a14-a305-f4328df4b75a tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047352 Oct 28 18:46:17.662335 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3668/7552] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:46:17 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:46:17.674787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:17.675333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:17.682180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:17.682680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:17.683129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:17.683870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:17.684341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:17.684782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:17.762949 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 is not attached to volume 8919b66c-779c-42a0-934a-891ccbf06792 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments/8919b66c-779c-42a0-934a-891ccbf06792 HTTP/1.1 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 is not attached to volume 8919b66c-779c-42a0-934a-891ccbf06792 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '6ad42fa1-7352-485c-ac81-9cba52a3ac97', 'id': '8919b66c-779c-42a0-934a-891ccbf06792'} Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8919b66c-779c-42a0-934a-891ccbf06792. Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 is not attached to volume 8919b66c-779c-42a0-934a-891ccbf06792 Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:17.764913 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 is not attached to volume 8919b66c-779c-42a0-934a-891ccbf06792 Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 is not attached to volume 8919b66c-779c-42a0-934a-891ccbf06792 {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9bb1f9c7-9eec-4850-ac83-906a6a9a6baa tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments/8919b66c-779c-42a0-934a-891ccbf06792" status: 404 len: 154 microversion: 2.1 time: 0.096307 Oct 28 18:46:17.775185 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3885/7553] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:46:17 2022] DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97/os-volume_attachments/8919b66c-779c-42a0-934a-891ccbf06792 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:46:21.118056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:21.118536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:21.126159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:21.126646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:21.127078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:21.127805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:21.128253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:21.128671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:21.158165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:46:21.239271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b16819eb-51cf-45d8-b831-200b7caee325 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 204 len: 0 microversion: 2.1 time: 0.124767 Oct 28 18:46:21.240328 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3669/7554] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:46:21 2022] DELETE /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:46:21.248727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:21.249283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:21.260186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:21.260692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:21.261136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:21.261845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:21.262306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:21.262738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:21.398761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:21.408185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-59ec7eec-d09e-4c32-9abe-f3e039e8e83e tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1559 microversion: 2.1 time: 0.163404 Oct 28 18:46:21.408994 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3886/7555] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:21 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:22.432775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:22.433477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:22.440647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:22.441127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:22.441561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:22.442243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:22.442699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:22.443120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:22.576603 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:22.585464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0f65a30c-a4c6-4c85-bff6-d2bbe47d6e52 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1559 microversion: 2.1 time: 0.156880 Oct 28 18:46:22.586028 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3670/7556] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:22 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:23.279246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad42fa1-7352-485c-ac81-9cba52a3ac97", "name": "network-vif-deleted", "tag": "03405a1c-cc6a-4522-9513-a6aa1eef1a5b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:23.296024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.297100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.298082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.310360 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] Creating event network-vif-deleted:03405a1c-cc6a-4522-9513-a6aa1eef1a5b for instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 on n-h2-860864-13 Oct 28 18:46:23.316427 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-5c0c5288-a23b-4f06-8bb3-d743dfe31ab2 req-32ea1434-71a2-41da-8aa7-0815c67bf381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041360 Oct 28 18:46:23.317041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3887/7557] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:23.610161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:23.610911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:23.618178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.618663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.619097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.619815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.620267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.620722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.651514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:23.651988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:23.652420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:23.652863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lazy-loading 'fault' on Instance uuid 6ad42fa1-7352-485c-ac81-9cba52a3ac97 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:46:23.694047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '293445f40265433fa2f70592d7050d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d905ecd3a28431c875dc6cf2643bde7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:23.701894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-16ecd212-5638-447c-a477-6f0f0eb4c39b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 200 len: 1352 microversion: 2.1 time: 0.096208 Oct 28 18:46:23.702472 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3671/7558] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:23 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:24.727686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:24.728533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] [instance: 6ad42fa1-7352-485c-ac81-9cba52a3ac97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:24.735851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.736350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.736805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.737510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:24.737974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:24.738412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:24.752633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] HTTP exception thrown: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Request method failure captured: Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 HTTP/1.1 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCMJW-ZDbqTyVzBu-7IRlseBNnDF0U5zxwjk-PL4oMLxQsV4ki71iOtQDqntkpA3C_e0NHZ4JdAz5rYLpbPbg0COrTcFQDKdzpmUXBGZ2hJWOzss6iNt8Nhb9wH8gUlE2BsRfYopt_pk-PJSL_nqcUePWsNGk7OJzI0FlqqcTfeScgk Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d905ecd3a28431c875dc6cf2643bde7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d905ecd3a28431c875dc6cf2643bde7"}]}] Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 7d905ecd3a28431c875dc6cf2643bde7 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-104058014 Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 293445f40265433fa2f70592d7050d8a Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestEncryptedCinderVolumes-104058014-project Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '6ad42fa1-7352-485c-ac81-9cba52a3ac97'} Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:46:24.754260 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Returning 404 to user: Instance 6ad42fa1-7352-485c-ac81-9cba52a3ac97 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2142e145-ceed-4e79-9dc5-06ebd87728a3 tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97" status: 404 len: 111 microversion: 2.1 time: 0.033863 Oct 28 18:46:24.759464 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3888/7559] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:24 2022] GET /compute/v2.1/servers/6ad42fa1-7352-485c-ac81-9cba52a3ac97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:46:24.764795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0023e00c-d873-42d1-ac04-d380ee62051b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] Calling method '.version_select at 0x7f752454eca0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:24.784673 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0023e00c-d873-42d1-ac04-d380ee62051b tempest-TestEncryptedCinderVolumes-104058014 tempest-TestEncryptedCinderVolumes-104058014-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1116003905" status: 202 len: 0 microversion: 2.1 time: 0.023673 Oct 28 18:46:24.785255 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3672/7560] 10.222.0.48 () {58 vars in 1278 bytes} [Fri Oct 28 18:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1116003905 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:46:51.634778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc238ba4-8b7e-4f3d-807e-c2a25f557c57 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: .version_select at 0x7f751f0f7f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-494788370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsHmmYn8EG9PeDJEgQhKtysKugImKRj8E5o4LQY6DpSKnnO2ntCYDgZw12y/6WdDRAwMS420u1kqjDWqE2ds5v0kNKU0j52oKcTtqN3jFnmjDkVpSqMEiYfh/i8B25UXQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:51.641311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:51.641968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=34 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:51.653406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fc238ba4-8b7e-4f3d-807e-c2a25f557c57 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:46:51.658915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-fc238ba4-8b7e-4f3d-807e-c2a25f557c57 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for user bbaf8b363587422da662d4e9ac8bb1db and project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:46:51.681849 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc238ba4-8b7e-4f3d-807e-c2a25f557c57 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051149 Oct 28 18:46:51.682520 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3889/7561] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:46:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:46:51.730220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:51.730990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:46:51.736414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1748166846", "imageRef": "916aae10-7f2a-4d0c-957a-52c63937128b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-494788370", "networks": [{"uuid": "764a6c72-abea-4d70-819e-762e3b7d5092"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:46:51.789861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] validate_networks() for [('764a6c72-abea-4d70-819e-762e3b7d5092', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:46:52.269360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:46:52.269779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:46:52.270244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:46:52.270650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:46:52.271053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:46:52.279901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:52.280375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:52.280803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:52.282617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:52.283073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:52.283525 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:52.301880 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:46:52.307004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for user bbaf8b363587422da662d4e9ac8bb1db and project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:46:52.319746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:46:52.321933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='916aae10-7f2a-4d0c-957a-52c63937128b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:46:52.370056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50b0ea97-97d5-426c-bf87-5ab3d2504dc8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641649 Oct 28 18:46:52.370711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3673/7562] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:46:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:46:52.382797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d381e293-9586-4b14-bc26-24e206eafee3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:52.383472 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d381e293-9586-4b14-bc26-24e206eafee3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:52.440350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d381e293-9586-4b14-bc26-24e206eafee3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:52.449023 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d381e293-9586-4b14-bc26-24e206eafee3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1258 microversion: 2.1 time: 0.070564 Oct 28 18:46:52.449599 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3890/7563] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:52 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:53.473492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:53.474118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:53.481992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.482783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.483561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.484782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:53.485411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:53.485841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:53.554622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:53.564677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1b9eb159-cf17-467c-8df4-e33397b17fef tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1328 microversion: 2.1 time: 0.095845 Oct 28 18:46:53.567406 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3674/7564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:53 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:54.588447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:54.589178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:54.596587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:54.597363 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:54.597822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:54.598548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:54.599018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:54.599489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:54.739318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:54.748689 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f4e6816-eca5-4840-82be-0acf4e98620f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.164039 Oct 28 18:46:54.759401 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3891/7565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:54 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:55.773884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:55.774600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:55.782733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:55.783212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:55.783679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:55.784361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:55.784811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:55.785230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:55.931853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:55.939814 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5a67abf-fb92-4fc4-80e6-7dea90fe1c04 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.169825 Oct 28 18:46:55.940395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3675/7566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:55 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:56.962375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:56.963164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:56.971290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.971823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.972274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:56.975520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:56.976008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:56.976616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:57.253441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:57.263853 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-87448c1e-f57a-4194-ad3d-9c148b45911a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.305097 Oct 28 18:46:57.280262 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3892/7567] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:56 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:58.289939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:58.290560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:58.300324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:58.300869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:58.301503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:58.302236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:58.302681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:58.303102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:58.443764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:58.451326 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd9d352d-2fe8-4f85-ae93-d6a59cc1b506 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.165569 Oct 28 18:46:58.451938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3676/7568] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:58 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:46:59.474310 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:46:59.474915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:46:59.481954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:59.482450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:59.482897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:59.483634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:46:59.484096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:46:59.485055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:46:59.621712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:46:59.630788 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c278ba9-2640-4d1b-be6b-af88bf166e34 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.160382 Oct 28 18:46:59.632091 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3893/7569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:46:59 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:00.654194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:00.654761 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:00.661609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.662102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.662543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.663242 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:00.663732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:00.664161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:00.806649 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:00.816423 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edf0d42c-4183-4368-9a86-51ae0b39f000 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.166120 Oct 28 18:47:00.817732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3677/7570] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:00 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:01.842016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:01.842622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:01.850203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:01.850203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:01.850645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:01.851352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:01.851837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:01.852276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:01.986736 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:01.994457 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ec19095b-eb4d-459c-94cc-2875cee8a19b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.156410 Oct 28 18:47:01.995032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3894/7571] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:01 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:03.019509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:03.020055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:03.022654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:03.023399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:03.029911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:03.030393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:03.030822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:03.032234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:03.032680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:03.033097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:03.163901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:03.171514 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-293d7d0b-0c85-45e9-a3a7-33e1cc3d7c11 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.156578 Oct 28 18:47:03.172082 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3678/7572] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:03 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:04.195489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:04.196437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:04.198450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:04.206074 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.206706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.207163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.207913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.208379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.208830 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.344465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:04.352232 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9649fd5b-f626-4264-9720-727311b10647 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.161299 Oct 28 18:47:04.352812 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3895/7573] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:04 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:04.775663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:04.788902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:04.789497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:04.789931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:04.803060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] Creating event network-changed:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:47:04.808078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-19fd6205-a813-4319-9a7c-45264017bce0 req-991d18da-2b06-4bcd-a2fc-a4467f715380 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036573 Oct 28 18:47:04.808678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3679/7574] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:47:05.374825 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:05.375502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:05.382701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:05.383195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:05.383666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:05.384375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:05.384843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:05.385282 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:05.518317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:05.526054 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cf888684-164b-4ab6-89b7-d468bbc72423 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.155113 Oct 28 18:47:05.526750 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3896/7575] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:05 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:06.550453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:06.551163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:06.558160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:06.558635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:06.559064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:06.559775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:06.560220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:06.560637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:06.694580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:06.702134 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86f2db2f-4919-435a-a00e-abff80774914 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.156559 Oct 28 18:47:06.702707 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3680/7576] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:06 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:07.725720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:07.726488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:07.732704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:07.733165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:07.733631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:07.734926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:07.736014 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:07.736460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:07.867873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:07.875941 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d1697229-2c86-4b5d-9f42-d58c879f1715 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.154317 Oct 28 18:47:07.876515 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3897/7577] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:07 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:08.900043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:08.900669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:08.907923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:08.908398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:08.908831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:08.909518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:08.909966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:08.910383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:09.042056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:09.049894 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7694738d-97b1-44a6-88d4-5552802d4bd5 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.154304 Oct 28 18:47:09.050458 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3681/7578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:08 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:10.072767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:10.073388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:10.080258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:10.080751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:10.081200 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:10.081902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:10.082365 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:10.082800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:10.211313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:10.219772 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9c79f76-170e-43c0-a220-98fa2e3af309 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.150880 Oct 28 18:47:10.220361 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3898/7579] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:10 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:11.243349 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:11.244081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:11.251554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.252036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.252464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.253142 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.253588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.254003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.386391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:11.394092 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-17490621-97a5-4f32-99a1-f35331ab6409 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.154739 Oct 28 18:47:11.394688 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3682/7580] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:11 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:11.757167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "name": "network-vif-plugged", "status": "completed", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:11.767908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:11.768404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:11.768860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:11.780164 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] Creating event network-vif-plugged:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:47:11.785593 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c1b7d3de-8929-4280-982b-eb6b9a940e3d req-ad797ba5-fd1d-48a6-9f56-0b6cc7a4503f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032524 Oct 28 18:47:11.786190 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3899/7581] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:12.416897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:12.417487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:12.425496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:12.425977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:12.426407 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:12.427087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:12.427563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:12.427986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:12.557624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:12.565387 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e1ac9e2-f711-4da4-b180-866dc30ffa86 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1358 microversion: 2.1 time: 0.152365 Oct 28 18:47:12.565976 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3683/7582] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:12 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:13.589727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:13.590442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:13.596718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.597219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.597671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.598378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.598846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.599293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.727041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:13.735343 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d48a2d04-6eff-448f-bc31-0847461a9252 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1549 microversion: 2.1 time: 0.150761 Oct 28 18:47:13.735956 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3900/7583] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:13 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:13.758427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:13.759034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:13.765924 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.766400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.766832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.767552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.768004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.768428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.906911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:13.914674 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8c2d88a4-cf25-4d5b-a817-0193da9dd7b7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1549 microversion: 2.1 time: 0.160335 Oct 28 18:47:13.915246 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3684/7584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:13 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:13.937672 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:13.942444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:13.943229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Searching by: {'deleted': False, 'project_id': '29351614f7c2415ebe2d181ea22a45f4'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 18:47:13.948536 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.949027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.949476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.950213 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:13.950689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:13.951133 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:13.974739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:47:14.004169 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-99c72002-b5db-4108-a70b-aad443344137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070488 Oct 28 18:47:14.004752 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3901/7585] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 18:47:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:14.016787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:14.017393 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:14.023334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:14.023860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:14.024301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:14.024998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:14.025454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:14.025896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:14.153576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:14.161841 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1992f5eb-bdb5-42a0-860d-2c7cd7006736 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1549 microversion: 2.1 time: 0.149081 Oct 28 18:47:14.162422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3685/7586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:14 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:47:15.708425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "582b0164-6653-42ae-bfd5-1a43c2d2ad54"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:15.710749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:15.717781 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:15.718277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:15.719321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:15.720646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:15.721144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:15.721585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:15.959605 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-815c2feb-7499-44b5-b8b4-2bf83c7f2eba tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255781 Oct 28 18:47:15.960255 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3902/7587] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:47:15 2022] POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:29.003734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:29.004355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:29.009012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:29.009675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=70 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:29.014558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:29.015053 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:29.015556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:29.016859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:29.017314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:29.017741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:29.152931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:29.161256 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-add68f1d-5df7-4ac1-aece-607d133bae6c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1595 microversion: 2.1 time: 0.162043 Oct 28 18:47:29.161837 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3686/7588] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:28 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:30.808126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:30.810192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:30.812022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:47:30.872235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:30.886022 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:30.886881 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:30.887632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:30.901840 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] Creating event network-changed:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:47:30.909606 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1b730147-75b6-43b5-994e-1dd62bc3a14c req-d3c9d6f0-28b5-400e-86b4-80b538501179 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115459 Oct 28 18:47:30.910226 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3903/7589] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:47:31.997854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1111728251"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:31.998409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:32.005831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:32.006318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:32.006758 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:32.007740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:32.008203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:32.008630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:32.140655 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.network.security_group_api [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Adding security group c66eb3d5-6b53-4b0b-89a8-171f6a5f8cc5 to port 37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b Oct 28 18:47:32.460238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-199d6e79-cba5-4dd3-b7f8-934469944ec6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action" status: 202 len: 0 microversion: 2.1 time: 0.466280 Oct 28 18:47:32.461309 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3687/7590] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:47:31 2022] POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:47:32.471862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:47:32.472537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:47:32.479026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:32.479561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:32.480327 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:32.480985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:32.481460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:32.481908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:32.927191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:47:32.943149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:47:32.947549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:47:32.948055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:47:32.948496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:47:32.954267 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6cdd9390-d58f-44d9-adac-51f7f98420a9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1761 microversion: 2.1 time: 0.488363 Oct 28 18:47:32.955039 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3904/7591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:47:32 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1761 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:47:32.961278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] Creating event network-changed:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:47:32.966737 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b7e8156c-732f-4838-b5fe-690b6d848219 req-81b400cd-a683-4357-824a-483e647d1edb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043250 Oct 28 18:47:32.967616 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3688/7592] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:49:44.607926 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:49:44.608870 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 18:49:44.609353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:49:44.610102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:49:44.611619 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 18:49:44.611619 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action (ip 10.222.0.48) !!! Oct 28 18:49:44.612590 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:49:44.612711 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action (ip 10.222.0.48) !!! Oct 28 18:49:44.613721 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:49:44.613825 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action (ip 10.222.0.48) !!! Oct 28 18:49:44.620325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:49:44.623231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:49:44.634514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:44.635018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:44.635497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:44.636467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:44.636934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:44.637376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:44.710966 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2fa0963-2800-4bcf-8c0f-f9c4385fc282 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action" status: 202 len: 0 microversion: 2.1 time: 0.104814 Oct 28 18:49:44.711728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3905/7593] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:49:44 2022] POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:49:44.718133 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:49:44.719028 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:49:44.719705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:49:44.720520 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:49:44.721431 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:49:44.721812 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 (ip 10.222.0.48) !!! Oct 28 18:49:44.723225 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 18:49:44.723387 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 (ip 10.222.0.48) !!! Oct 28 18:49:44.724864 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:49:44.725004 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:49:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 (ip 10.222.0.48) !!! Oct 28 18:49:44.732230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:49:44.733018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:49:44.743740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:44.744245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:44.744739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:44.745480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:44.746173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:44.746652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:44.948160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:49:44.956464 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-403908a9-655a-45d7-976b-bbc81ea4bcea tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1763 microversion: 2.1 time: 0.240229 Oct 28 18:49:44.957036 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3689/7594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:49:44 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1763 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:49:45.986144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:49:45.986860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:49:45.997780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:45.998287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:45.998735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:45.999476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:49:45.999953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:49:46.000392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:49:46.007788 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42720. Oct 28 18:49:46.009510 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42722. Oct 28 18:49:46.149425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:49:46.157842 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-81169857-089d-40dc-bd45-c917f48c5cd1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1761 microversion: 2.1 time: 0.179876 Oct 28 18:49:46.158412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3906/7595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:49:45 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1761 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:17.636725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:17.637442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:17.642169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1111728251"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:17.642700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:17.653221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:17.653712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:17.654144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:17.654897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:17.655326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:17.655788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:17.656895 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42766. Oct 28 18:51:17.659802 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42764. Oct 28 18:51:17.788965 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.network.security_group_api [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Removing security group c66eb3d5-6b53-4b0b-89a8-171f6a5f8cc5 from port 37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b Oct 28 18:51:18.089961 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a0ab05ff-f5d6-4d24-bf35-82b03f255756 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action" status: 202 len: 0 microversion: 2.1 time: 0.456083 Oct 28 18:51:18.090788 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3690/7596] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:51:17 2022] POST /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:51:18.096399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:18.097233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:18.101902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:18.112569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:18.113176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:18.113684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:18.130844 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] Creating event network-changed:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:51:18.137119 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-29cfd42f-a0eb-48d7-85b4-17d2a79ad418 req-4cbf1d07-43ab-4f34-8ab7-c00b2fdd2724 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042440 Oct 28 18:51:18.138341 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3907/7597] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:19.352373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:19.352922 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:19.358956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:19.359472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:19.359898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:19.360805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:19.361414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:19.362184 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:19.444238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lazy-loading 'services' on Instance uuid 811ba8e1-a381-4a6c-bfe8-2fc285442f82 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:51:19.517043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f28134a-842c-4068-9c1e-507b6a4e0524 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments/582b0164-6653-42ae-bfd5-1a43c2d2ad54" status: 202 len: 0 microversion: 2.1 time: 0.169319 Oct 28 18:51:19.517654 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3691/7598] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:51:19 2022] DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments/582b0164-6653-42ae-bfd5-1a43c2d2ad54 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:51:19.527462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:19.530550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:19.539268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:19.539869 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:19.540323 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:19.541016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:19.541528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:19.542051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:19.576049 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55297730-e7c6-4c03-9c88-31e786c7286e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053589 Oct 28 18:51:19.576714 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3908/7599] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:19 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:51:20.156119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:20.166297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:20.166777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:20.167215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:20.180360 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] Creating event network-changed:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:51:20.186290 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-64dbc286-23a1-410c-8dff-ae506cafd947 req-0205ea5b-b147-4e1f-a415-13905942974f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035038 Oct 28 18:51:20.187060 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3692/7600] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:51:20.590068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:20.593262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:20.600548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:20.601210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:20.601660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:20.602376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:20.602831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:20.603262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:20.636981 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a3402bea-abba-45b8-bfe6-c797cc925460 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051110 Oct 28 18:51:20.637783 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3909/7601] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:20 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:21.651038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:21.653772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:21.660270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:21.660764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:21.661198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:21.661909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:21.662363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:21.662789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:21.694337 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4648cd9-e508-43ee-85d8-370f8255abd0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 Oct 28 18:51:21.694913 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3693/7602] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:21 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:22.707627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:22.709713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:22.716829 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:22.717332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:22.717783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:22.718494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:22.718959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:22.719422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:22.749998 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4945b7b-55e4-48de-973c-c318ddfee22d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Oct 28 18:51:22.750574 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3910/7603] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:22 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:23.763729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:23.765863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:23.772754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:23.773230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:23.773834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:23.774680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:23.775133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:23.775579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:23.805129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ff598786-c08b-4148-8055-7019c552921c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Oct 28 18:51:23.805700 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3694/7604] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:23 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:24.818809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:24.820984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:24.829288 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:24.829786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:24.830233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:24.830932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:24.831417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:24.831860 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:24.860719 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf372073-a7af-4b54-a918-047a044f3707 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045967 Oct 28 18:51:24.861290 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3911/7605] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:51:24 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:51:24.872585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:24.873117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:24.880641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:24.881125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:24.881560 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:24.882254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:24.882713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:24.883140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:24.957317 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] HTTP exception thrown: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 is not attached to volume 582b0164-6653-42ae-bfd5-1a43c2d2ad54 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Request method failure captured: Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: request: DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments/582b0164-6653-42ae-bfd5-1a43c2d2ad54 HTTP/1.1 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCOM1DoFv0zpge8R7IxqN2Qh1j9_Q00Q-Ff8snKa5dKhY1L6bkBV1sq-rFvJvt1DMK9qPx6MBqiGofNdsxRfPzCinW2xIgpn27fcUjg0k6-yw-jHKZfe9I-9wKVK2G9WavxrSjtz02ho8hypu60j8piF5-nBz0ud91Pmg6DYyaFRu2A Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29351614f7c2415ebe2d181ea22a45f4"}]}] Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: bbaf8b363587422da662d4e9ac8bb1db Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 is not attached to volume 582b0164-6653-42ae-bfd5-1a43c2d2ad54 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'server_id': '811ba8e1-a381-4a6c-bfe8-2fc285442f82', 'id': '582b0164-6653-42ae-bfd5-1a43c2d2ad54'} Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 582b0164-6653-42ae-bfd5-1a43c2d2ad54. Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 is not attached to volume 582b0164-6653-42ae-bfd5-1a43c2d2ad54 Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:51:24.958905 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 is not attached to volume 582b0164-6653-42ae-bfd5-1a43c2d2ad54 Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Returning 404 to user: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 is not attached to volume 582b0164-6653-42ae-bfd5-1a43c2d2ad54 {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-564e816f-2e22-40c3-be4b-50c6f48c99a0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments/582b0164-6653-42ae-bfd5-1a43c2d2ad54" status: 404 len: 154 microversion: 2.1 time: 0.092447 Oct 28 18:51:24.963916 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3695/7606] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:51:24 2022] DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82/os-volume_attachments/582b0164-6653-42ae-bfd5-1a43c2d2ad54 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:51:28.210768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:28.211268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:28.218689 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:28.219178 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:28.219646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:28.220337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:28.220797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:28.221225 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:28.247393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:51:28.335442 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18c372c6-17d9-4c11-a558-eebd1e9f9ec9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 204 len: 0 microversion: 2.1 time: 0.128213 Oct 28 18:51:28.336138 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3912/7607] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:51:28 2022] DELETE /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:51:28.344358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:28.345026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:28.352338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:28.352822 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:28.353259 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:28.353948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:28.354399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:28.354819 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:28.492947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:28.501919 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a73fdb6b-9598-4953-8bac-9b28f5183db9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1555 microversion: 2.1 time: 0.161422 Oct 28 18:51:28.502684 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3696/7608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:28 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:29.526669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:29.527488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:29.535049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:29.535603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:29.536059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:29.536769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:29.537235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:29.537678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:29.666730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:29.675473 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e308dbdd-61ea-4570-b783-ae3e9ff58210 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1555 microversion: 2.1 time: 0.153125 Oct 28 18:51:29.676054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3913/7609] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:29 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:30.559977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811ba8e1-a381-4a6c-bfe8-2fc285442f82", "name": "network-vif-deleted", "tag": "37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:30.571024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:30.571549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:30.572710 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:30.585315 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] Creating event network-vif-deleted:37ec61cd-fe8f-4e16-9b3d-6ef9eda8329b for instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 on n-h2-860864-13 Oct 28 18:51:30.591630 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ed19be3c-f501-4d35-aa2d-73f1d6b91651 req-83d60f63-02b6-4853-89bc-69346aad6deb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101414 Oct 28 18:51:30.592229 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3697/7610] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:30.698340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:30.699774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:30.706658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:30.707090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:30.707566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:30.708267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:30.708731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:30.709170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:30.742824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:30.743316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:30.743796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:30.744253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lazy-loading 'fault' on Instance uuid 811ba8e1-a381-4a6c-bfe8-2fc285442f82 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:51:30.786143 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:30.795392 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c685aa2e-e803-4e50-8bee-6cb1edebb83e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 200 len: 1348 microversion: 2.1 time: 0.100773 Oct 28 18:51:30.796187 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3914/7611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:30 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:31.821089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:31.821788 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 811ba8e1-a381-4a6c-bfe8-2fc285442f82] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:31.828608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:31.829085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:31.829516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:31.830199 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:31.830647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:31.831069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:31.844988 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] HTTP exception thrown: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Request method failure captured: Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 HTTP/1.1 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCOM1DoFv0zpge8R7IxqN2Qh1j9_Q00Q-Ff8snKa5dKhY1L6bkBV1sq-rFvJvt1DMK9qPx6MBqiGofNdsxRfPzCinW2xIgpn27fcUjg0k6-yw-jHKZfe9I-9wKVK2G9WavxrSjtz02ho8hypu60j8piF5-nBz0ud91Pmg6DYyaFRu2A Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29351614f7c2415ebe2d181ea22a45f4"}]}] Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: bbaf8b363587422da662d4e9ac8bb1db Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '811ba8e1-a381-4a6c-bfe8-2fc285442f82'} Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:51:31.846579 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Returning 404 to user: Instance 811ba8e1-a381-4a6c-bfe8-2fc285442f82 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a82f2c6e-c182-4415-b6f3-b51337902fc6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82" status: 404 len: 111 microversion: 2.1 time: 0.032356 Oct 28 18:51:31.851161 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3698/7612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:31 2022] GET /compute/v2.1/servers/811ba8e1-a381-4a6c-bfe8-2fc285442f82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:51:31.857013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-54a13182-0968-4561-b546-3b05cc23e1b6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '.version_select at 0x7f751f050040>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:31.880969 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-54a13182-0968-4561-b546-3b05cc23e1b6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-494788370" status: 202 len: 0 microversion: 2.1 time: 0.027987 Oct 28 18:51:31.881555 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3915/7613] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Oct 28 18:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-494788370 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:51:41.046069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0aded0c1-ac18-408b-a28e-a33f401c1a85 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: .version_select at 0x7f751ec6a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2089352913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAYl6JVxzqn61kU2Q+c6RtllOJnBwbprFkLrg+Uk5W4BjOZCkSxlGYRtQNlZeoNPjOlmbyBKKf4v+DA47neUK8tnDOdoJUSjDCbgUGiYSSxYLibHqoxToEkI+9Tob/soQ=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:41.063638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0aded0c1-ac18-408b-a28e-a33f401c1a85 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:51:41.068977 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0aded0c1-ac18-408b-a28e-a33f401c1a85 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for user bbaf8b363587422da662d4e9ac8bb1db and project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:51:41.095529 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0aded0c1-ac18-408b-a28e-a33f401c1a85 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053423 Oct 28 18:51:41.096126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3699/7614] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:51:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:41.143953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:41.148180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1628786899", "imageRef": "778db812-8994-435e-8a09-11c8b8a7c37a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2089352913", "networks": [{"uuid": "764a6c72-abea-4d70-819e-762e3b7d5092"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:41.201864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] validate_networks() for [('764a6c72-abea-4d70-819e-762e3b7d5092', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:51:41.624376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:51:41.624820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:51:41.625314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:51:41.625734 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:51:41.626158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:51:41.635381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:41.635941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:41.636392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:41.637235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:41.637712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:41.638144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:41.655885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:51:41.661130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Getting quotas for user bbaf8b363587422da662d4e9ac8bb1db and project 29351614f7c2415ebe2d181ea22a45f4. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:51:41.674444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:51:41.676751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='778db812-8994-435e-8a09-11c8b8a7c37a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:51:41.723344 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-348d5e41-4137-45f2-a844-7bc8f0d042f9 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581110 Oct 28 18:51:41.724859 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3916/7615] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:51:41.736168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bd3f1925-462f-4da0-a09d-41013f3ad06c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:41.736774 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bd3f1925-462f-4da0-a09d-41013f3ad06c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:41.818881 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bd3f1925-462f-4da0-a09d-41013f3ad06c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:41.826871 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bd3f1925-462f-4da0-a09d-41013f3ad06c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1259 microversion: 2.1 time: 0.094500 Oct 28 18:51:41.827765 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3700/7616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:41 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:42.851403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:42.852027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:42.860601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:42.861421 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:42.861879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:42.862616 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:42.863328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:42.864164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:42.947965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:42.958239 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-db137eb3-8c40-4c1b-904f-557b258c7d0f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1329 microversion: 2.1 time: 0.111709 Oct 28 18:51:42.958835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3917/7617] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:42 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:43.982263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:43.983196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:43.985112 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:43.998357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:43.998888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:43.999888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:44.000829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:44.001487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:44.002143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:44.150670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:44.159476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aa67f2e2-2f93-4c1e-a806-a81536a04fbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.181174 Oct 28 18:51:44.160342 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3701/7618] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:43 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:45.182157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:45.183491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:45.191218 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:45.192041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:45.192826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:45.193779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:45.194576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:45.195219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:45.347387 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:45.355696 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba3a06ab-7959-40f1-a92a-4485a591ad93 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.177372 Oct 28 18:51:45.372436 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3918/7619] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:45 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:46.380584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:46.381317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:46.390766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:46.391459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:46.391897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:46.392602 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:46.393050 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:46.393469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:46.535573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:46.545235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0702d383-4c4e-4411-8295-b73b590814fa tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.168506 Oct 28 18:51:46.545829 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3702/7620] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:46 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:47.570386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:47.571082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:47.578518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:47.579031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:47.579514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:47.580241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:47.580749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:47.581226 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:47.728136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:47.737170 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad9e1c40-0af7-4839-9794-6176c99c4af6 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.170752 Oct 28 18:51:47.741762 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3919/7621] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:47 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:48.761995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:48.762693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:48.764727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:48.770249 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:48.770740 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:48.771177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:48.771912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:48.772371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:48.772796 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:48.928474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:48.938238 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-99802994-9cba-44ad-b12d-d946c9286def tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.180939 Oct 28 18:51:48.939005 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3703/7622] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:48 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:49.968944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:49.974204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:49.977075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:49.986072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:49.988595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:49.988879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:49.990437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:49.992247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:49.993215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:50.153274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:50.161256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ae26782a-b19d-4667-8bd0-eefee34a5773 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.197134 Oct 28 18:51:50.162154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3920/7623] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:49 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:51.185098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:51.185719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:51.192629 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:51.193104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:51.193531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:51.194209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:51.194656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:51.195071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:51.328561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:51.336129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d6f89d8-17aa-4924-8746-eb5a3a3520b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.155404 Oct 28 18:51:51.336690 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3704/7624] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:51 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:52.358205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:52.359097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:52.364157 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:52.364801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:52.372129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:52.372631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:52.373082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:52.373800 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:52.374267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:52.375021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:52.508095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:52.518228 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8bc42fe1-55af-4769-b745-d24af4b2e225 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.162249 Oct 28 18:51:52.518820 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3921/7625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:52 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:53.542437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:53.543051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:53.544987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:51:53.551637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:53.552127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:53.552589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:53.553287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:53.553736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:53.554158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:53.684379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:53.692129 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-77462133-e0a5-4ee4-84ed-74f739f44be8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.153712 Oct 28 18:51:53.692711 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3705/7626] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:53 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:51:53.744077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:51:53.756456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:53.756955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:53.757389 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:53.769393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] Creating event network-changed:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:51:53.774463 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-8d79bd40-0536-40e2-a149-02a1229342a0 req-4111346d-9a1e-4a21-b4ad-4c24c104ccde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034481 Oct 28 18:51:53.775153 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3922/7627] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:51:54.716363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:54.716907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:54.723941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:54.724419 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:54.724850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:54.725534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:54.725979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:54.726398 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:54.857718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:54.865245 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3c8047a9-9957-4541-81c3-3e100462dcd3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.153069 Oct 28 18:51:54.865807 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3706/7628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:54 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:55.889828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:55.890542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:55.897614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:55.898111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:55.898601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:55.899304 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:55.899794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:55.900232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:56.037429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:56.045885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8cb7cbed-0bb7-40dc-9df5-c66484140d6a tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.161023 Oct 28 18:51:56.046407 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3923/7629] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:55 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:57.068627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:57.069231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:57.076699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:57.077178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:57.077616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:57.078300 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:57.078746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:57.079195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:57.215085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:57.222795 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8e547bb2-1582-4acc-96b8-0a1454deac2f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.158139 Oct 28 18:51:57.223393 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3707/7630] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:57 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:58.245581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:58.246246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:58.253104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:58.253598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:58.254040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:58.254742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:58.255203 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:58.255680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:58.437894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:58.445651 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a20e60a6-6edb-401a-8e84-9dfb7cbfbd2c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.204108 Oct 28 18:51:58.446227 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3924/7631] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:58 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:51:59.468843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:51:59.469406 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:51:59.476113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:59.476595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:59.477035 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:59.477723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:51:59.478171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:51:59.478592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:51:59.614558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:51:59.622718 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dce8e922-ac73-4694-b9ca-dbfd2683da5f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.157964 Oct 28 18:51:59.623288 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3708/7632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:51:59 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:00.647251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:00.647843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:00.655853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:00.656397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:00.656855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:00.657704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:00.658169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:00.658604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:00.788548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:00.796297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fc15a0ef-54bf-4b50-ba78-ebc75bf18f55 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.153146 Oct 28 18:52:00.796906 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3925/7633] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:00 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:01.605208 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "name": "network-vif-plugged", "status": "completed", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:01.614688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:01.615106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:01.615744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:01.627822 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] Creating event network-vif-plugged:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:52:01.632969 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-42ea9376-ed45-4646-9d6a-fde59ae386a3 req-dc35417b-5d3d-482c-bd12-6694d6fd68fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092056 Oct 28 18:52:01.633565 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3709/7634] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:01.819164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:01.819810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:01.826999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:01.827527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:01.827971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:01.828697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:01.829155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:01.829587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:01.956885 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:01.965279 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf37bd58-33a8-4fd0-b81b-5bbcefb3c4b8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.149949 Oct 28 18:52:01.965857 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3926/7635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:01 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:02.991141 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:02.991864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:02.998687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:02.999172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:02.999632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:03.001069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:03.001522 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:03.001950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:03.139843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:03.147488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1dfaaccf-048d-41e4-90d0-d1964a7c12e3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1359 microversion: 2.1 time: 0.161733 Oct 28 18:52:03.148054 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3710/7636] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:02 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:52:04.170846 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:04.171505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:04.178558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.179049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.179549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.181583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.182058 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.182611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.312791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:04.320590 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e4a44019-45f9-4f39-98d6-a5075e67e770 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1549 microversion: 2.1 time: 0.154439 Oct 28 18:52:04.321162 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3927/7637] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:04 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:04.343997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:04.344611 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:04.351513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.351996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.352434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.353121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.353580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.354004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.487532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:04.495187 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b21284df-5ec8-457a-83c0-da7d5e040171 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1549 microversion: 2.1 time: 0.155028 Oct 28 18:52:04.495889 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3711/7638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:04 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:04.517908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:04.522658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:04.523477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Searching by: {'deleted': False, 'project_id': '29351614f7c2415ebe2d181ea22a45f4'} {{(pid=120568) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 18:52:04.528971 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.529465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.529915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.530659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.531124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.531600 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.555044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.multi_cell_list [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120568) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 18:52:04.581481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1f4aad7f-9733-44c0-99fa-9f38381e19ca tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067637 Oct 28 18:52:04.582069 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3928/7639] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Oct 28 18:52:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:04.594123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:04.594731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:04.600666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.601147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.601581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.602267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:04.602719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:04.603143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:04.730576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:04.738301 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9798efe7-d43a-486e-bcc2-cfec4b9fd019 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1549 microversion: 2.1 time: 0.147983 Oct 28 18:52:04.738871 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3712/7640] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:04 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:06.254217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "072ad2e4-c71c-4047-87b9-305f75bd4c2d"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:06.256629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:06.264275 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:06.264778 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:06.265234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:06.265939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:06.266410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:06.266852 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:06.507479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-22582cb7-13b9-4ebe-ab7f-3e32b1b0faa4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257066 Oct 28 18:52:06.508564 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3929/7641] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Oct 28 18:52:06 2022] POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:17.288320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:17.288921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:17.292365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=19 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:17.293591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=68 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:17.299484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:17.299963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:17.300400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:17.301084 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:17.301521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:17.301942 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:17.432316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:17.440543 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-727a0f77-7320-4bb8-8026-8f0a04ad7fe0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1595 microversion: 2.1 time: 0.156216 Oct 28 18:52:17.441124 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3713/7642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:17 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:19.039549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:19.045822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:19.046500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=19 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:19.047208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:52:19.053996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:19.054749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:19.055317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:19.069678 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] Creating event network-changed:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:52:19.075954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-389de1f1-c571-4ed9-8643-adf9d56ece4a req-9f114ba3-e4cb-4b56-a2e1-2918147734e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040578 Oct 28 18:52:19.076804 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3930/7643] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:52:20.392438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1556786542"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:20.393044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:20.399128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:20.399640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:20.400077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:20.400771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:20.401959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:20.402392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:20.532707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.network.security_group_api [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Adding security group c1f63f0f-3472-4aa6-b7e4-d11195f5bd8f to port c83b9443-8876-4af1-a5b5-d102d4aab998 Oct 28 18:52:20.849029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d78c649-5fd5-4638-b808-383dacd5f8d0 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action" status: 202 len: 0 microversion: 2.1 time: 0.460976 Oct 28 18:52:20.849758 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3714/7644] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:52:20 2022] POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:52:20.860160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:52:20.861140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:52:20.879631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:20.880259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:20.880723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:20.881489 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:20.881936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:20.882367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:21.041448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:52:21.050551 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-47ce8fb7-d806-420a-a62b-8e075cdb1b33 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1760 microversion: 2.1 time: 0.196130 Oct 28 18:52:21.051233 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3931/7645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:52:20 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1760 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:52:21.092008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:52:21.101831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:52:21.102317 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:52:21.102754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:52:21.114715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] Creating event network-changed:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:52:21.120625 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-aa8b033e-2efb-440b-946f-11734b1c433a req-815e57b0-3860-433f-afcb-bfbf8a8ffd5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032376 Oct 28 18:52:21.121658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3715/7646] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:53:09.207235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:53:09.209395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:09.211863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:53:09.212856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=8 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:53:09.220412 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:09.220912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:09.221347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:09.222084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:09.222545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:09.223030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:09.298222 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c40d4803-4938-434f-93da-694ae557910d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action" status: 202 len: 0 microversion: 2.1 time: 0.094847 Oct 28 18:53:09.298965 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3932/7647] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:53:09 2022] POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:53:09.307867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:09.308570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:09.311662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:53:09.312325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:53:09.313373 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:53:09.313555 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 (ip 10.222.0.48) !!! Oct 28 18:53:09.321261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:09.321741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:09.322180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:09.322876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:09.323380 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:09.323782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:09.470453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:09.479095 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-734fe7eb-a002-415c-afdf-8dd6c535fbbf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1752 microversion: 2.1 time: 0.175535 Oct 28 18:53:09.479909 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3716/7648] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:09 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:10.504730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:10.505462 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:10.511647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:10.512144 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:10.512589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:10.513293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:10.513806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:10.514306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:10.661557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:10.670050 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fb07cf2b-689d-474b-8652-32bc7dc359b1 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.171178 Oct 28 18:53:10.670661 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3933/7649] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:10 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:11.694558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:11.695116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:11.702148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:11.702630 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:11.703064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:11.703777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:11.704228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:11.704655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:11.845858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:11.854085 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd57b73e-d924-400f-ac7b-5299a439829f tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.163508 Oct 28 18:53:11.854659 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3717/7650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:11 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:12.879060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:12.879714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:12.887034 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:12.887832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:12.888468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:12.890613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:12.891491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:12.891988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:13.037577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:13.046354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c9191840-e2b2-4fb1-b996-b93fc8573850 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.170776 Oct 28 18:53:13.046946 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3934/7651] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:12 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:14.070744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:14.071345 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:14.079064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:14.079577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:14.080010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:14.080690 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:14.081136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:14.081554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:14.228284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:14.236567 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b19bebe4-c395-410a-b24f-dd34a6233dcb tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.169889 Oct 28 18:53:14.237140 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3718/7652] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:14 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:15.260865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:15.261482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:15.269455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:15.269934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:15.270379 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:15.271068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:15.271559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:15.272017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:15.416478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:15.424870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cff8c8df-8830-4691-8a39-7c52fd8e9db8 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.167901 Oct 28 18:53:15.425447 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3935/7653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:15 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:16.447101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:16.447675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:16.455312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:16.455825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:16.456266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:16.456960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:16.457414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:16.457839 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:16.891812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:16.900001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bcf6a51d-f14c-4560-8b9f-c20997c9c10b tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.456885 Oct 28 18:53:16.900586 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3719/7654] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:16 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:17.925680 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:17.926224 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:17.932125 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:17.932613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:17.933048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:17.933735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:17.934191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:17.934618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:18.075918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:18.085315 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9771958-a348-4dd8-b72d-9bf877e3b3d7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.164172 Oct 28 18:53:18.085881 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3936/7655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:17 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:19.108429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:19.109023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:19.115047 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:19.115566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:19.116003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:19.116687 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:19.117135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:19.117555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:19.261121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:19.270167 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c6eddde2-3dcf-492a-a8f6-cc54fff4cd0d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.165984 Oct 28 18:53:19.270739 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3720/7656] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:19 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:20.295326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:20.296577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:20.304276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:20.304788 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:20.305239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:20.306000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:20.306466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:20.306905 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:20.457250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:20.465657 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6e08204c-b54b-4e6a-9d19-adda3bb8d6a7 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.174454 Oct 28 18:53:20.466234 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3937/7657] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:20 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:21.490114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:21.490726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:21.497705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:21.498183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:21.498614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:21.499529 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:21.499982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:21.500403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:21.645541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:21.653753 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac84dcd9-4b1b-4d54-80ee-00df6cb300f2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.167582 Oct 28 18:53:21.654327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3721/7658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:21 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:22.677424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:22.678005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:22.684808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:22.685305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:22.685751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:22.687015 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:22.687511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:22.687949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:22.829175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:22.837698 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-21ed2549-d3f3-4dc9-804e-3e30e630b507 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.164274 Oct 28 18:53:22.838275 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3938/7659] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:22 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:23.860986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:23.861593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:23.868495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:23.868979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:23.869416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:23.870107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:23.870558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:23.870983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:24.021363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:24.029785 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6525326c-a243-4cf0-8bf8-8ff64325a056 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.173321 Oct 28 18:53:24.030367 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3722/7660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:23 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:25.053602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:25.054245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:25.061109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:25.061597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:25.062043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:25.062919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:25.063403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:25.063838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:25.205212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:25.213540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9dc4bbcd-6f02-4a57-80aa-de336d801fc4 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1757 microversion: 2.1 time: 0.163865 Oct 28 18:53:25.214121 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3939/7661] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:25 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:53:26.237742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:53:26.238352 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:53:26.245189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:26.245671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:26.246106 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:26.246798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:53:26.247251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:53:26.247700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:53:26.396779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:53:26.405074 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e3e0483d-adfe-4412-a1e4-609a970b7467 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1760 microversion: 2.1 time: 0.171371 Oct 28 18:53:26.405953 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3723/7662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:53:26 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:21.976481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1556786542"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:21.977112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:21.979401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=16 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:21.980193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:21.986161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:21.986655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:21.987100 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:21.987828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:21.988902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:21.989345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:22.116633 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.network.security_group_api [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Removing security group c1f63f0f-3472-4aa6-b7e4-d11195f5bd8f from port c83b9443-8876-4af1-a5b5-d102d4aab998 Oct 28 18:54:22.425328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c90a4d14-d1f1-4f53-a73a-980073a79137 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action" status: 202 len: 0 microversion: 2.1 time: 0.453206 Oct 28 18:54:22.429739 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3940/7663] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:54:21 2022] POST /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:54:22.435791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=16 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:22.437196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=48 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:22.491478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:22.502243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:22.503044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:22.503210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:22.514914 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] Creating event network-changed:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:54:22.522376 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-52173bf2-ea42-488e-985b-6c92e1fd57c7 req-8eb132a0-44b6-4759-94ca-9ac3dedd09d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091861 Oct 28 18:54:22.523395 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3724/7664] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:23.591193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:23.591871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:23.600036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:23.600246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:23.600802 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:23.601624 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:23.602195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:23.602741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:23.692465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lazy-loading 'services' on Instance uuid 2c401219-474b-4368-8dea-96e1ca504542 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:54:23.774622 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a2d6a715-cee8-46ca-9e02-0e9cce44b90e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments/072ad2e4-c71c-4047-87b9-305f75bd4c2d" status: 202 len: 0 microversion: 2.1 time: 0.188987 Oct 28 18:54:23.779549 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3941/7665] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:54:23 2022] DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments/072ad2e4-c71c-4047-87b9-305f75bd4c2d => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:54:23.785940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:23.789410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:23.800204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:23.800701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:23.801940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:23.802742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:23.803202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:23.804049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:23.839100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a54d174-2741-4d2a-ba46-11e1e1e036d2 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058388 Oct 28 18:54:23.840013 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3725/7666] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:23 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:54:24.539431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:24.549423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:24.550040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:24.550548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:24.566558 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] Creating event network-changed:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:54:24.571607 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-ebfc53c1-d23d-4f29-b77c-aac846b038a0 req-4f047758-e9c1-4434-871d-ec849253d345 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Oct 28 18:54:24.572545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3942/7667] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:24.852147 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:24.854465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:24.861596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:24.862169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:24.862716 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:24.864020 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:24.865040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:24.865536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:24.896632 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-04721f1a-5139-4c98-96af-74e93759883e tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048483 Oct 28 18:54:24.897208 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3726/7668] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:24 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:25.910429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:25.913245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:25.919795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:25.920302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:25.920752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:25.921494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:25.921956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:25.922401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:25.954079 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-68f3c39d-156e-4226-b316-c273e67f1ea3 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049063 Oct 28 18:54:25.954663 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3943/7669] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:25 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:26.966527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:26.968631 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:26.975997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:26.976485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:26.976920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:26.977613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:26.978077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:26.978502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:27.008278 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a708af49-0ca7-412d-8873-401b57727a50 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Oct 28 18:54:27.008846 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3727/7670] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:26 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:28.021408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:28.023657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:28.030573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:28.031077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:28.031559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:28.032280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:28.032747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:28.033188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:28.063328 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1a3f68b-85f4-4c45-bf1f-3282126d69cf tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046456 Oct 28 18:54:28.063943 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3944/7671] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:28 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:29.077182 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:29.079314 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:29.087412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:29.087837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:29.088270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:29.088955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:29.089403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:29.089824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:29.117481 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-47848feb-52c8-4950-9762-e8ca01f6f835 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044366 Oct 28 18:54:29.118028 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3728/7672] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Oct 28 18:54:29 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 18:54:29.128787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:29.130270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:29.136670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:29.137163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:29.137618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:29.138347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:29.138815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:29.139290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:29.215811 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] HTTP exception thrown: Instance 2c401219-474b-4368-8dea-96e1ca504542 is not attached to volume 072ad2e4-c71c-4047-87b9-305f75bd4c2d Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Request method failure captured: Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: request: DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments/072ad2e4-c71c-4047-87b9-305f75bd4c2d HTTP/1.1 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCOM1DoFv0zpge8R7IxqN2Qh1j9_Q00Q-Ff8snKa5dKhY1L6bkBV1sq-rFvJvt1DMK9qPx6MBqiGofNdsxRfPzCinW2xIgpn27fcUjg0k6-yw-jHKZfe9I-9wKVK2G9WavxrSjtz02ho8hypu60j8piF5-nBz0ud91Pmg6DYyaFRu2A Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29351614f7c2415ebe2d181ea22a45f4"}]}] Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: bbaf8b363587422da662d4e9ac8bb1db Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2c401219-474b-4368-8dea-96e1ca504542 is not attached to volume 072ad2e4-c71c-4047-87b9-305f75bd4c2d Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'server_id': '2c401219-474b-4368-8dea-96e1ca504542', 'id': '072ad2e4-c71c-4047-87b9-305f75bd4c2d'} Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 072ad2e4-c71c-4047-87b9-305f75bd4c2d. Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c401219-474b-4368-8dea-96e1ca504542 is not attached to volume 072ad2e4-c71c-4047-87b9-305f75bd4c2d Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:29.217625 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c401219-474b-4368-8dea-96e1ca504542 is not attached to volume 072ad2e4-c71c-4047-87b9-305f75bd4c2d Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Returning 404 to user: Instance 2c401219-474b-4368-8dea-96e1ca504542 is not attached to volume 072ad2e4-c71c-4047-87b9-305f75bd4c2d {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-756fff04-60d2-414b-9246-1b808999285c tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments/072ad2e4-c71c-4047-87b9-305f75bd4c2d" status: 404 len: 154 microversion: 2.1 time: 0.094450 Oct 28 18:54:29.222884 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3945/7673] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Oct 28 18:54:29 2022] DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542/os-volume_attachments/072ad2e4-c71c-4047-87b9-305f75bd4c2d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:32.470701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:32.471196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:32.478358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.478843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.479516 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.479980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.480436 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.480857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.507200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:54:32.590712 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7cc8cf53-608f-4dc2-b5f1-85cea95f4cff tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 204 len: 0 microversion: 2.1 time: 0.123441 Oct 28 18:54:32.594627 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3729/7674] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:54:32 2022] DELETE /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:54:32.600794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:32.601199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:32.608601 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.609097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.609548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.610251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:32.610711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:32.611148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:32.751984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:32.760821 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e659e531-38fb-4b88-a7ba-6b7750422d5d tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1555 microversion: 2.1 time: 0.164592 Oct 28 18:54:32.761421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3946/7675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:32 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:54:33.785741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:33.786428 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:33.793902 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:33.794382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:33.794812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:33.795517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:33.795965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:33.796383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:33.929633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:33.937568 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5323c6fd-63b8-41fd-973e-5700ed7a3145 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1555 microversion: 2.1 time: 0.156081 Oct 28 18:54:33.938247 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3730/7676] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:33 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:34.833482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c401219-474b-4368-8dea-96e1ca504542", "name": "network-vif-deleted", "tag": "c83b9443-8876-4af1-a5b5-d102d4aab998"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:34.844053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:34.844539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:34.844977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:34.857105 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] Creating event network-vif-deleted:c83b9443-8876-4af1-a5b5-d102d4aab998 for instance 2c401219-474b-4368-8dea-96e1ca504542 on n-h1-860864-13 Oct 28 18:54:34.861885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-fea86903-4c89-4051-a612-686c032100ac req-eb8cb9c5-5ae2-4b53-b4ec-6cb31d42c2d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Oct 28 18:54:34.862480 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3947/7677] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:54:34.962081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:34.962840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:34.969654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:34.970144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:34.970578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:34.971519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:34.971980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:34.972405 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:35.007794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:35.008227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:35.008666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:35.009124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lazy-loading 'fault' on Instance uuid 2c401219-474b-4368-8dea-96e1ca504542 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:54:35.050479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf8b363587422da662d4e9ac8bb1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29351614f7c2415ebe2d181ea22a45f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:35.059490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2f34935b-2425-480a-b00f-5b64215a9462 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 200 len: 1349 microversion: 2.1 time: 0.101240 Oct 28 18:54:35.060073 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3731/7678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:34 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:36.085254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:36.085963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [instance: 2c401219-474b-4368-8dea-96e1ca504542] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:36.092326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:36.092822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:36.093272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:36.093972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:36.094438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:36.094871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:36.108631 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] HTTP exception thrown: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Request method failure captured: Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 HTTP/1.1 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCOM1DoFv0zpge8R7IxqN2Qh1j9_Q00Q-Ff8snKa5dKhY1L6bkBV1sq-rFvJvt1DMK9qPx6MBqiGofNdsxRfPzCinW2xIgpn27fcUjg0k6-yw-jHKZfe9I-9wKVK2G9WavxrSjtz02ho8hypu60j8piF5-nBz0ud91Pmg6DYyaFRu2A Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29351614f7c2415ebe2d181ea22a45f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29351614f7c2415ebe2d181ea22a45f4"}]}] Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 29351614f7c2415ebe2d181ea22a45f4 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestMinimumBasicScenario-295490121 Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: bbaf8b363587422da662d4e9ac8bb1db Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestMinimumBasicScenario-295490121-project Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '2c401219-474b-4368-8dea-96e1ca504542'} Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:54:36.110242 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Returning 404 to user: Instance 2c401219-474b-4368-8dea-96e1ca504542 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-23ac392d-ce64-417c-a372-28d7ab6b5b69 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542" status: 404 len: 111 microversion: 2.1 time: 0.032076 Oct 28 18:54:36.116694 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3948/7679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:36 2022] GET /compute/v2.1/servers/2c401219-474b-4368-8dea-96e1ca504542 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:54:36.120338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a4384d2d-4a8d-4b5a-8a6e-29a02c559e92 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] Calling method '.version_select at 0x7f751ec219d0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:36.124756 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4384d2d-4a8d-4b5a-8a6e-29a02c559e92 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [3570a816-847d-4252-a441-9b50868e4528] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:54:37.132486 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4384d2d-4a8d-4b5a-8a6e-29a02c559e92 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] [3570a816-847d-4252-a441-9b50868e4528] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 43252. Oct 28 18:54:37.152765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a4384d2d-4a8d-4b5a-8a6e-29a02c559e92 tempest-TestMinimumBasicScenario-295490121 tempest-TestMinimumBasicScenario-295490121-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2089352913" status: 202 len: 0 microversion: 2.1 time: 1.036116 Oct 28 18:54:37.153344 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3732/7680] 10.222.0.48 () {58 vars in 1272 bytes} [Fri Oct 28 18:54:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2089352913 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 18:54:46.219673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=18 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:46.220417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:46.393903 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: .version_select at 0x7f75046bcb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1904536575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbavWA4eNMNBWgak3vfH9biu2aQKHDSQC4qRhIhugP7uSwG3o9HseF3w9jo/8Wp2TPnKJUEKwiVSQtX4P+2FBiJ9W/1eZ3pMoX2xbLHRYYokanYoHI4qZAGvawNJB1CMA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:46.409316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:54:46.415850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:54:46.430019 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [3cf5aaf0-af5c-4502-a810-4e1347ac3a02] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 18:54:47.437428 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [3cf5aaf0-af5c-4502-a810-4e1347ac3a02] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 43380. Oct 28 18:54:47.453767 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-efbd7033-5844-43fa-a42f-02e1cf292f40 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.239070 Oct 28 18:54:47.454435 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3949/7681] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:54:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:53.154444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:53.155478 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:54:53.161253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1028372194", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "fd8a63c0-2e3c-4d34-a002-5e4b4fa72ef7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1904536575", "security_groups": [{"name": "tempest-secgroup-smoke-2029563442"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:53.404048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] validate_networks() for [('fd8a63c0-2e3c-4d34-a002-5e4b4fa72ef7', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:54:53.965203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:54:53.965634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:54:53.966832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:54:53.967316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:54:53.967764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:54:53.982007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:53.982570 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:53.983015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:53.983927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:53.984441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:53.984878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:54.006760 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:54:54.012869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:54:54.031585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:54:54.035048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:54:54.090969 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0d79a2a0-3a5b-47b6-8425-a2a1cd2c9362 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.938372 Oct 28 18:54:54.091886 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3733/7682] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:54:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:54:54.101226 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:54:54.101742 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 18:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 (ip 10.222.0.48) !!! Oct 28 18:54:54.107858 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3dd27c6f-ba5e-46aa-80d0-6e1ae921cbc3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:54.108573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3dd27c6f-ba5e-46aa-80d0-6e1ae921cbc3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:54.185206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3dd27c6f-ba5e-46aa-80d0-6e1ae921cbc3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:54.196995 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3dd27c6f-ba5e-46aa-80d0-6e1ae921cbc3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1267 microversion: 2.1 time: 0.097643 Oct 28 18:54:54.197603 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3950/7683] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:54 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:55.221400 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:55.222012 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:55.231043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:55.231802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:55.233340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:55.236356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:55.236896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:55.237351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:55.306297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:55.315206 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd0a9c72-10f4-44b9-92be-e2568ca4f0fa tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1319 microversion: 2.1 time: 0.098549 Oct 28 18:54:55.316050 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3734/7684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:55 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:56.339041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:56.340973 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:56.350874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:56.351550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:56.352140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:56.359410 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:56.360048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:56.360512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:56.519537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:56.529465 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-caa5ab01-5755-405d-915c-da5e747eb5e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.194380 Oct 28 18:54:56.530062 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3951/7685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:56 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:56.907727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6976cb35-b310-46f2-bf6d-be845f93bd97", "tag": "09e6daec-5236-4e1e-99ca-3e6782171af8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:54:56.920350 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:56.921302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:56.921831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:56.934918 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] Creating event network-changed:09e6daec-5236-4e1e-99ca-3e6782171af8 for instance 6976cb35-b310-46f2-bf6d-be845f93bd97 on n-h2-860864-13 Oct 28 18:54:56.939775 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c0e5f0da-a263-4135-9307-d37ccb2fd381 req-569f4c75-cefe-4204-b91f-10db53d2d5a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035839 Oct 28 18:54:56.940381 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3735/7686] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:54:57.553904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:57.554580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:57.562021 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:57.562521 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:57.562976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:57.563714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:57.564186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:57.564627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:57.953756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:57.962283 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50f83528-f83b-415b-a065-311c1d91554a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.412337 Oct 28 18:54:57.962888 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3952/7687] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:57 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:54:58.986691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:54:58.987418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:54:58.994346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:58.994824 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:58.995266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:58.995981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:54:58.996432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:54:58.996857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:54:59.128810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:54:59.137081 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-74fb2e00-86f9-4ffa-9b6f-4b155b6e7a9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.155544 Oct 28 18:54:59.137653 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3736/7688] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:54:58 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:00.159996 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:00.160611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:00.168580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:00.169078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:00.169524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:00.170222 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:00.170685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:00.171116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:00.308828 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:00.316443 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9234448d-470d-480b-b86f-481eaf1c2053 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.160318 Oct 28 18:55:00.317563 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3953/7689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:00 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:01.339927 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:01.340535 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:01.347333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:01.347847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:01.348689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:01.349010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:01.349462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:01.349887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:01.481734 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:01.489627 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fa8106c9-454d-469d-93ce-976aaadf6cb1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.153637 Oct 28 18:55:01.490199 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3737/7690] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:01 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:02.075211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6976cb35-b310-46f2-bf6d-be845f93bd97", "name": "network-vif-plugged", "status": "completed", "tag": "09e6daec-5236-4e1e-99ca-3e6782171af8"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:02.086449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:02.088110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:02.088574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:02.101027 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] Creating event network-vif-plugged:09e6daec-5236-4e1e-99ca-3e6782171af8 for instance 6976cb35-b310-46f2-bf6d-be845f93bd97 on n-h2-860864-13 Oct 28 18:55:02.106218 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-f5b20c04-be0d-499b-8268-f5b771cfb460 req-1538d713-be4e-4c43-8b0a-747683e69a08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034984 Oct 28 18:55:02.106818 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3954/7691] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:02.512357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:02.512963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:02.520566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:02.521579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:02.522014 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:02.522702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:02.523156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:02.523605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:02.662575 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:02.670332 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1f6fafba-7a2f-4785-ae82-bf0326cd0315 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1393 microversion: 2.1 time: 0.161834 Oct 28 18:55:02.670922 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3738/7692] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:02 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:03.695635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:03.696256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:03.703440 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:03.703932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:03.704375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:03.705072 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:03.705532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:03.705963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:03.840636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:03.848481 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b9858ff-7074-4c3a-91df-da524922a0f9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1564 microversion: 2.1 time: 0.158372 Oct 28 18:55:03.849046 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3955/7693] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:03 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:03.872287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:03.872896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:03.880676 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:03.881166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:03.881606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:03.882303 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:03.882799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:03.883177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:03.993886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:04.026764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:04.030226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:04.038186 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e02341e2-c1c3-482c-b6bf-5a94d6676065 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1564 microversion: 2.1 time: 0.169741 Oct 28 18:55:04.038768 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3739/7694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:03 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:05.632231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:55:05.632917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:05.633865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6976cb35-b310-46f2-bf6d-be845f93bd97", "tag": "09e6daec-5236-4e1e-99ca-3e6782171af8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:05.635202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:05.642764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:05.643268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:05.643994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:05.644713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:05.645782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:05.646599 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:05.646800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:05.647279 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:05.647826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:05.658443 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] Creating event network-changed:09e6daec-5236-4e1e-99ca-3e6782171af8 for instance 6976cb35-b310-46f2-bf6d-be845f93bd97 on n-h2-860864-13 Oct 28 18:55:05.664417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3bc83887-3746-43a7-ac6b-304bc2e30bf9 req-3d7d1c8c-ec1d-4dde-bee3-70c5d3476e24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034960 Oct 28 18:55:05.665339 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3740/7695] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:55:05.806678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:55:05.815084 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4e4ffd3e-289f-4e7e-a5fb-ff72962ef0d1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1564 microversion: 2.1 time: 0.188363 Oct 28 18:55:05.816019 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3956/7696] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:55:05 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:55:39.128580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:39.129313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=36 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:55:39.133747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:55:39.136161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:55:39.149148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:39.149637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:39.150073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:39.150768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:55:39.151230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:55:39.151681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:55:39.202903 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5a61726-a02e-4197-97c8-328d93fb0777 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action" status: 200 len: 24575 microversion: 2.1 time: 0.076289 Oct 28 18:55:39.203575 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3741/7697] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:55:39 2022] POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action => generated 24575 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:56:09.642249 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:09.643451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=32 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:09.648623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:09.649161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:09.656174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.656671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.657115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.657815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.658276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.658710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.724803 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3e17c760-1a8a-4a51-b968-8482b25e978e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action" status: 202 len: 0 microversion: 2.1 time: 0.084131 Oct 28 18:56:09.725528 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3957/7698] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:56:09 2022] POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:56:09.734353 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:09.735085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:09.737808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:09.738640 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:09.745262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.745753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.746190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.746893 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:09.747348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:09.747798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:09.893550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:09.901455 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9a6ad662-efc2-4cb6-a975-108064b1d10f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1688 microversion: 2.1 time: 0.171349 Oct 28 18:56:09.902036 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3742/7699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:09 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:10.928757 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:10.929468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:10.935717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:10.936210 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:10.936654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:10.937348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:10.937809 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:10.938241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:11.073319 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:11.081113 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3ff8a60b-12d7-4988-b9b7-38f4c278f9bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1668 microversion: 2.1 time: 0.158188 Oct 28 18:56:11.081674 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3958/7700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:10 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:12.175057 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:12.177289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:12.185034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.185519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.185953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.186653 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.187107 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.187576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.235458 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50e0035a-09f5-4452-895a-93fe0fb9e024 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action" status: 200 len: 32647 microversion: 2.1 time: 0.064109 Oct 28 18:56:12.236115 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3743/7701] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:56:12 2022] POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action => generated 32647 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:56:12.247752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:12.248306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:12.255122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.255666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.256212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.256943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.257458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.257909 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.324466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9f00072-2987-4e8b-ab80-1aa673ac7c92 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action" status: 202 len: 0 microversion: 2.1 time: 0.080477 Oct 28 18:56:12.328243 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3959/7702] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:56:12 2022] POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:56:12.333954 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:12.335381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:12.343159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.343665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.344101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.344798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:12.345253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:12.345677 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:12.788015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:12.795714 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0700ff76-ad50-479b-b2e1-dd508582cdb9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1675 microversion: 2.1 time: 0.465948 Oct 28 18:56:12.796288 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3744/7703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:12 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1675 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:13.821819 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:13.822517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:13.828752 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:13.829240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:13.829683 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:13.830375 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:13.830832 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:13.831262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:13.964834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:13.972681 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6173ee15-dec0-4d7e-92fd-f91d6d814428 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1683 microversion: 2.1 time: 0.156641 Oct 28 18:56:13.973258 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3960/7704] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:13 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:14.070701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:14.072911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:14.080302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:14.080782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:14.081209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:14.081891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:14.082339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:14.082759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:14.136763 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-802a09a2-73aa-4a39-a40f-a4745bce1831 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action" status: 200 len: 35837 microversion: 2.1 time: 0.070327 Oct 28 18:56:14.137410 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3745/7705] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:56:14 2022] POST /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97/action => generated 35837 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:56:15.176019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:15.176770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:15.178820 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6976cb35-b310-46f2-bf6d-be845f93bd97", "tag": "09e6daec-5236-4e1e-99ca-3e6782171af8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:15.184694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:15.185317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:15.185884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.186720 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:15.187516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:15.188181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.189484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:15.190156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:15.190580 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.202496 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] Creating event network-changed:09e6daec-5236-4e1e-99ca-3e6782171af8 for instance 6976cb35-b310-46f2-bf6d-be845f93bd97 on n-h2-860864-13 Oct 28 18:56:15.207456 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-665b55a9-e2e6-42fa-b87d-adb694252aad req-6b9652dc-71b0-4c9c-958d-4d837371eab7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Oct 28 18:56:15.208277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3746/7706] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:56:15.216622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:56:15.310516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0ca76657-4180-47ef-a206-914a4aa3b4ae tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 204 len: 0 microversion: 2.1 time: 0.137498 Oct 28 18:56:15.311139 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3961/7707] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:56:15 2022] DELETE /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:56:15.320991 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:15.321998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:15.328260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:15.328739 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:15.329438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.330194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:15.330865 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:15.331417 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:15.472334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:15.481084 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b97c2935-b58a-45fe-b0b2-96df671becee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1689 microversion: 2.1 time: 0.165318 Oct 28 18:56:15.481677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3747/7708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:15 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:16.507158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:16.507894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:16.514453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:16.514957 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:16.515444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:16.516164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:16.516638 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:16.517081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:16.657976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:16.667122 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-69947cab-7ec2-4616-8321-074f0458258c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1689 microversion: 2.1 time: 0.164814 Oct 28 18:56:16.667734 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3962/7709] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:16 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:17.619868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6976cb35-b310-46f2-bf6d-be845f93bd97", "name": "network-vif-deleted", "tag": "09e6daec-5236-4e1e-99ca-3e6782171af8"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:17.631066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.631593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.632017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.645029 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] Creating event network-vif-deleted:09e6daec-5236-4e1e-99ca-3e6782171af8 for instance 6976cb35-b310-46f2-bf6d-be845f93bd97 on n-h2-860864-13 Oct 28 18:56:17.651119 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-c8983e38-5e9a-4a37-9448-443c26e21891 req-c7b42b82-f2a6-49bd-a627-5b63cf907dbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035604 Oct 28 18:56:17.651770 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3748/7710] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:17.691665 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:17.692297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:17.699872 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.700377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.700821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.701528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.701988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.702423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.741818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:17.742356 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:17.742873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:17.743346 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'fault' on Instance uuid 6976cb35-b310-46f2-bf6d-be845f93bd97 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:56:17.785217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:17.793906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b0ac7843-0ad2-46af-b158-2265daaf6bf8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 200 len: 1357 microversion: 2.1 time: 0.106166 Oct 28 18:56:17.794484 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3963/7711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:17 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:18.818431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:18.819238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: 6976cb35-b310-46f2-bf6d-be845f93bd97] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:18.825932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:18.826404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:18.826830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:18.827534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:18.827981 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:18.828397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:18.842237 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] HTTP exception thrown: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Request method failure captured: Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 HTTP/1.1 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCV1xTcEStBC93NKyUh4uvgOe0ugIhjtWxJxgUtthjZs7lw_VGzwLuqDWSbyAAwptNg-cRGRpPmosfXc1ymv53BjpBbYyoyop9KhsbhIyviLXRRfGYpSND16e-PuVRLPgbFMPm8Kxg5tAFUfdwc26cccVnXsgQ_pXt-bU0_Foebyc74 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fd82b6984b034506a34851741541ea87 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd82b6984b034506a34851741541ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd82b6984b034506a34851741541ea87"}]}] Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fd82b6984b034506a34851741541ea87 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 0594fb39380543f7afdda56ca8e437be Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '6976cb35-b310-46f2-bf6d-be845f93bd97'} Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:56:18.843837 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Returning 404 to user: Instance 6976cb35-b310-46f2-bf6d-be845f93bd97 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f2e6068-e32b-47e4-9a46-d23d610850e4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97" status: 404 len: 111 microversion: 2.1 time: 0.031158 Oct 28 18:56:18.848713 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3749/7712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:18 2022] GET /compute/v2.1/servers/6976cb35-b310-46f2-bf6d-be845f93bd97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 18:56:21.900336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50b5bde0-1233-40cb-a8d0-69ab593086ee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '.version_select at 0x7f751f6fedc0>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:21.921591 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50b5bde0-1233-40cb-a8d0-69ab593086ee tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904536575" status: 202 len: 0 microversion: 2.1 time: 0.025896 Oct 28 18:56:21.925737 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3964/7713] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 18:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904536575 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:56:21.950741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d8c22176-221b-406b-ba32-05cc0e4cc4a0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: .version_select at 0x7f751ec32670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1436765329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrMY489Ii5tI2LdvQqZJhW3af8xaeF+63yan+/BJm/rWd3woPz8vyyCRhC+3V4QfxQj2b8qpkVFjM1K0tzWfzxMydMjgt/SvuvOn6OKSE7ec3gvZ0KKXHJOcQHRqNN9bg=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:21.969610 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d8c22176-221b-406b-ba32-05cc0e4cc4a0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:56:21.975607 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d8c22176-221b-406b-ba32-05cc0e4cc4a0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:56:22.003141 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d8c22176-221b-406b-ba32-05cc0e4cc4a0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056381 Oct 28 18:56:22.009770 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3750/7714] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:56:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:27.526769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-689498519", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f49e523e-be33-444a-97fa-576b44e64c97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1436765329", "security_groups": [{"name": "tempest-secgroup-smoke-870037284"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:27.652023 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] validate_networks() for [('f49e523e-be33-444a-97fa-576b44e64c97', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:56:27.790102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:28.073655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:56:28.074131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:56:28.074623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:56:28.075071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:56:28.075531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:56:28.084557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:28.085175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:28.085626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:28.086438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:28.086915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:28.087361 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:28.105294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:56:28.110561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:56:28.123314 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:56:28.125698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:56:28.175958 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-892083ba-7a88-4e36-8121-f210930cca94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653755 Oct 28 18:56:28.176631 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3965/7715] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:56:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:56:28.188963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-00182cfb-937b-4256-9a49-4ae0ca6c5e9e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:28.189579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-00182cfb-937b-4256-9a49-4ae0ca6c5e9e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:28.258441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-00182cfb-937b-4256-9a49-4ae0ca6c5e9e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:28.266823 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-00182cfb-937b-4256-9a49-4ae0ca6c5e9e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1266 microversion: 2.1 time: 0.082524 Oct 28 18:56:28.267295 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3751/7716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:28 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:29.295993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:29.296644 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:29.307640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:29.308747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:29.309205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:29.310688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:29.311418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:29.312081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:29.408211 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:29.417564 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2c1c5e72-c1ac-4fa7-b528-3b70267c3e24 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1336 microversion: 2.1 time: 0.127975 Oct 28 18:56:29.418195 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3966/7717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:29 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:30.442079 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:30.443348 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:30.450064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=32 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:30.455163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:30.455939 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:30.457066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:30.458226 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:30.459558 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:30.460171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:30.625862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:30.635430 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8a5b8e28-e5c0-4b31-91c5-4f8f162f26ec tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.198301 Oct 28 18:56:30.636055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3752/7718] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:30 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:30.892505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe249efd-98c0-4910-8843-0e5eae6e256c", "tag": "db30581a-d67d-4407-bb12-8358a08841e7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:30.903516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:30.904026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:30.904548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:30.917697 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] Creating event network-changed:db30581a-d67d-4407-bb12-8358a08841e7 for instance fe249efd-98c0-4910-8843-0e5eae6e256c on n-h1-860864-13 Oct 28 18:56:30.923033 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a0a98a18-e7a9-432b-815a-3636ae54d291 req-8f4691ba-86e6-40a8-a1ba-5b72bf0d25a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121807 Oct 28 18:56:30.923714 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3967/7719] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:31.663094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:31.663749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:31.670836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:31.671320 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:31.671775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:31.672462 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:31.672913 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:31.673335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:31.809151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:31.816656 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ed8a5095-5084-4e1f-801e-879158116f6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.158133 Oct 28 18:56:31.817226 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3753/7720] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:31 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:32.841051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:32.841857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:32.848017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:32.848517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:32.848972 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:32.850243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:32.850934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:32.851446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:32.982770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:32.991087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ce5476da-341b-4225-80ae-4bb8ce7188d4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.154746 Oct 28 18:56:32.991692 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3968/7721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:32 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:34.013952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:34.014563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:34.022485 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:34.022967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:34.023430 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:34.024138 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:34.024589 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:34.025007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:34.161721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:34.170366 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-60ab41e2-a6b6-4697-8dd1-7c917ec4a1ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.160295 Oct 28 18:56:34.170941 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3754/7722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:34 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:35.195105 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:35.195764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:35.203435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:35.203942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:35.204399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:35.205207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:35.205583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:35.206059 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:35.344136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:35.355191 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d2c1a450-e836-4bbe-8df2-6f9adf619a8d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.164872 Oct 28 18:56:35.355820 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3969/7723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:35 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:36.379094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:36.379741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:36.387491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:36.387967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:36.388395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:36.389073 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:36.389518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:36.389933 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:36.522574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:36.530426 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3518edc9-d706-4767-97bc-4fad93264a94 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.155208 Oct 28 18:56:36.531021 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3755/7724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:36 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:36.741357 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe249efd-98c0-4910-8843-0e5eae6e256c", "name": "network-vif-plugged", "status": "completed", "tag": "db30581a-d67d-4407-bb12-8358a08841e7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:36.752165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:36.752673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:36.753338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:36.765559 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] Creating event network-vif-plugged:db30581a-d67d-4407-bb12-8358a08841e7 for instance fe249efd-98c0-4910-8843-0e5eae6e256c on n-h1-860864-13 Oct 28 18:56:36.770803 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0a3dfc54-1113-4538-8f66-24d33a43d01b req-039dd8e1-0b86-4171-b1be-eb2044185d86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033777 Oct 28 18:56:36.771417 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3970/7725] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:37.554221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:37.554762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:37.561588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:37.562068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:37.562495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:37.563178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:37.563648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:37.564069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:37.698422 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:37.706052 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-edf20915-d45c-4e71-84df-43164bf0dff3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1391 microversion: 2.1 time: 0.156779 Oct 28 18:56:37.706626 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3756/7726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:37 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:38.727491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:38.728312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:38.732816 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:38.733529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:38.740831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:38.741341 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:38.741792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:38.742502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:38.742969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:38.743431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:38.879602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:38.888107 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-323936cc-a23f-40e0-a25f-5844d29687e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1563 microversion: 2.1 time: 0.162415 Oct 28 18:56:38.888727 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3971/7727] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:38 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:38.910823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:38.911479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:38.913471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:38.919775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:38.920316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:38.920807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:38.921531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:38.921994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:38.922423 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:39.061686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:39.069801 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-53b48475-fc7d-43cd-92bb-d85ab2b02d7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1563 microversion: 2.1 time: 0.162661 Oct 28 18:56:39.070383 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3757/7728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:38 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:56:40.961814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe249efd-98c0-4910-8843-0e5eae6e256c", "tag": "db30581a-d67d-4407-bb12-8358a08841e7"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:56:40.965006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:56:40.965656 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:56:40.968431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:40.974212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:56:40.980978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:40.981191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:40.981464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:40.981635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:40.982186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:40.982454 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:40.982917 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:56:40.983408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:56:40.983855 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:56:40.995158 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] Creating event network-changed:db30581a-d67d-4407-bb12-8358a08841e7 for instance fe249efd-98c0-4910-8843-0e5eae6e256c on n-h1-860864-13 Oct 28 18:56:41.000457 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-3faec750-7e56-4759-9948-a42518559f2a req-c871ab24-b5cd-4c40-8c0d-a2cc1a181741 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042428 Oct 28 18:56:41.001327 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3758/7729] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:56:41.140377 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:56:41.149990 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e372f4b6-270b-4770-bc29-60386c166a0a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1563 microversion: 2.1 time: 0.196051 Oct 28 18:56:41.150681 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3972/7730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:56:40 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:12.438518 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=38 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:12.439288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:12.444177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:12.447212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:12.454177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:12.454664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:12.455103 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:12.455838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:12.456297 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:12.456728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:12.510697 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-301c1d9b-456d-40a1-9e8d-96882c03fb8b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action" status: 200 len: 24570 microversion: 2.1 time: 0.074267 Oct 28 18:57:12.511361 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3759/7731] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:57:12 2022] POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:57:42.937925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:42.938854 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=36 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:42.943453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:57:42.945892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:42.953494 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:42.953998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:42.954481 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:42.955195 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:42.955687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:42.956136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:43.029479 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6cc1d76-ca51-4163-b20b-8e826a0e597e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action" status: 202 len: 0 microversion: 2.1 time: 0.093298 Oct 28 18:57:43.030117 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3973/7732] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:57:42 2022] POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:57:43.039176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:43.039905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:43.044334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:43.045001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:57:43.049371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:43.049854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:43.050357 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:43.051048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:43.051521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:43.051943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:43.190287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:43.198338 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-536d4977-70c0-4806-96a1-27b29218794f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1674 microversion: 2.1 time: 0.163290 Oct 28 18:57:43.198910 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3760/7733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:43 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:44.223975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:44.224686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:44.231347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:44.231878 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:44.232333 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:44.233040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:44.233509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:44.233948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:44.461488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:44.469401 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7411680a-d8b1-4260-ac81-add2e4426080 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.250843 Oct 28 18:57:44.469969 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3974/7734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:44 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:45.495007 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:45.495644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:45.505593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:45.506070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:45.506503 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:45.507187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:45.507732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:45.508154 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:45.640583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:45.648626 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-18f278c2-00d3-4de0-a47c-775b184d614a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.157958 Oct 28 18:57:45.649210 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3761/7735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:45 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:46.672939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:46.673569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:46.679959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:46.680460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:46.681485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:46.682277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:46.682750 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:46.683196 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:46.817305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:46.825210 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3499c2af-93e4-4b9f-bd12-148395690b96 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.156246 Oct 28 18:57:46.825791 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3975/7736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:46 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:47.848624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:47.849218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:47.856706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:47.857238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:47.857799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:47.858815 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:47.859316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:47.859818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:47.989431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:47.997593 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bec79498-25f2-46d8-9446-ea48ad805683 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.152858 Oct 28 18:57:47.998163 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3762/7737] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:47 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:49.020685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:49.021332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:49.029499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:49.030008 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:49.030458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:49.031165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:49.031666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:49.032106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:49.168437 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:49.180942 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ecb8d55-b52d-48cc-a757-d4124496f589 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.164052 Oct 28 18:57:49.181673 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3976/7738] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:49 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:50.205062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:50.205666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:50.212959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:50.213434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:50.213859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:50.214540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:50.214986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:50.215427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:50.346715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:50.355472 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d1f626c3-4824-4bf9-80a8-f8f38a56a655 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.154343 Oct 28 18:57:50.356254 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3763/7739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:50 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:51.378136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:51.378761 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:51.385945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:51.386443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:51.386902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:51.387629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:51.388097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:51.388538 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:51.520967 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:51.529030 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34b53361-86ed-4cfe-8cfb-30777456ae58 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.154872 Oct 28 18:57:51.529600 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3977/7740] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:51 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:52.552453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:52.553056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:52.560120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:52.560540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:52.560970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:52.561652 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:52.562097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:52.562514 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:52.694892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:52.702666 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2ef0a3e4-18bc-44a8-b0bd-9248eb5b5f32 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.154067 Oct 28 18:57:52.703244 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3764/7741] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:52 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 18:57:53.726262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:53.726876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:53.734444 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:53.734938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:53.735393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:53.736101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:53.736578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:53.737032 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:53.867949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:53.876188 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8dbea1a6-25ef-4f35-9898-879ed1671f85 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1679 microversion: 2.1 time: 0.153735 Oct 28 18:57:53.876758 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3978/7742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:53 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:57:54.900843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:57:54.901732 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:57:54.908431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:54.908920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:54.909358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:54.910055 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:57:54.910513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:57:54.910941 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:57:55.047327 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:57:55.054965 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-da759654-c7b9-4e48-b771-fcdf3b804018 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1682 microversion: 2.1 time: 0.158689 Oct 28 18:57:55.055565 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3765/7743] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:57:54 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:25.269197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:25.271685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:25.273844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:25.274516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:25.281925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:25.282422 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:25.282870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:25.283602 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:25.284064 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:25.284500 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:25.343092 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8ec552b2-8dd1-4bcd-b37f-bab7991c9415 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action" status: 200 len: 69083 microversion: 2.1 time: 0.077999 Oct 28 18:58:25.343769 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3979/7744] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:58:25 2022] POST /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c/action => generated 69083 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 18:58:42.391931 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:42.392473 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:42.394969 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:42.395692 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe249efd-98c0-4910-8843-0e5eae6e256c", "tag": "db30581a-d67d-4407-bb12-8358a08841e7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:42.396172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=36 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:42.397684 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:58:42.399470 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c (ip 10.222.0.48) !!! Oct 28 18:58:42.402556 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 18:58:42.402688 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 18:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c (ip 10.222.0.48) !!! Oct 28 18:58:42.404863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:42.405543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:42.413797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:42.415052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:42.415324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:42.415717 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:42.416403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:42.417136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:42.417620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:42.418372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:42.418903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:42.432565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] Creating event network-changed:db30581a-d67d-4407-bb12-8358a08841e7 for instance fe249efd-98c0-4910-8843-0e5eae6e256c on n-h1-860864-13 Oct 28 18:58:42.438635 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6f2fa07d-ac5a-4b05-a337-9b58a87e426e req-179852bc-0dba-4934-8fcf-4eacec019867 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047492 Oct 28 18:58:42.439633 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3980/7745] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 18:58:42.457362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 18:58:42.557232 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c1df976f-c001-4be8-8846-0139f8881c25 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 204 len: 0 microversion: 2.1 time: 0.169187 Oct 28 18:58:42.570669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:42.571603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:42.574064 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3766/7746] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 18:58:42 2022] DELETE /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 18:58:42.580584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:42.581695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:42.582069 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:42.582856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:42.583458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:42.584053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:42.740499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:42.749381 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7c874518-080e-4e4f-bbfe-fcd121ca94dc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1688 microversion: 2.1 time: 0.184381 Oct 28 18:58:42.749984 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3981/7747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:42 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:43.774338 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:43.775040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:43.782351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:43.782834 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:43.783270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:43.783988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:43.784441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:43.784868 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:43.924920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:43.932708 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d5f4463e-3394-4b24-b6c5-e426f7db625c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1688 microversion: 2.1 time: 0.162916 Oct 28 18:58:43.933874 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3767/7748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:43 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:44.613256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe249efd-98c0-4910-8843-0e5eae6e256c", "name": "network-vif-deleted", "tag": "db30581a-d67d-4407-bb12-8358a08841e7"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:44.624427 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:44.624927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:44.625385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:44.637920 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] Creating event network-vif-deleted:db30581a-d67d-4407-bb12-8358a08841e7 for instance fe249efd-98c0-4910-8843-0e5eae6e256c on n-h1-860864-13 Oct 28 18:58:44.642913 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-75ebcdd9-07ae-4872-9c8e-89975074b84a req-eebdab29-888e-4b5e-97bc-9809fbcb1d7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033542 Oct 28 18:58:44.643552 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3982/7749] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:44.956890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:44.957506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:44.964583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:44.966948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:44.967762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:44.968565 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:44.969293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:44.969509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:45.004595 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:45.005082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:45.005836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:45.006674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'fault' on Instance uuid fe249efd-98c0-4910-8843-0e5eae6e256c {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 18:58:45.053542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:45.062221 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b126415d-037b-4fbf-91dd-976b04bdbc8e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 200 len: 1356 microversion: 2.1 time: 0.109189 Oct 28 18:58:45.062865 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3768/7750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:44 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:46.087603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:46.088345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: fe249efd-98c0-4910-8843-0e5eae6e256c] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:46.094610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:46.095109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:46.095597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:46.096303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:46.096799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:46.097243 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:46.111803 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] HTTP exception thrown: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Request method failure captured: Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c HTTP/1.1 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCV1xTcEStBC93NKyUh4uvgOe0ugIhjtWxJxgUtthjZs7lw_VGzwLuqDWSbyAAwptNg-cRGRpPmosfXc1ymv53BjpBbYyoyop9KhsbhIyviLXRRfGYpSND16e-PuVRLPgbFMPm8Kxg5tAFUfdwc26cccVnXsgQ_pXt-bU0_Foebyc74 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: fd82b6984b034506a34851741541ea87 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd82b6984b034506a34851741541ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd82b6984b034506a34851741541ea87"}]}] Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: fd82b6984b034506a34851741541ea87 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0594fb39380543f7afdda56ca8e437be Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'fe249efd-98c0-4910-8843-0e5eae6e256c'} Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:58:46.113468 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Returning 404 to user: Instance fe249efd-98c0-4910-8843-0e5eae6e256c could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49a90a48-c306-403f-90fc-766130e56c27 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c" status: 404 len: 111 microversion: 2.1 time: 0.032554 Oct 28 18:58:46.118892 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3983/7751] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:46 2022] GET /compute/v2.1/servers/fe249efd-98c0-4910-8843-0e5eae6e256c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 18:58:49.473670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d54e882c-8f98-4fda-aa77-4f6bdaf117c8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '.version_select at 0x7f751ec7bb80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:49.507707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d54e882c-8f98-4fda-aa77-4f6bdaf117c8 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1436765329" status: 202 len: 0 microversion: 2.1 time: 0.038014 Oct 28 18:58:49.508368 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3769/7752] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 18:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1436765329 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 18:58:49.534732 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61dc82cd-764b-4645-8837-cea4e87f4afb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: .version_select at 0x7f7524213430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1970797915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzH35LrIo2VIUmTSkpgcu//yiScFbklYgO0slyTUGw0yIope7heKK9Ut7ca7d32ZTDsSmiR8wJJ5pwfhHKc7Qwe2ZRlZoDTM+3ihFntp6unBocORqGbfmBxkl6i76awOA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:49.552806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-61dc82cd-764b-4645-8837-cea4e87f4afb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:58:49.559163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-61dc82cd-764b-4645-8837-cea4e87f4afb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:58:49.584826 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61dc82cd-764b-4645-8837-cea4e87f4afb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054006 Oct 28 18:58:49.585441 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3984/7753] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 18:58:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:55.076146 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-421478842", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "f4d6115b-285b-48cb-8a5a-14f03bb3c699"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1970797915", "security_groups": [{"name": "tempest-secgroup-smoke-809229385"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:55.086860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:55.189555 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] validate_networks() for [('f4d6115b-285b-48cb-8a5a-14f03bb3c699', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 18:58:55.653355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 18:58:55.653812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 18:58:55.654284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 18:58:55.654746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 18:58:55.655392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 18:58:55.669814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:55.670296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:55.670726 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:55.671469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:55.671911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:55.672340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:55.691065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 18:58:55.696647 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 18:58:55.711360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 18:58:55.713754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 18:58:55.768664 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-122ffb67-abfe-48a8-86f9-88bdda5e9b5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.699210 Oct 28 18:58:55.770041 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3770/7754] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 18:58:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 18:58:55.781873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee9874f0-88bd-4f27-bad0-b5726358bd23 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:55.783115 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee9874f0-88bd-4f27-bad0-b5726358bd23 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:55.867175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee9874f0-88bd-4f27-bad0-b5726358bd23 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:55.876456 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee9874f0-88bd-4f27-bad0-b5726358bd23 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1266 microversion: 2.1 time: 0.098495 Oct 28 18:58:55.877381 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3985/7755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:55 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:56.905228 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:56.906044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:56.915013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:56.915730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:56.916444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:56.918288 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:56.918850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:56.919733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:57.001299 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:57.010735 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4d9075cf-6a52-492c-8e08-cbf131415c7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1336 microversion: 2.1 time: 0.113074 Oct 28 18:58:57.012381 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3771/7756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:56 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:58.036524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:58.037168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:58.039407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:58:58.047965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:58.048293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:58.049152 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:58.050013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:58.050737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:58.051090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:58.208895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:58.219425 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6a950394-e32c-416d-a472-d78b52b29d5d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.186654 Oct 28 18:58:58.230722 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3986/7757] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:58 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:58:58.374046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:58:58.390736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:58.391543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:58.392097 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:58.406100 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] Creating event network-changed:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h2-860864-13 Oct 28 18:58:58.412906 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-683436f7-5c9c-492e-938e-83f6d9b0f55a req-72779c82-f128-4575-93e8-a42712f9bcf2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045117 Oct 28 18:58:58.414064 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3772/7758] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:58:59.244136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:58:59.244901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:58:59.252630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:59.253130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:59.253793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:59.254511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:58:59.254982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:58:59.255529 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:58:59.391241 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:58:59.399329 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e141259b-6bae-4b8b-b9e9-c7312f48492f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.159428 Oct 28 18:58:59.399946 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3987/7759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:58:59 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:00.423770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:00.424481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:00.430588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:00.431074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:00.431542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:00.432238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:00.432703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:00.433130 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:00.570298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:00.579077 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1eef9998-570b-42c7-89d9-75084cbccb7c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.160574 Oct 28 18:59:00.579692 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3773/7760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:00 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:01.602469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:01.603056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:01.609942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:01.610443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:01.610896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:01.611661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:01.612131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:01.612574 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:01.744664 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:01.752994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-74dda18e-c3c7-4717-9c90-cd4616dbc131 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.154593 Oct 28 18:59:01.753574 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3988/7761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:01 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:02.776161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:02.777457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:02.784513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:02.785002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:02.785439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:02.786131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:02.786591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:02.787018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:02.920678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:02.928191 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a3b07550-d90d-4758-b61f-fb951aa5969a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.156006 Oct 28 18:59:02.928763 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3774/7762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:02 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:03.952256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:03.952820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:03.959813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:03.960313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:03.960769 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:03.961482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:03.961956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:03.962404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:04.097798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:04.106403 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67e32a0c-87c4-44eb-9f7d-ee6b8392cbb5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.158335 Oct 28 18:59:04.106968 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3989/7763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:03 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:05.129287 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:05.129894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:05.137451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:05.137957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:05.138375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:05.139066 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:05.139574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:05.139999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:05.264648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "name": "network-vif-plugged", "status": "completed", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:05.275170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:05.275711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:05.276166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:05.288791 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] Creating event network-vif-plugged:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h2-860864-13 Oct 28 18:59:05.294357 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-05de6675-c51c-463e-b14b-5a79b347dc28 req-5611c00c-a9cc-490a-a7e4-41f4407f9f38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102033 Oct 28 18:59:05.294969 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3990/7764] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:05.557743 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:05.565416 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e1161176-3ac5-4688-8678-c7a6eb94411b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.440073 Oct 28 18:59:05.565989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3775/7765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:05 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:06.586580 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:06.592405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:06.593126 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:06.599669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:06.600174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:06.600634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:06.601350 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:06.601822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:06.602267 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:06.752563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:06.760344 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a522ba78-e47b-478e-b355-062fd4573061 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1391 microversion: 2.1 time: 0.174814 Oct 28 18:59:06.760921 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3991/7766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:06 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:07.783885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:07.784491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:07.786435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:07.787120 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:07.794576 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:07.795063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:07.795606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:07.796371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:07.796821 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:07.797246 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:07.933030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:07.941904 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cefa3a32-5d73-49d9-aa77-fa362657d058 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1562 microversion: 2.1 time: 0.161866 Oct 28 18:59:07.942564 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3776/7767] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:07 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:07.964284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:07.964948 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:07.971743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:07.972239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:07.972691 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:07.973402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:07.973863 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:07.974303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:08.111095 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:08.119024 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-72265c1c-901d-4562-8960-65f9dfa1ee6d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1562 microversion: 2.1 time: 0.158752 Oct 28 18:59:08.119662 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3992/7768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:07 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:10.019801 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 18:59:10.020618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:10.020996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:10.029323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:10.029930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:10.030628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:10.031459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:10.031742 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:10.032195 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:10.032321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:10.032646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:10.032804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:10.045379 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] Creating event network-changed:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h2-860864-13 Oct 28 18:59:10.050951 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-04070661-f9f3-48f7-b426-627e64b589eb req-6cb17ce8-4568-4abc-b360-e362b3bb797a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Oct 28 18:59:10.052041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3993/7769] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 18:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 18:59:10.175087 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 18:59:10.182940 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a41dfa67-3c3d-482b-93d2-8bca4920b194 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1562 microversion: 2.1 time: 0.167851 Oct 28 18:59:10.184323 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3777/7770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 18:59:10 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 18:59:41.462526 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:41.463321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 18:59:41.468548 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 18:59:41.470803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 18:59:41.478043 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:41.478537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:41.478991 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:41.479730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 18:59:41.480199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 18:59:41.480640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 18:59:41.533047 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ac3fccbb-1b29-4957-81b9-286b7c9296c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action" status: 200 len: 24573 microversion: 2.1 time: 0.072482 Oct 28 18:59:41.533694 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3994/7771] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 18:59:41 2022] POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:00:11.970309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:11.971070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=40 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:12.028672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:12.031046 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:12.037088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:12.037573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:12.038009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:12.038698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:12.039148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:12.039608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:12.119086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:12.126447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120567) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 19:00:12.133122 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:00:12.133540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:00:12.134039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:00:12.134444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:00:12.134848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:00:12.198725 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a0d1e8a-e9fa-4f59-9f8d-5e093d915477 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action" status: 202 len: 0 microversion: 2.1 time: 0.231040 Oct 28 19:00:12.202346 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3778/7772] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:00:11 2022] POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:00:12.208456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:12.209172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:12.212963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:12.213623 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:00:12.220056 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:12.220604 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:12.221121 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:12.221861 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:12.222595 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:12.223232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:12.370122 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:12.378954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e8f5ded-a2f1-4b56-9034-4af4b0e47ad7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1689 microversion: 2.1 time: 0.174731 Oct 28 19:00:12.382259 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3995/7773] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:12 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:13.408264 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:13.408984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:13.415817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:13.416918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:13.417365 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:13.418068 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:13.418563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:13.418984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:13.597546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:13.605264 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3e1665b6-97ec-4715-a084-097d33e02ecd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1689 microversion: 2.1 time: 0.203274 Oct 28 19:00:13.605847 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3779/7774] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:13 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:14.629770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:14.630334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:14.637545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:14.638038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:14.638484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:14.639185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:14.639676 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:14.640110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:14.775628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:14.783571 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-86c48b07-6b5b-42d2-9901-b8903a48c2fd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.157800 Oct 28 19:00:14.784155 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3996/7775] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:14 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:15.807871 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:15.808479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:15.816311 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:15.816794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:15.817233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:15.817918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:15.818370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:15.818794 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:15.950915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:15.958624 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d71c12d0-1a5e-43f1-9009-a5721bbc105f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.154690 Oct 28 19:00:15.959191 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3780/7776] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:15 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:16.982219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:16.982843 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:16.989388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:16.989891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:16.990345 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:16.991053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:16.991556 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:16.991998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:17.126113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:17.133921 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7db49593-ace5-42b1-a53d-c39b7dc8a18c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.155725 Oct 28 19:00:17.134503 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3997/7777] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:16 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:18.158870 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:18.159613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:18.165995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:18.166549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:18.166985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:18.167702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:18.168155 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:18.168572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:18.309412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:18.317760 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2d312588-61d1-4897-8d26-d898b3d80b51 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.163430 Oct 28 19:00:18.318335 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3781/7778] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:18 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:19.341301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:19.341919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:19.349303 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:19.349786 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:19.350237 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:19.350944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:19.351435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:19.351877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:19.485987 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:19.493750 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3dedee51-d20b-4a2c-8468-99cbc3dd4007 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.156444 Oct 28 19:00:19.494339 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3998/7779] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:19 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:20.518435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:20.519024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:20.525764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.526256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.526686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.527388 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:20.527842 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:20.528262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:20.962730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:20.970976 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b78a0bf2-a8c9-485d-8b81-04147b7c19e0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.457128 Oct 28 19:00:20.971609 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3782/7780] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:20 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:21.994111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:21.994735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:22.001760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:22.002265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:22.002723 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:22.003525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:22.004001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:22.004451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:22.136251 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:22.145026 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e69036fd-ce47-4cc5-bc5a-3f00bcc3c12e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.154846 Oct 28 19:00:22.145851 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 3999/7781] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:21 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:23.245049 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:23.245661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:23.253517 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:23.254004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:23.254444 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:23.255139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:23.255623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:23.256051 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:23.392174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:23.400165 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-36f64741-8702-48a5-96be-e2d2f4639826 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.159022 Oct 28 19:00:23.400737 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3783/7782] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:23 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:24.425331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:24.425981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:24.432959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:24.433452 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:24.433902 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:24.434597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:24.435055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:24.435513 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:24.566428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:24.574256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b9b561ef-1ab9-4b4c-bfed-d14d119fe123 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.154004 Oct 28 19:00:24.574824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4000/7783] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:24 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:25.597648 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:25.598358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:25.605323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:25.605814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:25.606256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:25.606956 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:25.607433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:25.607863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:25.741456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:25.749967 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02018c71-6acf-401d-af73-bbeba8456ad5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1694 microversion: 2.1 time: 0.155566 Oct 28 19:00:25.750817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3784/7784] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:25 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:26.632804 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "name": "network-vif-unplugged", "status": "completed", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:26.643659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:26.644194 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:26.644714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:26.661466 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Creating event network-vif-unplugged:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h1-860864-13 Oct 28 19:00:26.666954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120568) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:00:26.680503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6facf364-7d96-4399-8969-894ec621ea9d req-99af00bd-785e-43a7-be68-d3139ce169d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051387 Oct 28 19:00:26.681186 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4001/7785] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:26.780408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:26.781209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:26.788359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:26.788892 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:26.789332 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:26.790029 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:26.790479 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:26.790959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:26.926682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:26.934640 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3a4a4f4b-48bd-4f85-b65f-5c015821c5b1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1693 microversion: 2.1 time: 0.158174 Oct 28 19:00:26.935228 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3785/7786] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:26 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:27.960475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:27.961104 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:27.968474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:27.969485 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:27.969947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:27.970654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:27.971124 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:27.971603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:28.106793 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:28.114694 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-675cc118-ce08-4c57-b0eb-06ac39f98dc4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1691 microversion: 2.1 time: 0.158655 Oct 28 19:00:28.115269 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4002/7787] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:27 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:28.721499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:28.731537 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:28.732016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:28.732448 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:28.744617 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Creating event network-changed:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h1-860864-13 Oct 28 19:00:28.750506 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860864-13', 'n-h2-860864-13'} {{(pid=120567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 19:00:28.761255 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-f5effeeb-8214-4c6f-ac3b-004870eb9cae req-ad065967-adee-4a72-9ca8-8da63b1b3e36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043595 Oct 28 19:00:28.761838 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3786/7788] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:00:29.138148 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:29.138770 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:29.145945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:29.146448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:29.147051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:29.147635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:29.148759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:29.149208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:29.293787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:29.302266 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd317bf7-e38e-4c7d-a73e-e0ede5976cf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1691 microversion: 2.1 time: 0.168097 Oct 28 19:00:29.302853 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4003/7789] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:29 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:30.326852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:30.327698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:30.334136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.334627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.335067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.335800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.336255 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.336680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.475209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:30.483113 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9ce1caa0-4302-47ca-bfa7-3ae857e46946 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1688 microversion: 2.1 time: 0.161479 Oct 28 19:00:30.484114 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3787/7790] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:30 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:30.507990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:30.508524 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:30.516217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.516718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.517172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.517886 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.518348 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.518784 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.579178 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-492e5556-4dd6-4dcd-b62d-24403a780e6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action" status: 204 len: 0 microversion: 2.1 time: 0.075012 Oct 28 19:00:30.580090 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4004/7791] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:00:30 2022] POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:00:30.591038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:30.591704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:30.598873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.599456 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.599905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.600624 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.601091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.601530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.740361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:30.748920 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-133c5068-639a-42b5-ad06-a7c30f349e33 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1688 microversion: 2.1 time: 0.163860 Oct 28 19:00:30.750019 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3788/7792] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:30 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:30.773467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:30.774230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:30.780966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.781716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.782245 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.783089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:30.783660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:30.784176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:30.929071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:30.937653 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d51ef79c-2090-45ec-9be4-2f6436b7d8b0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1688 microversion: 2.1 time: 0.168354 Oct 28 19:00:30.938244 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4005/7793] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:30 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:31.962224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:31.962929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:31.972267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:31.973127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:31.973615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:31.975420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:31.975804 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:31.976325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:32.122165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:32.130168 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e2cb78d-fa9c-4eb3-83c8-16f44b0533c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1688 microversion: 2.1 time: 0.172066 Oct 28 19:00:32.130745 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3789/7794] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:31 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:33.154037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:00:33.154690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:00:33.161813 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:33.162312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:33.162763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:33.163505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:33.163977 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:33.164414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:33.295856 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:00:33.304370 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-61bd80f2-aded-40a3-8ef8-fb0e2b1e846b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1680 microversion: 2.1 time: 0.154304 Oct 28 19:00:33.304949 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4006/7795] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:00:33 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:00:33.964392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "name": "network-vif-plugged", "status": "completed", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:00:33.974946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:00:33.975644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:00:33.976118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:00:33.988043 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] Creating event network-vif-plugged:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h1-860864-13 Oct 28 19:00:33.992994 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-aa716967-1c72-400f-86be-1d54f8db34a0 req-dee143dd-f493-404a-b666-fed4c1811226 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Oct 28 19:00:33.993597 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3790/7796] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:01.515655 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:01.518013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:01.520382 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=24 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.521318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:01.527036 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:01.527579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:01.528033 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:01.528739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:01.529216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:01.529654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:01.582954 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d4bae69-0954-4ca3-92ce-309184648e7f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action" status: 200 len: 24570 microversion: 2.1 time: 0.071300 Oct 28 19:01:01.583607 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4007/7797] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:01:01 2022] POST /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:01:18.643173 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=30 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:18.644369 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:18.648786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:18.649370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:18.652050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:18.652660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:18.657669 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:18.658450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:18.659109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:18.659873 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:18.660321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:18.660754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:18.690250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:01:18.710263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:18.725480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:18.726236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:18.726791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:18.741038 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] Creating event network-changed:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h1-860864-13 Oct 28 19:01:18.746648 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7579ff65-08cb-4e19-9bf7-a568f7aef738 req-6f43b4dc-005f-45b6-ac66-77ce9079f44b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102742 Oct 28 19:01:18.747805 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4008/7798] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:01:18.785706 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dd963797-073a-4cc2-af38-a9f5ffd18c6c tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 204 len: 0 microversion: 2.1 time: 0.143187 Oct 28 19:01:18.785706 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3791/7799] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:01:18 2022] DELETE /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:01:18.797258 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:18.799073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:18.809426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:18.810474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:18.810474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:18.811290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:18.811794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:18.812287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:18.959959 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:18.967758 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-164caab4-102d-4627-898d-053fc82b7fbd tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1686 microversion: 2.1 time: 0.176735 Oct 28 19:01:18.968339 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4009/7800] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:18 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:19.993378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:19.994101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:20.000932 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:20.001578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:20.002003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:20.002699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:20.003165 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:20.003615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:20.136789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:20.145013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a2408d0b-033d-4048-a98e-129e0e633985 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1686 microversion: 2.1 time: 0.155894 Oct 28 19:01:20.145601 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3792/7801] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:19 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:20.786384 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8", "name": "network-vif-deleted", "tag": "59e30645-be27-4ad6-8d9a-1509eb325e6b"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:20.797151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:20.797637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:20.798078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:20.810997 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] Creating event network-vif-deleted:59e30645-be27-4ad6-8d9a-1509eb325e6b for instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 on n-h1-860864-13 Oct 28 19:01:20.816857 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-bf771f8b-9bcf-4894-8519-39cb00aed2ae req-99afc1fb-b29f-4ba3-b99d-3b766af3bec7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Oct 28 19:01:20.817451 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4010/7802] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:21.170222 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:21.171021 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:21.180957 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:21.181730 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:21.182752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:21.183736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:21.184696 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:21.185325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:21.226237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:21.226722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:21.227167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:21.227625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'fault' on Instance uuid e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:01:21.271538 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:21.280928 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-784aa47a-7bb8-4970-8fc7-766f687b7f39 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 200 len: 1356 microversion: 2.1 time: 0.114583 Oct 28 19:01:21.281506 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3793/7803] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:21 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:22.306418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:22.307156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:22.313492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:22.314097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:22.314609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:22.315332 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:22.315864 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:22.316305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:22.329646 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] HTTP exception thrown: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Request method failure captured: Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 HTTP/1.1 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCV1xTcEStBC93NKyUh4uvgOe0ugIhjtWxJxgUtthjZs7lw_VGzwLuqDWSbyAAwptNg-cRGRpPmosfXc1ymv53BjpBbYyoyop9KhsbhIyviLXRRfGYpSND16e-PuVRLPgbFMPm8Kxg5tAFUfdwc26cccVnXsgQ_pXt-bU0_Foebyc74 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd82b6984b034506a34851741541ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd82b6984b034506a34851741541ea87"}]}] Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0594fb39380543f7afdda56ca8e437be Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8'} Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:01:22.331488 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Returning 404 to user: Instance e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c8516ef0-6b32-47bf-ad88-371f4afff321 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8" status: 404 len: 111 microversion: 2.1 time: 0.031662 Oct 28 19:01:22.336879 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4011/7804] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:22 2022] GET /compute/v2.1/servers/e758d8e8-e0e5-4ff7-9906-d8bf4b86ddf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:01:25.365798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5a3c9b7a-a243-49a6-8add-6aabaed8d8e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '.version_select at 0x7f751ed34160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:25.388031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5a3c9b7a-a243-49a6-8add-6aabaed8d8e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1970797915" status: 202 len: 0 microversion: 2.1 time: 0.026049 Oct 28 19:01:25.389104 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3794/7805] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 19:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1970797915 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:01:25.416985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-412810f2-ed60-4461-80e7-372343759320 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: .version_select at 0x7f75245c2700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1167569295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN4Ek6D8XwwG3bW0vVkoCVjxVl4ngyVqFIViUKf6khzamxRLBA9Kn/zpaYDACYHcq+72xYhm4mGaq01GpZejCiDOL4onF7If9mdrstil80oQ4ZWXgGTPC6SkgCtDgqElQ=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:25.433443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-412810f2-ed60-4461-80e7-372343759320 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:01:25.439912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-412810f2-ed60-4461-80e7-372343759320 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:01:25.463499 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-412810f2-ed60-4461-80e7-372343759320 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050497 Oct 28 19:01:25.464248 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4012/7806] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 19:01:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:30.975072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1515195868", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "69f5a69f-bf84-4251-b2d1-407500e905ba"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1167569295", "security_groups": [{"name": "tempest-secgroup-smoke-1182949590"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:31.119316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] validate_networks() for [('69f5a69f-bf84-4251-b2d1-407500e905ba', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:01:31.280045 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:31.540291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:01:31.540721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:01:31.541202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:01:31.541616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:01:31.542037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:01:31.551987 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:31.552475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:31.552920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:31.553662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:31.554362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:31.554800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:31.572980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:01:31.578306 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:01:31.591617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:01:31.593965 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:01:31.643203 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8041da78-cc97-444a-958e-630c72a0f53f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671617 Oct 28 19:01:31.650547 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3795/7807] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:01:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:01:31.656016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a08d7f30-ad4d-4195-8182-c682d35db3fb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:31.656650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a08d7f30-ad4d-4195-8182-c682d35db3fb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:31.723127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a08d7f30-ad4d-4195-8182-c682d35db3fb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:31.730765 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a08d7f30-ad4d-4195-8182-c682d35db3fb tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1267 microversion: 2.1 time: 0.078885 Oct 28 19:01:31.731675 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4013/7808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:31 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:32.758986 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:32.759666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:32.777244 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:32.778341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:32.778341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:32.778887 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:32.779339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:32.779797 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:32.903497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:32.921884 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f26e711d-7eaa-4b90-9b15-4fa191df4353 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1327 microversion: 2.1 time: 0.171720 Oct 28 19:01:32.922559 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3796/7809] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:32 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:33.946337 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:33.947083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:33.949176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:33.957044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:33.957637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:33.958492 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:33.959295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:33.959939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:33.960457 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:34.101927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:34.111048 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bb457372-23a4-483d-9ac4-f3b90dd8be02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.168655 Oct 28 19:01:34.111751 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4014/7810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:33 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:34.399800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d358dac1-7ea9-41bf-bd12-09aadcee2ebd", "tag": "82b092ea-04eb-4eb2-9c46-366eaf676fed"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:34.411093 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:34.411618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:34.412052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:34.422959 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] Creating event network-changed:82b092ea-04eb-4eb2-9c46-366eaf676fed for instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd on n-h2-860864-13 Oct 28 19:01:34.429427 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-57ad974b-4430-4692-ad97-cac1ef2de0ae req-d979f119-09e0-43c0-86ac-322e50912c8d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093119 Oct 28 19:01:34.430045 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3797/7811] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:35.134726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:35.135438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:35.143219 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:35.143741 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:35.144204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:35.144893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:35.145373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:35.145803 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:35.280747 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:35.289095 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52d75d27-f585-49b4-9df5-14f238dc415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.158319 Oct 28 19:01:35.289677 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4015/7812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:35 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:36.313852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:36.314584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:36.320875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.321363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.321802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.322499 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:36.322953 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:36.323414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:36.459513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:36.467359 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-92c5ebd5-2a61-45a1-a187-de33a0703ee1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.158713 Oct 28 19:01:36.467992 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3798/7813] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:36 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:37.490516 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:37.491130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:37.498096 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:37.498566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:37.499012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:37.499743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:37.500395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:37.500833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:37.637186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:37.645005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01b7fb2f-3366-4b5e-88d3-0dd061d0a0e9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.159001 Oct 28 19:01:37.645572 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4016/7814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:37 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:38.668229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:38.668802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:38.676554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:38.677048 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:38.677490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:38.678194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:38.678656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:38.679090 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:38.809890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:38.818226 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-118ccb38-bc0d-43bb-9fd9-eca74dbbb298 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.153988 Oct 28 19:01:38.818801 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3799/7815] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:38 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:39.840517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:39.841145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:39.848295 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:39.848874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:39.849336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:39.850055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:39.850531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:39.850975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:39.995287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:40.003723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1163fcc2-3496-4a55-b167-d49cb54fb3b6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.167138 Oct 28 19:01:40.004324 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4017/7816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:39 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:40.019714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d358dac1-7ea9-41bf-bd12-09aadcee2ebd", "name": "network-vif-plugged", "status": "completed", "tag": "82b092ea-04eb-4eb2-9c46-366eaf676fed"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:40.032221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:40.032709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:40.033161 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:40.045868 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] Creating event network-vif-plugged:82b092ea-04eb-4eb2-9c46-366eaf676fed for instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd on n-h2-860864-13 Oct 28 19:01:40.051487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-bccca34a-ff30-4dfe-b615-97737a7cae9d req-fd25ee21-9879-4f79-a690-da80c81aa446 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035745 Oct 28 19:01:40.052167 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3800/7817] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:41.027586 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:41.028217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:41.036007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:41.036510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:41.036963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:41.037678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:41.038150 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:41.038597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:41.169634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:41.177994 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d63f51d7-847c-405d-8800-62ea446b6180 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1393 microversion: 2.1 time: 0.154352 Oct 28 19:01:41.178572 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4018/7818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:41 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:42.199807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.200612 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.206863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:42.207617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:42.215627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.216121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.216556 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.217286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.217727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.218150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.358715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:42.368060 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54352327-32aa-4556-9a90-8cf5a08928bf tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1566 microversion: 2.1 time: 0.170113 Oct 28 19:01:42.368759 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3801/7819] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:42 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:01:42.390615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:42.391250 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:42.393376 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:01:42.400532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.401041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.401738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.402469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:42.402961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:42.403542 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:42.547155 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:42.556720 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b7720a71-7a65-44fb-af4d-8b500570ab8a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1566 microversion: 2.1 time: 0.169955 Oct 28 19:01:42.557665 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4019/7820] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:42 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:01:44.448212 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:01:44.449453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:01:44.450913 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d358dac1-7ea9-41bf-bd12-09aadcee2ebd", "tag": "82b092ea-04eb-4eb2-9c46-366eaf676fed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:01:44.457482 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.457978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.458416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.459360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.460064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.460491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.463228 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:01:44.463771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:01:44.464212 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:01:44.476722 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] Creating event network-changed:82b092ea-04eb-4eb2-9c46-366eaf676fed for instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd on n-h2-860864-13 Oct 28 19:01:44.482080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6ec9667a-c297-4642-939f-2e2cf7263d54 req-ffc6a97b-c19a-4942-8f89-2c2e31b31da7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035057 Oct 28 19:01:44.483433 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4020/7821] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:01:44.609708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:01:44.618751 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4ee0ca2f-4660-403f-9953-4a13ec8f092f tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1566 microversion: 2.1 time: 0.174391 Oct 28 19:01:44.619727 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3802/7822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:01:44 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:02:15.900328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:15.902635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:15.904966 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:02:15.905109 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action (ip 10.222.0.48) !!! Oct 28 19:02:15.906495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:15.907336 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=38 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:15.914916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:15.915424 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:15.915880 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:15.916592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:15.917061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:15.917504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:15.968099 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-390fc17f-7fb1-4ef0-8542-ec40e88db2c0 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action" status: 200 len: 24568 microversion: 2.1 time: 0.072406 Oct 28 19:02:15.968773 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4021/7823] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:02:15 2022] POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:46.436156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:46.436911 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=36 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:46.441749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:46.450030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:46.450513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:46.450952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:46.476190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Going to try to stop instance {{(pid=120567) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 19:02:46.517101 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-413def07-0ee3-47d7-a597-148c3968cdf4 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action" status: 202 len: 0 microversion: 2.1 time: 0.082580 Oct 28 19:02:46.517709 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3803/7824] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:02:46 2022] POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:02:46.528045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:46.528851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:46.531283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:46.532085 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:02:46.539841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:46.540338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:46.540787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:46.541522 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:46.541983 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:46.542418 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:46.732490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:46.740503 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-67a5a252-f40f-4677-aad8-dc2abe460559 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.216960 Oct 28 19:02:46.741083 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4022/7825] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:46 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:47.766136 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:47.766852 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:47.773995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:47.774487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:47.774929 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:47.775654 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:47.776113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:47.776549 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:47.911609 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:47.919391 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-170c4f22-ebcb-4db8-9822-604511fcee62 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.158705 Oct 28 19:02:47.919973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3804/7826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:47 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:48.946079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:48.946701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:48.954514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:48.955006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:48.955484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:48.956182 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:48.956642 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:48.957075 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:49.089402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:49.097155 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-543b1eca-8980-419e-b67b-9c427ba18670 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.156096 Oct 28 19:02:49.097708 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4023/7827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:48 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:50.121780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:50.122373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:50.129364 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:50.129848 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:50.130394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:50.131168 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:50.131731 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:50.132160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:50.262275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:50.270086 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ad2c65bf-8f0a-497c-868e-1f9c1696a376 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.152298 Oct 28 19:02:50.271144 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3805/7828] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:50 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:51.294205 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:51.294827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:51.301772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:51.302573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:51.302853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:51.303596 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:51.304062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:51.304531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:51.439117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:51.447631 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-611f0727-2edf-4fed-920e-73aa3df2fd9b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.157234 Oct 28 19:02:51.448216 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4024/7829] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:51 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:52.471917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:52.472480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:52.480383 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:52.480897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:52.481333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:52.482023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:52.482483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:52.482908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:52.612988 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:52.621240 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0db73d2e-2f16-4777-b9bc-9e98879124c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.153238 Oct 28 19:02:52.621816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3806/7830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:52 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:53.645482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:53.647229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:53.653895 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:53.654392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:53.654841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:53.655577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:53.656040 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:53.656478 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:53.789697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:53.797583 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9f825190-5f95-4999-b2f4-c30a959cce87 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.156121 Oct 28 19:02:53.798160 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4025/7831] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:53 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:54.823617 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:54.824231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:54.831279 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:54.831803 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:54.832238 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:54.832935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:54.834465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:54.834907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:54.977295 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:54.985787 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3085cae1-d1ce-438a-99a4-a106c0a11bea tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.166065 Oct 28 19:02:54.986382 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3807/7832] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:54 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:02:56.010050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:56.010684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:56.017711 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:56.018217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:56.018674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:56.019416 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:56.019893 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:56.020342 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:56.170504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:56.179102 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7cdde70f-2fed-4fa4-bfa8-dc4f7779e0e2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1694 microversion: 2.1 time: 0.173019 Oct 28 19:02:56.179709 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4026/7833] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:56 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:57.202310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:57.202926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:57.210581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:57.211077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:57.211591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:57.212323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:57.212858 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:57.213293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:57.369802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:57.380016 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-546cd466-ae86-404a-bee3-15969a2d69c9 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1671 microversion: 2.1 time: 0.181661 Oct 28 19:02:57.380774 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3808/7834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:57 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:58.495799 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:58.498739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:58.506394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:58.506993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:58.507468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:58.508175 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:58.508645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:58.509078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:58.565048 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-78afdf1e-f6d8-4ef3-a888-4310d9499dbc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action" status: 200 len: 36443 microversion: 2.1 time: 0.074064 Oct 28 19:02:58.565804 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4027/7835] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:02:58 2022] POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action => generated 36443 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:02:58.579876 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:02:58.588166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:58.588814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:58.589260 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:58.615032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Going to try to start instance {{(pid=120567) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 19:02:58.660013 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4f8e629-fd3d-49a6-88ec-df220cfc3f4d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action" status: 202 len: 0 microversion: 2.1 time: 0.084526 Oct 28 19:02:58.660633 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3809/7836] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:02:58 2022] POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:02:58.671047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:58.671823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:58.680129 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:58.680637 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:58.681094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:58.681818 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:58.682281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:58.682721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:58.860117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:02:58.868401 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ad27182e-e8a2-4b2c-9267-d8815caee2b3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1680 microversion: 2.1 time: 0.202012 Oct 28 19:02:58.868919 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4028/7837] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:58 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:02:59.896070 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:02:59.896786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:02:59.903240 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:59.903769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:59.904215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:02:59.904915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:02:59.905378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:02:59.905812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:00.035262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:00.043525 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c843a6d9-ba4b-44f3-b9c6-b16afd1b287e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1684 microversion: 2.1 time: 0.153230 Oct 28 19:03:00.044172 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3810/7838] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:02:59 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:32.264700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:32.266929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:32.269607 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=14 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:32.270276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=40 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:32.277546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:32.278051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:32.278530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:32.279273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:32.279777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:32.280221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:32.336488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e513b7ae-90b3-4212-b673-0166771eb2f2 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action" status: 200 len: 61001 microversion: 2.1 time: 0.075715 Oct 28 19:03:32.337154 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4029/7839] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:03:32 2022] POST /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd/action => generated 61001 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:03:56.180657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:56.181230 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:56.183274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d358dac1-7ea9-41bf-bd12-09aadcee2ebd", "tag": "82b092ea-04eb-4eb2-9c46-366eaf676fed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:56.185498 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=16 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:56.186841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:56.190777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:56.191807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=4 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:03:56.192193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:56.192771 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:56.193057 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:03:56.193460 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.193720 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 28 19:03:56.194326 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:56.195754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:56.196188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.209531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:56.210184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:56.210762 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.223766 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] Creating event network-changed:82b092ea-04eb-4eb2-9c46-366eaf676fed for instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd on n-h2-860864-13 Oct 28 19:03:56.230330 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-1145e3ea-34f5-4641-8748-d43252cb6449 req-7b18c6a8-bc3f-48ac-b8e3-cf2c7ebde9ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050565 Oct 28 19:03:56.230886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:03:56.231534 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4030/7840] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:03:56.316693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bad63bc7-f828-490e-a3f9-18e08a5dd87e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 204 len: 0 microversion: 2.1 time: 0.140223 Oct 28 19:03:56.317662 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3811/7841] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:03:56 2022] DELETE /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:03:56.327685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:56.328456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:56.337039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:56.338456 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:56.340857 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.341953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:56.342965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:56.343952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:56.503901 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:56.513356 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1bdb300-d830-4370-8b30-43d1be4ad2df tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1690 microversion: 2.1 time: 0.191236 Oct 28 19:03:56.514365 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4031/7842] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:56 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:57.540574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:57.541275 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:57.548975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.549463 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.549904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.550593 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:57.551044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:57.551497 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:57.695282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:57.703279 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d4562140-87a8-4159-9c23-a99c640db666 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1690 microversion: 2.1 time: 0.167002 Oct 28 19:03:57.703897 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3812/7843] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:57 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:03:58.436722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d358dac1-7ea9-41bf-bd12-09aadcee2ebd", "name": "network-vif-deleted", "tag": "82b092ea-04eb-4eb2-9c46-366eaf676fed"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:03:58.447628 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.448673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.449344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.461406 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] Creating event network-vif-deleted:82b092ea-04eb-4eb2-9c46-366eaf676fed for instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd on n-h2-860864-13 Oct 28 19:03:58.466647 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-021d691b-8af2-43a9-b0db-d225669fae91 req-b1a58e04-9502-4480-991c-5f0f87417c43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034200 Oct 28 19:03:58.467257 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4032/7844] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:03:58.727762 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:58.728375 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:58.735472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.735970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.736413 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.737121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.737578 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.738004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.775023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:58.775540 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:58.775985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:58.777124 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'fault' on Instance uuid d358dac1-7ea9-41bf-bd12-09aadcee2ebd {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:03:58.818943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:03:58.828448 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-69ba9ee2-0ce4-4732-b068-b730f503ddd6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 200 len: 1357 microversion: 2.1 time: 0.104486 Oct 28 19:03:58.829126 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3813/7845] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:58 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:03:59.854230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:03:59.855285 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: d358dac1-7ea9-41bf-bd12-09aadcee2ebd] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:03:59.862549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:59.863047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:59.863537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:59.864246 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:03:59.864713 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:03:59.865216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:03:59.879005 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] HTTP exception thrown: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Request method failure captured: Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd HTTP/1.1 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCV1xTcEStBC93NKyUh4uvgOe0ugIhjtWxJxgUtthjZs7lw_VGzwLuqDWSbyAAwptNg-cRGRpPmosfXc1ymv53BjpBbYyoyop9KhsbhIyviLXRRfGYpSND16e-PuVRLPgbFMPm8Kxg5tAFUfdwc26cccVnXsgQ_pXt-bU0_Foebyc74 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd82b6984b034506a34851741541ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd82b6984b034506a34851741541ea87"}]}] Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 0594fb39380543f7afdda56ca8e437be Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'd358dac1-7ea9-41bf-bd12-09aadcee2ebd'} Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:03:59.880673 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Returning 404 to user: Instance d358dac1-7ea9-41bf-bd12-09aadcee2ebd could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2273737d-7646-48b1-a4c7-23916c2ee5e5 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd" status: 404 len: 111 microversion: 2.1 time: 0.032983 Oct 28 19:03:59.886974 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4033/7846] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:03:59 2022] GET /compute/v2.1/servers/d358dac1-7ea9-41bf-bd12-09aadcee2ebd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:04:03.215638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-54d2b66f-5923-4bba-bdb3-8e7c3591f122 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '.version_select at 0x7f7525d69b80>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:03.221634 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54d2b66f-5923-4bba-bdb3-8e7c3591f122 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [3570a816-847d-4252-a441-9b50868e4528] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:04:04.232726 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-54d2b66f-5923-4bba-bdb3-8e7c3591f122 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [3570a816-847d-4252-a441-9b50868e4528] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44258. Oct 28 19:04:04.252931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-54d2b66f-5923-4bba-bdb3-8e7c3591f122 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167569295" status: 202 len: 0 microversion: 2.1 time: 1.041908 Oct 28 19:04:04.253524 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3814/7847] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 19:04:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167569295 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:04:04.286841 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e6da226f-2ac4-4e99-8057-d0267574e8ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: .version_select at 0x7f7524192940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1342324544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTDYCjBbIgnvflmJVudO5n4oGJEfuAo/+TTpJNRpcvurbgL/W93RLohC68z8iklhWwOZfgD4eJAGodU2gSU2JKFCfRrQXVnK9KXvlVsCveJCuipC096qTr/NolxV9q1kA=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:04.304630 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e6da226f-2ac4-4e99-8057-d0267574e8ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:04:04.309821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-e6da226f-2ac4-4e99-8057-d0267574e8ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:04:04.336190 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e6da226f-2ac4-4e99-8057-d0267574e8ca tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053270 Oct 28 19:04:04.336787 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4034/7848] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 19:04:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:10.102723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:10.109896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1028416400", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "networks": [{"uuid": "e4f2750a-c885-4f81-bf5a-879df5e59611"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1342324544", "security_groups": [{"name": "tempest-secgroup-smoke-1781510377"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:10.232272 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] validate_networks() for [('e4f2750a-c885-4f81-bf5a-879df5e59611', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:04:10.730693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:04:10.731276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:04:10.731955 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:04:10.732372 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:04:10.732789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:04:10.743292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:10.744116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:10.745323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:10.746381 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:10.747086 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:10.747729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:10.767712 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:04:10.774219 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Getting quotas for user 0594fb39380543f7afdda56ca8e437be and project fd82b6984b034506a34851741541ea87. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:04:10.788248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:04:10.790583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:04:10.839193 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [08c461a0-c9e6-460f-bf71-b2fea782cbcd] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:04:11.847427 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [08c461a0-c9e6-460f-bf71-b2fea782cbcd] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44306. Oct 28 19:04:11.862216 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-30718798-da1b-47a8-a24c-a1352988a36b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.761255 Oct 28 19:04:11.863219 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3815/7849] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:04:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:04:11.881717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba9731cc-d4b5-4fe8-9a31-736ea4a67a02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:11.882362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba9731cc-d4b5-4fe8-9a31-736ea4a67a02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:11.885386 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:11.945364 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba9731cc-d4b5-4fe8-9a31-736ea4a67a02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:11.954003 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba9731cc-d4b5-4fe8-9a31-736ea4a67a02 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1267 microversion: 2.1 time: 0.083435 Oct 28 19:04:11.954596 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4035/7850] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:11 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:12.979415 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:12.981738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:12.990391 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:12.991214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:12.991891 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:12.992864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:12.993488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:12.994115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:13.095877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:13.106031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-13d3440c-e29f-4953-8003-aac9de8df932 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1327 microversion: 2.1 time: 0.131034 Oct 28 19:04:13.107024 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3816/7851] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:12 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:14.132653 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:14.133908 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:14.142696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:14.143201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:14.143883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:14.144889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:14.145061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:14.145654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:14.406806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:14.414496 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d668de16-3ea5-4194-937c-55b9c54cb184 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.286014 Oct 28 19:04:14.415273 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4036/7852] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:14 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:14.634899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc649140-723a-4968-8d9f-fc8c88523805", "tag": "f7c8c551-6273-4a76-9f90-a2ae3e536562"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:14.647857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:14.648718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:14.650700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:14.666115 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] Creating event network-changed:f7c8c551-6273-4a76-9f90-a2ae3e536562 for instance dc649140-723a-4968-8d9f-fc8c88523805 on n-h1-860864-13 Oct 28 19:04:14.673106 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-df655bb8-8be3-49b7-8c9a-3cbc5246f2d0 req-aa89e6b3-f598-46c7-8da6-d6ed2dd1eb5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041376 Oct 28 19:04:14.674386 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3817/7853] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:15.439262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:15.439922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:15.446796 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:15.447294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:15.447775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:15.448487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:15.449497 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:15.449941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:15.580004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:15.587756 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bd125f79-3775-4693-af87-f93d0558913e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.152406 Oct 28 19:04:15.588342 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4037/7854] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:15 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:16.611521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:16.612270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:16.618534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:16.619022 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:16.619491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:16.620187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:16.620847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:16.621290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:16.756643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:16.765296 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-378446b0-5d53-4b02-81a3-40bac3ef415b tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.158896 Oct 28 19:04:16.765870 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3818/7855] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:16 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:17.788685 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:17.789306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:17.796254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:17.796751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:17.797197 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:17.797891 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:17.798353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:17.798790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:17.931078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:17.939393 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7bd0d3a2-2ce7-40c7-8aea-84be30311191 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.154580 Oct 28 19:04:17.939901 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4038/7856] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:17 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:18.962293 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:18.962905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:18.969866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:18.970351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:18.970785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:18.971504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:18.971959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:18.972386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:19.106583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:19.114444 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e6bfa6e1-6fb5-4511-b14b-6e760ba947a1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.156199 Oct 28 19:04:19.115025 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3819/7857] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:18 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:04:20.138442 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:20.138995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:20.145766 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:20.146265 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:20.146718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:20.147704 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:20.148208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:20.148918 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:20.290633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:20.298389 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7711a290-22c8-4485-8aa7-3a9805b2f5bc tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.164061 Oct 28 19:04:20.298973 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4039/7858] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:20 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:21.098885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:21.099697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:21.153655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc649140-723a-4968-8d9f-fc8c88523805", "name": "network-vif-plugged", "status": "completed", "tag": "f7c8c551-6273-4a76-9f90-a2ae3e536562"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:21.163310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:21.163830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:21.164267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:21.176453 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] Creating event network-vif-plugged:f7c8c551-6273-4a76-9f90-a2ae3e536562 for instance dc649140-723a-4968-8d9f-fc8c88523805 on n-h1-860864-13 Oct 28 19:04:21.181437 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-17a496df-5c28-4bb6-bbeb-73b8af69296a req-bf4b62e4-c062-465d-b92c-2e9421659381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087939 Oct 28 19:04:21.182029 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3820/7859] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:21.321889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:21.322499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:21.334597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:21.335102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:21.335583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:21.336305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:21.336772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:21.337215 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:21.472807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:21.481189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7b0c3fa1-4fb6-4eab-b8a0-f6274fa2e943 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.163327 Oct 28 19:04:21.481766 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4040/7860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:21 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:22.506194 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:22.506908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:22.514545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:22.515040 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:22.515584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:22.516302 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:22.516759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:22.517192 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:22.660619 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:22.668998 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-513f0c43-a112-4d12-8f0a-9690c29f3f2a tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1393 microversion: 2.1 time: 0.168095 Oct 28 19:04:22.669584 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3821/7861] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:22 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:23.692946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:23.693496 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:23.695447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:23.702491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:23.702984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:23.703466 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:23.704173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:23.704660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:23.705097 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:23.836004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:23.844354 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-34db3e3b-d034-4502-93fd-3c6f8128e95e tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1565 microversion: 2.1 time: 0.155392 Oct 28 19:04:23.844923 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4041/7862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:23 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:23.867530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:23.868144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:23.875143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:23.875666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:23.876108 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:23.876802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:23.877258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:23.877682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:24.016656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:24.024647 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6df9e66f-e31a-44c8-9b7c-0cbf77116ec7 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1565 microversion: 2.1 time: 0.161060 Oct 28 19:04:24.025225 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3822/7863] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:23 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:25.907090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:04:25.912572 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc649140-723a-4968-8d9f-fc8c88523805", "tag": "f7c8c551-6273-4a76-9f90-a2ae3e536562"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:25.919794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:25.924408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:25.924961 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:25.927038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:25.927333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:25.927696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:25.928209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:25.928989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:25.929517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:25.930186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:25.941099 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] Creating event network-changed:f7c8c551-6273-4a76-9f90-a2ae3e536562 for instance dc649140-723a-4968-8d9f-fc8c88523805 on n-h1-860864-13 Oct 28 19:04:25.946379 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-63f6e68e-acb2-464c-9afa-641617f0a86f req-28c66196-33d1-4791-a835-abc53eaac561 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037613 Oct 28 19:04:25.947198 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3823/7864] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:04:26.157354 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:04:26.165892 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9b23e79e-433b-4e0e-b6ad-6e7720365734 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1565 microversion: 2.1 time: 0.263491 Oct 28 19:04:26.166879 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4042/7865] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:04:25 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1565 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:04:57.445174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:04:57.447534 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:04:57.450358 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:57.451009 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=38 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:04:57.457747 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:57.458225 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:57.458655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:57.459343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:04:57.459818 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:04:57.460237 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:04:57.510611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-aadc429e-61be-46fe-836f-eb44049cb3c3 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action" status: 200 len: 24572 microversion: 2.1 time: 0.069734 Oct 28 19:04:57.511244 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3824/7866] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:04:57 2022] POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action => generated 24572 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:05:27.879490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:27.880272 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=42 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.084199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:28.084746 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:28.090614 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.091102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.091575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.092280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.092739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.093170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.115666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'flavor' on Instance uuid dc649140-723a-4968-8d9f-fc8c88523805 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:05:28.181724 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-074b0f62-f14a-4bfc-b5ab-e5b58aae3dfe tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action" status: 202 len: 0 microversion: 2.1 time: 0.303844 Oct 28 19:05:28.182352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4043/7867] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:05:27 2022] POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:05:28.191921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:28.192792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:28.195547 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.196183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:28.202324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.203004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.203281 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.204085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:28.204536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:28.204960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:28.459767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:28.468828 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5e35889c-ba5c-4893-ae46-ac9a69e608af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1692 microversion: 2.1 time: 0.281187 Oct 28 19:05:28.469406 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3825/7868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:28 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:29.494722 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:29.495474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:29.503088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:29.503636 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:29.504093 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:29.504808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:29.505306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:29.505751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:29.642294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:29.650534 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa64ee74-69b9-4b9a-9477-06bf5e2beaad tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1692 microversion: 2.1 time: 0.160128 Oct 28 19:05:29.651109 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4044/7869] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:29 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:30.676914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:30.677483 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:30.685258 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:30.685750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:30.687052 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:30.687554 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:30.688015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:30.688452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:30.820663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:30.829128 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2b42c395-00fe-4559-8439-4d897a4f4ea1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1675 microversion: 2.1 time: 0.156070 Oct 28 19:05:30.829848 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3826/7870] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:30 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:31.927509 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:31.929851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:31.937284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:31.937776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:31.938227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:31.938937 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:31.939438 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:31.939883 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:31.994546 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f606079c-edfd-434c-9aff-b29c482e17c1 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action" status: 200 len: 35528 microversion: 2.1 time: 0.070875 Oct 28 19:05:31.995206 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4045/7871] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:05:31 2022] POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action => generated 35528 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:05:32.007850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:32.008389 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:32.015972 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.016521 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.016963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.017657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.018113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.018542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.084125 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-81e637b3-b0f1-4afc-a4ad-27c4a8d56a43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action" status: 202 len: 0 microversion: 2.1 time: 0.080055 Oct 28 19:05:32.084754 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3827/7872] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:05:32 2022] POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:05:32.094041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:32.094838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:32.102402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.103101 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.103663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.104391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:32.104859 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:32.105302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:32.329767 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:32.337685 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-10986501-fec5-4a25-b0a9-afdcefd7f204 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1681 microversion: 2.1 time: 0.248175 Oct 28 19:05:32.338434 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4046/7873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:32 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:33.364224 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:33.364938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:33.371190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:33.371720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:33.372166 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:33.372863 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:33.373321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:33.373754 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:33.510233 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:33.518701 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dae817fa-f4ca-4d83-b288-09256b00ea7d tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1681 microversion: 2.1 time: 0.159739 Oct 28 19:05:33.519277 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3828/7874] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:33 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:34.542719 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:34.543411 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:34.550724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.551230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.551733 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:34.552455 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.552927 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.553373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:34.684952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:34.693377 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a6239e3f-711e-45fd-b21e-4f4cd59bae59 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1684 microversion: 2.1 time: 0.154705 Oct 28 19:05:34.693952 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4047/7875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:34 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:34.795089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:34.798075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:34.804908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.805401 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.805841 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:34.806531 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:34.806984 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:34.807439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:34.848256 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c2614c99-a541-448b-8bfb-5fb6bc8fad43 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action" status: 200 len: 35528 microversion: 2.1 time: 0.057073 Oct 28 19:05:34.848880 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3829/7876] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:05:34 2022] POST /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805/action => generated 35528 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 19:05:36.122176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:36.123783 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:36.125670 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc649140-723a-4968-8d9f-fc8c88523805", "tag": "f7c8c551-6273-4a76-9f90-a2ae3e536562"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:36.131423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.131933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.132394 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.133111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.133583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.134187 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.136201 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.136684 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.137121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.149677 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] Creating event network-changed:f7c8c551-6273-4a76-9f90-a2ae3e536562 for instance dc649140-723a-4968-8d9f-fc8c88523805 on n-h1-860864-13 Oct 28 19:05:36.154595 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5fdb5cd8-ba31-4eea-8c5a-54e007508707 req-7ed3822d-f921-411a-b885-09671e5e9f6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033626 Oct 28 19:05:36.155708 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3830/7877] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:36.162432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:05:36.203735 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:05:36.203995 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 (ip 10.222.0.48) !!! Oct 28 19:05:36.269185 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-65df2d01-85a3-4958-bed7-43578ca69227 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 204 len: 0 microversion: 2.1 time: 0.150659 Oct 28 19:05:36.269720 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4048/7878] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:05:36 2022] DELETE /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:05:36.279814 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:36.281144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:36.287829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.288346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.288777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.289488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:36.290143 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:36.290782 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:36.437816 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:36.445661 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-cd8d2350-1515-4da8-a0a0-2157eab505af tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1690 microversion: 2.1 time: 0.171077 Oct 28 19:05:36.446234 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3831/7879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:36 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:37.473499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:37.474504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:37.482461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:37.482982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:37.483510 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:37.484235 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:37.484791 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:37.485236 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:37.689512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:37.697515 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f79f3223-a9c2-4ec6-8306-57f05a878390 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1690 microversion: 2.1 time: 0.228900 Oct 28 19:05:37.698098 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4049/7880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:37 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1690 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:38.376191 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc649140-723a-4968-8d9f-fc8c88523805", "name": "network-vif-deleted", "tag": "f7c8c551-6273-4a76-9f90-a2ae3e536562"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:38.387253 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.387888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.388321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.400540 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] Creating event network-vif-deleted:f7c8c551-6273-4a76-9f90-a2ae3e536562 for instance dc649140-723a-4968-8d9f-fc8c88523805 on n-h1-860864-13 Oct 28 19:05:38.406409 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-fba43888-7d7b-4f8b-bf16-275a1d5e9e7c req-3bfc935a-9260-41ec-82b9-ecd7a7d317e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034875 Oct 28 19:05:38.407022 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3832/7881] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:38.722298 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:38.723119 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:38.730498 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.731281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.731759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.732479 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.732943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.734477 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.766771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:38.767263 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:38.767743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:38.768199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lazy-loading 'fault' on Instance uuid dc649140-723a-4968-8d9f-fc8c88523805 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:05:38.812687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0594fb39380543f7afdda56ca8e437be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd82b6984b034506a34851741541ea87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:38.820325 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e9219b0-4cc4-40e1-b7ea-e554305231e6 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 200 len: 1357 microversion: 2.1 time: 0.102465 Oct 28 19:05:38.820902 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4050/7882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:38 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:39.845360 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:39.846102 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] [instance: dc649140-723a-4968-8d9f-fc8c88523805] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:39.852435 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:39.852935 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:39.853379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:39.854081 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:39.854541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:39.854978 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:39.868898 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] HTTP exception thrown: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Request method failure captured: Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 HTTP/1.1 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCV1xTcEStBC93NKyUh4uvgOe0ugIhjtWxJxgUtthjZs7lw_VGzwLuqDWSbyAAwptNg-cRGRpPmosfXc1ymv53BjpBbYyoyop9KhsbhIyviLXRRfGYpSND16e-PuVRLPgbFMPm8Kxg5tAFUfdwc26cccVnXsgQ_pXt-bU0_Foebyc74 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd82b6984b034506a34851741541ea87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd82b6984b034506a34851741541ea87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd82b6984b034506a34851741541ea87"}]}] Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: fd82b6984b034506a34851741541ea87 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1993692410 Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 0594fb39380543f7afdda56ca8e437be Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1993692410-project Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'dc649140-723a-4968-8d9f-fc8c88523805'} Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:05:39.870515 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Returning 404 to user: Instance dc649140-723a-4968-8d9f-fc8c88523805 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7e52a498-d754-402d-8b05-8d78fa899516 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805" status: 404 len: 111 microversion: 2.1 time: 0.032080 Oct 28 19:05:39.876973 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3833/7883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:39 2022] GET /compute/v2.1/servers/dc649140-723a-4968-8d9f-fc8c88523805 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:05:43.314764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4523ca5e-6cde-4296-b745-e2dd4282ae99 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] Calling method '.version_select at 0x7f752411aa60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:43.336519 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4523ca5e-6cde-4296-b745-e2dd4282ae99 tempest-TestNetworkAdvancedServerOps-1993692410 tempest-TestNetworkAdvancedServerOps-1993692410-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1342324544" status: 202 len: 0 microversion: 2.1 time: 0.030175 Oct 28 19:05:43.337073 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4051/7884] 10.222.0.48 () {58 vars in 1284 bytes} [Fri Oct 28 19:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1342324544 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:05:54.661313 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=18 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:54.662544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:54.852178 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f97b6d99-54da-48cf-9bdb-64e53296fe32 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'create', calling method: .version_select at 0x7f7524572d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1918525226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYsEQhdATacaCoI0LvS18S76WTRZBekZ6pKWpcSIm5RdTTOcs9hZLqd6qSm4EAuQ73jmIPYd7Y1w+rEdRCZJEViJYEZtQD1+ac1aEjci10w5oZY8HSNUgNCzmjHyDFRlw=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:54.869853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f97b6d99-54da-48cf-9bdb-64e53296fe32 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for project 99c78c1f39a940089543d87a8401db3b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:05:54.877591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-f97b6d99-54da-48cf-9bdb-64e53296fe32 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for user 416b44d4047240c48f1f0112381e814d and project 99c78c1f39a940089543d87a8401db3b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:05:54.905361 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f97b6d99-54da-48cf-9bdb-64e53296fe32 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.250062 Oct 28 19:05:54.907082 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3834/7885] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 19:05:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:05:55.935173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1171534162", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1918525226", "security_groups": [{"name": "tempest-secgroup-smoke-1803619967"}], "networks": [{"uuid": "a28d74a5-60af-4843-923d-3d743881584a"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:55.949591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:55.950266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:05:56.053334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] validate_networks() for [('a28d74a5-60af-4843-923d-3d743881584a', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:05:56.563810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:05:56.564661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:05:56.565808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:05:56.566919 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:05:56.568401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:05:56.586647 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:56.588047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:56.588805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:56.590167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:56.591673 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:56.592480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:56.621712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for project 99c78c1f39a940089543d87a8401db3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:05:56.628398 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for user 416b44d4047240c48f1f0112381e814d and project 99c78c1f39a940089543d87a8401db3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:05:56.642729 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:05:56.645091 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:05:56.697913 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-21788edc-eaa0-43e5-b76c-f0e39e4f6e63 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766197 Oct 28 19:05:56.699395 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4052/7886] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:05:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:05:56.712480 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97b7c684-994c-4a82-8940-a83f626af094 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:56.714082 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97b7c684-994c-4a82-8940-a83f626af094 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:56.777703 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97b7c684-994c-4a82-8940-a83f626af094 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:56.786089 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97b7c684-994c-4a82-8940-a83f626af094 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1247 microversion: 2.1 time: 0.079279 Oct 28 19:05:56.786748 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3835/7887] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:56 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1247 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:05:57.817151 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:57.818045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:57.833926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:57.834561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:57.834998 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:57.835760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:57.836415 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:57.837035 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:57.926936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:57.936260 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a435055d-a2e2-42c5-8786-248fff1b2ed0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1307 microversion: 2.1 time: 0.129095 Oct 28 19:05:57.937872 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4053/7888] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:57 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:58.962985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:05:58.963783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:05:58.979250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:58.979789 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:58.980232 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:58.980937 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:58.981395 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:58.981823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:59.122402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:05:59.131057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d98eea55-36c5-4ff2-b5ee-aa9039888217 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.173697 Oct 28 19:05:59.131677 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3836/7889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:05:58 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:05:59.330965 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:05:59.342671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:05:59.343491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:05:59.344233 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:05:59.356516 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] Creating event network-changed:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h2-860864-13 Oct 28 19:05:59.366262 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-e53fab03-2519-487b-83a0-73bff3859179 req-3a63a0f3-a19a-49a2-b51b-be2379309376 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039156 Oct 28 19:05:59.367064 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4054/7890] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:00.157681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:00.158341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:00.165324 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.165844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.166283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.166985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:00.167484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:00.167905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:00.316209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:00.324078 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a5f8d011-4dec-441e-b499-b2f77ae06c01 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.170945 Oct 28 19:06:00.324658 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3837/7891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:00 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:01.350088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:01.350806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:01.357106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:01.357605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:01.358054 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:01.359446 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:01.359928 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:01.360373 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:01.493140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:01.500852 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ba204ca4-2f27-42ee-b659-f38a41cd8151 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.155976 Oct 28 19:06:01.501421 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4055/7892] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:01 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:02.524745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:02.525385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:02.532849 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:02.533331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:02.533767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:02.534459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:02.534918 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:02.535339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:02.670034 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:02.678422 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f608ebe4-cca8-4ccb-bcf0-b0ef5aac2a0a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.157886 Oct 28 19:06:02.678989 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3838/7893] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:02 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:03.701404 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:03.702019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:03.709061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:03.709551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:03.709995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:03.710688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:03.711145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:03.711605 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:03.842787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:03.850462 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a607642a-99cd-4fac-ae23-0368ec4e73bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.152996 Oct 28 19:06:03.851032 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4056/7894] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:03 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:04.874341 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:04.874899 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:04.882361 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:04.882833 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:04.883280 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:04.884003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:04.884466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:04.884898 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:05.021713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:05.029646 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db31a374-5aea-4701-b164-643e3076e1c3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.159418 Oct 28 19:06:05.030267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3839/7895] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:04 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:06.052810 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:06.053432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:06.061353 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:06.061853 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:06.062309 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:06.064434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:06.064434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:06.064434 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:06.211290 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:06.223452 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-49c166b9-f9c4-4d5d-8f9a-c54721a11605 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.174546 Oct 28 19:06:06.224041 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4057/7896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:06 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:07.191078 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "name": "network-vif-plugged", "status": "completed", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:07.200394 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:07.207875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.208355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.208869 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.220791 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] Creating event network-vif-plugged:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h2-860864-13 Oct 28 19:06:07.226223 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-97441de7-7856-4641-9ab7-0e1aa2a76577 req-b437820c-26e2-4f65-803e-a890fedf4a48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040030 Oct 28 19:06:07.226826 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3840/7897] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:06:07.253156 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:07.253780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:07.256301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:07.257425 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:06:07.264545 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.265049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.265525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.267615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:07.268094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:07.268534 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:07.405254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:07.413138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6d721f84-4b47-4ca8-a4cb-9994fa3edb45 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.165344 Oct 28 19:06:07.413706 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4058/7898] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:07 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:08.438857 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:08.439625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:08.445867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.446359 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.446875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.447625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:08.448091 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:08.448524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:08.589390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:08.598230 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-64a3e9f3-d783-4006-841b-6f3a56f6ab65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1373 microversion: 2.1 time: 0.164523 Oct 28 19:06:08.598819 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3841/7899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:08 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:09.621264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:09.621794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:09.629587 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.630079 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.630528 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.631231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.631728 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.632168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.766461 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:09.774568 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8d9ded44-254f-4e22-b338-905d96f74da1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1556 microversion: 2.1 time: 0.157392 Oct 28 19:06:09.775158 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4059/7900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:09 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:09.797638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:06:09.798291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:06:09.805145 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.805627 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.806063 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.806752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:09.807205 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:09.807664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:09.941144 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:06:09.949010 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ac7e5f3f-cbb8-4598-b4e0-9824664d4bc2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1556 microversion: 2.1 time: 0.155925 Oct 28 19:06:09.949585 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3842/7901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:06:09 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:06:11.570514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:06:11.581329 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:06:11.581820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:06:11.582264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:06:11.593286 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] Creating event network-changed:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h2-860864-13 Oct 28 19:06:11.598501 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-a9a06456-065c-4152-a49f-d6cc1fd2bf9e req-1ce602f0-9288-4f02-847a-ade23e279ea4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031675 Oct 28 19:06:11.599095 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4060/7902] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:37.385040 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:08:37.386336 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:08:37.386904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:37.387686 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=38 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:37.388973 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:08:37.389151 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action (ip 10.222.0.48) !!! Oct 28 19:08:37.391536 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:08:37.391690 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action (ip 10.222.0.48) !!! Oct 28 19:08:37.403292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:37.403856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:37.414768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.415252 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.415715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.416411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.416867 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.417301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.442210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lazy-loading 'flavor' on Instance uuid 0ed30618-d7b1-472a-9693-eb2def2aa919 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:08:37.636001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2083a5f0-cf30-44b8-a4af-1990d2b436de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action" status: 202 len: 0 microversion: 2.1 time: 0.252302 Oct 28 19:08:37.636631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3843/7903] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:08:37 2022] POST /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:08:37.654417 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:08:37.655919 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:08:37.657454 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:37.658558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=42 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:08:37.660318 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:08:37.660684 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 (ip 10.222.0.48) !!! Oct 28 19:08:37.662010 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:08:37.662153 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 (ip 10.222.0.48) !!! Oct 28 19:08:37.669273 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:37.670127 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:37.682618 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.683208 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.683688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.684406 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:37.684884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:37.685318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:37.982078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:37.990723 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1e4197fe-1726-42d8-964f-b43117251ffd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.349335 Oct 28 19:08:37.991306 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4061/7904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:37 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:39.016567 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:39.017274 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:39.026563 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.027044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.027507 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.028204 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:39.028657 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:39.029080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:39.029771 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44680. Oct 28 19:08:39.034152 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44682. Oct 28 19:08:39.164998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:39.173351 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f6c24dc-6de0-459c-8aca-f83c10f4c0fe tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.163029 Oct 28 19:08:39.173933 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3844/7905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:39 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:40.196876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:40.197501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:40.206436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.206934 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.207397 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.208111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:40.208581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:40.209018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:40.216588 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44686. Oct 28 19:08:40.226473 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44688. Oct 28 19:08:40.347776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:40.355696 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-01b67a43-8308-4f23-adbe-7954361cf967 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.162768 Oct 28 19:08:40.356277 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4062/7906] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:40 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:41.379543 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:41.380153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:41.386938 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.387447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.387885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.388569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:41.389019 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:41.389438 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:41.521699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:41.529853 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7a512172-ba12-4c53-92a7-be6aefbd8c57 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.154863 Oct 28 19:08:41.530436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3845/7907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:41 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:42.554031 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:42.554674 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:42.561649 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.562820 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.563287 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.564112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:42.564590 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:42.565066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:42.703541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:42.711488 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-de375eaa-22eb-4a6b-a24f-3f5f627827ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.161526 Oct 28 19:08:42.712078 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4063/7908] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:42 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:43.735632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:43.736269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:43.743172 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.743689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.744457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.744810 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:43.745266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:43.745693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:43.876659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:43.884396 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-63584f57-0071-4fb0-9767-49271bae7c44 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.152872 Oct 28 19:08:43.884979 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3846/7909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:43 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:44.908622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:44.909268 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:44.916068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.916567 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.917016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:44.917727 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:44.918192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:44.918632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:45.052654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:45.060484 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-04f89303-4390-46c3-882f-8738a3bb4756 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.156474 Oct 28 19:08:45.061066 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4064/7910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:44 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:46.085018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:46.085622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:46.092679 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.093159 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.093700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.094404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:46.094854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:46.095276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:46.227013 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:46.234785 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b9d8337f-a366-4969-b22a-e9cda4271341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.153791 Oct 28 19:08:46.235359 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3847/7911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:46 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:47.258845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:47.259501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:47.266925 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.267453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.267904 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.268603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:47.269192 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:47.269635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:47.405046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:47.413792 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-717fd7c0-8ea0-4040-aa2b-a00022ef4694 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.158915 Oct 28 19:08:47.414362 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4065/7912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:47 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:48.437536 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:48.438153 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:48.445167 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.445643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.446074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.446759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:48.447298 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:48.447746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:48.582542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:48.590243 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2c2b4835-0cdb-4fee-bb27-b7be86dc7b17 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.157031 Oct 28 19:08:48.590817 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3848/7913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:48 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:49.614877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:49.615539 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:49.622631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.623160 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.623632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.624349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:49.625433 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:49.625871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:49.756042 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:49.763787 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ed94cfe4-2062-41d6-9cbe-2b90a17241f7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1701 microversion: 2.1 time: 0.152881 Oct 28 19:08:49.764367 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4066/7914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:49 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:50.787694 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:50.788309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:50.795174 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.795681 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.796116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.797915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:50.798370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:50.798795 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:50.936152 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:50.945477 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e8730823-0a2e-46b8-b97f-2fb206abd6b9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1701 microversion: 2.1 time: 0.161690 Oct 28 19:08:50.946063 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3849/7915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:50 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:51.969331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:51.969955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:51.977048 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.977551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.977999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:51.978710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:51.979172 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:51.979633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:52.121759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:52.130914 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a9c37a7d-9398-4f38-923a-bf3ccc3d3955 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1701 microversion: 2.1 time: 0.165546 Oct 28 19:08:52.132016 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4067/7916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:51 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1701 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:53.156960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:53.158193 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:53.165069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.165573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.166001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.166701 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:53.167157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:53.167618 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:53.306930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:53.315038 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b5c62797-8cf1-4f2e-871a-4489bddee507 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.163049 Oct 28 19:08:53.315645 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3850/7917] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:53 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:54.080177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "name": "network-vif-plugged", "status": "completed", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:08:54.093936 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.094698 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.095764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.110675 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] Creating event network-vif-plugged:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h2-860864-13 Oct 28 19:08:54.115105 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] [b1ed98ca-133f-4eb3-9c22-66d6630cdf82] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:08:54.340092 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:54.341980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:54.354546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.355442 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.356127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.356940 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:54.357544 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:54.358043 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:54.823650 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:54.832467 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-61b019e5-566f-4a09-943f-0d3651ae80dc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.496383 Oct 28 19:08:54.833054 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3851/7918] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:54 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:08:55.123851 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] [b1ed98ca-133f-4eb3-9c22-66d6630cdf82] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44744. Oct 28 19:08:55.129019 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7f3032dd-73df-43c4-ba3c-bc15cf4253a5 req-a5f9c992-ee07-4bd7-ae97-ce9e00fbe760 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.053884 Oct 28 19:08:55.135838 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4068/7919] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:08:55.857289 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:55.857967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:55.865853 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.866397 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.867004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:55.867742 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:55.868209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:55.868641 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:56.015183 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:56.025056 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-504a1008-10e9-4ca7-a14a-35572a1cd1b1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.172000 Oct 28 19:08:56.025678 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3852/7920] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:55 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:57.052317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:57.053065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:57.060868 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.061654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.063549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.064589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:57.065340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:57.066001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:57.221984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:57.233759 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-629d1eaa-a210-4171-aefc-1d9a0204a4c6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.187933 Oct 28 19:08:57.235000 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4069/7921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:57 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:58.258210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:58.260044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:58.268121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.268746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.269263 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.269983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:58.270581 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:58.271026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:58.421744 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:58.430723 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-907a2244-09c3-4fea-9ebd-1a0d2e53466b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.176421 Oct 28 19:08:58.431304 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3853/7922] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:58 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:08:59.456113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:08:59.457609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:08:59.464870 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.465657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.466335 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.467221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:08:59.467718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:08:59.468186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:08:59.614110 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:08:59.622068 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6ad50883-11b9-4db1-b9f4-a67bfd4472cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.170550 Oct 28 19:08:59.635826 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4070/7923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:08:59 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:00.647190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:00.647844 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:00.654908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.655524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.656464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.657210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:00.659976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:00.659976 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:00.810889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:00.820147 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-785510d6-4900-46f2-b591-85ff5e823c1c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.176961 Oct 28 19:09:00.835940 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3854/7924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:00 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:01.844495 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:01.845873 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:01.854774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.855300 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.855774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:01.856487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:01.856955 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:01.857393 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:02.005163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:02.013435 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2448d0d9-3f57-46c2-b65f-47a88d86bb97 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1696 microversion: 2.1 time: 0.173326 Oct 28 19:09:02.014054 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4071/7925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:01 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:03.037277 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:03.037914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:03.044920 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.045412 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.045854 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.047077 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:03.047566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:03.048003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:03.185323 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:03.193246 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a5b2d2b-e36a-4a26-a55c-22967dd84883 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1678 microversion: 2.1 time: 0.159958 Oct 28 19:09:03.193950 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3855/7926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:03 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:04.217259 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:04.217941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:04.225024 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.225519 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.225969 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.226669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:04.227135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:04.227606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:04.366740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:04.375704 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b4ecdccc-6a88-4fe1-816c-e930580a63e2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1678 microversion: 2.1 time: 0.162266 Oct 28 19:09:04.376297 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4072/7927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:04 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:05.399633 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.400245 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.407866 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.408351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.408791 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.409481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.409936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.410363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.545776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.553579 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6ac819d8-89ab-48e2-bbae-9f9eda00253f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1621 microversion: 2.1 time: 0.158246 Oct 28 19:09:05.554216 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3856/7928] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1621 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:05.576764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:05.578284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.584882 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.585378 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.585827 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.586535 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.586999 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.587469 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.628338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120568) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:09:05.697190 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6c30d93e-ae93-41e4-acd4-31a43df06a93 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action" status: 202 len: 0 microversion: 2.1 time: 0.124325 Oct 28 19:09:05.697843 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4073/7929] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:09:05 2022] POST /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:09:05.706579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:05.707186 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:05.713276 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.713766 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.714196 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.714886 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:05.715331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:05.715847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:05.735735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:05.858494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:05.866384 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-83c5a770-60ae-4a1c-84fb-27497fced426 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1629 microversion: 2.1 time: 0.164152 Oct 28 19:09:05.866999 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3857/7930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:05 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1629 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:06.031844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "name": "network-vif-unplugged", "status": "completed", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:06.043090 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.043834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.044499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.056366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] Unable to find a host for instance 0ed30618-d7b1-472a-9693-eb2def2aa919. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:09:06.057260 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3b93d5e7-e327-4ff1-bbf6-db1691f72c6b req-9f52c96f-a59a-48ac-be7a-8d94163bde2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029758 Oct 28 19:09:06.057858 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4074/7931] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 19:09:06.890569 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:06.891180 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:06.898000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.898488 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.898959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:06.900032 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:06.900490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:06.901001 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:07.038190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:07.045931 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-22f3769e-98a0-4bde-a0c6-3113e88725d5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1629 microversion: 2.1 time: 0.159295 Oct 28 19:09:07.046557 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3858/7932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:06 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:08.069533 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:08.070169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:08.072978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:08.078879 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.079807 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.080283 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.081007 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:08.081476 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:08.081915 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:08.085718 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:08.243276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:08.251732 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5357a6a9-1c9e-4caf-95f9-8ede2decdfdd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1629 microversion: 2.1 time: 0.186094 Oct 28 19:09:08.252321 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4075/7933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:08 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1629 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:09.275071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:09.275719 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:09.277721 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=33 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:09:09.283121 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.283622 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.284054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.284745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:09.285197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:09.285616 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:09.417042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:09.425230 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8102cff6-298f-4479-a452-3ff252ec4bb5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1629 microversion: 2.1 time: 0.154736 Oct 28 19:09:09.425792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3859/7934] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:09 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:10.449805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:10.450423 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:10.457385 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.457875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.458317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.459012 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:10.459505 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:10.459943 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:10.593929 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:10.602039 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-03340c4d-a0b5-4ae9-9811-384d27d9dff2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1629 microversion: 2.1 time: 0.156399 Oct 28 19:09:10.602724 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4076/7935] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:10 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1629 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:11.629447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:11.630065 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:11.637099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.637588 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.638024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.638720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:11.639177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:11.639753 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:11.780545 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:11.788710 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2188efea-0813-407d-9b14-ab3f1a1c0215 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.163192 Oct 28 19:09:11.789297 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3860/7936] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:11 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:11.990648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:12.000754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.001248 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.001695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.013420 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] Creating event network-changed:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h1-860864-13 Oct 28 19:09:12.018859 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-79f717fa-8e00-402b-a35e-e79dfa626050 req-f5468248-fcad-4df1-8302-f29d4a9401a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094080 Oct 28 19:09:12.019494 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4077/7937] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:12.814261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:12.814951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:12.837333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.837837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.838283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:12.839002 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:12.839493 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:12.839923 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:13.035318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:13.044497 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3b6230b9-6880-4d2a-baba-9ed2ca5ced8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.234736 Oct 28 19:09:13.061497 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3861/7938] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:12 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:14.070449 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:14.071158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:14.077508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.078001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.078447 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.079185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:14.079703 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:14.080145 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:14.242553 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:14.252187 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c5ea64cf-13f5-486e-bca4-c817d09caeca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.186775 Oct 28 19:09:14.256690 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4078/7939] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:14 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:15.275894 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:15.276546 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:15.285421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.285909 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.286343 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.287067 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:15.287715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:15.288140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:15.458370 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:15.466054 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c51c6f93-df52-41b6-ba7e-d3a888cc865c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.194346 Oct 28 19:09:15.466631 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3862/7940] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:15 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:16.491296 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:16.491994 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:16.502443 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.503051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.503619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.504451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:16.505184 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:16.505688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:16.652566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:16.661870 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2c2493f4-9e0b-476e-a305-b6f669c14808 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.174660 Oct 28 19:09:16.675962 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4079/7941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:16 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:17.687256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:17.687921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:17.694983 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:17.695585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:17.696109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:17.696885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:17.697410 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:17.697908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:17.840705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:17.855202 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b908b86c-6fb7-45d3-b795-9c7b5b04aa56 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.172695 Oct 28 19:09:17.865918 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3863/7942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:17 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:18.881402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:18.883004 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:18.892001 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:18.892503 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:18.892954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:18.893670 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:18.894130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:18.894591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:19.044620 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:19.053996 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-b3c166e2-39aa-4dec-98ff-891b874c0560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.177181 Oct 28 19:09:19.054573 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4080/7943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:18 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:20.079088 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:20.079992 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:20.087069 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.087601 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.099962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.099962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:20.099962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:20.106817 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:20.285903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:20.295490 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7c4e9a11-bd95-4553-af72-e9027d236a65 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.220986 Oct 28 19:09:20.311627 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3864/7944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:20 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:21.319763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:21.320399 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:21.327780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.328280 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.328716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.329408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:21.329867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:21.330297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:21.465931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:21.474302 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0106673c-af22-4e12-9ec2-e8b1fe5bb369 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.158598 Oct 28 19:09:21.474878 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4081/7945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:21 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:22.497738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:22.498356 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:22.505290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.505776 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.506211 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.506897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:22.507351 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:22.507799 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:22.641459 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:22.650045 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5f065efc-76e7-4a21-93d1-c6d312c74762 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.156211 Oct 28 19:09:22.650671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3865/7946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:22 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:23.674772 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:23.675334 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:23.682164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.682660 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.683114 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.683845 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:23.684311 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:23.684745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:23.814714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:23.822482 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-c1139b06-9675-4855-909a-2ce1bcfae928 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.152320 Oct 28 19:09:23.823057 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4082/7947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:23 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:24.845189 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:24.845808 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:24.852781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.853267 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.853733 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.854426 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:24.854879 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:24.855309 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:24.991723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:25.000055 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e0f885a7-50e0-4623-bfe9-ed8c7697c0f5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.158827 Oct 28 19:09:25.000632 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3866/7948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:24 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:26.024154 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:26.025041 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:26.032700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.033201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.033654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.034369 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:26.034838 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:26.035281 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:26.168269 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:26.176138 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3cb42598-391f-448c-97a6-95846947808b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.156139 Oct 28 19:09:26.176712 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4083/7949] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:26 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:27.199714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:27.200269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:27.207290 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:27.207813 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:27.208254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:27.208947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:27.209404 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:27.209830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:27.353023 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:27.362146 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96e0f994-8219-4e27-8ad0-17b23d0584de tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.166303 Oct 28 19:09:27.362601 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3867/7950] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:27 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.386190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:28.386811 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:28.395445 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.395949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.396390 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.397173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.397566 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.397997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.537264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:28.546666 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-232e4ed4-f835-4366-b61f-32663a6a0180 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.164231 Oct 28 19:09:28.559386 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4084/7951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:28 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:28.606724 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "name": "network-vif-plugged", "status": "completed", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:09:28.616363 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:28.616787 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:28.617213 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:28.631499 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] Creating event network-vif-plugged:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h1-860864-13 Oct 28 19:09:28.636476 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-9977a908-2e79-48a0-a339-0346d27b12d5 req-355ab8ef-dc83-4834-8224-7e3319d50610 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105976 Oct 28 19:09:28.637066 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3868/7952] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:09:29.570976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:29.571577 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:29.579067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.579597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.580051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.580754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:29.581221 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:29.581666 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:29.719970 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:29.727824 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-9ebb7e3f-c3a5-4585-93a5-eaab8aec0196 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1687 microversion: 2.1 time: 0.160835 Oct 28 19:09:29.728413 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4085/7953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:29 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:09:30.752836 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:09:30.753550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:09:30.759828 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.760318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.760764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.761491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:09:30.761952 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:09:30.762382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:09:30.894140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:09:30.902145 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ab49b933-ffc5-419b-8ee1-76a37462cfea tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1674 microversion: 2.1 time: 0.154783 Oct 28 19:09:30.902732 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3869/7954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:09:30 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:15.847787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=21 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.851527 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=23 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.852709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=70 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.853634 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=61 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:15.866865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:15.867407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:15.875019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.875554 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.876016 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.876740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.877209 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.877735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.904138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:11:15.920386 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:15.931038 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:15.931875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:15.932312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:15.946057 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] Creating event network-changed:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h1-860864-13 Oct 28 19:11:15.952471 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-53c83059-d61a-4955-b470-5cf97cdb39b8 req-083347a3-f4f2-4aed-95d0-21e7f49a8ca8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102816 Oct 28 19:11:15.953087 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3870/7955] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:15.992076 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a544505a-d0d4-46e3-97be-1c66d413c377 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 204 len: 0 microversion: 2.1 time: 0.146255 Oct 28 19:11:15.996668 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4086/7956] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:11:15 2022] DELETE /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:11:16.003720 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:16.004943 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:16.011947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.012928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.013613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.014559 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:16.015220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:16.015872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:16.209928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:16.219693 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-9f12e543-997d-4543-8891-f7741b79f1fb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.221231 Oct 28 19:11:16.220287 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3871/7957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:15 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.244667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:17.245417 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:17.252986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.253490 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.253944 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.254663 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.255131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.255613 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.394396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:17.402794 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-55fd9b42-fec4-4c3d-8735-e0054e262aaf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1680 microversion: 2.1 time: 0.162427 Oct 28 19:11:17.403396 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4087/7958] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:17 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:17.972897 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed30618-d7b1-472a-9693-eb2def2aa919", "name": "network-vif-deleted", "tag": "40568e4a-12ac-479c-8785-c7162a6ab2ab"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:17.984646 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:17.985131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:17.985573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:17.997148 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] Creating event network-vif-deleted:40568e4a-12ac-479c-8785-c7162a6ab2ab for instance 0ed30618-d7b1-472a-9693-eb2def2aa919 on n-h1-860864-13 Oct 28 19:11:18.002027 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-5feab99c-13c6-44f8-86d4-df057244fc2e req-33186cd2-05a2-47c2-9a3d-873d40b54d6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Oct 28 19:11:18.002642 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3872/7959] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:18.427712 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:18.428610 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:18.436464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.436950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.437392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.438103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.438696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.439136 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.473474 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:18.473975 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:18.474448 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:18.474911 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lazy-loading 'fault' on Instance uuid 0ed30618-d7b1-472a-9693-eb2def2aa919 {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:11:18.518094 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:18.530589 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8e208c76-0cae-4e4c-95a3-b43960ed07ec tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 200 len: 1337 microversion: 2.1 time: 0.107036 Oct 28 19:11:18.531167 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4088/7960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:18 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 1337 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:19.555585 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.556286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: 0ed30618-d7b1-472a-9693-eb2def2aa919] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:19.563054 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.563577 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.564008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.564700 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:19.565148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:19.565568 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:19.579087 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] HTTP exception thrown: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Request method failure captured: Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 HTTP/1.1 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCgNzIuxSqV1rip6Sf10fWsxNPbXvZ2edZcAV3h2_v_SL88aV16clMruQjsruZPGNApt9rXu_0mahegnv6fKhbWSYgFDI2cZxAlYB-LjsZJwNK92nDbjKCgpsQ-dAYbQZ1on5T1cQ86cOSccwIswa3P7nZjsXwmhoRy5FRMkbm1Z68k Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 99c78c1f39a940089543d87a8401db3b Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestShelveInstance-1340460559 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99c78c1f39a940089543d87a8401db3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99c78c1f39a940089543d87a8401db3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_99c78c1f39a940089543d87a8401db3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/99c78c1f39a940089543d87a8401db3b"}]}] Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestShelveInstance-1340460559 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 99c78c1f39a940089543d87a8401db3b Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestShelveInstance-1340460559 Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestShelveInstance-1340460559-project Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 416b44d4047240c48f1f0112381e814d Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestShelveInstance-1340460559-project Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': '0ed30618-d7b1-472a-9693-eb2def2aa919'} Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:11:19.580725 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Returning 404 to user: Instance 0ed30618-d7b1-472a-9693-eb2def2aa919 could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-90ba7a68-adc2-499b-a157-ac68a426c439 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919" status: 404 len: 111 microversion: 2.1 time: 0.031739 Oct 28 19:11:19.586541 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3873/7961] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:19 2022] GET /compute/v2.1/servers/0ed30618-d7b1-472a-9693-eb2def2aa919 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 19:11:19.748255 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-53b65074-ca51-485c-84ec-3d4f88ea2e31 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '.version_select at 0x7f752434aa60>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:19.779082 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-53b65074-ca51-485c-84ec-3d4f88ea2e31 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1918525226" status: 202 len: 0 microversion: 2.1 time: 0.034868 Oct 28 19:11:19.779728 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4089/7962] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 19:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1918525226 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:11:19.800966 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1a4ba0fa-2743-4385-878b-05797c7e4074 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'create', calling method: .version_select at 0x7f75245720d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1075893659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOG/ES3nm/m3L3/h3zmiZMCeoKAy2yEJ8FTrbqUZwl98Be793zmdLPoNLHT1GN4/0ZGHeiJGji+Yp53anAqfw9i5wmXPqQ1W+slfDsA0A4bmyONvOSDYYbf37WjPPU/cQ=="}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:19.816530 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1a4ba0fa-2743-4385-878b-05797c7e4074 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for project 99c78c1f39a940089543d87a8401db3b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:19.821682 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-1a4ba0fa-2743-4385-878b-05797c7e4074 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for user 416b44d4047240c48f1f0112381e814d and project 99c78c1f39a940089543d87a8401db3b. Resources: {'key_pairs'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:19.849042 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1a4ba0fa-2743-4385-878b-05797c7e4074 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052361 Oct 28 19:11:19.849655 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3874/7963] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 19:11:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:36.094426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:36.095247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:36.099349 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-890186244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1075893659", "security_groups": [{"name": "tempest-secgroup-smoke-733964816"}], "networks": [{"uuid": "a28d74a5-60af-4843-923d-3d743881584a"}], "block_device_mapping_v2": [{"uuid": "9cb04e91-7f61-4aed-8402-a980557ce499", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:36.225017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] validate_networks() for [('a28d74a5-60af-4843-923d-3d743881584a', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:11:36.673392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:11:36.673835 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:11:36.674326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:11:36.674779 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:11:36.675204 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:11:36.685112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.685632 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.686084 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.686833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:36.687301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:36.687775 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:36.706669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for project 99c78c1f39a940089543d87a8401db3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:11:36.712177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Getting quotas for user 416b44d4047240c48f1f0112381e814d and project 99c78c1f39a940089543d87a8401db3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:11:36.770191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:11:36.772405 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cb04e91-7f61-4aed-8402-a980557ce499',volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:11:36.909380 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-577f21e2-6a43-47d0-8f66-e16e360a1abb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816731 Oct 28 19:11:36.910033 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4090/7964] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:11:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:11:36.920140 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=12 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:36.920917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:36.921722 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:36.926792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-617070fd-d213-4a3e-b873-b8af5d1ee8a3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:36.928968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-617070fd-d213-4a3e-b873-b8af5d1ee8a3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:36.994963 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-617070fd-d213-4a3e-b873-b8af5d1ee8a3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:37.003390 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-617070fd-d213-4a3e-b873-b8af5d1ee8a3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1088 microversion: 2.1 time: 0.085811 Oct 28 19:11:37.004089 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3875/7965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:36 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:38.028062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:38.030039 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:38.037206 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.037705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.038161 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.038877 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:38.039347 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:38.040005 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:38.108403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:38.116819 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7dc58b36-4b52-4ce3-a9f9-19db9b2ca683 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1204 microversion: 2.1 time: 0.094380 Oct 28 19:11:38.117585 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4091/7966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:38 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:39.142379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:39.142962 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:39.152026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.152613 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.153234 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.153907 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.154376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.155579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.307185 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:39.316836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-c43d51e2-6e45-4b53-872a-0decb0032454 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1271 microversion: 2.1 time: 0.178619 Oct 28 19:11:39.317430 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3876/7967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:39 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:39.906780 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:39.921071 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:39.922045 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:39.923262 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:39.937577 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] Creating event network-changed:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:11:39.943906 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b66f5cbb-26ab-4aa8-a662-dea789453b8b req-340fff86-ff3e-4fe9-ac98-bfb6c41e60b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044923 Oct 28 19:11:39.945352 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4092/7968] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:40.342132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:40.342856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:40.366378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.367113 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.367745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.368697 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:40.369491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:40.370094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:40.532266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:40.540996 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc34f9de-9f4f-4997-b317-6b4368d03ec6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1271 microversion: 2.1 time: 0.203717 Oct 28 19:11:40.542026 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3877/7969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:40 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:41.566815 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:41.567592 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:41.574591 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.575092 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.575582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.576293 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:41.576764 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:41.577207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:41.717651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:41.725796 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aa335516-8ca1-418b-bb2b-fca5e2f45809 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1271 microversion: 2.1 time: 0.164385 Oct 28 19:11:41.726715 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4093/7970] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:41 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:42.748781 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:42.749526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:42.756792 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.757282 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.757727 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.758433 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:42.758890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:42.759318 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:42.908706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:42.919856 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3bca7265-eb93-49a0-95c0-52d3458ab5ae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1271 microversion: 2.1 time: 0.175184 Oct 28 19:11:42.920567 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3878/7971] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:42 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:43.945933 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:43.946805 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:43.954806 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.955359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.955896 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:43.957053 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:43.957579 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:43.958065 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:44.107777 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:44.120541 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0640d2ea-0dd3-4d8c-ba47-bdcf86d5d83c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.178908 Oct 28 19:11:44.121429 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4094/7972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:43 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:11:45.145680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:45.146250 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:45.153491 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.153979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.154411 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.155126 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:45.155614 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:45.156044 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:45.288709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:45.297154 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-db9b2537-ab67-4244-87d3-83e8fcf26c54 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.155546 Oct 28 19:11:45.297751 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3879/7973] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:45 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:46.320408 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:46.321017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:46.328776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.329274 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.329726 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.330435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:46.330900 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:46.331338 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:46.471658 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:46.480210 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf52c5e0-1694-48fa-b25e-49c2b1e604c8 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.163319 Oct 28 19:11:46.480793 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4095/7974] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:46 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:47.504408 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:47.505016 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:47.507888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:47.514829 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.515310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.515769 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.516458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:47.516908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:47.517329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:47.649080 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:47.657623 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86212131-28fa-4bd2-a0c9-5c907c1ef1b0 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.157043 Oct 28 19:11:47.658404 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3880/7975] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:47 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:48.680954 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:48.681520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:48.683488 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:48.684193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:11:48.692164 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.692675 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.693130 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.693874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:48.694344 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:48.694792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:48.837939 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:48.845875 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-89263278-9ced-493a-8640-60ad27e0bb0f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.169192 Oct 28 19:11:48.846459 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4096/7976] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:48 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:49.871024 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:49.871645 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:49.878472 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.878959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.879465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:49.880188 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:49.880642 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:49.881064 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:50.014495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:50.022331 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7da3c16c-cc0b-4af5-a1a5-9c65d8362399 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.155946 Oct 28 19:11:50.022920 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3881/7977] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:49 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:51.046871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:51.047467 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:51.054306 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.054798 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.055244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.055976 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:51.056441 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:51.056875 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:51.190635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:51.199243 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2b452d73-46f7-40de-919b-68eb401e7882 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.157022 Oct 28 19:11:51.199929 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4097/7978] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:51 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:52.222119 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:52.222752 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:52.230490 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.230973 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.231427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.232125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:52.232574 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:52.232995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:52.368840 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:52.377488 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-0ccfb2f9-b89d-4d58-9b5f-bb0c94ff8939 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.159244 Oct 28 19:11:52.378055 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3882/7979] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:52 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:53.401952 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:53.402702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:53.410191 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.410730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.411260 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.411932 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:53.412429 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:53.412897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:53.549739 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:53.558157 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d6b0ede5-71a3-442b-a591-2632c6ecfce2 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.160573 Oct 28 19:11:53.559092 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4098/7980] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:53 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:54.582060 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:54.582656 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:54.590519 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.591003 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.591465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.592169 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.592628 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.593104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.734095 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:54.744809 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8ad0f34d-af77-469c-b5d2-57cd8ee1e4bd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.166545 Oct 28 19:11:54.751660 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3883/7981] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:54 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:54.896426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "name": "network-vif-plugged", "status": "completed", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:54.912202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:54.912699 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:54.913142 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:54.928469 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] Creating event network-vif-plugged:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:11:54.933884 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-0b971485-05e7-4e4f-9981-8db3576b6ce4 req-facd991e-65d7-4702-ab83-096b279d32bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041298 Oct 28 19:11:54.934516 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4099/7982] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:11:55.769434 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:55.770033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:55.777958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.778440 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.778888 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.779615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:55.780074 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:55.780501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:55.915266 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:55.924102 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f4ede437-72ce-4f69-bb6f-e09cab5db9dd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1259 microversion: 2.1 time: 0.158587 Oct 28 19:11:55.924696 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3884/7983] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:55 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:56.950464 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:56.951186 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:56.957884 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.958388 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.958833 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:56.959585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:56.960046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:56.960480 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.096669 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.104940 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-7a61439c-8593-4724-a23d-a98e1e95f341 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1443 microversion: 2.1 time: 0.160343 Oct 28 19:11:57.105153 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4100/7984] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:56 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:57.127874 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:11:57.128487 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:11:57.135390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.136729 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.137006 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.137838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:57.138308 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:57.138745 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:57.278509 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:11:57.286449 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8854b44a-cbfa-4c9c-8078-0c8a8a3d2af9 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1443 microversion: 2.1 time: 0.162542 Oct 28 19:11:57.287035 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3885/7985] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:11:57 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:11:58.959165 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:11:58.970874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:11:58.971491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:11:58.972181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:11:58.985051 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] Creating event network-changed:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:11:58.990278 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-9678b09a-f177-48e6-9900-a69fcf03fd89 req-5bd2aaaf-c1d8-4757-9cb1-208c95b9122b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035391 Oct 28 19:11:58.990929 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4101/7986] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:13:56.577225 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:13:56.578377 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:13:56.578948 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=24 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.579738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=60 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.580524 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:13:56.580708 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action (ip 10.222.0.48) !!! Oct 28 19:13:56.582395 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:13:56.582552 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action (ip 10.222.0.48) !!! Oct 28 19:13:56.583823 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:13:56.583953 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action (ip 10.222.0.48) !!! Oct 28 19:13:56.591885 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:13:56.592421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.609209 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.609693 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.610127 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.610967 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.611432 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.611860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.640335 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lazy-loading 'flavor' on Instance uuid b66e3d99-5991-4ead-9d8c-7521217b6245 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:13:56.723355 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4298a41f-aa6d-4185-93c7-b600d5323aad tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action" status: 202 len: 0 microversion: 2.1 time: 0.147753 Oct 28 19:13:56.724029 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3886/7987] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:13:56 2022] POST /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:13:56.730801 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:13:56.731785 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:13:56.732471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.733414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=56 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:13:56.734903 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:13:56.735059 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 (ip 10.222.0.48) !!! Oct 28 19:13:56.737608 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:13:56.737809 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:13:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 (ip 10.222.0.48) !!! Oct 28 19:13:56.747256 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:56.748109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:56.758568 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.759063 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.759559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:56.760795 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:56.761254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:56.761697 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:57.001137 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:57.011565 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-2fd50c54-54ea-4ec7-b0ad-2f303a0640a1 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.282750 Oct 28 19:13:57.012172 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4102/7988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:56 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:58.037950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:58.038666 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:58.047458 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.048036 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.048387 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.049094 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:58.049550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:58.049979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:58.054869 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45272. Oct 28 19:13:58.058115 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45270. Oct 28 19:13:58.204723 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:58.213829 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-86473ae4-10ec-4b0b-a04e-288f13a3c0cb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.180987 Oct 28 19:13:58.214434 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3887/7989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:58 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:13:59.238537 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:13:59.239316 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:13:59.247688 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.248198 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.248648 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.249401 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:13:59.251181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:13:59.251181 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:13:59.269777 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45278. Oct 28 19:13:59.270546 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45276. Oct 28 19:13:59.404705 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:13:59.413983 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d7edae5b-ae33-4b9f-901e-3ab21f10137d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.179394 Oct 28 19:13:59.414578 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4103/7990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:13:59 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:00.439678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:00.440376 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:00.447344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.447998 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.448464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.449190 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:00.449692 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:00.450129 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:00.590910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:00.598852 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-471588d9-6600-4323-8c19-872635e62f74 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.163404 Oct 28 19:14:00.599445 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3888/7991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:00 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:01.623782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:01.624330 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:01.632087 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.632593 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.633047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.633763 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:01.634234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:01.634686 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:01.770710 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:01.780140 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-f6895923-f5b3-4189-ae2f-d83eb0195e1f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.160980 Oct 28 19:14:01.780755 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4104/7992] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:01 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:02.805921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:02.806552 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:02.816171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.816667 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.817104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.817812 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:02.818284 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:02.818704 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:02.960908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:02.969728 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2fbd816-4f86-4cf5-afa1-1a829597e408 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.167702 Oct 28 19:14:02.970310 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3889/7993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:02 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:03.995910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:03.996576 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:04.003808 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.004312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.004760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.005486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:04.005945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:04.006381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:04.173047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:04.182080 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d071e33d-e793-4585-aeca-797ac7cb0ec5 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.190979 Oct 28 19:14:04.182634 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4105/7994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:03 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:05.207176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:05.207779 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:05.215177 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.215708 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.216148 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.216859 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:05.217321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:05.217748 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:05.371637 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:05.379310 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-25d0c0a4-137c-4b0c-8118-8c08c432ec55 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.176851 Oct 28 19:14:05.379936 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3890/7995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:05 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:06.414744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:06.415687 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:06.426837 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.427569 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.428199 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.429294 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:06.429968 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:06.430737 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:06.613787 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:06.622857 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-43c45469-fe4e-46f3-aae6-b2e07157405b tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.214047 Oct 28 19:14:06.623609 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4106/7996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:06 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:07.647179 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:07.647889 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:07.655785 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.656310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.656749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.657453 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:07.657910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:07.658334 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:07.805757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:07.814870 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-8debe23a-d63b-4d95-ab6b-3f813244d405 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.171977 Oct 28 19:14:07.815497 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3891/7997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:07 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:08.842499 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:08.843106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:08.850366 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.850862 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.851312 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:08.852050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:08.852511 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:08.852947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:09.015468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:09.024189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-40e13d2b-3c6a-4a03-b3bd-dc7b008003ba tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.187346 Oct 28 19:14:09.024787 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4107/7998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:08 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:10.049403 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:10.050026 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:10.057979 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.058470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.058934 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.059683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:10.060133 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:10.060557 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:10.209783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:10.218836 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5b209bb7-4d55-4577-9343-d15b0d284f8a tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.173810 Oct 28 19:14:10.219444 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3892/7999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:10 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.244961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.245684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.254940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.255603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.256116 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.257471 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.258078 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.258573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.419147 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.432226 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4d1dc467-f262-481e-a76f-cf14c68d4fbd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1569 microversion: 2.1 time: 0.191435 Oct 28 19:14:11.433380 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4108/8000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:11.464901 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:11.465643 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.473018 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.473513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.474005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.474713 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.475171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.475985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.590310 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120567) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 19:14:11.666035 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-6a590089-620a-4dad-bd22-2ea20e996fc7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "POST /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action" status: 202 len: 0 microversion: 2.1 time: 0.205997 Oct 28 19:14:11.666938 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3893/8001] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:14:11 2022] POST /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:14:11.677756 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:11.678887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:11.687060 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.688077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.688077 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.688821 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:11.689657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:11.689898 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:11.866392 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:11.876124 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-1904e57d-8de0-4cb0-88ea-044269cc0dfd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1517 microversion: 2.1 time: 0.203515 Oct 28 19:14:11.876746 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4109/8002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:11 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:12.903592 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:12.904757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:12.911114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.911718 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.912160 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:12.912950 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:12.913441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:12.913936 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.089675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:13.101001 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-50a6292e-c7be-412c-9475-316702a5d5ab tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1517 microversion: 2.1 time: 0.203784 Oct 28 19:14:13.101535 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3894/8003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:12 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:13.540589 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "name": "network-vif-unplugged", "status": "completed", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:13.551986 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:13.552487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:13.552997 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:13.565451 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.compute.server_external_events [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] Unable to find a host for instance b66e3d99-5991-4ead-9d8c-7521217b6245. Dropping event network-vif-unplugged {{(pid=120568) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 19:14:13.566378 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-951200a7-a598-457e-b9f0-11de78ede8e3 req-e1b7bab0-e18b-4776-a8dc-1ea0cbe82ae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029740 Oct 28 19:14:13.567070 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4110/8004] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 19:14:14.125915 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:14.127221 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:14.134877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.135904 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.136339 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.137030 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:14.137484 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:14.137930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:14.282378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:14.290667 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b01b19a4-6c5c-444d-81ff-a99fc2595be3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1517 microversion: 2.1 time: 0.168614 Oct 28 19:14:14.295402 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3895/8005] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:14 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:15.315609 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:15.316247 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:15.323050 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.323585 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.324038 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.324759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:15.325253 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:15.325694 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:15.458106 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:15.466117 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e40cab9d-6df7-4ccf-92d6-7246c4371560 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1517 microversion: 2.1 time: 0.154463 Oct 28 19:14:15.466700 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4111/8006] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:15 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:16.489970 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:16.491123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:16.499163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.499678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.500114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.500807 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:16.501254 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:16.501675 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:16.645767 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:16.654452 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-193a606b-a7bd-4206-928e-164f8cb4bef6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1519 microversion: 2.1 time: 0.168496 Oct 28 19:14:16.655402 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3896/8007] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:16 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:17.680239 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:17.680844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:17.688066 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.688583 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.689019 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.689731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:17.690202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:17.690645 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:17.830640 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:17.839540 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-817c0314-ebc9-418b-9133-a738021caac3 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1519 microversion: 2.1 time: 0.163428 Oct 28 19:14:17.840132 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4112/8008] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:17 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:18.863777 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:18.864409 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:18.873042 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.873526 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.873960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:18.874659 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:18.875111 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:18.875573 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:19.011930 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:19.019743 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fac759e8-1f89-47dd-82fc-b1699a06d6cd tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1519 microversion: 2.1 time: 0.160041 Oct 28 19:14:19.020314 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3897/8009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:18 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:20.045167 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:20.045792 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:20.053006 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.053508 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.053961 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.054695 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:20.055162 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:20.055627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:20.202098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:20.209691 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-aac7b2c0-9bde-4a78-9223-3a53bd7efebb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1519 microversion: 2.1 time: 0.168571 Oct 28 19:14:20.210302 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4113/8010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:20 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:21.234906 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:21.235586 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:21.242830 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.243321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.244542 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.245548 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:21.245994 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:21.246418 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:21.390632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:21.398594 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2e1a33f0-979a-44fa-9423-c560f8109902 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1519 microversion: 2.1 time: 0.167688 Oct 28 19:14:21.399184 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3898/8011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:21 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:22.423254 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:22.423990 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:22.431871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.432284 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.432738 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.433745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:22.434098 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:22.434541 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:22.592297 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:22.606916 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cd187a79-c0ed-4133-bfcc-19e5e1d5a17f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.187461 Oct 28 19:14:22.608084 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4114/8012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:22 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:23.631750 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:23.632328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:23.639802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.640283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.640725 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.641427 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:23.641875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:23.642292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:23.661680 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:24.082975 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:24.091417 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d40ff237-08bc-4cc4-8295-1a2940cb7376 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.463711 Oct 28 19:14:24.092006 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3899/8013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:23 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:25.116682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:25.117512 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:25.125082 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.125668 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.126185 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.126910 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:25.127402 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:25.127850 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:25.269201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:25.278297 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ee9aec2f-6092-418b-a30d-212a01d78b86 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.165708 Oct 28 19:14:25.278902 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4115/8014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:25 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:26.302025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:26.302644 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:26.311476 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.312004 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.312431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.313606 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:26.314150 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:26.314501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:26.461468 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:26.469962 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b2b69c31-2da3-4eca-8a0e-dffb3f7776be tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.171880 Oct 28 19:14:26.470551 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3900/8015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:26 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:27.493834 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:27.495138 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:27.497894 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=29 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:27.503768 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.504277 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.504730 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.505475 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:27.505947 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:27.506391 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:27.509831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=81 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:27.644751 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:27.654717 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6af39709-daea-4601-bda9-f26a67d397ca tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.164946 Oct 28 19:14:27.655337 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4116/8016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:27 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:28.678385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:28.678980 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:28.681101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:14:28.687689 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.688203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.688634 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:28.689329 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:28.689809 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:28.690227 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:28.837307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:28.846181 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-5bcbb228-492b-430d-ac3e-d5a40223cb67 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.171886 Oct 28 19:14:28.846752 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3901/8017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:28 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:29.871009 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:29.871684 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:29.878328 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.878822 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.879308 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:29.880067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:29.880507 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:29.880940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:30.017735 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:30.026530 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-dc565040-20ef-415e-b54d-94d5f6ce34ee tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.159583 Oct 28 19:14:30.027135 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4117/8018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:29 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:31.050504 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:31.051104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:31.059390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.059877 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.060307 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.060999 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:31.061450 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:31.061872 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:31.206285 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:31.214707 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-214c7804-3ba3-4cb3-85f2-a46c97b3577f tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.168127 Oct 28 19:14:31.215308 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3902/8019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:31 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:32.239395 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:32.240037 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:32.247931 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.248428 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.248871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.249584 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:32.250044 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:32.250871 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:32.397426 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:32.405961 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-6fefade7-b63f-4e27-addd-027a6e20c5bf tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.170544 Oct 28 19:14:32.406551 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4118/8020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:32 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:33.429477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:33.430089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:33.437336 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.437826 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.438261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.438995 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.439477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.439908 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.578636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:33.586709 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-ae961340-3f2a-449b-b0e3-44ae82acc536 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.161179 Oct 28 19:14:33.587420 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3903/8021] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:33 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:33.730551 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "name": "network-vif-plugged", "status": "completed", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:14:33.740626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:33.741244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:33.741563 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:33.754645 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] Creating event network-vif-plugged:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:14:33.759973 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-7240a95b-d5f9-4e83-8564-1668d9ab30f4 req-2d97f2d5-1428-443e-93cb-2874e91931e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086954 Oct 28 19:14:33.760605 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4119/8022] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:14:34.611262 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:34.611926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:34.619402 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:34.619905 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:34.620344 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:34.621037 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:34.621494 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:34.621917 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:34.762292 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:34.770829 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-40d3c862-5f55-4cfc-a2e1-a26895be4bf6 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1575 microversion: 2.1 time: 0.163429 Oct 28 19:14:34.771473 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3904/8023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:34 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:14:35.799180 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:14:35.799945 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:14:35.806874 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.807458 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.807916 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.808633 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:14:35.809113 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:14:35.809550 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:14:35.948331 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:14:35.956244 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-12cb1d13-49d2-40c3-b5f7-212f3b832123 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1562 microversion: 2.1 time: 0.162337 Oct 28 19:14:35.956824 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4120/8024] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:14:35 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:50.478921 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=7 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.483844 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=9 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.484501 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=25 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.489227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:50.492471 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=32 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:15:50.498098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:50.498864 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:50.503646 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.504170 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.504627 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.509974 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.510495 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.510947 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.511985 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.512451 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.512883 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.518945 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] Creating event network-changed:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:15:50.525556 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-b1770483-d24c-4946-b225-c20e93e6334d req-59fd1dbd-f350-49a2-a9b0-34336df82112 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044394 Oct 28 19:15:50.526858 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4121/8025] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:15:50.551116 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:15:50.666045 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-895de6fc-0cb1-4fed-a229-7845d8a49bae tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 204 len: 0 microversion: 2.1 time: 0.188832 Oct 28 19:15:50.667671 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3905/8026] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:15:50 2022] DELETE /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:15:50.677000 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:50.677867 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:50.685641 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.686270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.686840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.687754 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:50.688504 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:50.689030 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:50.845682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:50.854844 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-bf391ff8-ab12-4f0e-a088-b55c7ce1fc8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.183018 Oct 28 19:15:50.855473 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4122/8027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:50 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:51.880683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:51.881583 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:51.888831 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.889325 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.889763 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:51.890475 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:51.890928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:51.891355 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.046672 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:52.055655 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-be728372-182f-4ccd-a0eb-e7a31b398cfb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1568 microversion: 2.1 time: 0.179193 Oct 28 19:15:52.056261 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3906/8028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:51 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:52.857561 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66e3d99-5991-4ead-9d8c-7521217b6245", "name": "network-vif-deleted", "tag": "6c2fd2f7-dd88-4cf3-8b9b-2448656f6209"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:15:52.868606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:52.869575 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:52.870026 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:52.887960 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] Creating event network-vif-deleted:6c2fd2f7-dd88-4cf3-8b9b-2448656f6209 for instance b66e3d99-5991-4ead-9d8c-7521217b6245 on n-h2-860864-13 Oct 28 19:15:52.893355 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-78d35ed2-e4c1-4e7b-a940-8a974ee16665 req-8b412319-92af-464d-863a-f2ce6ad7fbbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123144 Oct 28 19:15:52.893979 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4123/8029] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:15:53.085800 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:53.088131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:53.100362 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:53.102513 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:53.103220 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:53.104496 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:53.105315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:53.106333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:53.197638 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:53.213765 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-97dd0de1-bb97-4656-953f-6ffd3de81804 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1219 microversion: 2.1 time: 0.135402 Oct 28 19:15:53.214816 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3907/8030] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:53 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:54.237940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:54.238677 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:54.247582 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.248201 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.248657 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.249367 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:54.249826 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:54.250276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:54.321520 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:54.329671 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0263aa7d-4a24-4093-88ae-616e867bf4bb tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1219 microversion: 2.1 time: 0.095971 Oct 28 19:15:54.330269 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4124/8031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:54 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:15:55.356072 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:55.357465 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:55.368996 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.369741 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.370492 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.371457 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:55.372210 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:55.372903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:55.441958 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:55.450235 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-f183a184-b417-4a7b-8c56-5d13470406c7 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1219 microversion: 2.1 time: 0.099824 Oct 28 19:15:55.450831 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3908/8032] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:55 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:56.477517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:56.478140 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:56.485264 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.485765 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.486207 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.486921 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:56.487407 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:56.487840 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:56.556823 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:56.565492 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-079b201b-a434-4366-86b0-55d8e9f6cd8c tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1219 microversion: 2.1 time: 0.092569 Oct 28 19:15:56.566065 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4125/8033] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:56 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:57.591315 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:57.592532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:57.599508 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.600008 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.600449 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.601910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.602373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.603099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.649660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:57.650157 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:57.650605 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:57.651328 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.objects.instance [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lazy-loading 'fault' on Instance uuid b66e3d99-5991-4ead-9d8c-7521217b6245 {{(pid=120567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:15:57.722688 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416b44d4047240c48f1f0112381e814d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c78c1f39a940089543d87a8401db3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:15:57.734317 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-dc450dc2-5a5e-401b-b0aa-0e24805f8d0d tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 200 len: 1178 microversion: 2.1 time: 0.147126 Oct 28 19:15:57.734933 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3909/8034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:57 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 1178 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:15:58.758028 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:58.758654 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] [instance: b66e3d99-5991-4ead-9d8c-7521217b6245] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:15:58.765949 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.766450 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.766897 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.767650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:15:58.768117 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:15:58.768555 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:15:58.789940 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] HTTP exception thrown: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Request method failure captured: Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 HTTP/1.1 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCgNzIuxSqV1rip6Sf10fWsxNPbXvZ2edZcAV3h2_v_SL88aV16clMruQjsruZPGNApt9rXu_0mahegnv6fKhbWSYgFDI2cZxAlYB-LjsZJwNK92nDbjKCgpsQ-dAYbQZ1on5T1cQ86cOSccwIswa3P7nZjsXwmhoRy5FRMkbm1Z68k Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 99c78c1f39a940089543d87a8401db3b Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestShelveInstance-1340460559 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99c78c1f39a940089543d87a8401db3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99c78c1f39a940089543d87a8401db3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_99c78c1f39a940089543d87a8401db3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/99c78c1f39a940089543d87a8401db3b"}]}] Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestShelveInstance-1340460559 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 99c78c1f39a940089543d87a8401db3b Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestShelveInstance-1340460559 Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestShelveInstance-1340460559-project Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 416b44d4047240c48f1f0112381e814d Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestShelveInstance-1340460559-project Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': 'b66e3d99-5991-4ead-9d8c-7521217b6245'} Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:15:58.791700 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Returning 404 to user: Instance b66e3d99-5991-4ead-9d8c-7521217b6245 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-e448c6c0-fc66-43c1-82d6-f6628b60ab88 tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245" status: 404 len: 111 microversion: 2.1 time: 0.039207 Oct 28 19:15:58.800460 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4126/8035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:15:58 2022] GET /compute/v2.1/servers/b66e3d99-5991-4ead-9d8c-7521217b6245 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:15:58.993005 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fecd08cd-e377-4112-9e30-0d8037ef9acc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] Calling method '.version_select at 0x7f75242e7ee0>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:15:59.028722 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fecd08cd-e377-4112-9e30-0d8037ef9acc tempest-TestShelveInstance-1340460559 tempest-TestShelveInstance-1340460559-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1075893659" status: 202 len: 0 microversion: 2.1 time: 0.039663 Oct 28 19:15:59.029279 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3910/8036] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Oct 28 19:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1075893659 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 19:16:19.042549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=12 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:19.045559 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=24 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:19.326532 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-30dfea8d-67b4-459c-9a4b-ad2eb9168a38 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Action: 'create', calling method: .version_select at 0x7f752460a4c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1111877827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEvFJOyusZ5GWNkTXfKifos91uwq5cZV16VUCoZ3HyND1Lhc+5QSXHcmSsTGeLpmBJJ0m2axzU5ki125R0CYzhLfXIHPR1JoG3GlsmQM41G+l8pB/EnG9CihMD+L0Bv5w=="}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:19.357981 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-30dfea8d-67b4-459c-9a4b-ad2eb9168a38 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:19.371978 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-30dfea8d-67b4-459c-9a4b-ad2eb9168a38 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for user 7eeb76b78d0440b9b94700d31770bf46 and project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'key_pairs'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:19.425125 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-30dfea8d-67b4-459c-9a4b-ad2eb9168a38 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.383410 Oct 28 19:16:19.426412 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4127/8037] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Oct 28 19:16:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:20.536312 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:20.537825 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:20.545114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1892888745", "imageRef": "4f7274c7-779f-4acb-8077-345620e4cdc6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1111877827", "security_groups": [{"name": "tempest-secgroup-smoke-309914431"}], "networks": [{"uuid": "80586639-9b88-4cb5-a3a6-6df126341988"}]}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:20.808623 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.network.neutron [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] validate_networks() for [('80586639-9b88-4cb5-a3a6-6df126341988', None, None, None, None, None)] {{(pid=120567) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:16:21.227903 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Flavor limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:16:21.228414 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Image limits 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:16:21.228968 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Flavor pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:16:21.229390 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Image pref 0:0:0 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:16:21.229802 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.virt.hardware [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:16:21.245470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.245960 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.246392 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:21.247125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:21.247608 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:21.248041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:21.267171 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:16:21.273959 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.quota [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for user 7eeb76b78d0440b9b94700d31770bf46 and project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'cores', 'instances', 'ram'} {{(pid=120567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:16:21.290416 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Going to run 1 instances... {{(pid=120567) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:16:21.292856 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f7274c7-779f-4acb-8077-345620e4cdc6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:16:21.349536 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d17403c7-cc50-405a-a259-e5f4640c61e4 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.816591 Oct 28 19:16:21.351314 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3911/8038] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:16:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 19:16:21.364400 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-cc2dd2b2-87d3-4ee5-a901-1151e2e905fb tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:21.365027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-cc2dd2b2-87d3-4ee5-a901-1151e2e905fb tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:21.436068 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-cc2dd2b2-87d3-4ee5-a901-1151e2e905fb tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:21.443669 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-cc2dd2b2-87d3-4ee5-a901-1151e2e905fb tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1249 microversion: 2.1 time: 0.083830 Oct 28 19:16:21.445452 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4128/8039] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:21 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:22.479770 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:22.481862 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:22.500474 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:22.501431 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:22.502214 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:22.504698 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:22.506330 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:22.507469 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:22.610566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:22.630375 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-b83293ca-f9b1-4ed6-ad92-c4b8986dcad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1309 microversion: 2.1 time: 0.162219 Oct 28 19:16:22.631436 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3912/8040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:22 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:23.657930 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:23.658701 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:23.668231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:23.668782 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:23.669244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:23.670325 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:23.670831 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:23.681238 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:23.835487 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:23.846114 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-52e7489d-c025-4ce8-9c60-ee666b5d0a41 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.191958 Oct 28 19:16:23.846462 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4129/8041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:23 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:24.224062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:24.240625 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.242346 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.242982 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.258007 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] Creating event network-changed:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:16:24.265347 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-59138d76-c195-44fd-be3f-b580fc08aa3e req-10f72b4b-8b0c-431d-89a9-0abc38ba1f2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046789 Oct 28 19:16:24.266284 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3913/8042] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:24.870851 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:24.872227 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:24.879724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.880230 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.880745 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:24.882102 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:24.882621 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:24.883067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:25.031650 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:25.042189 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3b5df1bc-d182-4350-8b45-199a88ae862d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.175303 Oct 28 19:16:25.042787 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4130/8043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:24 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:26.067441 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:26.068056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:26.076098 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.076579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.077025 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.077738 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:26.078200 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:26.078636 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:26.218000 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:26.226271 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-3ccb318b-39b2-402a-bf48-e5ffc939df94 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.163134 Oct 28 19:16:26.226872 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3914/8044] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:26 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:27.250525 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:27.251468 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:27.260966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.261544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.262302 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.263543 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:27.264317 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:27.265051 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:27.418177 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:27.426256 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-041116f4-5a85-440b-8a11-e8846c064da7 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.180399 Oct 28 19:16:27.426860 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4131/8045] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:27 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:28.452635 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:28.453709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:28.462926 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.463452 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.463890 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.464600 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:28.465085 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:28.465511 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:28.628158 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:28.638373 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-fe689419-7644-442d-8e26-6b407baa7c33 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.192312 Oct 28 19:16:28.638974 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3915/8046] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:28 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:29.662690 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:29.663270 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:29.669383 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.669876 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.670321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.671018 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:29.671506 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:29.671950 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:29.823486 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:29.831415 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-ca66e85d-d269-4d73-9c3a-7e3da4576e40 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.173028 Oct 28 19:16:29.832010 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4132/8047] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:29 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:30.316477 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "name": "network-vif-plugged", "status": "completed", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:30.328283 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.328772 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.329202 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.341915 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] Creating event network-vif-plugged:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:16:30.347302 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-08486759-fb60-4737-a40d-5bb5ac75b89f req-0480296e-e520-4774-a9f5-17fa85cd46bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035492 Oct 28 19:16:30.347957 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3916/8048] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:16:30.854517 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:30.855132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:30.862132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.862635 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.863089 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:30.863842 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:30.864315 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:30.864759 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:31.019171 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:31.022664 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-907e926c-dd54-4f4d-b11b-9417bfe7822c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1374 microversion: 2.1 time: 0.172039 Oct 28 19:16:31.023469 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4133/8049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:30 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:32.044919 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:32.045620 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=6 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:32.050765 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:32.051502 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:32.059117 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.059632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.060075 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.060780 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.061236 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.061665 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.202437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:32.210606 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-96af820e-7764-4f41-9c29-dc4d75f1bb4c tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1559 microversion: 2.1 time: 0.166777 Oct 28 19:16:32.211189 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3917/8050] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:32 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:16:32.233432 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:16:32.234088 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:16:32.236055 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=6 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:16:32.242693 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.243193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.243749 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.244465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:32.244942 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:32.245381 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:32.394276 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:16:32.405836 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-4f98dc9e-9903-4001-8d5d-e3ebd60739a6 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1559 microversion: 2.1 time: 0.176339 Oct 28 19:16:32.406425 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4134/8051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:16:32 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:16:34.306584 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:16:34.318109 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:16:34.318528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:16:34.319056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:16:34.331413 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] Creating event network-changed:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:16:34.337459 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-58ce3886-0d13-43af-8d9d-bc5b4d8d41d0 req-591b48c1-1c52-4abd-8c76-bb372b15c78d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Oct 28 19:16:34.338560 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3918/8052] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:00.356838 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:19:00.357730 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 19:19:00.358558 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:00.359419 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=36 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:00.360500 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:19:00.360690 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102/action (ip 10.222.0.48) !!! Oct 28 19:19:00.362156 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:19:00.362156 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102/action (ip 10.222.0.48) !!! Oct 28 19:19:00.363094 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 19:19:00.363274 n-d-860864-13 devstack@n-api.service[120568]: Fri Oct 28 19:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102/action (ip 10.222.0.48) !!! Oct 28 19:19:00.368941 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-131402374"}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:00.371403 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:00.384017 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:00.384527 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:00.384980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:00.385702 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:00.386168 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:00.386603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:00.717153 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-3fe2a969-91d3-4ff5-9437-f430c52119f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "POST /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102/action" status: 202 len: 0 microversion: 2.1 time: 0.362179 Oct 28 19:19:00.717822 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4135/8053] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:19:00 2022] POST /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:19:07.096170 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:19:07.096987 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:19:07.097615 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:07.098928 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=32 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:07.100453 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:19:07.100642 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 28 19:19:07.101719 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:19:07.101913 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 28 19:19:07.102856 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 19:19:07.103865 n-d-860864-13 devstack@n-api.service[120567]: Fri Oct 28 19:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Oct 28 19:19:07.109151 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "name": "network-vif-plugged", "status": "completed", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:07.130501 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:07.130910 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:07.131340 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:07.142963 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] Creating event network-vif-plugged:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:19:07.149750 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-384b7ab9-041d-4172-978d-81019624d154 req-a4fee505-c18e-4888-b5c1-1c3c08ff8676 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055349 Oct 28 19:19:07.150550 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3919/8054] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:18.405484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:18.406321 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:18.414076 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45834. Oct 28 19:19:18.422762 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45836. Oct 28 19:19:18.428774 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1453744465", "imageRef": "8d5691d7-6e8e-4354-a393-5fafce6098d8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1111877827", "security_groups": [{"name": "tempest-secgroup-smoke-309914431"}], "networks": [{"uuid": "80586639-9b88-4cb5-a3a6-6df126341988"}]}} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:18.543938 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.network.neutron [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] validate_networks() for [('80586639-9b88-4cb5-a3a6-6df126341988', None, None, None, None, None)] {{(pid=120568) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 19:19:19.058546 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Flavor limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 19:19:19.058982 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Image limits 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 19:19:19.059573 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Flavor pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 19:19:19.060027 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Image pref 0:0:0 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 19:19:19.060453 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.virt.hardware [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120568) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 19:19:19.070482 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.070985 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.071465 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.072202 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:19.072667 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:19.073103 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:19.090984 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 19:19:19.096326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.quota [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Getting quotas for user 7eeb76b78d0440b9b94700d31770bf46 and project 74d8e4f1ed3145eaaa4d03361b6389d8. Resources: {'cores', 'instances', 'ram'} {{(pid=120568) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 19:19:19.110193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Going to run 1 instances... {{(pid=120568) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 19:19:19.112758 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d5691d7-6e8e-4354-a393-5fafce6098d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120568) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 19:19:19.165874 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-88831f3b-2a96-4a50-8a5f-96259566db4e tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764012 Oct 28 19:19:19.166545 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4136/8055] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Oct 28 19:19:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 19:19:19.187215 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:19.188071 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:19.199291 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-d51a6dff-b06a-4066-9ca5-f5160252aad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:19.200062 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-d51a6dff-b06a-4066-9ca5-f5160252aad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:19.203601 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0b44b6b-a371-442f-a6d6-005724c9ae6d] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45860. Oct 28 19:19:19.216468 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [-] [99ce7a83-eb80-496a-97ff-989f7d191ba5] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45858. Oct 28 19:19:19.266333 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-d51a6dff-b06a-4066-9ca5-f5160252aad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:19.274047 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-d51a6dff-b06a-4066-9ca5-f5160252aad3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1249 microversion: 2.1 time: 0.091271 Oct 28 19:19:19.274639 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3920/8056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:19 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:20.304046 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5f54d5e7-f4d3-45ac-bf16-792978fdb323 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:20.304794 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5f54d5e7-f4d3-45ac-bf16-792978fdb323 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:20.365435 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5f54d5e7-f4d3-45ac-bf16-792978fdb323 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:20.372563 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5f54d5e7-f4d3-45ac-bf16-792978fdb323 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1249 microversion: 2.1 time: 0.073791 Oct 28 19:19:20.373134 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4137/8057] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:20 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:21.396261 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-7bdba353-f932-4cf1-8587-2bf9198c79a9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:21.396875 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-7bdba353-f932-4cf1-8587-2bf9198c79a9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:21.451805 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-7bdba353-f932-4cf1-8587-2bf9198c79a9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:21.458783 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-7bdba353-f932-4cf1-8587-2bf9198c79a9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1249 microversion: 2.1 time: 0.066524 Oct 28 19:19:21.459353 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3921/8058] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:21 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:22.482109 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-75f859f8-477b-49f3-8538-5607a61c0b67 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:22.482740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-75f859f8-477b-49f3-8538-5607a61c0b67 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:22.538709 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-75f859f8-477b-49f3-8538-5607a61c0b67 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:22.546186 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-75f859f8-477b-49f3-8538-5607a61c0b67 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1249 microversion: 2.1 time: 0.068127 Oct 28 19:19:22.546796 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4138/8059] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:22 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:23.142301 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:23.154231 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.154702 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.155132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.167557 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] Creating event network-vif-unplugged:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:19:23.172877 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-ff250ec3-62e1-4261-bdbb-bcb9cfda9e65 req-79200cbd-2f2f-43b5-aa08-fe9fcc23ff51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034513 Oct 28 19:19:23.173649 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3922/8060] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:23.569966 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:23.570565 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:23.578696 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.579131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.579611 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.582740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:23.582740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:23.582740 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:23.646502 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:23.654817 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-a66abfe2-e59a-4503-a5b7-2e090681d430 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1253 microversion: 2.1 time: 0.089313 Oct 28 19:19:23.655433 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4139/8061] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:23 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:24.688101 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:24.688878 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:24.695964 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.696524 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.697132 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.697662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:24.698118 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:24.698550 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:24.791135 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:24.804314 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-af99b8a6-30d6-4763-86f1-e0d2e57097ff tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1307 microversion: 2.1 time: 0.129716 Oct 28 19:19:24.807119 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3923/8062] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:24 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:25.842305 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:25.843626 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:25.851659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.852619 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.853326 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:25.854409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:25.855135 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:25.855865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:26.082299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:26.094748 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-50a57f5d-04c5-4495-b4d7-a85d04870294 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.256264 Oct 28 19:19:26.095695 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4140/8063] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:25 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:27.121198 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:27.122223 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:27.129421 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:27.130115 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:27.130591 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:27.131321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:27.131811 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:27.132247 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:27.289373 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:27.309547 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-bb68154c-85b9-47e7-b99b-03061eb623d2 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.194580 Oct 28 19:19:27.319422 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3924/8064] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:27 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:28.334771 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:28.336240 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:28.344980 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:28.345776 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:28.346216 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:28.347581 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:28.348049 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:28.348974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:28.502659 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:28.512145 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-05281241-117b-4ab7-91d8-840075c714c1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.181785 Oct 28 19:19:28.512889 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4141/8065] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:28 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:29.541736 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:29.542510 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:29.549884 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.550382 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.551015 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.552728 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:29.553083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:29.553512 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:29.732176 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:29.749152 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-95e69541-ca33-414a-abdb-518ed49f4888 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.210855 Oct 28 19:19:29.753326 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3925/8066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:29 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:30.777989 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:30.780179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:30.782865 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:30.791047 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.791824 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.792339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.793132 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:30.793671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:30.794173 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:30.941594 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:30.950292 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-5b1c6af8-bf32-42fb-b368-e012d8629dcf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.177001 Oct 28 19:19:30.951601 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4142/8067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:30 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:31.975786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:31.976505 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:31.980304 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell0:SELECT=4 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:31.986379 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.986990 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.987481 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:31.988203 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:31.988683 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:31.989466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:32.134248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:32.141929 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-72a3f6d2-23eb-4366-b538-68e1955ca6f1 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.170483 Oct 28 19:19:32.142505 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3926/8068] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:31 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:33.166715 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:33.167324 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:33.169946 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell0:SELECT=10 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:19:33.175578 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:33.176081 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:33.176651 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:33.177491 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:33.177963 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:33.178409 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:33.322724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:33.331579 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-0378c8e4-bf58-4dde-9f2f-7fd6ba740a81 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.168724 Oct 28 19:19:33.332203 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4143/8069] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:33 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:34.356131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:34.356764 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:34.365566 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.366321 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.366843 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.367768 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:34.368429 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:34.368861 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:34.524056 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:34.532487 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-1404c522-d43c-4ce6-9ab6-6158211ff859 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.180764 Oct 28 19:19:34.533267 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3927/8070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:34 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:35.002313 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:35.013866 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.014716 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.015163 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.029199 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] Creating event network-changed:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:19:35.034779 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-2c9414c3-d71c-4f06-a193-4eecb1076cb9 req-c2eb4757-7643-4cd0-82b7-6339e5bc1946 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041335 Oct 28 19:19:35.035590 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4144/8071] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:35.558664 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:35.559278 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:35.566256 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.566749 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.567714 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.568439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:35.568896 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:35.569331 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:35.712083 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:35.720006 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-68bd5d95-bb96-43a7-949d-703243d2ae74 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.165363 Oct 28 19:19:35.720591 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3928/8072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:35 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:36.746234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:36.746974 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:36.753436 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:36.753940 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:36.754396 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:36.755706 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:36.756179 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:36.756622 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:36.898083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:36.906448 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-18ad4ac4-78ec-405a-bdbb-67789990b6f0 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.165358 Oct 28 19:19:36.907042 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4145/8073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:36 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:19:37.930286 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:37.930914 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:37.938528 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:37.939028 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:37.939662 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:37.940243 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:37.940705 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:37.941131 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:38.083175 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:38.091170 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-37b222ab-cd12-48af-b203-3eec724e8496 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.165691 Oct 28 19:19:38.091780 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3929/8074] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:37 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:39.116166 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:39.116714 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:39.123359 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:39.123887 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:39.124339 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:39.125067 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:39.125530 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:39.125988 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:39.269149 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:39.278368 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fabdac02-dd96-46ed-8cf6-296e7b69a0e3 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.167235 Oct 28 19:19:39.278975 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4146/8075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:39 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:40.303420 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:40.304039 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:40.311156 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:40.311655 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:40.312089 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:40.312786 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:40.313235 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:40.313661 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:40.772783 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:40.780851 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08558d76-d3f3-4551-be14-d976622a3fbf tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.481977 Oct 28 19:19:40.781442 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3930/8076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:40 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:41.466176 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "name": "network-vif-plugged", "status": "completed", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:41.474995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.475514 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.475956 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.487971 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] Creating event network-vif-plugged:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:19:41.494022 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-c45296dc-8537-4acd-8d4e-62b44d75e5b6 req-939dd98b-61dd-4c4d-b211-7f5a87b863c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096885 Oct 28 19:19:41.494641 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4147/8077] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:19:41.805912 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:41.806671 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:41.813746 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.814229 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.814663 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.815399 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:41.815847 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:41.816269 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:41.963123 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:41.972909 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-666a353d-6880-4fa9-a028-7899886d3f53 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1374 microversion: 2.1 time: 0.171630 Oct 28 19:19:41.973528 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3931/8078] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:41 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:42.997562 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:42.998278 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:43.005801 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.006606 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.007062 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:43.008013 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.008484 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.008922 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:43.154289 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:43.167215 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d5b0bc35-f68b-41e6-8b62-0c7453456190 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1559 microversion: 2.1 time: 0.174853 Oct 28 19:19:43.167835 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4148/8079] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:42 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:43.190218 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:19:43.190798 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:19:43.198561 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.199058 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.199532 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:43.200251 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:43.200711 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:43.201139 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:43.356099 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:19:43.365031 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a7bf95a4-bff6-466d-883b-bd4476a8f95d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1559 microversion: 2.1 time: 0.178663 Oct 28 19:19:43.365960 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3932/8080] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:19:43 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:19:45.352953 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:19:45.373431 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:19:45.374217 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:19:45.374671 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:19:45.387402 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] Creating event network-changed:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:19:45.392628 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-3aba4028-3a08-420f-a101-f6a841447f7f req-0bb86b8f-8ad7-4436-a83b-7e3157bef69f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044222 Oct 28 19:19:45.393258 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4149/8081] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:21:48.178579 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=30 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:48.179464 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=62 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:48.236076 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-155755422"}} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:48.238461 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:21:48.244466 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.244951 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.245660 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.246371 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:48.246823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:48.247248 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:48.595999 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-2a31aa5b-a5dc-4a5a-8c1d-fd2d95cdd5f9 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "POST /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f/action" status: 202 len: 0 microversion: 2.1 time: 0.419136 Oct 28 19:21:48.596565 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3933/8082] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Oct 28 19:21:48 2022] POST /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 19:21:54.064810 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 19:21:54.065872 n-d-860864-13 devstack@n-api.service[120568]: ERROR oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 28 19:21:54.066549 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:54.067598 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=56 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:21:54.074597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "name": "network-vif-plugged", "status": "completed", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:21:54.087158 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:21:54.087682 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:21:54.088123 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:21:54.100280 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] Creating event network-vif-plugged:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:21:54.107597 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6fd0b268-7fd3-4767-ab78-392811250f8b req-82c46ae9-0152-4040-a27d-6369de203e21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042388 Oct 28 19:21:54.108232 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4150/8083] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:07.436735 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_api:SELECT=2 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:07.437699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG dbcounter [-] [120567] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:07.442850 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:07.444017 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:07.444266 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_cell1:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:07.445744 n-d-860864-13 devstack@n-api.service[120568]: DEBUG dbcounter [-] [120568] Writing DB stats nova_api:SELECT=2 {{(pid=120568) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:22:07.452104 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.452674 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.453128 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.454033 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.454715 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.455437 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.466912 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [254ff988-df37-4cd2-91e9-49f2521ff38e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46214. Oct 28 19:22:07.476722 n-d-860864-13 devstack@n-api.service[120568]: INFO oslo.messaging._drivers.impl_rabbit [-] [218c0591-a50f-4571-9fc9-52a4fa84e0c8] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46216. Oct 28 19:22:07.492699 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Going to try to terminate instance {{(pid=120567) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:22:07.566061 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:07.582715 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-4e3a4f9e-80f9-404c-9f07-bfce9453fc3a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 204 len: 0 microversion: 2.1 time: 0.147472 Oct 28 19:22:07.587159 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3934/8084] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:22:07 2022] DELETE /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:22:07.594010 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:07.594632 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:07.597631 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.598414 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.599111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.601757 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.602257 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.602691 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.603470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:07.603997 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:07.604775 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:07.615885 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.compute.server_external_events [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] Creating event network-changed:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:22:07.622913 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [req-6a1ab602-62c7-45d8-b829-305c2c1cd4ce req-ba477071-c95a-4bf2-87a6-3ba6687be03c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183268 Oct 28 19:22:07.623957 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4151/8085] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:22:07.764368 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:07.772200 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-e9c23af8-a619-4432-b616-4adf05403c29 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1683 microversion: 2.1 time: 0.183627 Oct 28 19:22:07.772791 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3935/8086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:07 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:08.798229 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:08.799193 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:08.805597 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:08.806232 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:08.806678 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:08.807420 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:08.807890 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:08.808849 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:08.953518 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:08.961491 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fbb5e15b-ed6d-4322-8562-32477a3f243d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1683 microversion: 2.1 time: 0.168332 Oct 28 19:22:08.962076 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4152/8087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:08 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:09.749447 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a389d3e8-bb6a-4cbe-8d30-d381cf6d242f", "name": "network-vif-deleted", "tag": "fa42c969-bf97-4a92-a943-ccdcc55e1d9c"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:09.759197 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:09.759707 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:09.760137 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:09.771678 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] Creating event network-vif-deleted:fa42c969-bf97-4a92-a943-ccdcc55e1d9c for instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f on n-h1-860864-13 Oct 28 19:22:09.776578 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-b36e0381-582d-43c7-813c-2cc7cec58d1f req-fe7ddad6-bb97-4481-8621-d65681b3b31e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089289 Oct 28 19:22:09.778240 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3936/8088] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:09.994544 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:09.995190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:10.003188 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:10.003721 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:10.004174 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.004889 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:10.005352 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:10.005790 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.041743 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:10.042244 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:10.042993 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:10.043717 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.objects.instance [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lazy-loading 'fault' on Instance uuid a389d3e8-bb6a-4cbe-8d30-d381cf6d242f {{(pid=120568) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 19:22:10.089073 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:10.100166 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-966a917b-7d56-4804-9868-347068294b1d tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 200 len: 1339 microversion: 2.1 time: 0.109739 Oct 28 19:22:10.101011 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4153/8089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:09 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:11.128114 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:11.128823 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: a389d3e8-bb6a-4cbe-8d30-d381cf6d242f] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:11.135059 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.135596 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.136041 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.137378 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:11.137837 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:11.138270 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:11.152611 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.wsgi [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] HTTP exception thrown: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Request method failure captured: Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: request: GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f HTTP/1.1 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Accept: application/json Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Accept-Encoding: identity Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Connection: close Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Content-Length: 0 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Content-Type: application/json Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Host: 10.222.0.48 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: Openstack-System-Scope: None Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: User-Agent: python-urllib3/1.26.12 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Auth-Token: gAAAAABjXCp88tSy7oIkXe1oIQ31iAQXN633BJiNP5C9KOH-YV4QHZxzxmX0PHnB3wxqElQ1uLitqwLiJutByNUEqI0AGf7Fi-ThHNhY9YrQfp1iN1HpRZdR2cgYHEUU_mmReTdowGwp1PsrujHdG5jDiV2PNlZoKnxySoVjLUA29aN2pjgzur8 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Id: None Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Domain-Name: None Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Identity-Status: Confirmed Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Is-Admin-Project: True Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Id: default Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Domain-Name: Default Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Id: 74d8e4f1ed3145eaaa4d03361b6389d8 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Project-Name: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Role: reader,member Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Roles: reader,member Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d8e4f1ed3145eaaa4d03361b6389d8"}]}] Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Id: 74d8e4f1ed3145eaaa4d03361b6389d8 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-Tenant-Name: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-User: tempest-TestSnapshotPattern-1518150575-project Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Id: default Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Domain-Name: Default Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Id: 7eeb76b78d0440b9b94700d31770bf46 Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: X-User-Name: tempest-TestSnapshotPattern-1518150575-project Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: method: > Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: exception: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: action_args: {'id': 'a389d3e8-bb6a-4cbe-8d30-d381cf6d242f'} Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:11.154385 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: ERROR nova.api.openstack.wsgi Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Returning 404 to user: Instance a389d3e8-bb6a-4cbe-8d30-d381cf6d242f could not be found. {{(pid=120567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-a6e96010-0f97-4c91-b545-fc348da9601b tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f" status: 404 len: 111 microversion: 2.1 time: 0.033264 Oct 28 19:22:11.160439 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3937/8090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:11 2022] GET /compute/v2.1/servers/a389d3e8-bb6a-4cbe-8d30-d381cf6d242f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:22:12.551995 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:12.552515 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:12.553470 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:12.560322 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.561112 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.561603 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.562318 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.562912 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.563531 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.564163 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.565096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.565096 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.577523 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] Creating event network-changed:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:22:12.582786 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-0f08556a-e376-4287-8b87-4ab4a1f1a41f req-f191b21e-0c76-48cf-8b11-c116501348c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032868 Oct 28 19:22:12.583414 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3938/8091] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 19:22:12.594301 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Going to try to terminate instance {{(pid=120568) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 19:22:12.689087 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-8bcab62f-e06c-403b-8c0b-e404e484fb47 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "DELETE /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 204 len: 0 microversion: 2.1 time: 0.140673 Oct 28 19:22:12.689989 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4154/8092] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Oct 28 19:22:12 2022] DELETE /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 19:22:12.699832 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:12.700759 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.compute.api [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120567) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:12.707187 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.707709 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.708149 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.708860 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:12.709316 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:12.709838 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:12.863061 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.policy [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120567) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:12.871844 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-02d6e288-8b29-46a3-9466-a9006f78a53a tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1684 microversion: 2.1 time: 0.176854 Oct 28 19:22:12.872421 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3939/8093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:12 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 19:22:13.899231 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:13.900169 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:13.908615 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:13.909111 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:13.909557 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:13.910299 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:13.910760 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:13.911190 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:13.978731 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.policy [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eeb76b78d0440b9b94700d31770bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d8e4f1ed3145eaaa4d03361b6389d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120568) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 19:22:13.987729 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-fdc126cc-d547-40c3-90ec-3d0f63d6b411 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 200 len: 1498 microversion: 2.1 time: 0.092873 Oct 28 19:22:13.988336 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4155/8094] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:13 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 1498 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 19:22:14.038678 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723628a3-0bd3-4070-90a2-fa5be9b8c102", "name": "network-vif-deleted", "tag": "8bc8d502-b7ec-4476-9ffd-1572009608f4"}]} {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 19:22:14.052125 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:14.052706 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:14.053296 n-d-860864-13 devstack@n-api.service[120567]: DEBUG oslo_concurrency.lockutils [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:14.071071 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.compute.server_external_events [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] Creating event network-vif-deleted:8bc8d502-b7ec-4476-9ffd-1572009608f4 for instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 on n-h2-860864-13 Oct 28 19:22:14.076905 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [req-23aac8cf-a6eb-486b-922a-91717133db44 req-d7045149-967e-432a-9345-bde16f8adb81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042215 Oct 28 19:22:14.077651 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3940/8095] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Oct 28 19:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 19:22:15.014724 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '>' {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:15.015362 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.compute.api [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [instance: 723628a3-0bd3-4070-90a2-fa5be9b8c102] Fetching instance by UUID {{(pid=120568) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 19:22:15.022629 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:15.023131 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:15.023661 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:15.024340 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Acquiring lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 19:22:15.024797 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 19:22:15.025234 n-d-860864-13 devstack@n-api.service[120568]: DEBUG oslo_concurrency.lockutils [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Lock "344a014f-e9f4-4420-b7d8-3807d7aceda4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120568) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 19:22:15.039203 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.wsgi [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] HTTP exception thrown: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Request method failure captured: Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: request: GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 HTTP/1.1 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Accept: application/json Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Accept-Encoding: identity Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Connection: close Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Content-Length: 0 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Content-Type: application/json Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Host: 10.222.0.48 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: Openstack-System-Scope: None Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: User-Agent: python-urllib3/1.26.12 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Auth-Token: gAAAAABjXCp88tSy7oIkXe1oIQ31iAQXN633BJiNP5C9KOH-YV4QHZxzxmX0PHnB3wxqElQ1uLitqwLiJutByNUEqI0AGf7Fi-ThHNhY9YrQfp1iN1HpRZdR2cgYHEUU_mmReTdowGwp1PsrujHdG5jDiV2PNlZoKnxySoVjLUA29aN2pjgzur8 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Id: None Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Domain-Name: None Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Identity-Status: Confirmed Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Is-Admin-Project: True Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Id: default Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Domain-Name: Default Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Id: 74d8e4f1ed3145eaaa4d03361b6389d8 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Project-Name: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Role: reader,member Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Roles: reader,member Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_74d8e4f1ed3145eaaa4d03361b6389d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/74d8e4f1ed3145eaaa4d03361b6389d8"}]}] Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Id: 74d8e4f1ed3145eaaa4d03361b6389d8 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-Tenant-Name: tempest-TestSnapshotPattern-1518150575 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-User: tempest-TestSnapshotPattern-1518150575-project Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Id: default Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Domain-Name: Default Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Id: 7eeb76b78d0440b9b94700d31770bf46 Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: X-User-Name: tempest-TestSnapshotPattern-1518150575-project Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: method: > Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: exception: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: action_args: {'id': '723628a3-0bd3-4070-90a2-fa5be9b8c102'} Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: {{(pid=120568) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 19:22:15.040926 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: ERROR nova.api.openstack.wsgi Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: DEBUG nova.api.openstack.wsgi [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Returning 404 to user: Instance 723628a3-0bd3-4070-90a2-fa5be9b8c102 could not be found. {{(pid=120568) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: INFO nova.api.openstack.requestlog [None req-d9f308bc-2f1d-41b3-95f8-66c443d78757 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102" status: 404 len: 111 microversion: 2.1 time: 0.032865 Oct 28 19:22:15.045083 n-d-860864-13 devstack@n-api.service[120568]: [pid: 120568|app: 0|req: 4156/8096] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Oct 28 19:22:15 2022] GET /compute/v2.1/servers/723628a3-0bd3-4070-90a2-fa5be9b8c102 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 19:22:15.208946 n-d-860864-13 devstack@n-api.service[120567]: DEBUG nova.api.openstack.wsgi [None req-08635022-4e89-428c-a0e8-ae54ca857518 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] Calling method '.version_select at 0x7f7524437160>' {{(pid=120567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 19:22:15.214919 n-d-860864-13 devstack@n-api.service[120567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08635022-4e89-428c-a0e8-ae54ca857518 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [3570a816-847d-4252-a441-9b50868e4528] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 19:22:16.221584 n-d-860864-13 devstack@n-api.service[120567]: INFO oslo.messaging._drivers.impl_rabbit [None req-08635022-4e89-428c-a0e8-ae54ca857518 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] [3570a816-847d-4252-a441-9b50868e4528] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46296. Oct 28 19:22:16.241188 n-d-860864-13 devstack@n-api.service[120567]: INFO nova.api.openstack.requestlog [None req-08635022-4e89-428c-a0e8-ae54ca857518 tempest-TestSnapshotPattern-1518150575 tempest-TestSnapshotPattern-1518150575-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1111877827" status: 202 len: 0 microversion: 2.1 time: 1.037325 Oct 28 19:22:16.241792 n-d-860864-13 devstack@n-api.service[120567]: [pid: 120567|app: 0|req: 3941/8097] 10.222.0.48 () {58 vars in 1257 bytes} [Fri Oct 28 19:22:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1111877827 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)